[KIDS] visual grading and manual mask production
Hugo Buddelmeijer
buddel at astro.rug.nl
Thu Apr 18 11:12:22 CEST 2013
The ingestion is ongoing! I will give an estimated time for completion as soon as I have one.
And I suppose by then we will continue with the next batch already ;-)
Francesco La Barbera <flabarber at gmail.com> schreef:
>HI Hugo,
>
>no changes at all since 22:00 last time. Pls, go ahead with ingestion
>!!!
>
>cheers,
>F.
>
>
>
>On Thu, Apr 18, 2013 at 7:45 AM, Hugo Buddelmeijer
><buddel at astro.rug.nl>wrote:
>
>> Thanks Francesco!
>>
>> Did anything change since about 22:00 last night?
>>
>> I went to bed at about that time and noticed that the files were
>there, so
>> I went ahead and started downloaded them anyway before receiving your
>email.
>>
>> To be certain, I'm downloading the files again. However, I'll start
>> ingesting the files I downloaded last night if you say that there
>have been
>> no changes.
>>
>> Hugo
>>
>>
>> On 04/17/2013 11:04 PM, Francesco La Barbera wrote:
>>
>>> Dear All,
>>>
>>> the sourcelists have been created with the latest masks that Mario
>>> passed us.
>>>
>>> Hugo, pls go ahead with ingestion from the same link as last time:
>>>
>>>
>http://vstportal.oacn.inaf.it/**KIDSCAT/ESO_DR1_kc1.6/<http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/>
>>>
>>> As usual, I checked that all data products/plots are in the proper
>place
>>> for each coadd.
>>>
>>> Cheers,
>>> Francesco
>>>
>>>
>>>
>>> On Wed, Apr 10, 2013 at 2:53 PM, Francesco La Barbera
>>> <flabarber at gmail.com <mailto:flabarber at gmail.com>> wrote:
>>>
>>> Dear All,
>>>
>>> I'm happy to inform you that the new sourcelists have been
>produced
>>> now.
>>>
>>> Hugo, you can access them for AW ingestion at the same link as
>last
>>> time, i.e.
>>>
>>>
>http://vstportal.oacn.inaf.it/**KIDSCAT/ESO_DR1_kc1.6/<http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/>
>>>
>>> I checked that all files are in place, and there was no evident
>>> issue with all different data products.
>>> The sourcelists have been generated with the new, latest, masks
>>> passed me by Mario and Nicola,
>>> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
>>> estimates).
>>>
>>> Pls, lemme know if everything is OK with this.
>>>
>>> Cheers,
>>> Francesco
>>>
>>>
>>>
>>>
>>> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
>>> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>>>
>>> Dear Nicola and Mario and Hugo,
>>>
>>> How is the automated mask + sourcelist production going?
>>>
>>> I am now coordinating the visual grading and manual mask
>>> production.
>>> My plan is to have that team start to work on all coadds at
>>> is_valid=1 and 2 asap.
>>> (NB: all coadds that will be re-processed this week are now
>set
>>> to is_valid=0)
>>>
>>> As far as I see this effort is decoupled (enough) from your
>>> mask+sourcelist effort and there can start now. I will tell
>the
>>> manual mask team to anticipate improvement on the current
>>> automated masks. And hence start no manually improving
>those.
>>>
>>> Please let me know if you see problems with this decoupled
>>> parallel effort.
>>>
>>> Best wishes, Gijs
>>>
>>>
>>>
>>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>>
>>>>
>>>> OK Lino. Thanks
>>>>
>>>> N
>>>>
>>>>
>>>>
>>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>>
>>>>> Hi Nicola,
>>>>>
>>>>> the manual masks are on beo3 in the dir:
>>>>>
>>>>> /opt/AW/current/astro/**experimental/kids/regionfiles
>>>>>
>>>>> Lino
>>>>>
>>>>>
>>>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>>
>wrote:
>>>>>
>>>>>
>>>>> Hi Lino,
>>>>>
>>>>> automatic masking is about to start. Mario and I are
>>>>> still struggling with the g-band but we should be able
>to
>>>>> work this out by the end of the day.
>>>>> Meanwhile r,i,u are ready to go after we have checked
>the
>>>>> spike length, which needs just some more very short
>>>>> visual test.
>>>>> This means that auto-masks will be possibly ready
>>>>> tomorrow morning.
>>>>>
>>>>> To start the sourcelists extraction, though, we need
>to
>>>>> incorporate the manual masks into the auto masks,
>since
>>>>> the idea is to provide a unique flag in the catalogs.
>>>>> Thus we need to know whether the final manual masks
>are
>>>>> also ready for the download. If so please give to
>Mario
>>>>> the necessary references for that.
>>>>>
>>>>> Cheers,
>>>>>
>>>>> Nicola
>>>>>
>>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>>
>>>>>> Hi Mario and Nicola,
>>>>>>
>>>>>> the coadds are ready for automatic masking.
>>>>>>
>>>>>> Lino
>>>>>>
>>>>>> ---------- Forwarded message ----------
>>>>>> From: <jelte at strw.leidenuniv.nl
>>>>>>
><mailto:jelte at strw.leidenuniv.**nl<jelte at strw.leidenuniv.nl>
>>>>>> >>
>>>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>>>> <mailto:verdoes at astro.rug.nl>>**, Lino Grado
>>>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>>>
>>>>>>
>>>>>> Hi Gijs and Lino,
>>>>>>
>>>>>> just to let you know that reprocessing is done now.
>>>>>> We now have again 200 DR1 coadds:
>>>>>>
>>>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>>>> awe> list =
>>>>>> [CoaddedRegriddedFrame(object_**id=c.db_object_id)
>for c
>>>>>> in query]
>>>>>> awe> len(list)
>>>>>> 200
>>>>>>
>>>>>> The total number of reprocessed coadds is 50:
>>>>>> awe> query = Comment.content ==
>>>>>> 'KiDS-ESO-DR1-Coadd-**Reprocessed-After-QA1'
>>>>>> awe> list =
>>>>>> [CoaddedRegriddedFrame(object_**id=c.db_object_id)
>for c
>>>>>> in query]
>>>>>> awe> len(list)
>>>>>> 50
>>>>>>
>>>>>> Querying for the comment
>'KiDS-ESO-DR1-Coadd-DISCARDED'
>>>>>> will also give 50
>>>>>> coadds, namely the ones replaced by the reprocessed
>coadds.
>>>>>>
>>>>>> From the 74 is_valid=0 coadds, 24 were not
>reprocessed
>>>>>> since according to
>>>>>> the reprocessing teams there was no improvement
>>>>>> possible. These coadds
>>>>>> that are retained in DR1 can be recognized by the
>comment
>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-**After-QA1':
>>>>>>
>>>>>> awe> query = Comment.content ==
>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-**After-QA1'
>>>>>> awe> list =
>>>>>> [CoaddedRegriddedFrame(object_**id=c.db_object_id)
>for c
>>>>>> in query]
>>>>>> awe> len(list)
>>>>>> 24
>>>>>>
>>>>>> Cheers,
>>>>>> Jelte
>>>>>>
>>>>>> > Hi Gijs and Lino,
>>>>>> >
>>>>>> > reprocessing is almost done.
>>>>>> > There were still 3 coadds that needed to be
>>>>>> reprocessed and that is
>>>>>> > currently being done.
>>>>>> > Over the weekend I will update their comments etc,
>and
>>>>>> notify Mario so
>>>>>> > he can download the new ones for source extraction.
>>>>>> >
>>>>>> > I have also put a table on the wiki with the coadds
>>>>>> that were set to
>>>>>> > is_valid = 1 during the visual inspection (QA1):
>>>>>> >
>>>>>> http://wiki.astro-wise.org/**
>>>>>> projects:kids:data_deliveries:**kids-eso-dr1:**
>>>>>>
>productiondashboard#coadd_set_**to_is_valid_1_during_qa1<http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1>
>>>>>> > Also included in the table (where it was clear to
>me)
>>>>>> is the reasons why
>>>>>> > the visual inspection team thinks these coadds
>could
>>>>>> be improved if
>>>>>> > there is enough time.
>>>>>> > We should set up a dedicated team that can have a
>look
>>>>>> at these coadds
>>>>>> > next week to see which ones can be improved by
>>>>>> reprocessing.
>>>>>> > In any case our goal should be to have all final
>>>>>> coadds by next Friday
>>>>>> > (April 12).
>>>>>> >
>>>>>> > Cheers,
>>>>>> > Jelte
>>>>>> >
>>>>>> > --
>>>>>> > Dr. Jelte T. A. de Jong
>>>>>> > KiDS project manager
>>>>>> > Sterrewacht Leiden
>>>>>> > Leiden University, Leiden, the Netherlands
>>>>>> > E: jelte at strw.leidenuniv.nl
>>>>>>
><mailto:jelte at strw.leidenuniv.**nl<jelte at strw.leidenuniv.nl>
>>>>>> >
>>>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>>>> >
>>>>>> >
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>**>>>>>>>>>>>
>>>>>>
>>>>>> Aniello Grado, PhD
>>>>>>
>>>>>> Ricercatore Astronomo
>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>> Via Moiariello 16 80131 Napoli
>>>>>> ITALIA
>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>
>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>**>>>>>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Nicola R. Napolitano
>>>>> Research Astronomer
>>>>> INAF - Observatory of Capodimonte
>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>;
>fax:+39
>>>>> 081 456710 <tel:%2B39%20081%20456710>
>>>>> email:napolita at na.astro.it
><mailto:napolita at na.astro.it>
>>>>> web
>page:http://www.na.astro.it/~**napolita<http://www.na.astro.it/~napolita>
><
>>>>>
>http://www.na.astro.it/%**7Enapolita<http://www.na.astro.it/%7Enapolita>
>>>>> >
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>**>>>>>>>>>>>
>>>>>
>>>>> Aniello Grado, PhD
>>>>>
>>>>> Ricercatore Astronomo
>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>> Via Moiariello 16 80131 Napoli
>>>>> ITALIA
>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>
>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>**>>>>>>>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Nicola R. Napolitano
>>>> Research Astronomer
>>>> INAF - Observatory of Capodimonte
>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39
>081
>>>> 456710 <tel:%2B39%20081%20456710>
>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>> web
>page:http://www.na.astro.it/~**napolita<http://www.na.astro.it/~napolita>
><
>>>>
>http://www.na.astro.it/%**7Enapolita<http://www.na.astro.it/%7Enapolita>
>>>> >
>>>>
>>>
>>> --
>>>
>------------------------------**------------------------------**
>>> --------
>>> |dr Gijs Verdoes Kleijn | astronomer
>>> |
>>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>
> |
>>> OmegaCEN / Kapteyn Institute / |
>>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/~**
>>> verdoes <http://www.astro.rug.nl/~verdoes>> | Target
>>> |
>>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> |
>>> University of Groningen |
>>> |mobile:+31-654658050 <tel:%2B31-654658050> |
>>> postal address: |
>>>
>>> | | Kapteyn Astronomical
>>> Institute |
>>> | | Postbus 800, 9700 AV,
>>> Groningen|
>>> | | The Netherlands
>>> |
>>>
>------------------------------**------------------------------**
>>> --------
>>>
>>>
>>>
>>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130418/b8688c3d/attachment-0001.html
More information about the KiDS
mailing list