[KIDS] visual grading and manual mask production
Mario Radovich
mario.radovich at oapd.inaf.it
Wed Apr 10 16:11:04 CEST 2013
I am afraid I will not be able to join the telecon tomorrow, but in
case of any issue concerning the automatic masks, please let me know.
Cheers
Mario
On 04/10/2013 04:08 PM, Nicola R. Napolitano wrote:
>
> Tomorrow is fine with me.
>
> N
>
> On 4/10/13 3:57 PM, Gijs Verdoes Kleijn wrote:
>> Tomorrow sounds better than Friday.
>> Unfortunately I cannot be there, but Jelte can act on my behalf as I
>> will give him my input.
>> @Hugo: could you be there tomorrow?: your input regarding KiDS-CAT
>> and a posteriori manual masks is valuable
>>
>> Cheers, Gijs
>>
>> On 04/10/2013 03:46 PM, Jelte de Jong wrote:
>>> Dear all,
>>>
>>> a quick telecon might be a good idea. However, I would prefer
>>> tomorrow afternoon, as I have a meeting all day on Friday.
>>>
>>> Cheers,
>>> Jelte
>>>
>>> On 10/04/13 15:37, Nicola R. Napolitano wrote:
>>>>
>>>> Hi Gijs,
>>>>
>>>> thank you very much for the update. Do you think a quick teleconf
>>>> on Friday afternoon would be a good idea to make the point on the
>>>> ESO-DR1 status and establish a schedule for the final production
>>>> steps and a check list for the ESO delivery?
>>>>
>>>> Cheers,
>>>>
>>>> Nicola
>>>>
>>>> On 4/10/13 3:19 PM, Gijs Verdoes Kleijn wrote:
>>>>> Dear Francesco, KiDS-CAT team et al.,
>>>>>
>>>>> That is good news. Great work!
>>>>>
>>>>> The manual masking team is on its way to complete the manual
>>>>> masking effort by the end of this week.
>>>>> Jelte, Lino and I will decide together with you, the KiDS-CAT
>>>>> team, how to deal with that update efficiently regarding
>>>>> sourcelist re-production.
>>>>>
>>>>> Best, Gijs
>>>>>
>>>>> On 04/10/2013 02:53 PM, Francesco La Barbera wrote:
>>>>>> Dear All,
>>>>>>
>>>>>> I'm happy to inform you that the new sourcelists have been
>>>>>> produced now.
>>>>>>
>>>>>> Hugo, you can access them for AW ingestion at the same link as
>>>>>> last time, i.e.
>>>>>>
>>>>>> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>>>>>>
>>>>>> I checked that all files are in place, and there was no evident
>>>>>> issue with all different data products.
>>>>>> The sourcelists have been generated with the new, latest, masks
>>>>>> passed me by Mario and Nicola,
>>>>>> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
>>>>>> estimates).
>>>>>>
>>>>>> Pls, lemme know if everything is OK with this.
>>>>>>
>>>>>> Cheers,
>>>>>> Francesco
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
>>>>>> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>>>>>>
>>>>>> Dear Nicola and Mario and Hugo,
>>>>>>
>>>>>> How is the automated mask + sourcelist production going?
>>>>>>
>>>>>> I am now coordinating the visual grading and manual mask
>>>>>> production.
>>>>>> My plan is to have that team start to work on all coadds at
>>>>>> is_valid=1 and 2 asap.
>>>>>> (NB: all coadds that will be re-processed this week are now
>>>>>> set to is_valid=0)
>>>>>>
>>>>>> As far as I see this effort is decoupled (enough) from your
>>>>>> mask+sourcelist effort and there can start now. I will tell
>>>>>> the manual mask team to anticipate improvement on the current
>>>>>> automated masks. And hence start no manually improving those.
>>>>>>
>>>>>> Please let me know if you see problems with this decoupled
>>>>>> parallel effort.
>>>>>>
>>>>>> Best wishes, Gijs
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>>>>>>
>>>>>>> OK Lino. Thanks
>>>>>>>
>>>>>>> N
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>>>>>> Hi Nicola,
>>>>>>>>
>>>>>>>> the manual masks are on beo3 in the dir:
>>>>>>>>
>>>>>>>> /opt/AW/current/astro/experimental/kids/regionfiles
>>>>>>>>
>>>>>>>> Lino
>>>>>>>>
>>>>>>>>
>>>>>>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>>>>>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>> wrote:
>>>>>>>>
>>>>>>>>
>>>>>>>> Hi Lino,
>>>>>>>>
>>>>>>>> automatic masking is about to start. Mario and I are
>>>>>>>> still struggling with the g-band but we should be able
>>>>>>>> to work this out by the end of the day.
>>>>>>>> Meanwhile r,i,u are ready to go after we have checked
>>>>>>>> the spike length, which needs just some more very short
>>>>>>>> visual test.
>>>>>>>> This means that auto-masks will be possibly ready
>>>>>>>> tomorrow morning.
>>>>>>>>
>>>>>>>> To start the sourcelists extraction, though, we need to
>>>>>>>> incorporate the manual masks into the auto masks, since
>>>>>>>> the idea is to provide a unique flag in the catalogs.
>>>>>>>> Thus we need to know whether the final manual masks are
>>>>>>>> also ready for the download. If so please give to Mario
>>>>>>>> the necessary references for that.
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>>
>>>>>>>> Nicola
>>>>>>>>
>>>>>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>>>>>> Hi Mario and Nicola,
>>>>>>>>>
>>>>>>>>> the coadds are ready for automatic masking.
>>>>>>>>>
>>>>>>>>> Lino
>>>>>>>>>
>>>>>>>>> ---------- Forwarded message ----------
>>>>>>>>> From: <jelte at strw.leidenuniv.nl
>>>>>>>>> <mailto:jelte at strw.leidenuniv.nl>>
>>>>>>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>>>>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>>>>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>>>>>>> <mailto:verdoes at astro.rug.nl>>, Lino Grado
>>>>>>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hi Gijs and Lino,
>>>>>>>>>
>>>>>>>>> just to let you know that reprocessing is done now.
>>>>>>>>> We now have again 200 DR1 coadds:
>>>>>>>>>
>>>>>>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>>>>>>> awe> list =
>>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c
>>>>>>>>> in query]
>>>>>>>>> awe> len(list)
>>>>>>>>> 200
>>>>>>>>>
>>>>>>>>> The total number of reprocessed coadds is 50:
>>>>>>>>> awe> query = Comment.content ==
>>>>>>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>>>>>>> awe> list =
>>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c
>>>>>>>>> in query]
>>>>>>>>> awe> len(list)
>>>>>>>>> 50
>>>>>>>>>
>>>>>>>>> Querying for the comment
>>>>>>>>> 'KiDS-ESO-DR1-Coadd-DISCARDED' will also give 50
>>>>>>>>> coadds, namely the ones replaced by the reprocessed
>>>>>>>>> coadds.
>>>>>>>>>
>>>>>>>>> From the 74 is_valid=0 coadds, 24 were not reprocessed
>>>>>>>>> since according to
>>>>>>>>> the reprocessing teams there was no improvement
>>>>>>>>> possible. These coadds
>>>>>>>>> that are retained in DR1 can be recognized by the comment
>>>>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>>>>>>
>>>>>>>>> awe> query = Comment.content ==
>>>>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>>>>>>> awe> list =
>>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c
>>>>>>>>> in query]
>>>>>>>>> awe> len(list)
>>>>>>>>> 24
>>>>>>>>>
>>>>>>>>> Cheers,
>>>>>>>>> Jelte
>>>>>>>>>
>>>>>>>>> > Hi Gijs and Lino,
>>>>>>>>> >
>>>>>>>>> > reprocessing is almost done.
>>>>>>>>> > There were still 3 coadds that needed to be
>>>>>>>>> reprocessed and that is
>>>>>>>>> > currently being done.
>>>>>>>>> > Over the weekend I will update their comments etc,
>>>>>>>>> and notify Mario so
>>>>>>>>> > he can download the new ones for source extraction.
>>>>>>>>> >
>>>>>>>>> > I have also put a table on the wiki with the coadds
>>>>>>>>> that were set to
>>>>>>>>> > is_valid = 1 during the visual inspection (QA1):
>>>>>>>>> >
>>>>>>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>>>>>>> > Also included in the table (where it was clear to
>>>>>>>>> me) is the reasons why
>>>>>>>>> > the visual inspection team thinks these coadds could
>>>>>>>>> be improved if
>>>>>>>>> > there is enough time.
>>>>>>>>> > We should set up a dedicated team that can have a
>>>>>>>>> look at these coadds
>>>>>>>>> > next week to see which ones can be improved by
>>>>>>>>> reprocessing.
>>>>>>>>> > In any case our goal should be to have all final
>>>>>>>>> coadds by next Friday
>>>>>>>>> > (April 12).
>>>>>>>>> >
>>>>>>>>> > Cheers,
>>>>>>>>> > Jelte
>>>>>>>>> >
>>>>>>>>> > --
>>>>>>>>> > Dr. Jelte T. A. de Jong
>>>>>>>>> > KiDS project manager
>>>>>>>>> > Sterrewacht Leiden
>>>>>>>>> > Leiden University, Leiden, the Netherlands
>>>>>>>>> > E: jelte at strw.leidenuniv.nl
>>>>>>>>> <mailto:jelte at strw.leidenuniv.nl>
>>>>>>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>>>>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>>>>>>> >
>>>>>>>>> >
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Aniello Grado, PhD
>>>>>>>>>
>>>>>>>>> Ricercatore Astronomo
>>>>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>>>>> Via Moiariello 16 80131 Napoli
>>>>>>>>> ITALIA
>>>>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>>>>
>>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Nicola R. Napolitano
>>>>>>>> Research Astronomer
>>>>>>>> INAF - Observatory of Capodimonte
>>>>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>
>>>>>>>> Aniello Grado, PhD
>>>>>>>>
>>>>>>>> Ricercatore Astronomo
>>>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>>>> Via Moiariello 16 80131 Napoli
>>>>>>>> ITALIA
>>>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>>>
>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Nicola R. Napolitano
>>>>>>> Research Astronomer
>>>>>>> INAF - Observatory of Capodimonte
>>>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>>>
>>>>>> --
>>>>>> --------------------------------------------------------------------
>>>>>> |dr Gijs Verdoes Kleijn | astronomer |
>>>>>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
>>>>>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
>>>>>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
>>>>>> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
>>>>>> | | Kapteyn Astronomical Institute |
>>>>>> | | Postbus 800, 9700 AV, Groningen|
>>>>>> | | The Netherlands |
>>>>>> --------------------------------------------------------------------
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> --------------------------------------------------------------------
>>>>> |dr Gijs Verdoes Kleijn | astronomer |
>>>>> |e-mail:verdoes at astro.rug.nl | OmegaCEN / Kapteyn Institute / |
>>>>> |www:www.astro.rug.nl/~verdoes | Target |
>>>>> |tel: +31-50-3638326 | University of Groningen |
>>>>> |mobile: +31-654658050 | postal address: |
>>>>> | | Kapteyn Astronomical Institute |
>>>>> | | Postbus 800, 9700 AV, Groningen|
>>>>> | | The Netherlands |
>>>>> --------------------------------------------------------------------
>>>>
>>>>
>>>> --
>>>> Nicola R. Napolitano
>>>> Research Astronomer
>>>> INAF - Observatory of Capodimonte
>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>> phone: +39 081 5575509; fax: +39 081 456710
>>>> email:napolita at na.astro.it
>>>> web page:http://www.na.astro.it/~napolita
>>>
>>> --
>>> Dr. Jelte T. A. de Jong
>>> KiDS project manager
>>> Sterrewacht Leiden
>>> Leiden University, Leiden, the Netherlands
>>> E:jelte at strw.leidenuniv.nl
>>> T: +31-(0)715275818
>>> W: jelte.jdejong.net
>>
>> --
>> --------------------------------------------------------------------
>> |dr Gijs Verdoes Kleijn | astronomer |
>> |e-mail:verdoes at astro.rug.nl | OmegaCEN / Kapteyn Institute / |
>> |www:www.astro.rug.nl/~verdoes | Target |
>> |tel: +31-50-3638326 | University of Groningen |
>> |mobile: +31-654658050 | postal address: |
>> | | Kapteyn Astronomical Institute |
>> | | Postbus 800, 9700 AV, Groningen|
>> | | The Netherlands |
>> --------------------------------------------------------------------
>
>
> --
> Nicola R. Napolitano
> Research Astronomer
> INAF - Observatory of Capodimonte
> Salita Moiariello, 16, 80131, Napoli (Italy)
> phone: +39 081 5575509; fax: +39 081 456710
> email:napolita at na.astro.it
> web page:http://www.na.astro.it/~napolita
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130410/e133093f/attachment-0001.html
More information about the KiDS
mailing list