[KIDS] visual grading and manual mask production
Nicola R. Napolitano
napolita at na.astro.it
Wed Apr 10 16:14:12 CEST 2013
I hope I can be a valid substitution of Mario on auto-masking.
N
On 4/10/13 4:11 PM, Mario Radovich wrote:
> I am afraid I will not be able to join the telecon tomorrow, but in
> case of any issue concerning the automatic masks, please let me know.
>
> Cheers
>
> Mario
>
>
> On 04/10/2013 04:08 PM, Nicola R. Napolitano wrote:
>>
>> Tomorrow is fine with me.
>>
>> N
>>
>> On 4/10/13 3:57 PM, Gijs Verdoes Kleijn wrote:
>>> Tomorrow sounds better than Friday.
>>> Unfortunately I cannot be there, but Jelte can act on my behalf as I
>>> will give him my input.
>>> @Hugo: could you be there tomorrow?: your input regarding KiDS-CAT
>>> and a posteriori manual masks is valuable
>>>
>>> Cheers, Gijs
>>>
>>> On 04/10/2013 03:46 PM, Jelte de Jong wrote:
>>>> Dear all,
>>>>
>>>> a quick telecon might be a good idea. However, I would prefer
>>>> tomorrow afternoon, as I have a meeting all day on Friday.
>>>>
>>>> Cheers,
>>>> Jelte
>>>>
>>>> On 10/04/13 15:37, Nicola R. Napolitano wrote:
>>>>>
>>>>> Hi Gijs,
>>>>>
>>>>> thank you very much for the update. Do you think a quick teleconf
>>>>> on Friday afternoon would be a good idea to make the point on the
>>>>> ESO-DR1 status and establish a schedule for the final production
>>>>> steps and a check list for the ESO delivery?
>>>>>
>>>>> Cheers,
>>>>>
>>>>> Nicola
>>>>>
>>>>> On 4/10/13 3:19 PM, Gijs Verdoes Kleijn wrote:
>>>>>> Dear Francesco, KiDS-CAT team et al.,
>>>>>>
>>>>>> That is good news. Great work!
>>>>>>
>>>>>> The manual masking team is on its way to complete the manual
>>>>>> masking effort by the end of this week.
>>>>>> Jelte, Lino and I will decide together with you, the KiDS-CAT
>>>>>> team, how to deal with that update efficiently regarding
>>>>>> sourcelist re-production.
>>>>>>
>>>>>> Best, Gijs
>>>>>>
>>>>>> On 04/10/2013 02:53 PM, Francesco La Barbera wrote:
>>>>>>> Dear All,
>>>>>>>
>>>>>>> I'm happy to inform you that the new sourcelists have been
>>>>>>> produced now.
>>>>>>>
>>>>>>> Hugo, you can access them for AW ingestion at the same link as
>>>>>>> last time, i.e.
>>>>>>>
>>>>>>> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>>>>>>>
>>>>>>> I checked that all files are in place, and there was no evident
>>>>>>> issue with all different data products.
>>>>>>> The sourcelists have been generated with the new, latest, masks
>>>>>>> passed me by Mario and Nicola,
>>>>>>> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
>>>>>>> estimates).
>>>>>>>
>>>>>>> Pls, lemme know if everything is OK with this.
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Francesco
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
>>>>>>> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>>>>>>>
>>>>>>> Dear Nicola and Mario and Hugo,
>>>>>>>
>>>>>>> How is the automated mask + sourcelist production going?
>>>>>>>
>>>>>>> I am now coordinating the visual grading and manual mask
>>>>>>> production.
>>>>>>> My plan is to have that team start to work on all coadds at
>>>>>>> is_valid=1 and 2 asap.
>>>>>>> (NB: all coadds that will be re-processed this week are now
>>>>>>> set to is_valid=0)
>>>>>>>
>>>>>>> As far as I see this effort is decoupled (enough) from your
>>>>>>> mask+sourcelist effort and there can start now. I will tell
>>>>>>> the manual mask team to anticipate improvement on the
>>>>>>> current automated masks. And hence start no manually
>>>>>>> improving those.
>>>>>>>
>>>>>>> Please let me know if you see problems with this decoupled
>>>>>>> parallel effort.
>>>>>>>
>>>>>>> Best wishes, Gijs
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>>>>>>>
>>>>>>>> OK Lino. Thanks
>>>>>>>>
>>>>>>>> N
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>>>>>>> Hi Nicola,
>>>>>>>>>
>>>>>>>>> the manual masks are on beo3 in the dir:
>>>>>>>>>
>>>>>>>>> /opt/AW/current/astro/experimental/kids/regionfiles
>>>>>>>>>
>>>>>>>>> Lino
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>>>>>>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>> wrote:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hi Lino,
>>>>>>>>>
>>>>>>>>> automatic masking is about to start. Mario and I are
>>>>>>>>> still struggling with the g-band but we should be able
>>>>>>>>> to work this out by the end of the day.
>>>>>>>>> Meanwhile r,i,u are ready to go after we have checked
>>>>>>>>> the spike length, which needs just some more very
>>>>>>>>> short visual test.
>>>>>>>>> This means that auto-masks will be possibly ready
>>>>>>>>> tomorrow morning.
>>>>>>>>>
>>>>>>>>> To start the sourcelists extraction, though, we need
>>>>>>>>> to incorporate the manual masks into the auto masks,
>>>>>>>>> since the idea is to provide a unique flag in the
>>>>>>>>> catalogs.
>>>>>>>>> Thus we need to know whether the final manual masks
>>>>>>>>> are also ready for the download. If so please give to
>>>>>>>>> Mario the necessary references for that.
>>>>>>>>>
>>>>>>>>> Cheers,
>>>>>>>>>
>>>>>>>>> Nicola
>>>>>>>>>
>>>>>>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>>>>>>> Hi Mario and Nicola,
>>>>>>>>>>
>>>>>>>>>> the coadds are ready for automatic masking.
>>>>>>>>>>
>>>>>>>>>> Lino
>>>>>>>>>>
>>>>>>>>>> ---------- Forwarded message ----------
>>>>>>>>>> From: <jelte at strw.leidenuniv.nl
>>>>>>>>>> <mailto:jelte at strw.leidenuniv.nl>>
>>>>>>>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>>>>>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>>>>>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>>>>>>>> <mailto:verdoes at astro.rug.nl>>, Lino Grado
>>>>>>>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hi Gijs and Lino,
>>>>>>>>>>
>>>>>>>>>> just to let you know that reprocessing is done now.
>>>>>>>>>> We now have again 200 DR1 coadds:
>>>>>>>>>>
>>>>>>>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>>>>>>>> awe> list =
>>>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>>>>> c in query]
>>>>>>>>>> awe> len(list)
>>>>>>>>>> 200
>>>>>>>>>>
>>>>>>>>>> The total number of reprocessed coadds is 50:
>>>>>>>>>> awe> query = Comment.content ==
>>>>>>>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>>>>>>>> awe> list =
>>>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>>>>> c in query]
>>>>>>>>>> awe> len(list)
>>>>>>>>>> 50
>>>>>>>>>>
>>>>>>>>>> Querying for the comment
>>>>>>>>>> 'KiDS-ESO-DR1-Coadd-DISCARDED' will also give 50
>>>>>>>>>> coadds, namely the ones replaced by the reprocessed
>>>>>>>>>> coadds.
>>>>>>>>>>
>>>>>>>>>> From the 74 is_valid=0 coadds, 24 were not
>>>>>>>>>> reprocessed since according to
>>>>>>>>>> the reprocessing teams there was no improvement
>>>>>>>>>> possible. These coadds
>>>>>>>>>> that are retained in DR1 can be recognized by the comment
>>>>>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>>>>>>>
>>>>>>>>>> awe> query = Comment.content ==
>>>>>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>>>>>>>> awe> list =
>>>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>>>>> c in query]
>>>>>>>>>> awe> len(list)
>>>>>>>>>> 24
>>>>>>>>>>
>>>>>>>>>> Cheers,
>>>>>>>>>> Jelte
>>>>>>>>>>
>>>>>>>>>> > Hi Gijs and Lino,
>>>>>>>>>> >
>>>>>>>>>> > reprocessing is almost done.
>>>>>>>>>> > There were still 3 coadds that needed to be
>>>>>>>>>> reprocessed and that is
>>>>>>>>>> > currently being done.
>>>>>>>>>> > Over the weekend I will update their comments etc,
>>>>>>>>>> and notify Mario so
>>>>>>>>>> > he can download the new ones for source extraction.
>>>>>>>>>> >
>>>>>>>>>> > I have also put a table on the wiki with the coadds
>>>>>>>>>> that were set to
>>>>>>>>>> > is_valid = 1 during the visual inspection (QA1):
>>>>>>>>>> >
>>>>>>>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>>>>>>>> > Also included in the table (where it was clear to
>>>>>>>>>> me) is the reasons why
>>>>>>>>>> > the visual inspection team thinks these coadds
>>>>>>>>>> could be improved if
>>>>>>>>>> > there is enough time.
>>>>>>>>>> > We should set up a dedicated team that can have a
>>>>>>>>>> look at these coadds
>>>>>>>>>> > next week to see which ones can be improved by
>>>>>>>>>> reprocessing.
>>>>>>>>>> > In any case our goal should be to have all final
>>>>>>>>>> coadds by next Friday
>>>>>>>>>> > (April 12).
>>>>>>>>>> >
>>>>>>>>>> > Cheers,
>>>>>>>>>> > Jelte
>>>>>>>>>> >
>>>>>>>>>> > --
>>>>>>>>>> > Dr. Jelte T. A. de Jong
>>>>>>>>>> > KiDS project manager
>>>>>>>>>> > Sterrewacht Leiden
>>>>>>>>>> > Leiden University, Leiden, the Netherlands
>>>>>>>>>> > E: jelte at strw.leidenuniv.nl
>>>>>>>>>> <mailto:jelte at strw.leidenuniv.nl>
>>>>>>>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>>>>>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>>>>>>>> >
>>>>>>>>>> >
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Aniello Grado, PhD
>>>>>>>>>>
>>>>>>>>>> Ricercatore Astronomo
>>>>>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>>>>>> Via Moiariello 16 80131 Napoli
>>>>>>>>>> ITALIA
>>>>>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>>>>>
>>>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Nicola R. Napolitano
>>>>>>>>> Research Astronomer
>>>>>>>>> INAF - Observatory of Capodimonte
>>>>>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Aniello Grado, PhD
>>>>>>>>>
>>>>>>>>> Ricercatore Astronomo
>>>>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>>>>> Via Moiariello 16 80131 Napoli
>>>>>>>>> ITALIA
>>>>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>>>>
>>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Nicola R. Napolitano
>>>>>>>> Research Astronomer
>>>>>>>> INAF - Observatory of Capodimonte
>>>>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>>>>
>>>>>>> --
>>>>>>> --------------------------------------------------------------------
>>>>>>> |dr Gijs Verdoes Kleijn | astronomer |
>>>>>>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
>>>>>>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
>>>>>>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
>>>>>>> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
>>>>>>> | | Kapteyn Astronomical Institute |
>>>>>>> | | Postbus 800, 9700 AV, Groningen|
>>>>>>> | | The Netherlands |
>>>>>>> --------------------------------------------------------------------
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> --------------------------------------------------------------------
>>>>>> |dr Gijs Verdoes Kleijn | astronomer |
>>>>>> |e-mail:verdoes at astro.rug.nl | OmegaCEN / Kapteyn Institute / |
>>>>>> |www:www.astro.rug.nl/~verdoes | Target |
>>>>>> |tel: +31-50-3638326 | University of Groningen |
>>>>>> |mobile: +31-654658050 | postal address: |
>>>>>> | | Kapteyn Astronomical Institute |
>>>>>> | | Postbus 800, 9700 AV, Groningen|
>>>>>> | | The Netherlands |
>>>>>> --------------------------------------------------------------------
>>>>>
>>>>>
>>>>> --
>>>>> Nicola R. Napolitano
>>>>> Research Astronomer
>>>>> INAF - Observatory of Capodimonte
>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>> phone: +39 081 5575509; fax: +39 081 456710
>>>>> email:napolita at na.astro.it
>>>>> web page:http://www.na.astro.it/~napolita
>>>>
>>>> --
>>>> Dr. Jelte T. A. de Jong
>>>> KiDS project manager
>>>> Sterrewacht Leiden
>>>> Leiden University, Leiden, the Netherlands
>>>> E:jelte at strw.leidenuniv.nl
>>>> T: +31-(0)715275818
>>>> W: jelte.jdejong.net
>>>
>>> --
>>> --------------------------------------------------------------------
>>> |dr Gijs Verdoes Kleijn | astronomer |
>>> |e-mail:verdoes at astro.rug.nl | OmegaCEN / Kapteyn Institute / |
>>> |www:www.astro.rug.nl/~verdoes | Target |
>>> |tel: +31-50-3638326 | University of Groningen |
>>> |mobile: +31-654658050 | postal address: |
>>> | | Kapteyn Astronomical Institute |
>>> | | Postbus 800, 9700 AV, Groningen|
>>> | | The Netherlands |
>>> --------------------------------------------------------------------
>>
>>
>> --
>> Nicola R. Napolitano
>> Research Astronomer
>> INAF - Observatory of Capodimonte
>> Salita Moiariello, 16, 80131, Napoli (Italy)
>> phone: +39 081 5575509; fax: +39 081 456710
>> email:napolita at na.astro.it
>> web page:http://www.na.astro.it/~napolita
>
--
Nicola R. Napolitano
Research Astronomer
INAF - Observatory of Capodimonte
Salita Moiariello, 16, 80131, Napoli (Italy)
phone: +39 081 5575509; fax: +39 081 456710
email: napolita at na.astro.it
web page: http://www.na.astro.it/~napolita
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130410/06ec91f6/attachment-0001.html
More information about the KiDS
mailing list