[KIDS] visual grading and manual mask production
Jelte de Jong
jelte at strw.leidenuniv.nl
Wed Apr 10 18:31:28 CEST 2013
Dear all,
shall we do the telecon at 14:00 tomorrow afternoon, and use the usual
telecon set-up?
Jelte
On 10/04/13 16:17, aniello grado wrote:
> fine for me, but at 16.45 I have to leave.
>
> Lino
>
>
> On Wed, Apr 10, 2013 at 3:46 PM, Jelte de Jong
> <jelte at strw.leidenuniv.nl <mailto:jelte at strw.leidenuniv.nl>> wrote:
>
> Dear all,
>
> a quick telecon might be a good idea. However, I would prefer
> tomorrow afternoon, as I have a meeting all day on Friday.
>
> Cheers,
> Jelte
>
>
> On 10/04/13 15:37, Nicola R. Napolitano wrote:
>>
>> Hi Gijs,
>>
>> thank you very much for the update. Do you think a quick teleconf
>> on Friday afternoon would be a good idea to make the point on the
>> ESO-DR1 status and establish a schedule for the final production
>> steps and a check list for the ESO delivery?
>>
>> Cheers,
>>
>> Nicola
>>
>> On 4/10/13 3:19 PM, Gijs Verdoes Kleijn wrote:
>>> Dear Francesco, KiDS-CAT team et al.,
>>>
>>> That is good news. Great work!
>>>
>>> The manual masking team is on its way to complete the manual
>>> masking effort by the end of this week.
>>> Jelte, Lino and I will decide together with you, the KiDS-CAT
>>> team, how to deal with that update efficiently regarding
>>> sourcelist re-production.
>>>
>>> Best, Gijs
>>>
>>> On 04/10/2013 02:53 PM, Francesco La Barbera wrote:
>>>> Dear All,
>>>>
>>>> I'm happy to inform you that the new sourcelists have been
>>>> produced now.
>>>>
>>>> Hugo, you can access them for AW ingestion at the same link as
>>>> last time, i.e.
>>>>
>>>> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>>>>
>>>> I checked that all files are in place, and there was no evident
>>>> issue with all different data products.
>>>> The sourcelists have been generated with the new, latest, masks
>>>> passed me by Mario and Nicola,
>>>> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
>>>> estimates).
>>>>
>>>> Pls, lemme know if everything is OK with this.
>>>>
>>>> Cheers,
>>>> Francesco
>>>>
>>>>
>>>>
>>>>
>>>> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
>>>> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>>>>
>>>> Dear Nicola and Mario and Hugo,
>>>>
>>>> How is the automated mask + sourcelist production going?
>>>>
>>>> I am now coordinating the visual grading and manual mask
>>>> production.
>>>> My plan is to have that team start to work on all coadds at
>>>> is_valid=1 and 2 asap.
>>>> (NB: all coadds that will be re-processed this week are now
>>>> set to is_valid=0)
>>>>
>>>> As far as I see this effort is decoupled (enough) from your
>>>> mask+sourcelist effort and there can start now. I will tell
>>>> the manual mask team to anticipate improvement on the
>>>> current automated masks. And hence start no manually
>>>> improving those.
>>>>
>>>> Please let me know if you see problems with this decoupled
>>>> parallel effort.
>>>>
>>>> Best wishes, Gijs
>>>>
>>>>
>>>>
>>>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>>>>
>>>>> OK Lino. Thanks
>>>>>
>>>>> N
>>>>>
>>>>>
>>>>>
>>>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>>>> Hi Nicola,
>>>>>>
>>>>>> the manual masks are on beo3 in the dir:
>>>>>>
>>>>>> /opt/AW/current/astro/experimental/kids/regionfiles
>>>>>>
>>>>>> Lino
>>>>>>
>>>>>>
>>>>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>>>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>> wrote:
>>>>>>
>>>>>>
>>>>>> Hi Lino,
>>>>>>
>>>>>> automatic masking is about to start. Mario and I are
>>>>>> still struggling with the g-band but we should be
>>>>>> able to work this out by the end of the day.
>>>>>> Meanwhile r,i,u are ready to go after we have checked
>>>>>> the spike length, which needs just some more very
>>>>>> short visual test.
>>>>>> This means that auto-masks will be possibly ready
>>>>>> tomorrow morning.
>>>>>>
>>>>>> To start the sourcelists extraction, though, we need
>>>>>> to incorporate the manual masks into the auto masks,
>>>>>> since the idea is to provide a unique flag in the
>>>>>> catalogs.
>>>>>> Thus we need to know whether the final manual masks
>>>>>> are also ready for the download. If so please give to
>>>>>> Mario the necessary references for that.
>>>>>>
>>>>>> Cheers,
>>>>>>
>>>>>> Nicola
>>>>>>
>>>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>>>> Hi Mario and Nicola,
>>>>>>>
>>>>>>> the coadds are ready for automatic masking.
>>>>>>>
>>>>>>> Lino
>>>>>>>
>>>>>>> ---------- Forwarded message ----------
>>>>>>> From: <jelte at strw.leidenuniv.nl
>>>>>>> <mailto:jelte at strw.leidenuniv.nl>>
>>>>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>>>>> <mailto:verdoes at astro.rug.nl>>, Lino Grado
>>>>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>>>>
>>>>>>>
>>>>>>> Hi Gijs and Lino,
>>>>>>>
>>>>>>> just to let you know that reprocessing is done now.
>>>>>>> We now have again 200 DR1 coadds:
>>>>>>>
>>>>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>>>>> awe> list =
>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>> c in query]
>>>>>>> awe> len(list)
>>>>>>> 200
>>>>>>>
>>>>>>> The total number of reprocessed coadds is 50:
>>>>>>> awe> query = Comment.content ==
>>>>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>>>>> awe> list =
>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>> c in query]
>>>>>>> awe> len(list)
>>>>>>> 50
>>>>>>>
>>>>>>> Querying for the comment
>>>>>>> 'KiDS-ESO-DR1-Coadd-DISCARDED' will also give 50
>>>>>>> coadds, namely the ones replaced by the reprocessed
>>>>>>> coadds.
>>>>>>>
>>>>>>> From the 74 is_valid=0 coadds, 24 were not
>>>>>>> reprocessed since according to
>>>>>>> the reprocessing teams there was no improvement
>>>>>>> possible. These coadds
>>>>>>> that are retained in DR1 can be recognized by the
>>>>>>> comment
>>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>>>>
>>>>>>> awe> query = Comment.content ==
>>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>>>>> awe> list =
>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>> c in query]
>>>>>>> awe> len(list)
>>>>>>> 24
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Jelte
>>>>>>>
>>>>>>> > Hi Gijs and Lino,
>>>>>>> >
>>>>>>> > reprocessing is almost done.
>>>>>>> > There were still 3 coadds that needed to be
>>>>>>> reprocessed and that is
>>>>>>> > currently being done.
>>>>>>> > Over the weekend I will update their comments etc,
>>>>>>> and notify Mario so
>>>>>>> > he can download the new ones for source extraction.
>>>>>>> >
>>>>>>> > I have also put a table on the wiki with the
>>>>>>> coadds that were set to
>>>>>>> > is_valid = 1 during the visual inspection (QA1):
>>>>>>> >
>>>>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>>>>> > Also included in the table (where it was clear to
>>>>>>> me) is the reasons why
>>>>>>> > the visual inspection team thinks these coadds
>>>>>>> could be improved if
>>>>>>> > there is enough time.
>>>>>>> > We should set up a dedicated team that can have a
>>>>>>> look at these coadds
>>>>>>> > next week to see which ones can be improved by
>>>>>>> reprocessing.
>>>>>>> > In any case our goal should be to have all final
>>>>>>> coadds by next Friday
>>>>>>> > (April 12).
>>>>>>> >
>>>>>>> > Cheers,
>>>>>>> > Jelte
>>>>>>> >
>>>>>>> > --
>>>>>>> > Dr. Jelte T. A. de Jong
>>>>>>> > KiDS project manager
>>>>>>> > Sterrewacht Leiden
>>>>>>> > Leiden University, Leiden, the Netherlands
>>>>>>> > E: jelte at strw.leidenuniv.nl
>>>>>>> <mailto:jelte at strw.leidenuniv.nl>
>>>>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>>>>> >
>>>>>>> >
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>
>>>>>>> Aniello Grado, PhD
>>>>>>>
>>>>>>> Ricercatore Astronomo
>>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>>> Via Moiariello 16 80131 Napoli
>>>>>>> ITALIA
>>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>>
>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Nicola R. Napolitano
>>>>>> Research Astronomer
>>>>>> INAF - Observatory of Capodimonte
>>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>
>>>>>> Aniello Grado, PhD
>>>>>>
>>>>>> Ricercatore Astronomo
>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>> Via Moiariello 16 80131 Napoli
>>>>>> ITALIA
>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>
>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Nicola R. Napolitano
>>>>> Research Astronomer
>>>>> INAF - Observatory of Capodimonte
>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>
>>>> --
>>>> --------------------------------------------------------------------
>>>> |dr Gijs Verdoes Kleijn | astronomer |
>>>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
>>>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
>>>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
>>>> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
>>>> | | Kapteyn Astronomical Institute |
>>>> | | Postbus 800, 9700 AV, Groningen|
>>>> | | The Netherlands |
>>>> --------------------------------------------------------------------
>>>>
>>>>
>>>
>>> --
>>> --------------------------------------------------------------------
>>> |dr Gijs Verdoes Kleijn | astronomer |
>>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
>>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
>>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
>>> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
>>> | | Kapteyn Astronomical Institute |
>>> | | Postbus 800, 9700 AV, Groningen|
>>> | | The Netherlands |
>>> --------------------------------------------------------------------
>>
>>
>> --
>> Nicola R. Napolitano
>> Research Astronomer
>> INAF - Observatory of Capodimonte
>> Salita Moiariello, 16, 80131, Napoli (Italy)
>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>
> --
> Dr. Jelte T. A. de Jong
> KiDS project manager
> Sterrewacht Leiden
> Leiden University, Leiden, the Netherlands
> E:jelte at strw.leidenuniv.nl <mailto:jelte at strw.leidenuniv.nl>
> T:+31-(0)715275818 <tel:%2B31-%280%29715275818>
> W:jelte.jdejong.net <http://jelte.jdejong.net>
>
>
>
>
> --
> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>
> Aniello Grado, PhD
>
> Ricercatore Astronomo
> INAF- Osservatorio Astronomico di Capodimonte
> Via Moiariello 16 80131 Napoli
> ITALIA
> Tel: 0039 0815575547
> Fax: 0039 0815575433
>
> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
--
Dr. Jelte T. A. de Jong
KiDS project manager
Sterrewacht Leiden
Leiden University, Leiden, the Netherlands
E: jelte at strw.leidenuniv.nl
T: +31-(0)715275818
W: jelte.jdejong.net
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130410/7ba74b87/attachment-0001.html
More information about the KiDS
mailing list