[KIDS] visual grading and manual mask production
Jelte de Jong
jelte at strw.leidenuniv.nl
Wed Apr 10 15:46:16 CEST 2013
Dear all,
a quick telecon might be a good idea. However, I would prefer tomorrow
afternoon, as I have a meeting all day on Friday.
Cheers,
Jelte
On 10/04/13 15:37, Nicola R. Napolitano wrote:
>
> Hi Gijs,
>
> thank you very much for the update. Do you think a quick teleconf on
> Friday afternoon would be a good idea to make the point on the ESO-DR1
> status and establish a schedule for the final production steps and a
> check list for the ESO delivery?
>
> Cheers,
>
> Nicola
>
> On 4/10/13 3:19 PM, Gijs Verdoes Kleijn wrote:
>> Dear Francesco, KiDS-CAT team et al.,
>>
>> That is good news. Great work!
>>
>> The manual masking team is on its way to complete the manual masking
>> effort by the end of this week.
>> Jelte, Lino and I will decide together with you, the KiDS-CAT team,
>> how to deal with that update efficiently regarding sourcelist
>> re-production.
>>
>> Best, Gijs
>>
>> On 04/10/2013 02:53 PM, Francesco La Barbera wrote:
>>> Dear All,
>>>
>>> I'm happy to inform you that the new sourcelists have been produced now.
>>>
>>> Hugo, you can access them for AW ingestion at the same link as last
>>> time, i.e.
>>>
>>> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>>>
>>> I checked that all files are in place, and there was no evident
>>> issue with all different data products.
>>> The sourcelists have been generated with the new, latest, masks
>>> passed me by Mario and Nicola,
>>> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
>>> estimates).
>>>
>>> Pls, lemme know if everything is OK with this.
>>>
>>> Cheers,
>>> Francesco
>>>
>>>
>>>
>>>
>>> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
>>> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>>>
>>> Dear Nicola and Mario and Hugo,
>>>
>>> How is the automated mask + sourcelist production going?
>>>
>>> I am now coordinating the visual grading and manual mask production.
>>> My plan is to have that team start to work on all coadds at
>>> is_valid=1 and 2 asap.
>>> (NB: all coadds that will be re-processed this week are now set
>>> to is_valid=0)
>>>
>>> As far as I see this effort is decoupled (enough) from your
>>> mask+sourcelist effort and there can start now. I will tell the
>>> manual mask team to anticipate improvement on the current
>>> automated masks. And hence start no manually improving those.
>>>
>>> Please let me know if you see problems with this decoupled
>>> parallel effort.
>>>
>>> Best wishes, Gijs
>>>
>>>
>>>
>>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>>>
>>>> OK Lino. Thanks
>>>>
>>>> N
>>>>
>>>>
>>>>
>>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>>> Hi Nicola,
>>>>>
>>>>> the manual masks are on beo3 in the dir:
>>>>>
>>>>> /opt/AW/current/astro/experimental/kids/regionfiles
>>>>>
>>>>> Lino
>>>>>
>>>>>
>>>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>> wrote:
>>>>>
>>>>>
>>>>> Hi Lino,
>>>>>
>>>>> automatic masking is about to start. Mario and I are still
>>>>> struggling with the g-band but we should be able to work
>>>>> this out by the end of the day.
>>>>> Meanwhile r,i,u are ready to go after we have checked the
>>>>> spike length, which needs just some more very short visual
>>>>> test.
>>>>> This means that auto-masks will be possibly ready tomorrow
>>>>> morning.
>>>>>
>>>>> To start the sourcelists extraction, though, we need to
>>>>> incorporate the manual masks into the auto masks, since
>>>>> the idea is to provide a unique flag in the catalogs.
>>>>> Thus we need to know whether the final manual masks are
>>>>> also ready for the download. If so please give to Mario
>>>>> the necessary references for that.
>>>>>
>>>>> Cheers,
>>>>>
>>>>> Nicola
>>>>>
>>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>>> Hi Mario and Nicola,
>>>>>>
>>>>>> the coadds are ready for automatic masking.
>>>>>>
>>>>>> Lino
>>>>>>
>>>>>> ---------- Forwarded message ----------
>>>>>> From: <jelte at strw.leidenuniv.nl
>>>>>> <mailto:jelte at strw.leidenuniv.nl>>
>>>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>>>> <mailto:verdoes at astro.rug.nl>>, Lino Grado
>>>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>>>
>>>>>>
>>>>>> Hi Gijs and Lino,
>>>>>>
>>>>>> just to let you know that reprocessing is done now.
>>>>>> We now have again 200 DR1 coadds:
>>>>>>
>>>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>>>> awe> list =
>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>>>> query]
>>>>>> awe> len(list)
>>>>>> 200
>>>>>>
>>>>>> The total number of reprocessed coadds is 50:
>>>>>> awe> query = Comment.content ==
>>>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>>>> awe> list =
>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>>>> query]
>>>>>> awe> len(list)
>>>>>> 50
>>>>>>
>>>>>> Querying for the comment 'KiDS-ESO-DR1-Coadd-DISCARDED'
>>>>>> will also give 50
>>>>>> coadds, namely the ones replaced by the reprocessed coadds.
>>>>>>
>>>>>> From the 74 is_valid=0 coadds, 24 were not reprocessed
>>>>>> since according to
>>>>>> the reprocessing teams there was no improvement possible.
>>>>>> These coadds
>>>>>> that are retained in DR1 can be recognized by the comment
>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>>>
>>>>>> awe> query = Comment.content ==
>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>>>> awe> list =
>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>>>> query]
>>>>>> awe> len(list)
>>>>>> 24
>>>>>>
>>>>>> Cheers,
>>>>>> Jelte
>>>>>>
>>>>>> > Hi Gijs and Lino,
>>>>>> >
>>>>>> > reprocessing is almost done.
>>>>>> > There were still 3 coadds that needed to be reprocessed
>>>>>> and that is
>>>>>> > currently being done.
>>>>>> > Over the weekend I will update their comments etc, and
>>>>>> notify Mario so
>>>>>> > he can download the new ones for source extraction.
>>>>>> >
>>>>>> > I have also put a table on the wiki with the coadds
>>>>>> that were set to
>>>>>> > is_valid = 1 during the visual inspection (QA1):
>>>>>> >
>>>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>>>> > Also included in the table (where it was clear to me)
>>>>>> is the reasons why
>>>>>> > the visual inspection team thinks these coadds could be
>>>>>> improved if
>>>>>> > there is enough time.
>>>>>> > We should set up a dedicated team that can have a look
>>>>>> at these coadds
>>>>>> > next week to see which ones can be improved by
>>>>>> reprocessing.
>>>>>> > In any case our goal should be to have all final coadds
>>>>>> by next Friday
>>>>>> > (April 12).
>>>>>> >
>>>>>> > Cheers,
>>>>>> > Jelte
>>>>>> >
>>>>>> > --
>>>>>> > Dr. Jelte T. A. de Jong
>>>>>> > KiDS project manager
>>>>>> > Sterrewacht Leiden
>>>>>> > Leiden University, Leiden, the Netherlands
>>>>>> > E: jelte at strw.leidenuniv.nl
>>>>>> <mailto:jelte at strw.leidenuniv.nl>
>>>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>>>> >
>>>>>> >
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>
>>>>>> Aniello Grado, PhD
>>>>>>
>>>>>> Ricercatore Astronomo
>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>> Via Moiariello 16 80131 Napoli
>>>>>> ITALIA
>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>
>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Nicola R. Napolitano
>>>>> Research Astronomer
>>>>> INAF - Observatory of Capodimonte
>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>
>>>>> Aniello Grado, PhD
>>>>>
>>>>> Ricercatore Astronomo
>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>> Via Moiariello 16 80131 Napoli
>>>>> ITALIA
>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>
>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>
>>>>
>>>> --
>>>> Nicola R. Napolitano
>>>> Research Astronomer
>>>> INAF - Observatory of Capodimonte
>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>
>>> --
>>> --------------------------------------------------------------------
>>> |dr Gijs Verdoes Kleijn | astronomer |
>>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
>>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
>>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
>>> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
>>> | | Kapteyn Astronomical Institute |
>>> | | Postbus 800, 9700 AV, Groningen|
>>> | | The Netherlands |
>>> --------------------------------------------------------------------
>>>
>>>
>>
>> --
>> --------------------------------------------------------------------
>> |dr Gijs Verdoes Kleijn | astronomer |
>> |e-mail:verdoes at astro.rug.nl | OmegaCEN / Kapteyn Institute / |
>> |www:www.astro.rug.nl/~verdoes | Target |
>> |tel: +31-50-3638326 | University of Groningen |
>> |mobile: +31-654658050 | postal address: |
>> | | Kapteyn Astronomical Institute |
>> | | Postbus 800, 9700 AV, Groningen|
>> | | The Netherlands |
>> --------------------------------------------------------------------
>
>
> --
> Nicola R. Napolitano
> Research Astronomer
> INAF - Observatory of Capodimonte
> Salita Moiariello, 16, 80131, Napoli (Italy)
> phone: +39 081 5575509; fax: +39 081 456710
> email:napolita at na.astro.it
> web page:http://www.na.astro.it/~napolita
--
Dr. Jelte T. A. de Jong
KiDS project manager
Sterrewacht Leiden
Leiden University, Leiden, the Netherlands
E: jelte at strw.leidenuniv.nl
T: +31-(0)715275818
W: jelte.jdejong.net
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130410/5e7dc0ca/attachment-0001.html
More information about the KiDS
mailing list