[KIDS] visual grading and manual mask production
Nicola R. Napolitano
napolita at na.astro.it
Wed Apr 10 15:37:41 CEST 2013
Hi Gijs,
thank you very much for the update. Do you think a quick teleconf on
Friday afternoon would be a good idea to make the point on the ESO-DR1
status and establish a schedule for the final production steps and a
check list for the ESO delivery?
Cheers,
Nicola
On 4/10/13 3:19 PM, Gijs Verdoes Kleijn wrote:
> Dear Francesco, KiDS-CAT team et al.,
>
> That is good news. Great work!
>
> The manual masking team is on its way to complete the manual masking
> effort by the end of this week.
> Jelte, Lino and I will decide together with you, the KiDS-CAT team,
> how to deal with that update efficiently regarding sourcelist
> re-production.
>
> Best, Gijs
>
> On 04/10/2013 02:53 PM, Francesco La Barbera wrote:
>> Dear All,
>>
>> I'm happy to inform you that the new sourcelists have been produced now.
>>
>> Hugo, you can access them for AW ingestion at the same link as last
>> time, i.e.
>>
>> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>>
>> I checked that all files are in place, and there was no evident issue
>> with all different data products.
>> The sourcelists have been generated with the new, latest, masks
>> passed me by Mario and Nicola,
>> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
>> estimates).
>>
>> Pls, lemme know if everything is OK with this.
>>
>> Cheers,
>> Francesco
>>
>>
>>
>>
>> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
>> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>>
>> Dear Nicola and Mario and Hugo,
>>
>> How is the automated mask + sourcelist production going?
>>
>> I am now coordinating the visual grading and manual mask production.
>> My plan is to have that team start to work on all coadds at
>> is_valid=1 and 2 asap.
>> (NB: all coadds that will be re-processed this week are now set
>> to is_valid=0)
>>
>> As far as I see this effort is decoupled (enough) from your
>> mask+sourcelist effort and there can start now. I will tell the
>> manual mask team to anticipate improvement on the current
>> automated masks. And hence start no manually improving those.
>>
>> Please let me know if you see problems with this decoupled
>> parallel effort.
>>
>> Best wishes, Gijs
>>
>>
>>
>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>>
>>> OK Lino. Thanks
>>>
>>> N
>>>
>>>
>>>
>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>> Hi Nicola,
>>>>
>>>> the manual masks are on beo3 in the dir:
>>>>
>>>> /opt/AW/current/astro/experimental/kids/regionfiles
>>>>
>>>> Lino
>>>>
>>>>
>>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>> wrote:
>>>>
>>>>
>>>> Hi Lino,
>>>>
>>>> automatic masking is about to start. Mario and I are still
>>>> struggling with the g-band but we should be able to work
>>>> this out by the end of the day.
>>>> Meanwhile r,i,u are ready to go after we have checked the
>>>> spike length, which needs just some more very short visual
>>>> test.
>>>> This means that auto-masks will be possibly ready tomorrow
>>>> morning.
>>>>
>>>> To start the sourcelists extraction, though, we need to
>>>> incorporate the manual masks into the auto masks, since the
>>>> idea is to provide a unique flag in the catalogs.
>>>> Thus we need to know whether the final manual masks are
>>>> also ready for the download. If so please give to Mario the
>>>> necessary references for that.
>>>>
>>>> Cheers,
>>>>
>>>> Nicola
>>>>
>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>> Hi Mario and Nicola,
>>>>>
>>>>> the coadds are ready for automatic masking.
>>>>>
>>>>> Lino
>>>>>
>>>>> ---------- Forwarded message ----------
>>>>> From: <jelte at strw.leidenuniv.nl
>>>>> <mailto:jelte at strw.leidenuniv.nl>>
>>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>>> <mailto:verdoes at astro.rug.nl>>, Lino Grado
>>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>>
>>>>>
>>>>> Hi Gijs and Lino,
>>>>>
>>>>> just to let you know that reprocessing is done now.
>>>>> We now have again 200 DR1 coadds:
>>>>>
>>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>>> awe> list =
>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>>> query]
>>>>> awe> len(list)
>>>>> 200
>>>>>
>>>>> The total number of reprocessed coadds is 50:
>>>>> awe> query = Comment.content ==
>>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>>> awe> list =
>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>>> query]
>>>>> awe> len(list)
>>>>> 50
>>>>>
>>>>> Querying for the comment 'KiDS-ESO-DR1-Coadd-DISCARDED'
>>>>> will also give 50
>>>>> coadds, namely the ones replaced by the reprocessed coadds.
>>>>>
>>>>> From the 74 is_valid=0 coadds, 24 were not reprocessed
>>>>> since according to
>>>>> the reprocessing teams there was no improvement possible.
>>>>> These coadds
>>>>> that are retained in DR1 can be recognized by the comment
>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>>
>>>>> awe> query = Comment.content ==
>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>>> awe> list =
>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>>> query]
>>>>> awe> len(list)
>>>>> 24
>>>>>
>>>>> Cheers,
>>>>> Jelte
>>>>>
>>>>> > Hi Gijs and Lino,
>>>>> >
>>>>> > reprocessing is almost done.
>>>>> > There were still 3 coadds that needed to be reprocessed
>>>>> and that is
>>>>> > currently being done.
>>>>> > Over the weekend I will update their comments etc, and
>>>>> notify Mario so
>>>>> > he can download the new ones for source extraction.
>>>>> >
>>>>> > I have also put a table on the wiki with the coadds that
>>>>> were set to
>>>>> > is_valid = 1 during the visual inspection (QA1):
>>>>> >
>>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>>> > Also included in the table (where it was clear to me) is
>>>>> the reasons why
>>>>> > the visual inspection team thinks these coadds could be
>>>>> improved if
>>>>> > there is enough time.
>>>>> > We should set up a dedicated team that can have a look
>>>>> at these coadds
>>>>> > next week to see which ones can be improved by reprocessing.
>>>>> > In any case our goal should be to have all final coadds
>>>>> by next Friday
>>>>> > (April 12).
>>>>> >
>>>>> > Cheers,
>>>>> > Jelte
>>>>> >
>>>>> > --
>>>>> > Dr. Jelte T. A. de Jong
>>>>> > KiDS project manager
>>>>> > Sterrewacht Leiden
>>>>> > Leiden University, Leiden, the Netherlands
>>>>> > E: jelte at strw.leidenuniv.nl
>>>>> <mailto:jelte at strw.leidenuniv.nl>
>>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>>> >
>>>>> >
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>
>>>>> Aniello Grado, PhD
>>>>>
>>>>> Ricercatore Astronomo
>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>> Via Moiariello 16 80131 Napoli
>>>>> ITALIA
>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>
>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>
>>>>
>>>> --
>>>> Nicola R. Napolitano
>>>> Research Astronomer
>>>> INAF - Observatory of Capodimonte
>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>
>>>> Aniello Grado, PhD
>>>>
>>>> Ricercatore Astronomo
>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>> Via Moiariello 16 80131 Napoli
>>>> ITALIA
>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>
>>>
>>> --
>>> Nicola R. Napolitano
>>> Research Astronomer
>>> INAF - Observatory of Capodimonte
>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>
>> --
>> --------------------------------------------------------------------
>> |dr Gijs Verdoes Kleijn | astronomer |
>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
>> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
>> | | Kapteyn Astronomical Institute |
>> | | Postbus 800, 9700 AV, Groningen|
>> | | The Netherlands |
>> --------------------------------------------------------------------
>>
>>
>
> --
> --------------------------------------------------------------------
> |dr Gijs Verdoes Kleijn | astronomer |
> |e-mail:verdoes at astro.rug.nl | OmegaCEN / Kapteyn Institute / |
> |www:www.astro.rug.nl/~verdoes | Target |
> |tel: +31-50-3638326 | University of Groningen |
> |mobile: +31-654658050 | postal address: |
> | | Kapteyn Astronomical Institute |
> | | Postbus 800, 9700 AV, Groningen|
> | | The Netherlands |
> --------------------------------------------------------------------
--
Nicola R. Napolitano
Research Astronomer
INAF - Observatory of Capodimonte
Salita Moiariello, 16, 80131, Napoli (Italy)
phone: +39 081 5575509; fax: +39 081 456710
email: napolita at na.astro.it
web page: http://www.na.astro.it/~napolita
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130410/f6628554/attachment-0001.html
More information about the KiDS
mailing list