[KIDS] visual grading and manual mask production

Francesco La Barbera flabarber at gmail.com
Wed Apr 10 21:48:14 CEST 2013


Hi Jelte,

tomorrow 14:00 is fine to me too.

Cheers,
Francesco



On Wed, Apr 10, 2013 at 6:31 PM, Jelte de Jong <jelte at strw.leidenuniv.nl>wrote:

>  Dear all,
>
> shall we do the telecon at 14:00 tomorrow afternoon, and use the usual
> telecon set-up?
>
> Jelte
>
>
> On 10/04/13 16:17, aniello grado wrote:
>
> fine for me, but at 16.45 I have to leave.
>
>  Lino
>
>
> On Wed, Apr 10, 2013 at 3:46 PM, Jelte de Jong <jelte at strw.leidenuniv.nl>wrote:
>
>>  Dear all,
>>
>> a quick telecon might be a good idea. However, I would prefer tomorrow
>> afternoon, as I have a meeting all day on Friday.
>>
>> Cheers,
>> Jelte
>>
>>
>> On 10/04/13 15:37, Nicola R. Napolitano wrote:
>>
>>
>> Hi Gijs,
>>
>> thank you very much for the update. Do you think a quick teleconf on
>> Friday afternoon would be a good idea to make the point on the ESO-DR1
>> status and establish a schedule for the final production steps  and a check
>> list for the ESO delivery?
>>
>> Cheers,
>>
>> Nicola
>>
>> On 4/10/13 3:19 PM, Gijs Verdoes Kleijn wrote:
>>
>> Dear Francesco, KiDS-CAT team et al.,
>>
>> That is good news. Great work!
>>
>> The manual masking team is on its way to complete the manual masking
>> effort by the end of this week.
>> Jelte, Lino and I will decide together with you, the KiDS-CAT team, how
>> to deal with that update efficiently regarding sourcelist re-production.
>>
>> Best, Gijs
>>
>> On 04/10/2013 02:53 PM, Francesco La Barbera wrote:
>>
>> Dear All,
>>
>>  I'm happy to inform you that the new sourcelists have been produced now.
>>
>>  Hugo, you can access them for AW ingestion at the same link as last
>> time, i.e.
>>
>>  http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>>
>>  I checked that all files are in place, and there was no evident issue
>> with all different data products.
>> The sourcelists have been generated with the new, latest, masks passed me
>> by Mario and Nicola,
>> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
>> estimates).
>>
>>  Pls, lemme know if everything is OK with this.
>>
>>  Cheers,
>> Francesco
>>
>>
>>
>>
>>  On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn <
>> verdoes at astro.rug.nl> wrote:
>>
>>>  Dear Nicola and Mario and Hugo,
>>>
>>> How is the automated mask + sourcelist production going?
>>>
>>> I am now coordinating the visual grading and manual mask production.
>>> My plan is to have that team start to work on all coadds at is_valid=1
>>> and 2 asap.
>>> (NB: all coadds that will be re-processed this week are now set to
>>> is_valid=0)
>>>
>>> As far as I see this effort is decoupled (enough) from your
>>> mask+sourcelist effort and there can start now. I will tell the manual mask
>>> team to anticipate improvement on the current automated masks. And hence
>>> start no manually improving those.
>>>
>>> Please let me know if you see problems with this decoupled parallel
>>> effort.
>>>
>>> Best wishes, Gijs
>>>
>>>
>>>
>>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>>
>>>
>>> OK Lino. Thanks
>>>
>>> N
>>>
>>>
>>>
>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>
>>> Hi Nicola,
>>>
>>>  the manual masks are on beo3 in the dir:
>>>
>>>  /opt/AW/current/astro/experimental/kids/regionfiles
>>>
>>>  Lino
>>>
>>>
>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano <
>>> napolita at na.astro.it> wrote:
>>>
>>>>
>>>> Hi Lino,
>>>>
>>>> automatic masking is about to start. Mario and I are still struggling
>>>> with the g-band but we should be able to work this out by the end of the
>>>> day.
>>>> Meanwhile r,i,u are ready to go after we have checked the spike length,
>>>> which needs just some more very short visual test.
>>>> This means that auto-masks will be possibly ready tomorrow morning.
>>>>
>>>> To start the sourcelists extraction, though, we need to incorporate the
>>>> manual masks into the auto masks, since the idea is to provide a unique
>>>> flag in the catalogs.
>>>> Thus we need to know whether the final manual masks are also ready for
>>>> the download. If so please give to Mario the necessary references for that.
>>>>
>>>> Cheers,
>>>>
>>>> Nicola
>>>>
>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>
>>>> Hi Mario and Nicola,
>>>>
>>>>  the coadds are ready for automatic masking.
>>>>
>>>>  Lino
>>>>
>>>> ---------- Forwarded message ----------
>>>> From: <jelte at strw.leidenuniv.nl>
>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl>, Lino Grado <
>>>> agrado at na.astro.it>
>>>>
>>>>
>>>> Hi Gijs and Lino,
>>>>
>>>> just to let you know that reprocessing is done now.
>>>> We now have again 200 DR1 coadds:
>>>>
>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>> awe> list = [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>> query]
>>>> awe> len(list)
>>>> 200
>>>>
>>>> The total number of reprocessed coadds is 50:
>>>> awe> query = Comment.content ==
>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>> awe> list = [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>> query]
>>>> awe> len(list)
>>>> 50
>>>>
>>>> Querying for the comment 'KiDS-ESO-DR1-Coadd-DISCARDED' will also give
>>>> 50
>>>> coadds, namely the ones replaced by the reprocessed coadds.
>>>>
>>>> From the 74 is_valid=0 coadds, 24 were not reprocessed since according
>>>> to
>>>> the reprocessing teams there was no improvement possible. These coadds
>>>> that are retained in DR1 can be recognized by the comment
>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>
>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>> awe> list = [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>> query]
>>>> awe> len(list)
>>>> 24
>>>>
>>>> Cheers,
>>>> Jelte
>>>>
>>>> > Hi Gijs and Lino,
>>>> >
>>>> > reprocessing is almost done.
>>>> > There were still 3 coadds that needed to be reprocessed and that is
>>>> > currently being done.
>>>> > Over the weekend I will update their comments etc, and notify Mario so
>>>> > he can download the new ones for source extraction.
>>>> >
>>>> > I have also put a table on the wiki with the coadds that were set to
>>>> > is_valid = 1 during the visual inspection (QA1):
>>>> >
>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>> > Also included in the table (where it was clear to me) is the reasons
>>>> why
>>>> > the visual inspection team thinks these coadds could be improved if
>>>> > there is enough time.
>>>> > We should set up a dedicated team that can have a look at these coadds
>>>> > next week to see which ones can be improved by reprocessing.
>>>> > In any case our goal should be to have all final coadds by next Friday
>>>> > (April 12).
>>>> >
>>>> > Cheers,
>>>> > Jelte
>>>> >
>>>> > --
>>>> > Dr. Jelte T. A. de Jong
>>>> > KiDS project manager
>>>> > Sterrewacht Leiden
>>>> > Leiden University, Leiden, the Netherlands
>>>> > E: jelte at strw.leidenuniv.nl
>>>> > T: +31-(0)715275818
>>>> > W: jelte.jdejong.net
>>>> >
>>>> >
>>>>
>>>>
>>>>
>>>>
>>>>  --
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>
>>>>  Aniello Grado, PhD
>>>>
>>>>  Ricercatore Astronomo
>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>> Via Moiariello 16 80131 Napoli
>>>> ITALIA
>>>> Tel: 0039 0815575547 <0039%200815575547>
>>>> Fax: 0039 0815575433 <0039%200815575433>
>>>>
>>>>  <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>
>>>>
>>>>
>>>>   --
>>>> Nicola R. Napolitano
>>>> Research Astronomer
>>>> INAF - Observatory of Capodimonte
>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>> phone: +39 081 5575509; fax: +39 081 456710
>>>> email: napolita at na.astro.it
>>>> web page: http://www.na.astro.it/~napolita
>>>>
>>>>
>>>
>>>
>>>  --
>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>
>>>  Aniello Grado, PhD
>>>
>>>  Ricercatore Astronomo
>>> INAF- Osservatorio Astronomico di Capodimonte
>>> Via Moiariello 16 80131 Napoli
>>> ITALIA
>>> Tel: 0039 0815575547 <0039%200815575547>
>>> Fax: 0039 0815575433 <0039%200815575433>
>>>
>>>  <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>
>>>
>>>
>>> --
>>> Nicola R. Napolitano
>>> Research Astronomer
>>> INAF - Observatory of Capodimonte
>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>> phone: +39 081 5575509; fax: +39 081 456710
>>> email: napolita at na.astro.it
>>> web page: http://www.na.astro.it/~napolita
>>>
>>>
>>> --
>>> --------------------------------------------------------------------
>>> |dr Gijs Verdoes Kleijn         |   astronomer                     |
>>> |e-mail: verdoes at astro.rug.nl   |   OmegaCEN / Kapteyn Institute / |
>>> |www: www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> |   Target                         |
>>> |tel: +31-50-3638326            |   University of Groningen        |
>>> |mobile: +31-654658050          |   postal address:                |
>>> |                               |   Kapteyn Astronomical Institute |
>>> |                               |   Postbus 800, 9700 AV, Groningen|
>>> |                               |   The Netherlands                |
>>> --------------------------------------------------------------------
>>>
>>>
>>
>> --
>> --------------------------------------------------------------------
>> |dr Gijs Verdoes Kleijn         |   astronomer                     |
>> |e-mail: verdoes at astro.rug.nl   |   OmegaCEN / Kapteyn Institute / |
>> |www: www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> |   Target                         |
>> |tel: +31-50-3638326            |   University of Groningen        |
>> |mobile: +31-654658050          |   postal address:                |
>> |                               |   Kapteyn Astronomical Institute |
>> |                               |   Postbus 800, 9700 AV, Groningen|
>> |                               |   The Netherlands                |
>> --------------------------------------------------------------------
>>
>>
>>
>> --
>> Nicola R. Napolitano
>> Research Astronomer
>> INAF - Observatory of Capodimonte
>> Salita Moiariello, 16, 80131, Napoli (Italy)
>> phone: +39 081 5575509; fax: +39 081 456710
>> email: napolita at na.astro.it
>> web page: http://www.na.astro.it/~napolita
>>
>>
>> --
>> Dr. Jelte T. A. de Jong
>> KiDS project manager
>> Sterrewacht Leiden
>> Leiden University, Leiden, the Netherlands
>> E: jelte at strw.leidenuniv.nl
>> T: +31-(0)715275818
>> W: jelte.jdejong.net
>>
>>
>
>
>  --
> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>
>  Aniello Grado, PhD
>
>  Ricercatore Astronomo
> INAF- Osservatorio Astronomico di Capodimonte
> Via Moiariello 16 80131 Napoli
> ITALIA
> Tel: 0039 0815575547
> Fax: 0039 0815575433
>
>  <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>
>
> --
> Dr. Jelte T. A. de Jong
> KiDS project manager
> Sterrewacht Leiden
> Leiden University, Leiden, the Netherlands
> E: jelte at strw.leidenuniv.nl
> T: +31-(0)715275818
> W: jelte.jdejong.net
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130410/3da53fc2/attachment-0001.html 


More information about the KiDS mailing list