[KIDS] visual grading and manual mask production
Jelte de Jong
jelte at strw.leidenuniv.nl
Thu Apr 11 10:38:03 CEST 2013
Dear all,
Emanuella requested the telecon to start at 14:30 instead of 14:00, so
if this is OK for everybody else then let's do that.
So drop me a line if 14:30 is NOT OK for you.
Cheers,
Jelte
On 11/04/13 09:25, aniello grado wrote:
> ok for me.
>
> Lino
>
>
> On Wed, Apr 10, 2013 at 6:31 PM, Jelte de Jong
> <jelte at strw.leidenuniv.nl <mailto:jelte at strw.leidenuniv.nl>> wrote:
>
> Dear all,
>
> shall we do the telecon at 14:00 tomorrow afternoon, and use the
> usual telecon set-up?
>
> Jelte
>
>
> On 10/04/13 16:17, aniello grado wrote:
>> fine for me, but at 16.45 I have to leave.
>>
>> Lino
>>
>>
>> On Wed, Apr 10, 2013 at 3:46 PM, Jelte de Jong
>> <jelte at strw.leidenuniv.nl <mailto:jelte at strw.leidenuniv.nl>> wrote:
>>
>> Dear all,
>>
>> a quick telecon might be a good idea. However, I would prefer
>> tomorrow afternoon, as I have a meeting all day on Friday.
>>
>> Cheers,
>> Jelte
>>
>>
>> On 10/04/13 15:37, Nicola R. Napolitano wrote:
>>>
>>> Hi Gijs,
>>>
>>> thank you very much for the update. Do you think a quick
>>> teleconf on Friday afternoon would be a good idea to make
>>> the point on the ESO-DR1 status and establish a schedule for
>>> the final production steps and a check list for the ESO
>>> delivery?
>>>
>>> Cheers,
>>>
>>> Nicola
>>>
>>> On 4/10/13 3:19 PM, Gijs Verdoes Kleijn wrote:
>>>> Dear Francesco, KiDS-CAT team et al.,
>>>>
>>>> That is good news. Great work!
>>>>
>>>> The manual masking team is on its way to complete the
>>>> manual masking effort by the end of this week.
>>>> Jelte, Lino and I will decide together with you, the
>>>> KiDS-CAT team, how to deal with that update efficiently
>>>> regarding sourcelist re-production.
>>>>
>>>> Best, Gijs
>>>>
>>>> On 04/10/2013 02:53 PM, Francesco La Barbera wrote:
>>>>> Dear All,
>>>>>
>>>>> I'm happy to inform you that the new sourcelists have been
>>>>> produced now.
>>>>>
>>>>> Hugo, you can access them for AW ingestion at the same
>>>>> link as last time, i.e.
>>>>>
>>>>> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>>>>>
>>>>> I checked that all files are in place, and there was no
>>>>> evident issue with all different data products.
>>>>> The sourcelists have been generated with the new, latest,
>>>>> masks passed me by Mario and Nicola,
>>>>> and using KIDS-CAT v.1.6 (that includes sat mag and
>>>>> ellipticity estimates).
>>>>>
>>>>> Pls, lemme know if everything is OK with this.
>>>>>
>>>>> Cheers,
>>>>> Francesco
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
>>>>> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>>>>>
>>>>> Dear Nicola and Mario and Hugo,
>>>>>
>>>>> How is the automated mask + sourcelist production going?
>>>>>
>>>>> I am now coordinating the visual grading and manual
>>>>> mask production.
>>>>> My plan is to have that team start to work on all
>>>>> coadds at is_valid=1 and 2 asap.
>>>>> (NB: all coadds that will be re-processed this week
>>>>> are now set to is_valid=0)
>>>>>
>>>>> As far as I see this effort is decoupled (enough) from
>>>>> your mask+sourcelist effort and there can start now. I
>>>>> will tell the manual mask team to anticipate
>>>>> improvement on the current automated masks. And hence
>>>>> start no manually improving those.
>>>>>
>>>>> Please let me know if you see problems with this
>>>>> decoupled parallel effort.
>>>>>
>>>>> Best wishes, Gijs
>>>>>
>>>>>
>>>>>
>>>>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>>>>>
>>>>>> OK Lino. Thanks
>>>>>>
>>>>>> N
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>>>>> Hi Nicola,
>>>>>>>
>>>>>>> the manual masks are on beo3 in the dir:
>>>>>>>
>>>>>>> /opt/AW/current/astro/experimental/kids/regionfiles
>>>>>>>
>>>>>>> Lino
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>>>>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>>
>>>>>>> wrote:
>>>>>>>
>>>>>>>
>>>>>>> Hi Lino,
>>>>>>>
>>>>>>> automatic masking is about to start. Mario and I
>>>>>>> are still struggling with the g-band but we
>>>>>>> should be able to work this out by the end of
>>>>>>> the day.
>>>>>>> Meanwhile r,i,u are ready to go after we have
>>>>>>> checked the spike length, which needs just some
>>>>>>> more very short visual test.
>>>>>>> This means that auto-masks will be possibly
>>>>>>> ready tomorrow morning.
>>>>>>>
>>>>>>> To start the sourcelists extraction, though, we
>>>>>>> need to incorporate the manual masks into the
>>>>>>> auto masks, since the idea is to provide a
>>>>>>> unique flag in the catalogs.
>>>>>>> Thus we need to know whether the final manual
>>>>>>> masks are also ready for the download. If so
>>>>>>> please give to Mario the necessary references
>>>>>>> for that.
>>>>>>>
>>>>>>> Cheers,
>>>>>>>
>>>>>>> Nicola
>>>>>>>
>>>>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>>>>> Hi Mario and Nicola,
>>>>>>>>
>>>>>>>> the coadds are ready for automatic masking.
>>>>>>>>
>>>>>>>> Lino
>>>>>>>>
>>>>>>>> ---------- Forwarded message ----------
>>>>>>>> From: <jelte at strw.leidenuniv.nl
>>>>>>>> <mailto:jelte at strw.leidenuniv.nl>>
>>>>>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>>>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>>>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>>>>>> <mailto:verdoes at astro.rug.nl>>, Lino Grado
>>>>>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Hi Gijs and Lino,
>>>>>>>>
>>>>>>>> just to let you know that reprocessing is done now.
>>>>>>>> We now have again 200 DR1 coadds:
>>>>>>>>
>>>>>>>> awe> query = Comment.content ==
>>>>>>>> 'KiDS-ESO-DR1-Coadd'
>>>>>>>> awe> list =
>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>>> c in query]
>>>>>>>> awe> len(list)
>>>>>>>> 200
>>>>>>>>
>>>>>>>> The total number of reprocessed coadds is 50:
>>>>>>>> awe> query = Comment.content ==
>>>>>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>>>>>> awe> list =
>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>>> c in query]
>>>>>>>> awe> len(list)
>>>>>>>> 50
>>>>>>>>
>>>>>>>> Querying for the comment
>>>>>>>> 'KiDS-ESO-DR1-Coadd-DISCARDED' will also give 50
>>>>>>>> coadds, namely the ones replaced by the
>>>>>>>> reprocessed coadds.
>>>>>>>>
>>>>>>>> From the 74 is_valid=0 coadds, 24 were not
>>>>>>>> reprocessed since according to
>>>>>>>> the reprocessing teams there was no improvement
>>>>>>>> possible. These coadds
>>>>>>>> that are retained in DR1 can be recognized by
>>>>>>>> the comment
>>>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>>>>>
>>>>>>>> awe> query = Comment.content ==
>>>>>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>>>>>> awe> list =
>>>>>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for
>>>>>>>> c in query]
>>>>>>>> awe> len(list)
>>>>>>>> 24
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>> Jelte
>>>>>>>>
>>>>>>>> > Hi Gijs and Lino,
>>>>>>>> >
>>>>>>>> > reprocessing is almost done.
>>>>>>>> > There were still 3 coadds that needed to be
>>>>>>>> reprocessed and that is
>>>>>>>> > currently being done.
>>>>>>>> > Over the weekend I will update their comments
>>>>>>>> etc, and notify Mario so
>>>>>>>> > he can download the new ones for source
>>>>>>>> extraction.
>>>>>>>> >
>>>>>>>> > I have also put a table on the wiki with the
>>>>>>>> coadds that were set to
>>>>>>>> > is_valid = 1 during the visual inspection (QA1):
>>>>>>>> >
>>>>>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>>>>>> > Also included in the table (where it was
>>>>>>>> clear to me) is the reasons why
>>>>>>>> > the visual inspection team thinks these
>>>>>>>> coadds could be improved if
>>>>>>>> > there is enough time.
>>>>>>>> > We should set up a dedicated team that can
>>>>>>>> have a look at these coadds
>>>>>>>> > next week to see which ones can be improved
>>>>>>>> by reprocessing.
>>>>>>>> > In any case our goal should be to have all
>>>>>>>> final coadds by next Friday
>>>>>>>> > (April 12).
>>>>>>>> >
>>>>>>>> > Cheers,
>>>>>>>> > Jelte
>>>>>>>> >
>>>>>>>> > --
>>>>>>>> > Dr. Jelte T. A. de Jong
>>>>>>>> > KiDS project manager
>>>>>>>> > Sterrewacht Leiden
>>>>>>>> > Leiden University, Leiden, the Netherlands
>>>>>>>> > E: jelte at strw.leidenuniv.nl
>>>>>>>> <mailto:jelte at strw.leidenuniv.nl>
>>>>>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>>>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>>>>>> >
>>>>>>>> >
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>
>>>>>>>> Aniello Grado, PhD
>>>>>>>>
>>>>>>>> Ricercatore Astronomo
>>>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>>>> Via Moiariello 16 80131 Napoli
>>>>>>>> ITALIA
>>>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>>>
>>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Nicola R. Napolitano
>>>>>>> Research Astronomer
>>>>>>> INAF - Observatory of Capodimonte
>>>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>>
>>>>>>> Aniello Grado, PhD
>>>>>>>
>>>>>>> Ricercatore Astronomo
>>>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>>>> Via Moiariello 16 80131 Napoli
>>>>>>> ITALIA
>>>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>>>
>>>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Nicola R. Napolitano
>>>>>> Research Astronomer
>>>>>> INAF - Observatory of Capodimonte
>>>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>>>
>>>>> --
>>>>> --------------------------------------------------------------------
>>>>> |dr Gijs Verdoes Kleijn | astronomer |
>>>>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
>>>>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
>>>>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
>>>>> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
>>>>> | | Kapteyn Astronomical Institute |
>>>>> | | Postbus 800, 9700 AV, Groningen|
>>>>> | | The Netherlands |
>>>>> --------------------------------------------------------------------
>>>>>
>>>>>
>>>>
>>>> --
>>>> --------------------------------------------------------------------
>>>> |dr Gijs Verdoes Kleijn | astronomer |
>>>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
>>>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
>>>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
>>>> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
>>>> | | Kapteyn Astronomical Institute |
>>>> | | Postbus 800, 9700 AV, Groningen|
>>>> | | The Netherlands |
>>>> --------------------------------------------------------------------
>>>
>>>
>>> --
>>> Nicola R. Napolitano
>>> Research Astronomer
>>> INAF - Observatory of Capodimonte
>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>
>> --
>> Dr. Jelte T. A. de Jong
>> KiDS project manager
>> Sterrewacht Leiden
>> Leiden University, Leiden, the Netherlands
>> E:jelte at strw.leidenuniv.nl <mailto:jelte at strw.leidenuniv.nl>
>> T:+31-(0)715275818 <tel:%2B31-%280%29715275818>
>> W:jelte.jdejong.net <http://jelte.jdejong.net>
>>
>>
>>
>>
>> --
>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>
>> Aniello Grado, PhD
>>
>> Ricercatore Astronomo
>> INAF- Osservatorio Astronomico di Capodimonte
>> Via Moiariello 16 80131 Napoli
>> ITALIA
>> Tel: 0039 0815575547 <tel:0039%200815575547>
>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>
>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>
> --
> Dr. Jelte T. A. de Jong
> KiDS project manager
> Sterrewacht Leiden
> Leiden University, Leiden, the Netherlands
> E:jelte at strw.leidenuniv.nl <mailto:jelte at strw.leidenuniv.nl>
> T:+31-(0)715275818 <tel:%2B31-%280%29715275818>
> W:jelte.jdejong.net <http://jelte.jdejong.net>
>
>
>
>
> --
> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>
> Aniello Grado, PhD
>
> Ricercatore Astronomo
> INAF- Osservatorio Astronomico di Capodimonte
> Via Moiariello 16 80131 Napoli
> ITALIA
> Tel: 0039 0815575547
> Fax: 0039 0815575433
>
> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
--
Dr. Jelte T. A. de Jong
KiDS project manager
Sterrewacht Leiden
Leiden University, Leiden, the Netherlands
E: jelte at strw.leidenuniv.nl
T: +31-(0)715275818
W: jelte.jdejong.net
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130411/0b0ea29b/attachment-0001.html
More information about the KiDS
mailing list