[KIDS] visual grading and manual mask production
Gijs Verdoes Kleijn
verdoes at astro.rug.nl
Wed Apr 10 15:19:33 CEST 2013
Dear Francesco, KiDS-CAT team et al.,
That is good news. Great work!
The manual masking team is on its way to complete the manual masking
effort by the end of this week.
Jelte, Lino and I will decide together with you, the KiDS-CAT team, how
to deal with that update efficiently regarding sourcelist re-production.
Best, Gijs
On 04/10/2013 02:53 PM, Francesco La Barbera wrote:
> Dear All,
>
> I'm happy to inform you that the new sourcelists have been produced now.
>
> Hugo, you can access them for AW ingestion at the same link as last
> time, i.e.
>
> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>
> I checked that all files are in place, and there was no evident issue
> with all different data products.
> The sourcelists have been generated with the new, latest, masks passed
> me by Mario and Nicola,
> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
> estimates).
>
> Pls, lemme know if everything is OK with this.
>
> Cheers,
> Francesco
>
>
>
>
> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>
> Dear Nicola and Mario and Hugo,
>
> How is the automated mask + sourcelist production going?
>
> I am now coordinating the visual grading and manual mask production.
> My plan is to have that team start to work on all coadds at
> is_valid=1 and 2 asap.
> (NB: all coadds that will be re-processed this week are now set to
> is_valid=0)
>
> As far as I see this effort is decoupled (enough) from your
> mask+sourcelist effort and there can start now. I will tell the
> manual mask team to anticipate improvement on the current
> automated masks. And hence start no manually improving those.
>
> Please let me know if you see problems with this decoupled
> parallel effort.
>
> Best wishes, Gijs
>
>
>
> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>
>> OK Lino. Thanks
>>
>> N
>>
>>
>>
>> On 4/8/13 8:41 PM, aniello grado wrote:
>>> Hi Nicola,
>>>
>>> the manual masks are on beo3 in the dir:
>>>
>>> /opt/AW/current/astro/experimental/kids/regionfiles
>>>
>>> Lino
>>>
>>>
>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>> wrote:
>>>
>>>
>>> Hi Lino,
>>>
>>> automatic masking is about to start. Mario and I are still
>>> struggling with the g-band but we should be able to work
>>> this out by the end of the day.
>>> Meanwhile r,i,u are ready to go after we have checked the
>>> spike length, which needs just some more very short visual test.
>>> This means that auto-masks will be possibly ready tomorrow
>>> morning.
>>>
>>> To start the sourcelists extraction, though, we need to
>>> incorporate the manual masks into the auto masks, since the
>>> idea is to provide a unique flag in the catalogs.
>>> Thus we need to know whether the final manual masks are also
>>> ready for the download. If so please give to Mario the
>>> necessary references for that.
>>>
>>> Cheers,
>>>
>>> Nicola
>>>
>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>> Hi Mario and Nicola,
>>>>
>>>> the coadds are ready for automatic masking.
>>>>
>>>> Lino
>>>>
>>>> ---------- Forwarded message ----------
>>>> From: <jelte at strw.leidenuniv.nl
>>>> <mailto:jelte at strw.leidenuniv.nl>>
>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>> <mailto:verdoes at astro.rug.nl>>, Lino Grado
>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>
>>>>
>>>> Hi Gijs and Lino,
>>>>
>>>> just to let you know that reprocessing is done now.
>>>> We now have again 200 DR1 coadds:
>>>>
>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>> awe> list =
>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>> query]
>>>> awe> len(list)
>>>> 200
>>>>
>>>> The total number of reprocessed coadds is 50:
>>>> awe> query = Comment.content ==
>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>> awe> list =
>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>> query]
>>>> awe> len(list)
>>>> 50
>>>>
>>>> Querying for the comment 'KiDS-ESO-DR1-Coadd-DISCARDED'
>>>> will also give 50
>>>> coadds, namely the ones replaced by the reprocessed coadds.
>>>>
>>>> From the 74 is_valid=0 coadds, 24 were not reprocessed
>>>> since according to
>>>> the reprocessing teams there was no improvement possible.
>>>> These coadds
>>>> that are retained in DR1 can be recognized by the comment
>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>
>>>> awe> query = Comment.content ==
>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>> awe> list =
>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c in
>>>> query]
>>>> awe> len(list)
>>>> 24
>>>>
>>>> Cheers,
>>>> Jelte
>>>>
>>>> > Hi Gijs and Lino,
>>>> >
>>>> > reprocessing is almost done.
>>>> > There were still 3 coadds that needed to be reprocessed
>>>> and that is
>>>> > currently being done.
>>>> > Over the weekend I will update their comments etc, and
>>>> notify Mario so
>>>> > he can download the new ones for source extraction.
>>>> >
>>>> > I have also put a table on the wiki with the coadds that
>>>> were set to
>>>> > is_valid = 1 during the visual inspection (QA1):
>>>> >
>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>> > Also included in the table (where it was clear to me) is
>>>> the reasons why
>>>> > the visual inspection team thinks these coadds could be
>>>> improved if
>>>> > there is enough time.
>>>> > We should set up a dedicated team that can have a look at
>>>> these coadds
>>>> > next week to see which ones can be improved by reprocessing.
>>>> > In any case our goal should be to have all final coadds
>>>> by next Friday
>>>> > (April 12).
>>>> >
>>>> > Cheers,
>>>> > Jelte
>>>> >
>>>> > --
>>>> > Dr. Jelte T. A. de Jong
>>>> > KiDS project manager
>>>> > Sterrewacht Leiden
>>>> > Leiden University, Leiden, the Netherlands
>>>> > E: jelte at strw.leidenuniv.nl <mailto:jelte at strw.leidenuniv.nl>
>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>> >
>>>> >
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>
>>>> Aniello Grado, PhD
>>>>
>>>> Ricercatore Astronomo
>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>> Via Moiariello 16 80131 Napoli
>>>> ITALIA
>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>
>>>
>>> --
>>> Nicola R. Napolitano
>>> Research Astronomer
>>> INAF - Observatory of Capodimonte
>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>
>>>
>>>
>>>
>>> --
>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>
>>> Aniello Grado, PhD
>>>
>>> Ricercatore Astronomo
>>> INAF- Osservatorio Astronomico di Capodimonte
>>> Via Moiariello 16 80131 Napoli
>>> ITALIA
>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>
>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>
>>
>> --
>> Nicola R. Napolitano
>> Research Astronomer
>> INAF - Observatory of Capodimonte
>> Salita Moiariello, 16, 80131, Napoli (Italy)
>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>
> --
> --------------------------------------------------------------------
> |dr Gijs Verdoes Kleijn | astronomer |
> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/%7Everdoes> | Target |
> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
> | | Kapteyn Astronomical Institute |
> | | Postbus 800, 9700 AV, Groningen|
> | | The Netherlands |
> --------------------------------------------------------------------
>
>
--
--------------------------------------------------------------------
|dr Gijs Verdoes Kleijn | astronomer |
|e-mail: verdoes at astro.rug.nl | OmegaCEN / Kapteyn Institute / |
|www: www.astro.rug.nl/~verdoes | Target |
|tel: +31-50-3638326 | University of Groningen |
|mobile: +31-654658050 | postal address: |
| | Kapteyn Astronomical Institute |
| | Postbus 800, 9700 AV, Groningen|
| | The Netherlands |
--------------------------------------------------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130410/c5048a01/attachment-0001.html
More information about the KiDS
mailing list