[KIDS] visual grading and manual mask production
Hugo Buddelmeijer
buddel at astro.rug.nl
Thu Apr 18 07:45:33 CEST 2013
Thanks Francesco!
Did anything change since about 22:00 last night?
I went to bed at about that time and noticed that the files were there,
so I went ahead and started downloaded them anyway before receiving your
email.
To be certain, I'm downloading the files again. However, I'll start
ingesting the files I downloaded last night if you say that there have
been no changes.
Hugo
On 04/17/2013 11:04 PM, Francesco La Barbera wrote:
> Dear All,
>
> the sourcelists have been created with the latest masks that Mario
> passed us.
>
> Hugo, pls go ahead with ingestion from the same link as last time:
>
> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>
> As usual, I checked that all data products/plots are in the proper place
> for each coadd.
>
> Cheers,
> Francesco
>
>
>
> On Wed, Apr 10, 2013 at 2:53 PM, Francesco La Barbera
> <flabarber at gmail.com <mailto:flabarber at gmail.com>> wrote:
>
> Dear All,
>
> I'm happy to inform you that the new sourcelists have been produced now.
>
> Hugo, you can access them for AW ingestion at the same link as last
> time, i.e.
>
> http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/
>
> I checked that all files are in place, and there was no evident
> issue with all different data products.
> The sourcelists have been generated with the new, latest, masks
> passed me by Mario and Nicola,
> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
> estimates).
>
> Pls, lemme know if everything is OK with this.
>
> Cheers,
> Francesco
>
>
>
>
> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>
> Dear Nicola and Mario and Hugo,
>
> How is the automated mask + sourcelist production going?
>
> I am now coordinating the visual grading and manual mask production.
> My plan is to have that team start to work on all coadds at
> is_valid=1 and 2 asap.
> (NB: all coadds that will be re-processed this week are now set
> to is_valid=0)
>
> As far as I see this effort is decoupled (enough) from your
> mask+sourcelist effort and there can start now. I will tell the
> manual mask team to anticipate improvement on the current
> automated masks. And hence start no manually improving those.
>
> Please let me know if you see problems with this decoupled
> parallel effort.
>
> Best wishes, Gijs
>
>
>
> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>
>> OK Lino. Thanks
>>
>> N
>>
>>
>>
>> On 4/8/13 8:41 PM, aniello grado wrote:
>>> Hi Nicola,
>>>
>>> the manual masks are on beo3 in the dir:
>>>
>>> /opt/AW/current/astro/experimental/kids/regionfiles
>>>
>>> Lino
>>>
>>>
>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>> wrote:
>>>
>>>
>>> Hi Lino,
>>>
>>> automatic masking is about to start. Mario and I are
>>> still struggling with the g-band but we should be able to
>>> work this out by the end of the day.
>>> Meanwhile r,i,u are ready to go after we have checked the
>>> spike length, which needs just some more very short
>>> visual test.
>>> This means that auto-masks will be possibly ready
>>> tomorrow morning.
>>>
>>> To start the sourcelists extraction, though, we need to
>>> incorporate the manual masks into the auto masks, since
>>> the idea is to provide a unique flag in the catalogs.
>>> Thus we need to know whether the final manual masks are
>>> also ready for the download. If so please give to Mario
>>> the necessary references for that.
>>>
>>> Cheers,
>>>
>>> Nicola
>>>
>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>> Hi Mario and Nicola,
>>>>
>>>> the coadds are ready for automatic masking.
>>>>
>>>> Lino
>>>>
>>>> ---------- Forwarded message ----------
>>>> From: <jelte at strw.leidenuniv.nl
>>>> <mailto:jelte at strw.leidenuniv.nl>>
>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>> <mailto:verdoes at astro.rug.nl>>, Lino Grado
>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>
>>>>
>>>> Hi Gijs and Lino,
>>>>
>>>> just to let you know that reprocessing is done now.
>>>> We now have again 200 DR1 coadds:
>>>>
>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>> awe> list =
>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c
>>>> in query]
>>>> awe> len(list)
>>>> 200
>>>>
>>>> The total number of reprocessed coadds is 50:
>>>> awe> query = Comment.content ==
>>>> 'KiDS-ESO-DR1-Coadd-Reprocessed-After-QA1'
>>>> awe> list =
>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c
>>>> in query]
>>>> awe> len(list)
>>>> 50
>>>>
>>>> Querying for the comment 'KiDS-ESO-DR1-Coadd-DISCARDED'
>>>> will also give 50
>>>> coadds, namely the ones replaced by the reprocessed coadds.
>>>>
>>>> From the 74 is_valid=0 coadds, 24 were not reprocessed
>>>> since according to
>>>> the reprocessing teams there was no improvement
>>>> possible. These coadds
>>>> that are retained in DR1 can be recognized by the comment
>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1':
>>>>
>>>> awe> query = Comment.content ==
>>>> 'KiDS-ESO-DR1-Coadd-Retained-After-QA1'
>>>> awe> list =
>>>> [CoaddedRegriddedFrame(object_id=c.db_object_id) for c
>>>> in query]
>>>> awe> len(list)
>>>> 24
>>>>
>>>> Cheers,
>>>> Jelte
>>>>
>>>> > Hi Gijs and Lino,
>>>> >
>>>> > reprocessing is almost done.
>>>> > There were still 3 coadds that needed to be
>>>> reprocessed and that is
>>>> > currently being done.
>>>> > Over the weekend I will update their comments etc, and
>>>> notify Mario so
>>>> > he can download the new ones for source extraction.
>>>> >
>>>> > I have also put a table on the wiki with the coadds
>>>> that were set to
>>>> > is_valid = 1 during the visual inspection (QA1):
>>>> >
>>>> http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1
>>>> > Also included in the table (where it was clear to me)
>>>> is the reasons why
>>>> > the visual inspection team thinks these coadds could
>>>> be improved if
>>>> > there is enough time.
>>>> > We should set up a dedicated team that can have a look
>>>> at these coadds
>>>> > next week to see which ones can be improved by
>>>> reprocessing.
>>>> > In any case our goal should be to have all final
>>>> coadds by next Friday
>>>> > (April 12).
>>>> >
>>>> > Cheers,
>>>> > Jelte
>>>> >
>>>> > --
>>>> > Dr. Jelte T. A. de Jong
>>>> > KiDS project manager
>>>> > Sterrewacht Leiden
>>>> > Leiden University, Leiden, the Netherlands
>>>> > E: jelte at strw.leidenuniv.nl
>>>> <mailto:jelte at strw.leidenuniv.nl>
>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>> >
>>>> >
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>>
>>>> Aniello Grado, PhD
>>>>
>>>> Ricercatore Astronomo
>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>> Via Moiariello 16 80131 Napoli
>>>> ITALIA
>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>
>>>
>>> --
>>> Nicola R. Napolitano
>>> Research Astronomer
>>> INAF - Observatory of Capodimonte
>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>>>
>>>
>>>
>>>
>>> --
>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>>
>>> Aniello Grado, PhD
>>>
>>> Ricercatore Astronomo
>>> INAF- Osservatorio Astronomico di Capodimonte
>>> Via Moiariello 16 80131 Napoli
>>> ITALIA
>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>
>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>
>>
>>
>> --
>> Nicola R. Napolitano
>> Research Astronomer
>> INAF - Observatory of Capodimonte
>> Salita Moiariello, 16, 80131, Napoli (Italy)
>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081 456710 <tel:%2B39%20081%20456710>
>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>> web page:http://www.na.astro.it/~napolita <http://www.na.astro.it/%7Enapolita>
>
> --
> --------------------------------------------------------------------
> |dr Gijs Verdoes Kleijn | astronomer |
> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> | OmegaCEN / Kapteyn Institute / |
> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/~verdoes> | Target |
> |tel:+31-50-3638326 <tel:%2B31-50-3638326> | University of Groningen |
> |mobile:+31-654658050 <tel:%2B31-654658050> | postal address: |
> | | Kapteyn Astronomical Institute |
> | | Postbus 800, 9700 AV, Groningen|
> | | The Netherlands |
> --------------------------------------------------------------------
>
>
>
More information about the KiDS
mailing list