[KIDS] visual grading and manual mask production
Francesco La Barbera
flabarber at gmail.com
Thu Apr 18 08:45:04 CEST 2013
HI Hugo,
no changes at all since 22:00 last time. Pls, go ahead with ingestion !!!
cheers,
F.
On Thu, Apr 18, 2013 at 7:45 AM, Hugo Buddelmeijer <buddel at astro.rug.nl>wrote:
> Thanks Francesco!
>
> Did anything change since about 22:00 last night?
>
> I went to bed at about that time and noticed that the files were there, so
> I went ahead and started downloaded them anyway before receiving your email.
>
> To be certain, I'm downloading the files again. However, I'll start
> ingesting the files I downloaded last night if you say that there have been
> no changes.
>
> Hugo
>
>
> On 04/17/2013 11:04 PM, Francesco La Barbera wrote:
>
>> Dear All,
>>
>> the sourcelists have been created with the latest masks that Mario
>> passed us.
>>
>> Hugo, pls go ahead with ingestion from the same link as last time:
>>
>> http://vstportal.oacn.inaf.it/**KIDSCAT/ESO_DR1_kc1.6/<http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/>
>>
>> As usual, I checked that all data products/plots are in the proper place
>> for each coadd.
>>
>> Cheers,
>> Francesco
>>
>>
>>
>> On Wed, Apr 10, 2013 at 2:53 PM, Francesco La Barbera
>> <flabarber at gmail.com <mailto:flabarber at gmail.com>> wrote:
>>
>> Dear All,
>>
>> I'm happy to inform you that the new sourcelists have been produced
>> now.
>>
>> Hugo, you can access them for AW ingestion at the same link as last
>> time, i.e.
>>
>> http://vstportal.oacn.inaf.it/**KIDSCAT/ESO_DR1_kc1.6/<http://vstportal.oacn.inaf.it/KIDSCAT/ESO_DR1_kc1.6/>
>>
>> I checked that all files are in place, and there was no evident
>> issue with all different data products.
>> The sourcelists have been generated with the new, latest, masks
>> passed me by Mario and Nicola,
>> and using KIDS-CAT v.1.6 (that includes sat mag and ellipticity
>> estimates).
>>
>> Pls, lemme know if everything is OK with this.
>>
>> Cheers,
>> Francesco
>>
>>
>>
>>
>> On Tue, Apr 9, 2013 at 2:58 PM, Gijs Verdoes Kleijn
>> <verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl>> wrote:
>>
>> Dear Nicola and Mario and Hugo,
>>
>> How is the automated mask + sourcelist production going?
>>
>> I am now coordinating the visual grading and manual mask
>> production.
>> My plan is to have that team start to work on all coadds at
>> is_valid=1 and 2 asap.
>> (NB: all coadds that will be re-processed this week are now set
>> to is_valid=0)
>>
>> As far as I see this effort is decoupled (enough) from your
>> mask+sourcelist effort and there can start now. I will tell the
>> manual mask team to anticipate improvement on the current
>> automated masks. And hence start no manually improving those.
>>
>> Please let me know if you see problems with this decoupled
>> parallel effort.
>>
>> Best wishes, Gijs
>>
>>
>>
>> On 04/08/2013 11:04 PM, Nicola R. Napolitano wrote:
>>
>>>
>>> OK Lino. Thanks
>>>
>>> N
>>>
>>>
>>>
>>> On 4/8/13 8:41 PM, aniello grado wrote:
>>>
>>>> Hi Nicola,
>>>>
>>>> the manual masks are on beo3 in the dir:
>>>>
>>>> /opt/AW/current/astro/**experimental/kids/regionfiles
>>>>
>>>> Lino
>>>>
>>>>
>>>> On Mon, Apr 8, 2013 at 3:37 PM, Nicola R. Napolitano
>>>> <napolita at na.astro.it <mailto:napolita at na.astro.it>> wrote:
>>>>
>>>>
>>>> Hi Lino,
>>>>
>>>> automatic masking is about to start. Mario and I are
>>>> still struggling with the g-band but we should be able to
>>>> work this out by the end of the day.
>>>> Meanwhile r,i,u are ready to go after we have checked the
>>>> spike length, which needs just some more very short
>>>> visual test.
>>>> This means that auto-masks will be possibly ready
>>>> tomorrow morning.
>>>>
>>>> To start the sourcelists extraction, though, we need to
>>>> incorporate the manual masks into the auto masks, since
>>>> the idea is to provide a unique flag in the catalogs.
>>>> Thus we need to know whether the final manual masks are
>>>> also ready for the download. If so please give to Mario
>>>> the necessary references for that.
>>>>
>>>> Cheers,
>>>>
>>>> Nicola
>>>>
>>>> On 4/6/13 3:55 PM, aniello grado wrote:
>>>>
>>>>> Hi Mario and Nicola,
>>>>>
>>>>> the coadds are ready for automatic masking.
>>>>>
>>>>> Lino
>>>>>
>>>>> ---------- Forwarded message ----------
>>>>> From: <jelte at strw.leidenuniv.nl
>>>>> <mailto:jelte at strw.leidenuniv.**nl<jelte at strw.leidenuniv.nl>
>>>>> >>
>>>>> Date: Sat, Apr 6, 2013 at 2:24 PM
>>>>> Subject: Re: reprocessing and is_valid = 1 coadds
>>>>> To: Gijs Verdoes Kleijn <verdoes at astro.rug.nl
>>>>> <mailto:verdoes at astro.rug.nl>>**, Lino Grado
>>>>> <agrado at na.astro.it <mailto:agrado at na.astro.it>>
>>>>>
>>>>>
>>>>> Hi Gijs and Lino,
>>>>>
>>>>> just to let you know that reprocessing is done now.
>>>>> We now have again 200 DR1 coadds:
>>>>>
>>>>> awe> query = Comment.content == 'KiDS-ESO-DR1-Coadd'
>>>>> awe> list =
>>>>> [CoaddedRegriddedFrame(object_**id=c.db_object_id) for c
>>>>> in query]
>>>>> awe> len(list)
>>>>> 200
>>>>>
>>>>> The total number of reprocessed coadds is 50:
>>>>> awe> query = Comment.content ==
>>>>> 'KiDS-ESO-DR1-Coadd-**Reprocessed-After-QA1'
>>>>> awe> list =
>>>>> [CoaddedRegriddedFrame(object_**id=c.db_object_id) for c
>>>>> in query]
>>>>> awe> len(list)
>>>>> 50
>>>>>
>>>>> Querying for the comment 'KiDS-ESO-DR1-Coadd-DISCARDED'
>>>>> will also give 50
>>>>> coadds, namely the ones replaced by the reprocessed coadds.
>>>>>
>>>>> From the 74 is_valid=0 coadds, 24 were not reprocessed
>>>>> since according to
>>>>> the reprocessing teams there was no improvement
>>>>> possible. These coadds
>>>>> that are retained in DR1 can be recognized by the comment
>>>>> 'KiDS-ESO-DR1-Coadd-Retained-**After-QA1':
>>>>>
>>>>> awe> query = Comment.content ==
>>>>> 'KiDS-ESO-DR1-Coadd-Retained-**After-QA1'
>>>>> awe> list =
>>>>> [CoaddedRegriddedFrame(object_**id=c.db_object_id) for c
>>>>> in query]
>>>>> awe> len(list)
>>>>> 24
>>>>>
>>>>> Cheers,
>>>>> Jelte
>>>>>
>>>>> > Hi Gijs and Lino,
>>>>> >
>>>>> > reprocessing is almost done.
>>>>> > There were still 3 coadds that needed to be
>>>>> reprocessed and that is
>>>>> > currently being done.
>>>>> > Over the weekend I will update their comments etc, and
>>>>> notify Mario so
>>>>> > he can download the new ones for source extraction.
>>>>> >
>>>>> > I have also put a table on the wiki with the coadds
>>>>> that were set to
>>>>> > is_valid = 1 during the visual inspection (QA1):
>>>>> >
>>>>> http://wiki.astro-wise.org/**
>>>>> projects:kids:data_deliveries:**kids-eso-dr1:**
>>>>> productiondashboard#coadd_set_**to_is_valid_1_during_qa1<http://wiki.astro-wise.org/projects:kids:data_deliveries:kids-eso-dr1:productiondashboard#coadd_set_to_is_valid_1_during_qa1>
>>>>> > Also included in the table (where it was clear to me)
>>>>> is the reasons why
>>>>> > the visual inspection team thinks these coadds could
>>>>> be improved if
>>>>> > there is enough time.
>>>>> > We should set up a dedicated team that can have a look
>>>>> at these coadds
>>>>> > next week to see which ones can be improved by
>>>>> reprocessing.
>>>>> > In any case our goal should be to have all final
>>>>> coadds by next Friday
>>>>> > (April 12).
>>>>> >
>>>>> > Cheers,
>>>>> > Jelte
>>>>> >
>>>>> > --
>>>>> > Dr. Jelte T. A. de Jong
>>>>> > KiDS project manager
>>>>> > Sterrewacht Leiden
>>>>> > Leiden University, Leiden, the Netherlands
>>>>> > E: jelte at strw.leidenuniv.nl
>>>>> <mailto:jelte at strw.leidenuniv.**nl<jelte at strw.leidenuniv.nl>
>>>>> >
>>>>> > T: +31-(0)715275818 <tel:%2B31-%280%29715275818>
>>>>> > W: jelte.jdejong.net <http://jelte.jdejong.net>
>>>>> >
>>>>> >
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>**>>>>>>>>>>>
>>>>>
>>>>> Aniello Grado, PhD
>>>>>
>>>>> Ricercatore Astronomo
>>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>>> Via Moiariello 16 80131 Napoli
>>>>> ITALIA
>>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>>
>>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>**>>>>>>>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Nicola R. Napolitano
>>>> Research Astronomer
>>>> INAF - Observatory of Capodimonte
>>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39
>>>> 081 456710 <tel:%2B39%20081%20456710>
>>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>>> web page:http://www.na.astro.it/~**napolita<http://www.na.astro.it/~napolita> <
>>>> http://www.na.astro.it/%**7Enapolita<http://www.na.astro.it/%7Enapolita>
>>>> >
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>**>>>>>>>>>>>
>>>>
>>>> Aniello Grado, PhD
>>>>
>>>> Ricercatore Astronomo
>>>> INAF- Osservatorio Astronomico di Capodimonte
>>>> Via Moiariello 16 80131 Napoli
>>>> ITALIA
>>>> Tel: 0039 0815575547 <tel:0039%200815575547>
>>>> Fax: 0039 0815575433 <tel:0039%200815575433>
>>>>
>>>> <<<<<<<<<<<<<<<<<<<<>>>>>>>>>>**>>>>>>>>>>>
>>>>
>>>
>>>
>>> --
>>> Nicola R. Napolitano
>>> Research Astronomer
>>> INAF - Observatory of Capodimonte
>>> Salita Moiariello, 16, 80131, Napoli (Italy)
>>> phone:+39 081 5575509 <tel:%2B39%20081%205575509>; fax:+39 081
>>> 456710 <tel:%2B39%20081%20456710>
>>> email:napolita at na.astro.it <mailto:napolita at na.astro.it>
>>> web page:http://www.na.astro.it/~**napolita<http://www.na.astro.it/~napolita> <
>>> http://www.na.astro.it/%**7Enapolita<http://www.na.astro.it/%7Enapolita>
>>> >
>>>
>>
>> --
>> ------------------------------**------------------------------**
>> --------
>> |dr Gijs Verdoes Kleijn | astronomer
>> |
>> |e-mail:verdoes at astro.rug.nl <mailto:verdoes at astro.rug.nl> |
>> OmegaCEN / Kapteyn Institute / |
>> |www:www.astro.rug.nl/~verdoes <http://www.astro.rug.nl/~**
>> verdoes <http://www.astro.rug.nl/~verdoes>> | Target
>> |
>> |tel:+31-50-3638326 <tel:%2B31-50-3638326> |
>> University of Groningen |
>> |mobile:+31-654658050 <tel:%2B31-654658050> |
>> postal address: |
>>
>> | | Kapteyn Astronomical
>> Institute |
>> | | Postbus 800, 9700 AV,
>> Groningen|
>> | | The Netherlands
>> |
>> ------------------------------**------------------------------**
>> --------
>>
>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://listman.astro-wise.org/pipermail/kids/attachments/20130418/6d6f9cf7/attachment-0001.html
More information about the KiDS
mailing list