Re: e-transfer from terapix

From: JJ Kavelaars <jjk_at_hia-iha.nrc-cnrc.gc.ca>
Date: Thu, 22 Mar 2007 11:22:19 -0700

Hi Fred,

We are not planning to version the reprocessed data when the new
flats arrive. We will just replace the older versions with the new
ones... this is a product change and not a version issue. I
recommend the same with the names of the weights. They are not T000X
weights, just weights and don't require versions since they are
computed from the copy of the processed image that we have stored here.

We started e-transfer at this end....

JJ

On 22-Mar-07, at 10:03 AM, Frederic Magnard wrote:

>
> Hi JJ,
>
> On Wed, 21 Mar 2007, Frederic Magnard wrote:
>> The list of weight images is ready, just waiting to be filtered to
>> eliminate
>> already transfered files.
>
> OK, it took a while to get all the crc from the cfhtInfo proxy, but
> now
> only 6509 images (1.7TiB) will need to be transfered, out of 15850.
> 2150 are new version of existing weightimages, 4359 are new
> weightmaps.
> The new versions are re-processed weight map lost after a disk
> problem.
> So it's ok if they overwrite the former ones.
>
> But this raises the problem of weightmaps versioning. They depend
> on the
> flat fields, and then will be really different when the new flat
> fields
> will come out. So, I propose to add a release version in their name
> when
> we'll use the new flat fields: ######p_weight -> ######p_weight-T000x
> Are you OK with that ?
>
> /data/clix/fc6/cadc/new is now filled with 100GB of data to
> transfer, and
> will be filled up again if needed.
>
> Cheers,
> Fred.
>
>
Received on Thu Mar 22 2007 - 08:22:51 HST