Re: CFHT, TERAPIX e-transfer report

From: John Ouellette <john.ouellette_at_nrc-cnrc.gc.ca>
Date: Mon, 02 Mar 2009 15:01:18 -0800

Hi Kanoa -- the no_check pick-up was turned off deliberately several
months ago in October due to a bit of a train-wreck of files at the
time. The problem with no_check is that it does what it says: no file
verification tests are run on the files and they are blindly put into
the archive, potentially replacing good archive files with bad.
Admittedly, we should have informed you of this in October and discussed
the alternatives: mea culpa.

Is there any reason we can't run these files through new/ and/or
replace/? Before doing so, though, we should clean out the reject/
states so that we can see where these particular files fail (or not).
There are a large number of files in 'not_replace', some of which are
due to a batch of retransferring that we did to clean up a header issue.

J.

Kanoa Withington wrote:
>
> Hi Ling,
>
> For some reason files in our "no_check" directory have not been picked
> up in a while.
>
> Thanks,
>
> -Kanoa
>
> Ling Shao wrote, On 03/02/2009 11:48 AM:
> >
> > February 23, 2009 - March 1, 2009
> >
> > 14375 CFHT files (including 6716 raw files and 7659 detrended files)
> > have been transferred and ingested into our archive.
> > CFHT rejected files:
> > corrupt: 21 files.
> > empty: 1 file.
> > fitsverify: 182 files (including 86 files in this
> period).
> > header: 2161 files (including 2160 files in this period).
> > name: 32 files.
> > not_new: 836 files.
> > not_repalce: 7366 files.
> >
> > No file from TERAPIX site has been transferred.
> >
> > CFHT User requests:
> > 28 CFHT users submitted requests.
> > Files have been down loaded: 5592 files. Size: 932.8 GB.
> >
> > Thanks.
> >
> > Ling
>
Received on Mon Mar 02 2009 - 13:01:39 HST