Re: Pb Megacam image transfert from CADC

From: Ouellette, John <John.Ouellette_at_nrc-cnrc.gc.ca>
Date: Sat, 24 May 2008 12:15:29 -0700

My apologies Yannick -- I just reread your message and realized that the times you mentioned were exactly during the period of our network problems. The download that never completed was likely just not terminated correctly by curl. Since your subsequent download using wget worked, curl should now work, too. I will however still talk to our network admin about the problem.

John

----- Original Message -----
From: mellier_at_iap.fr <mellier_at_iap.fr>
To: Ouellette, John
Cc: Yannick Mellier <mellier_at_iap.fr>; Data Oversite Group Group <dog_at_cfht.hawaii.edu>
Sent: Sat May 24 13:22:57 2008
Subject: Re: Pb Megacam image transfert from CADC


   Dear John

   Thank you very much for your email and for looking at
the problem.

   I started a transfer yesterday at about 8:00 pm, Paris local
time. About 10 files were transferred without problem. All are
transferred using "curl". At about 9:00 pm yesterday, I curl-ed
967615p but it vever finished: about 2/3 were only transferred
this morning at 7:00 am, though it kept continuing to transfer
(no interruption over the night). In order to understand what
could happen I then went to CADC interface and got this image
interactively, using wget. It worked well
, but transferred the .gz image (I usually transfer the .fz image). I
interrupted the wget after about 10 mn this morning since I saw
thre was no problmen with wget and the .gz image. THis is
why you saw a "failure" after 5-10 minutes, I guess? In any case, I
stopped the curl also and gave up. I will try again tomorrow and will
keep you informed on the transfer.

   Cheers and thanks again,

yannick

>
> Hi Yannick -- There do not seem to be any problems on the CADC end: a
> few tests show that data is still capable of being transferred from our
> web servers at >60Mbytes/sec, and I can't see any failures on our
> storage nodes. According to our logs, there was one file (967615p) that
> didn't transfer properly to you, but the failure occurred after five or
> ten minutes, not five hours: there don't seem to be any problem with
> transferring that file at this time.
>
> Could you send me a list of files that you're having problems with?
> Perhaps I'm not seeing those failures being logged.
>
> John Ouellette
>
> Yannick Mellier wrote:
>>
>> Dear JJ
>>
>> Is there any problem at CADC? It takes 5 hours to transfer one
>> image.fz from CADC to Terapix.
>>
>> Cheers
>>
>> yannick
>>
>


Received on Sat May 24 2008 - 09:15:37 HST