CFHT archive manual - CFHT data distribution 

CFHT Data Distribution

  • distribute.pl
  • adh
  • Creating the CD
  • Shipping


  • distribute.pl

    Once a QSO program is considered complete, a list of images to be used for processing by adh is generated by distribute.pl. distribute.pl allows the QSO coordinator to examine the images selected for distribution and eliminate focus frames, uneccesary standard stars and unvalidated images from the program. The final list of images is named runid.list and is saved in /h/archive/distributions.


    adh

    Once the .list has been generated, adh can be run on the program. Adh can run from either Kapu or Ono. For larger programs, using Kapu is recommended since the tape library eliminates the need to manually switch tapes during processing. To run adh, log in as archive and use the following command in the archive home directory: (additional information on adh usage is available here)

    adh -file ~archive/distributions/runid.list MEF/SPLIT/RAW dlt/autodlt/dlt20

    A copy of the output is recorded in a log file as well as output to the screen.

    Adh first creates a spool directory for the program. The location and name of this spool directory should be noted in case a recover process is necessary. If using Ono, spool directories are located in /h/archive/spool and if using Kapu, spool directories are located in /data/kapu/spool. When starting adh using dlt you will be prompted to hit return to confirm that a tape has been loaded in the drive. For autodlt, this prompt does not occur.

    If the adh process fails, and you need to recover, enter the following command:

    adh -recover spoolx

    If adh has already created a manifest file for the distribution you will be asked if you would like it to read the manifest file and continue from where it left off. If you are not using autodlt it will also prompt you to press enter to confirm that the correct tape is in the drive.

    Once adh is complete you will see the following message in the log:

    Cleaning up process data (current, load)...

    At this point you can safely remove the tape from the drive and run the distribution tools on the program. Label each DLT with the runid, PI's name, and tape number (if multiple tapes).


    Creating the QSO CD and Distribution Packet

    In the spool directory for the program run the following tools:

    /cfht/src/dads/generateHTML.pl -U username -P password -v

    /cfht/src/dads/copyDADHTML

    /cfht/src/dads/exportlog.pl -U username -P password -F /h/archive/distributions/runid.list >qsolog.txt

    /cfht/src/scripts/mkDistLetter.pl -U username -P password -r runid >letter.tex
    latex letter.dvi
    dvips letter.dvi

    Print qsolog.txt, letter.ps and null.mediax.manifest. qsolog.txt should be printed as duplex, and letter.ps should be printed on CFHT letterhead.

    Create a spoolx.sav directory, and move the following files from the spoolx directory to the spoolx.sav directory:

    current log detrend_data standard_stars input_files

    In spoolx remove letter.*

    Spoolx can now be burned to CD. Name the CD with the runid. The CD and CD case should be labeled with the runid and PI's name.


    Shipping

    Each QSO distribution packet sent to a PI should include the following:

    Printout of tape manifest
    QSO form letter (on CFHT letterhead)
    Printout of QSO log
    DLT(s)
    QSO distribution CD

    All shipments to Hawaii addresses or P.O. Boxes should be sent via USPS Priority. All others should be sent via FedEx.

    The CFHT QSO Tape and Shipping Charges form must be submitted to the Front Office for each distribution. Attach the form to the box and include the number of tapes and total price on the form. The Front Office will add the appropriate shipping charges after the box is processed for shipping.


    Malia

    Last modified: Fri Sept 28 13:31:21 HST 2001