Queued Service Observations for ESPaDOnS

Phase 2 Proposal Submission Tutorial

Updated 11/24/2008



Table of Contents
A - Introduction B - Overview of the Phase 2 Tool (PH2) C - PH2: A detailed Tutorial D - A Few QSO Rules

E - Other Issues

A - Introduction [B - Overview] [C - Detailed Tutorial] [D - QSO rules] [E - Other issues] [TOC]

1) The QSO Project

The main concept behind the queue observation scheme is to perform programs only during sky conditions required to meet their science goals, as defined by the investigators. This can be achieved if the programs are all grouped together in a database and are selected appropriately according to a set of constraints, rules and sky conditions. Each night, several queues composed of different programs are prepared to cover diverse sky conditions and constraints. Observations are then carried out by a well trained, local team of observers in a service mode.

During 1999, CFHT started a project to implement the necessary software and to review all the issues for achieving a queue/service observing mode with its CFH12K mosaic camera. This Queued Service Observing (QSO) Project has been developed in parallel with other projects necessary for the data acquisition (NEO), processing and analysis (Elixir), and archiving and distribution (DADS). The software tools required for proposal submission, selection of programs, database management, and execution of the observations have all been developed within the QSO Project. Most of these software components are for internal use only except for two obvious exceptions: Poopsy, the proposal submission tool developed and maintained at CADC, and PH2, a Web based tool implemented and maintained by CFHT for the second tier of proposal submission (see below).

Starting in January 2001, queue observations were performed with the CFH12K camera for about 220 nights. By reaching good statistics on completeness, image quality requirements, Agency time balancing, and by meeting time constraints requirements for several programs, the QSO mode has been quite successful. Since 2003, all of the observations with MegaPrime have been conducted under the QSO mode. Starting with the semester 2005B, observations for WIRCam, the new wide-field near-IR imager, have also been done through the QSO system. Now, it's time for ESPaDOnS! One of the main advantage of integrating ESPaDOnS within QSO is the frequent time critical observations required for several science programs. Other than to be able to handle priorities under sky conditions better than in classical mode, QSO is particularly well adapted for this kind of time constraints.

The tutorial describes a version of PH2 developed specifically for observations with ESPaDOnS. Following the evaluation of the different Time Allocation Committees (TAC), the successful proposals have received a certain amount of telescope time, a grade and a rank, and are now ready to prepare detailed observations, the Phase 2 submission period.

2) The Phase 2 Proposal Submission

The Phase 2 submission for proposals accepted for the semester 2009A extends over a period of a few weeks. The two important dates to remember are given in the table below:

Event Date
Phase 2 Starts for Semester 2009A November 24, 2008 14:00 (HST) (24:00 UTC)
End of Phase 2 for Semester 2009A December 16, 2008 14:00 (HST) (24:00 UTC)

Please take these points into consideration:

3) Document Outline

This document presents the complete information for the second submission Phase of the QSO proposals accepted for ESPaDOnS. A general description of the Phase 2 tool is first presented in the section B. It includes a broad overview and, maybe more important, a description of the strategy behind the tool itself: the creation of the observation blocks, subsequently leading to the observation groups, the entity scheduled at the telescope. A brief discussion on the calibrations is also provided. The tool is simple enough that this overview might be sufficient for users accessing PH2 for the first time. Quick help files are also available from the button in PH2. Of course, there are substantial differences between the versions used for the different instruments at CFHT. A much more detailed tutorial is presented in Section C. For a complete description of the Phase 2 tool and other issues related to the Phase 2 submission, please refer to this section. Finally, the last two sections include some discussions already presented in the tutorial for the Phase 1 submission but still very relevant to the preparation of the observations during the Phase 2.

If you require more information about the Phase 2 submission, contact the QSO Team.

B - Overview of the Phase 2 Tool (PH2) [A - Introduction] [C - Detailed Tutorial] [D - QSO rules] [E - Other issues] [TOC]

1) PH2: Purpose

The Web based Phase 2 tool (PH2) has been developed for one main purpose: allowing the investigators of accepted QSO proposals to prepare a full description of their observations and to store this information in a database, accessible to the CFHT QSO Team. Observations to be carried out are extracted from this database during the QSO observing nights. PH2 represents then the key element in the QSO mode scheme. This is where the investigators tell the observers what observations should be done, and how (and sometimes when they should be done.)

PH2 is flexible enough to accommodate many kinds of queue programs (but not all of them...) while remaining relatively simple to use. It is also constantly a work in progress. We hope to introduce more options in the future versions to add more versatility. And, of course, suggestions are always welcome!

2) Some PH2 Notes

Some important characteristics of the actual version of PH2 for the general user are:

3) The PH2 Interface

The typical schematic presentation of the PH2 interface is shown below:

HINT: You can change the size of all the frames inside PH2 by dragging their side with the mouse.

4) The Concept of Observation Blocks

The entire architecture of PH2 and its database is based on the concept of Observation Block (OB). As illustrated below, an OB is formed of one (and only one) target, one (or many) instrumental configurations, and one (and only one) constraint.

The idea behind PH2 consists in several tables where the user can define these targets, instrumental configurations and constraints. Each row of these tables receives a unique label so each target, configuration or constraint is an unique entity. In other words, for example, one instrumental configuration defined only once might be subsequently used numerous times for observing different targets during the creation of the OBs.

Important: Since it is easier to schedule short observations at the telescope in a QSO mode, there is a limit of 2 hours (7200 seconds) for the total integration time of one individual observation block. PH2 will remind you if this time is exceeded...

The following four main steps lead to the creation of these observation blocks with ESPaDOnS:

i) Targets: When this section is selected, a table with several entry fields is presented (see below). The user can then define all the targets in the program by adding the appropriate rows to the table. Pointing coordinates can be entered in the table or grabbed from the Aladin tool. When the "Save" or "Proceed" buttons are pressed, this information is automatically saved in the database.

ii) Instrument Configurations: A table is presented for this section and the user can define all the instrument configurations (e.g. observing mode, readout, Stokes parameter, exposure time) planned to be used for observing the targets of the program (see below). Remember: The same configuration may be used for different targets over and over again so you might have to define it just once!

iii) Constraints: Finally, the last ingredient required for the creation of an OB is the constraint. These requirements for the observation (e.g. seeing, airmass) can be entered in a table similar to the one below. Again, one constraint may be used several times for different observations.

iv) Observation Blocks: Here you are! It is now time to associate all the above individual "entities" to create the observation blocks. This is very easy to do. You must first select one (or several) targets in your list (mouse click), then create a list of instrumental configuration(s) by selecting one or several of them (can be ordered with the arrows in the list), and finally, select one constraint. By clicking on the "Create OB" button, you add automatically one (or several) row(s) to the table of Observation Blocks. The creation of the OBs can be done very quickly if many targets used the same configurations and constraints because these remain selected after creating an OB. Very Important: The number of configurations that can be linked within an OB is unlimited; however, we recommend to keep the OBs as simple as possible to avoid additional overheads. You are almost done...

5) The Observation Groups

In principle, all the information entered in the tables above and used for the OBs would be enough for the operation of the QSO mode. However, to add more flexibility to PH2, we have introduced the concept of Observation Groups (OG). The OG will be the unit actually scheduled at the telescope and executed by the QSO Team So, it is necessary to fill the observation group form! The interface to prepare the groups is illustrated below. Three different types of groups are available, as illustrated below:

I-Time Accounting. An important aspect of the Observation Groups form is the accounting of the integration time (I-Time). This calculation is presented in the third frame and is automatically updated when an OG is created. The total readout time for the OBs, and the total I-time for the monitoring OG (N(iter) x I-Time (OB)) are automatically taken into account. If the "I-time left" becomes negative, a warning is displayed and the OG(s) created cannot be saved in the database.

The preparation of your observations is now completed! There are also other options available for the observation groups (e.g. time constraints, relational execution link, OG scheduler); that can be particularly helpful for some ESPaDOnS programs; information can be found in the detailed section below. A summary of the information saved into the QSO database is also available and can be sent by e-mail to the user.

6) A word on observing modes and data format with ESPaDOnS

ESPaDOnS has essentially two different observing mode: Spectroscopic (with or without sky) and Polarimetric. For the spectroscopic modes, the data produced consist in individual files (that is, independent odometer numbers) where the intensity (I) is established against wavelength. For the polarimetric mode, individual files are also produced. However, for a given Stokes parameter, 4 different files are generated. QSO will not produce data cubes with ESPaDOnS. For both modes, exposures can be repeated according to the number of sequences (Nseq) defined by the user within PH2. The table below gives a summary. The total I-time is automatically calculated in PH2, according to the mode selected.

Mode Spectra File(s) Produced Total Number of Files
Spectroscopic I vs. Lambda 1 ####.fits file [Nseq X 1 file]
Polarimetric Q vs. Lambda
U vs. Lambda
V vs. Lambda
W vs. Lambda
4 ####.fits file per
Stokes parameter
[Nseq X 4 files/Stokes]

7) A Word on the Calibrations

To process the ESPaDOnS data, a calibration plan has been developed by the QSO Team. The idea is to take all the necessary calibrations to reduce the data, on a nightly basis. This plan includes the necessary detrend frames for removal of the instrument signatures (bias, flat-fields) and for calibrating the spectra (ThAr, Fabry-Perot). For ESPaDOnS, you can consider the following situations:

  1. No programs under any circumstances are allowed to request "detrend" calibrations, including wavelength calibrations, during Phase 1 or Phase 2. These calibrations are exclusively handled by the QSO Team. It is, in fact, not possible to define detrend calibrations through PH2 for the general users...
  2. If your program requires observing spectrophotometric standards (or any other photometric calibrator), you must include these observations in your program. No systematic photometric, spectroscopic or polarimetric calibrations will be done by the QSO Team with ESPaDOnS.

8) PH2: ESPaDOnS and Recent Changes

For the current semester, these changes were made:

C - PH2: A Detailed Tutorial [A - Introduction] [B - Overview] [D - QSO rules] [E - Other issues] [TOC]

1) Accessing PH2

Accessing PH2 is limited to users having received confirmation of telescope time in the QSO mode with ESPaDOnS for a given semester. Before accessing PH2 through an User ID/Password system, some characteristics of PH2 should be known:

Access to PH2 is done through this small window:

2) Navigating within PH2

The left frame of PH2 is the Navigation Menu. The user can easily go from one page to the other by just clicking on the appropriate button. The button corresponding to the form currently opened becomes white with blue fonts.

HINT: It is highly recommended to navigate through PH2 with the menu buttons instead of the normal browser buttons. Activity in the different forms is monitored so using the PH2 buttons ensure that all the data are saved before moving to another section of the tool.

The navigation buttons and their corresponding pages are described below.

Button Corresponding Page
First page of PH2 (Login). UserID and Password required.
Program Selection Page, for multiple programs under the same User ID
Page describing the QSO program, the investigators (PI) and the TAC evaluation.
General Constraints and Information for the program. Depending on the answers, some options will be made available in the subsequent pages. Includes also a complete section for the distribution of the data.
Page containing the table used to define all of the targets used in the creation of the observation blocks
Page containing the table used to define all of the targets for which coordinates are changing with time (ephemeris). Only accessible if requested in Program Constraints page
Page used to define finding charts. Not mandatory and only accessible from the navigation menu.
Page containing the table used to define all of the instrument configuration (e.g. observing mode, Stokes parameter, exposure time) used in the creation of the observation blocks
Page containing the table used to define all of the sky constraints entering in the creation of the observation blocks.
Page allowing the creation of the observation blocks from the lists of targets, instrumental configurations and constraints defined in the previous pages.
Page allowing the creation of the observation groups (e.g. sequences) from a list of observation blocks. The I-time used for the program is also calculated and compared to the time allocated by TAC. Time constraints and REEL can be accessed here, if requested.
Optional tool that can be used to define a set of specific dates and times to execute one or a series of OGs.
Page describing all the observations prepared with PH2 and stored in the database for a specific program.
Page containing diverse forums related to the support of PH2 and the QSO mode. E-mail communication system available for contacting the QSO Team.
Logging out of PH2 (needs confirmation).
Opens the quick help files for PH2, containing information on the diverse parameters of the PH2 forms.
This document! Detailed overview and general description of PH2 and how to use it.

3) Program Selection

This page allows the selection of your program for your session::

This page can be opened at all time; it is possible to work on several programs at the same time without having to log out from PH2. The programs are first sorted out according to the semester (pull-down menu) and then are identified by the runID, instrument and title. Be careful: always make sure that you are editing the right program for the right instrument! For your convenience, the runID and instrument is shown on all the PH2 forms. Note: Following recommendations by the Time Allocation Committee, it is possible that a program was split into different programs with some specific I-time and grade/rank. If it's the case, the program with the higher ranking will keep the same runID as assigned during Poopsy Phase 1 but the other programs will be assigned a different runID by the QSO Team. When you click on "proceed", the version of PH2 you will need (MegaCam vs WIRCam vs ESPaDOnS) is loaded.

HINT: It is necessary to first select a program and click on the "Proceed" button before being able to navigate through the other pages of PH2.

Button
Function
Open the help files to the current page.
Save the content of the current page in the QSO database and open the next form.

4) Program Details

This page presents information regarding the program, the investigators, and the TAC evaluation:

Downloading/Uploading Target Files. At the bottom of the page, an option is available to download/upload a PH2 target list:

The "Download" option allows you to transform a list of target in the table of PH2 into an Astrores formatted file. For instance, if you have already a list of targets in a program that you would like to transfer to another program with a different runID, you can first go to the program with the target list, download it to an file on your local machine, edit it if necessary, and upload it in the appropriate program with the "upload" button. You can use also this button to create a template for further use: for instance, first enter a target, click "download", and you'll see the correct format for the Astrores template.

To upload a file, you can first save the example on your local machine by clicking on the "Astrores" button. All you have to do is to copy this template to your local machine within your favorite editor and then edit the ASCII table with your targets (do not change the XML code!). It is essential that you keep the appropriate format. Use the vertical lines as references for the number of spaces allowed. Most editors will keep this format automatically so it should not be a problem. Important Note: Versions 6 and 7 of Netscape have an unfortunate bug affecting the translation of the XML template downloaded and ruins the format of the file. There is a workaround: 1 - After opening the Astrores template, go to "view page source" in the top menu. This will shows the HTML code. 2 - With the mouse, copy all the code between the" XMP and /XMP lines and paste to an editor. 3 - Edit the two occurrences of lowercase "table" appearing in the code to uppercase "TABLE", and save. The file is now ready to be edited and is uploadable. You can upload the file to PH2 by giving the right path and by clicking on the "Upload" button. We strongly encourage you to verify carefully your target list after that!

Button
Function
Add N rows to the table.
Duplicate the selected rows N times.
Select all the rows in the table. Clicking again on it deselect all the rows.
Delete the selected rows. A confirmation window is displayed.
Check the entries for errors. The errors found are displayed in a separate window and are indicated by a red frame in the table. An automatic check is done also when the form is saved or when the "proceed" button is activated.
Display the next rows of the table.
Display the previous rows of the table.
Cancel all the modifications done to the current page and reload data stored in the database.
Save all the modifications done to the current page in the database and reload current page. Regular saving of the current form is recommended!
Save the content of the current page in the QSO database and open the next form.

7) Ephemeris

This form allows the user to define targets for which coordinates might rapidly change with time. The form is only accessible if requested in the Program Constraints section.

  1. At least 3 sets of coordinates must be entered, preferably 5.
  2. If the moving target moves slowly and is to be observed with sidereal rates (with or without guiding), the set of coordinates closest to the observing time will be sent to the telescope.
  3. If the moving target moves quickly enough that non-sidereal rates are necessary, sets of coordinates (at least 3, up to five) will be picked, and sent to the Telescope. Correct coordinates and rates will be interpolated by the Telescope Control System.

The general idea behind the ephemeris form is very simple: define a series of coordinates for a specific time for a given target. The table below shows the entry fields for the ephemeris of the target specified:

The top of the form allows the user to first give a name to a target. For instance, in the pull-down menu on the left, you can select "New". In the central window, you can then give a name to your target. When you click on "Update", the table in the middle frame window is then created and your target receives a label "ET#" (for "ephemeris target").

Each row in the table is an ephemeris labeled "E#" and includes the UTC Date (beginning of a night in Hawaii is ~ 05:00:00 UT) and the coordinates of the target for this date (in J2000.0). As many ephemeris as wanted can be entered for a target and as many targets as wanted can be entered for a program. After defining all of the ephemeris for the target, we recommend that you save it immediately before starting defining the ephemeris for the next target (if needed). When saved, the ET will appeared in the list of targets used for defining the observation blocks (below).

Since entering a large number of ephemeris can be cumbersome the Astrores format template can be used at the bottom of the page to upload ephemeris for a given target (that is, one upload per target is necessary). To do so, apply first the procedure described above (create a new target name and click on update), since the name of the target cannot be defined from the Astrores template. Below there is a Astrores template (XML) that can copied on your local machine and then used to upload ephemeris to the table in the middle frame. (You can also create your own template on your local machine by first defining a target and click on "download". However, see important note in the fixed target section if you are using Netscape 6 and 7). It is important that the format is respected. You can then prepare the ephemeris for the target as seen in the lower part of the template and save the template under a specific name. When saved on your local machine, you can then upload it by specifying the path. Check that everything is fine and then save the ephemeris table for that target. Repeat if necessary!

<?xml version = "1.0"?>
<!DOCTYPE ASTRO SYSTEM "http://vizier.u-strasbg.fr/xml/astrores.dtd">
<ASTRO ID="v0.8" xmlns:ASTRO="http://vizier.u-strasbg.fr/doc/astrores.htx">
<TABLE ID="Table">
<NAME>Ephemeris</NAME>

<title>Ephemeris for CFHT QSO</title>
<!-- Definition of each field -->
<FIELD name="DATE_UTC" datatype="A" width="19" format="YYYY-MM-DD hh:mm:ss">
<DESCRIPTION>UTC Date</DESCRIPTION>
</FIELD>
<FIELD name="RA_J2000" datatype="A" width="11" unit="h" format="RAh:RAm:RAs">
<DESCRIPTION>Right ascension of target</DESCRIPTION>
</FIELD>

<FIELD name="DEC_J2000" datatype="A" width="11" unit="deg" format="DEd:DEm:DEs">
<DESCRIPTION>Declination of target</DESCRIPTION>
</FIELD>
<!-- Data table -->
<DATA><CSV headlines="4" colsep="|">
<![CDATA[
DATE_UTC |RA_J2000 |DEC_J2000 |
YYYY-MM-DD hh:mm:ss|hh:mm:ss.ss|+dd:mm:ss.s|
1234567890123456789|12345678901|12345678901|
-------------------|-----------|-----------|
2003-06-04 06:30:00|09:34:00.00|+16:38:00.0|
2003-06-05 06:30:00|09:35:15.00|+16:31:50.0|
2003-06-06 06:30:00|09:36:33.00|+16:25:40.0|
]]></CSV></DATA>
</TABLE>
</ASTRO>
11) Finding Charts>

Since ESPaDOnS is a fiber-fed instrument, it is important to make sure that right target is put into the entrance fiber. Pointing of the telescope is limited to an accuracy of about +/- 10" on the sky so in crowded fields or when the target is faint, it might become difficult to identify the right object to put into the fiber. PH2 now hass a mandatory tool where the user can precisely identify their targets in finding charts reproducing the field of view of the guiding window seen at the telescope. This tool is based on the Aladin system and is very easy to use. The idea is that the user first identifies his/her target with a little red arrow in the Aladin field and save the chart (as a .gif file) in the QSO database. When a finding chart is available, it is automatically displayed next to the guiding window for the QSO observer at the telescope. For obvious reasons, finding charts can only be defined for fixed targets; moving fields are not possible.

The top frame allows the user to first select one of the fixed target, as defined in a previous form. Then the user can click on "FOV" which will open a Aladin window, displaying the 2' x 2' field of view of the ESPaDOnS guiders and a DSS image of the sky:

An example of such a field is displayed below. Contrary to the Aladin version available for the Fixed Targets form, the field of view marked with a blue square cannot be moved around.

The user can then select the last button at the bottom right called "point". This enables an option implemented by QSO so a little red arrow can be positioned in the field of view, next to the right target, by one click of the mouse. When this is done. the user goes back to PH2 and clicks on the "grab" button. When this is done, the table in the middle of the form is updated with the finding chart:

Note that the finding charts are displayed in the summary of the program.

12) Instrument Configurations

This is the second mandatory step in the creation of the observing blocks. This page allows the user to define all the instrumental configurations necessary for the program. The same configuration can be used several times with different targets. The main section of the page is a table with different options under pull-down menus or editable entry fields. Some entry fields are dynamically linked, that is, a selection in one of the pull-down menu will change the options in another one.

But, first the top frame can be used to help in the preparation of these configurations by offering the following elements:

The middle frame of the configuration page consists in a table and buttons to manipulate the entry fields:

Integration Time Calculation

The integration time (I-time) calculation is done for each instrument configuration (IC) according to the general formula:

I-time (IC) = Nseq x [S(Obs.mode) x [Exptime + Overheads (readout)]]

where:
Nseq = Number of sequences
S(Obs.mode) = Number of exposures generated, depending on the observing mode selected. For polarimetry, S=4. For spectroscopy, S=1
Exptime = Exposure time defined for each individual exposure
Overheads (readout) = Overhead charged for each individual exposure. It includes the readout time + some operational overheads, as defined in the table above.

Example: In polarimetric mode, the user requires 5 sequences with the Q parameter, the normal readout mode and exposure time of 100 sec/exp. We get: IC = 5 x [4 x (100 + 60)] = 3200 seconds (20 files generated).

Button
Function
Add N rows to the table.
Duplicate the selected rows N times.
Delete the selected rows. A confirmation window is displayed.
Select all the rows in the table. Clicking again on it deselect all the rows.
Check the entries for errors. The errors found are displayed in a separate window and are indicated by a red frame in the table. An automatic check is done also when the form is saved or when the "proceed" button is activated.
Display the next rows of the table.
Display the previous rows of the table.
Cancel all the modifications done to the current page and reload data stored in the database.
Save all the modifications done to the current page in the database and reload current page. Regular saving of the current form is recommended!
Save the content of the current page in the QSO database and open the next form.

13) Constraints

This page presents the table designed for defining the sky constraints under which the observations should be undertaken. The top frame displays information about the targets and instrument configurations defined previously:

The middle frame presents the table for the constraints:

A note on the Seeing. The constraint on the seeing is usually the strongest criterion for the selection of a program to be undertaken. Our goal is to never try observations during conditions exceeding the upper limit defined by your constraint by more than 10%, and at most 20%. The probability that your program is executed depends somewhat on this constraint, even with ESPaDOnS; the table below offers some statistics. Be realistic! In particular, for Programs with the C grade, it would be much preferable not to specify a seeing better than 1.0". It is important that you request a realistic IQ also when your targets do not reach a low airmass. For instance, asking for better than 1" when the airmass is never smaller than 2.0 is not very likely to happen... By definition, snapshots programs MUST request IQ > 1.5".

Image Quality (IQ) on Mauna Kea
Frequency (%)
IQ < 1.0"
70-80

1.0" < IQ < 1.5"
20-30
IQ > 1.5"
0-5
Button
Function
Add N rows to the table.
Duplicate the selected rows N times.
Delete the selected rows. A confirmation window is displayed.
Select all the rows in the table. Clicking again on it deselect all the rows.
Check the entries for errors. The errors found are displayed in a separate window and are indicated by a red frame in the table. An automatic check is done also when the form is saved or when the "proceed" button is activated.
Display the next rows of the table.
Display the previous rows of the table.
Cancel all the modifications done to the current page and reload data stored in the database.
Save all the modifications done to the current page in the database and reload current page. Regular saving of the current form is recommended!
Save the content of the current page in the QSO database and open the next form.

13) Observation Blocks

This is it! This page allows the user to link all the previously defined entities within observation blocks (OB). The main page is divided into two main frames:

HINT: The number of rows displayed at once is only a few. The "Next Page", "Previous Page" buttons can be used to navigate between the different pages. The blue links OB# represent the first row of each individual pages and can also be used for moving quickly from a page to another.

14) Observation Groups

This page presents the last step in the preparation of your observations: the creation of the observation groups (OG). The OGs will be the entities scheduled at the telescope so this step is necessary, even if you have previously defined all the observation blocks. The OG page is presented below:

Observation Groups: Options

There are three important options available for the Observation Groups, useful to precise specific observations. These options are first presented in the "Program Constraints" section and appear only in the OG form if requested.

Monitoring Parameters: Parameters for the monitoring OGs. This window appears only if you have indicated that your program requires monitoring. You can enter a period in hours, days or weeks. To enter the parameters, first select the unit and then fill up its value. The number of iterations corresponds to the numbers of times that this OG should be done at the interval of the period. The minimum number of iterations corresponds to the acceptable minimum number of observations to reach the science goals. We will reach for the total number of iterations but only OGs that have met the minimum number of iterations will be considered valid.

Relational Execution Link (REEL): For certain programs, it is important that the observations take place within a specific sequence of events. For instance, if OG1 is done and validated, only then OG2 should be done within a certain timescale. It is possible to manage this kind of sequence at a higher level on a small scale (that is, during the preparation of the queues) but on a larger scale, it is much more preferable to have these options "hard coded" in the database. To cover such possibilities, we have developed the concept of the REEL: basically, it is possible to create a causal link between observation groups. This can be done in the last window on the right, if you have selected the REEL option in the "Program Constraints" section. Essentially, a REEL means this: "After the validation of the reference OG, the linked OG should be done within a certain delay." You can then link several OGs, if needed. For instance, OG3 to OG2 to OG1, etc. The links created appear in the OG table. An example of a REEL sequence is showed below.

IMPORTANT: The REEL option should be used ONLY when appropriate. If the observations cannot be done within the window defined by the (delay +/- delay) (due to bad weather or technical problems), the completion of the chain will not be done. Also, the logic involved in defining the REELs in PH2 is complicated. It is preferable to define first all the OGs, save them, and then create the links. This can be done using the "modif OGs" button: after defining all the OGs, you can create the REEL link by selecting the OG from its label, entering the REEL parameters, click in the "select" box on the row, click on the "modif OGs" button and save. Deleting OGs which have REELs will not be permitted.

Time Constraints: For certain programs, some observations must be done during a specific time range. These entry fields, available in the OG table, allow the user to define such a constraint by specifying a period for which the observations should be undertaken. The user can enter a date and a time (HST) to specify such a window. These fields are optional and will appear only if required in the "Program Constraints" page. It must also be understood that these constraints are very severe: if for a reason or another (e.g. bad weather or conditions not meeting the sky constraints) the observations cannot be done during the period required, these observations will not be attempted again and will be taken out of the queue. Time constraints are not compatible with REELs, for example if an OG is to be done after another one is validated, that OG cannot have time constraints as well.

Button
Function
Create one observation group (it can be of types 1OB, MOB, or SOB).
Transform all the observation blocks defined in the previous form into observation groups. The recommended approach!
Modifying an existing observation group. After selecting one or several OGs in the table ("select" column), the OGs will be modified according to the parameters redefined by the top lists after clicking the "modif OG(s)" button. So, it is now possible to change an OG without having to delete it first from the table! Important: You must make sure that the total I-time allocated for your program has not been exceeded after modifying the OG(s).
Select all the rows in the table. Clicking again on it deselect all the rows.
Delete the selected rows. A confirmation window is displayed.
Check the entries for errors. The errors found are displayed in a separate window and are indicated by a red frame in the table. An automatic check is done also when the form is saved or when the "proceed" button is activated.
Display the next rows of the table.
Display the previous rows of the table.
Cancel all the modifications done to the current page and reload data stored in the database.
Save all the modifications done to the current page in the database and reload current page. Regular saving of the current form is recommended!
Save the content of the current page in the QSO database and open the next form.

15) OG Scheduler

For certain ESPaDOnS programs, observations can be done at specific but multiple times during a semester. For instance, if the observations has to be done during a specific transit of a binary system, several dates and times might be possible. These dates and times can now be defined precisely with a new tool, the OG scheduler, developed specifically for this purpose. The tool produces a series of possible dates and times for which one or several OGs should be executed. The OG scheduler is optional and should be used only for those few programs which really require this tool.

A note on Time Constraints

Before explaining how to use the OG scheduler, it is important to provide a clear distinction between the different possibilities offered by PH2 on how to define time constraints with ESPaDOnS. There are 3 distinct possibilities, two of them already introduced in the previous section on the OG form.

  1. Time Constraint Window: When requested in the program constraints page, it is possible to define time windows during which a OG should be done. This is the type of possible time constraint defined in the OG form. The OG will only be done within that time window.
  2. Monitoring: A specific OG might be done several times during the course of a semester, for monitoring a specific target. The monitoring is defined by a number of iterations and a period. The monitoring OG can be done within a time window, if desired.
  3. OG Scheduling: Several specific dates and times for a given OG can be needed, not just a window. OG scheduling refer to the possibility to define several dates and times for which an OG can be done. In other words, "an OG can be done at this date and time, or that one, or that one, etc...". Even a monitoring OG can be scheduled that way. In that case, it would mean "start this monitoring OG at one of these specific dates and times, then continue the monitoring of target according to the iterations and monitoring parameters (period)".

It is very easy to define a series of dates and times for which a OG could be done. NOTE: All dates and times specified within PH2 OG Scheduler are in HST. The top frame of the OG Scheduler looks like this:

After entering these parameters, by clicking the "create" button in the middle table will create the list of dates:

16) Summary

This page opens a complete summary of what is currently the Phase 2 status of the program. As showed below, the summary can be sent by e-mail to several destinations as a HTML attachment (to be compatible with people not using a browser for their mail system), by clicking on the "Send this page to" button. The summary can also be printed using the "Print" button of the browser used for PH2.

HINT: We strongly suggest that you keep the summary (printed or electronic) of the final version of the program submitted during the Phase 2. It will be useful to you for monitoring the progress of your program with the night reports and for any necessary communication between you and the QSO Team regarding the observations.

17) HelpDesk

The HelpDesk has been discontinued and will not be used for 2009A. For any question, comment, or suggestion, please send an email to the QSO Team: qsoteam -=at=- cfht.hawaii.edu

18) Logout

To exit PH2, you must confirm it by clicking on the "Logout" button in the window below. If you do not want to do so, select another page with the navigation buttons on the left frame.

Button Function
Logout from PH2 and open the first page of PH2.

D - A Few QSO Rules [A - Introduction] [B - Overview] [C - Detailed Tutorial] [E - Other issues] [TOC]

Maybe the most difficult task facing the queue observing model is found in the selection process leading to the execution of a science program. This selection can be based on simple criteria (e.g. mounted filters) but it becomes immensely complicated when other parameters like actual sky conditions, completeness level, science merit, monitoring and time constraints, filters availability, or targets visibility are taken into account.

The process, resulting in the choice of a specific program to be undertaken for the queue observations with ESPaDOnS, will be done in three steps:

1- Selection: This is the first selection of the viable observations stored in the database according to instrumental constraints, sky constraints, actual sky conditions, completeness level, and the position of the targets.

2- Ordering: This second step creates a prioritized list of observations to be sequentially executed regarding their TAC grade, rank, target positions, and user's priorities.

3- Human filtering: The final step consists in the possibility for the QSO observer to modify the queue list according to special constraint like the focus sequences, calibration plan, etc.

Without going into too many details, each of these steps include an algorithm based on a set of observing rules. The rules given here are not presented in any order of priority. Among them:

E - Other Issues [A - Introduction] [B - Overview] [C - Detailed Tutorial] [D - QSO rules] [TOC]

1) Night reports

After each observing night, a report detailing what observations were performed will be available on the CFHT Web site. These reports include the observations blocks executed and the sky conditions at the time of the observations. This does not necessarily mean that your data will be immediately available. The goal of these reports is to inform the community of the progress of the queue and, in particular, the current status of your program. If you see in the Night Reports that the QSO Team might have made a mistake (OG missing, wrong timing, no enough iterations...), please send an email to qsoteam -=at=- cfht.hawaii.edu IMMEDIATELY so we can fix the mistake (if possible).

2) Data Evaluation

As part of the data quality control assessment, all data taken will be automatically processed and calibrated at CFHT. Data evaluation will be done in two steps: during the observation by the Service Observer ("on-line" evaluation) and, during and after the data processing. This last step is very involving and represents one of the reasons why data cannot be distributed immediately. If the observations are judged satisfactory, the queue database is then updated by the Queue coordinator, and the reduced data are made available to PIs.

3) Data Distribution

Data is distributed to PIs by putting them on the Web, at a location known only to the PI of each program. Data is distributed only after a human has checked the data reduction log for warnings, error messages, inconsistencies, or anything wrong. Our goal is to make the raw and processed data available by noon, the day following a night of observation.

4) The QSO Team

The current QSO Team is formed of Nadine Manset (QSO Manager), Billy Mahoney (Database Specialist), Tom Vermeulen (System Programmer), Todd Burdullis (Senior Service Observer), and Mary Beth Laychak, Adam Draginda, Rachael Zelman, Peter Forshay (Service Observers). During a QSO run, supervision is ensured by the QSO Coordinator (one of the CFHT Resident Astronomers) who, among other things, is responsible for managing the queue database, data reduction, and maintaining the contact with the investigators, if necessary. The main coordinator for the ESPaDOnS QSO runs is be Nadine Manset. Observations will be conducted by the Service Observers and with a strong involvement by the Observing Assistants. Software support will also be provided during the observing nights. For TOO programs and decisions related to the viability of some programs, the CFHT Executive Director acts as the final authority.