Andy Howell edited Data reduction pipeline.tex  about 10 years ago

Commit id: 4622aafb5b933cdba9a42373630514a11858080e

deletions | additions      

       

correction is performed with a file obtained from a different night  stored in the archive or selected by the user.  \end{enumerate}  \subsection{floydsspec}  \label{sec:efosc-spec}  \textbf{floydsspec} is the executable used to perform the  \emph{interactive reduction}. In this section we will present the  syntax and main options available to use this task. When the pipeline  is installed, \textbf{floydsspec} should be run in the directory  containing the raw FLOYDS data. The script is able to recognize the  different types of data and lead the reducer to perform all the steps  described above. \textbf{floydsspec} does not need input file lists if  all the raw data are in the directory where the user is running it. A  list of files can be given as input if the user wishes to reduce only a  subset of data. Option ``\emph{-h}" will show all available options.  \begin{small}  \begin{verbatim}  $floydsspec (basic command)  $floydsspec -h (help on options)   $floydsspec listfiles (to only reduce data included in listfiles)  $floydsspec -i -A (recommended syntax: interactive, automatic [see below])  Usage: floydsspec [listfile -i -A -C --listflat list (use raw flat frames from this list) .....]  Options:  --version show program's version number and exit  -h, --help show this help message and exit  -i, --interactive run the script in interactive mode [recommended]  -c, --classify try to classify the reduced spectrum using SNID (if  installed)  -C, --cosmic removes cosmic rays using lacosmic  -v, --verbose   -A, --Automatic extract spectrum with previous parameters in the  database  -t, --trace trace extraction with another frame  -d, --dispersion interactively choose the disperasion line where  aperture and background are selected  -r REBIN, --rebin=REBIN  rebin blue part [pixels]  --fringing=FRINGING fringing correction [1] response, [2] computed  on 1d images minimizing scatter, [3] using apflatten  --noflat skip flat correction  --listsens=LISTSENS use sensitivity curve from this list  --listflat=LISTFLAT use the raw frames in this list for the flat  --listarc=LISTARC use the raw frames in this list for the arc   --listatmo=LISTATMO use the closest tellurich file from this list for  the telluric correction  \end{verbatim}  \end{small}  The options $--listatmo$ allow you to use a specific tellurich file\footnote{the tellurich file is a spectrum equal to one everywhere exept in correspondance of the tellurich lines.} to correct for atmospheric absorption from a list of files you provide.  The option $--listsens$ allow you to use a specific sensitivity function from a list of sensitivity functions that you provide. These files must have been produced with the FLOYDS pipeline. The option $-i$ is turns on the interactive mode for  extraction, line identification, wavelengh calibration checking, and  computing the sensitivity function. If the interactive mode is not on,  all these steps are done automatically. The option $-A$ allows the  user to rereduce some of the spectra from one night, but not  all. You can choose which spectra to extract again and which ones  should be skipped.  \subsection{floydsauto: Data product automatic reduction}  \textbf{floydsauto} is the executable used to perform  \emph{automatic reduction}. We do not report here all the options  available for this executable, since this script has been optimized to  run at LCOGT in order to produce the automatic data products for  external users. We will focus on data products.  \textbf{floydsauto} runs every day with a cron job on the last 5 days of  observations. For each night, it divides the observations using the  {\em PROPID}\footnote{{\em PROPID} is a unique number that identifies different  proposals}, reduces the data, and groups them in tar files. Each tar  file will have in the name the Proposal ID, the telescope, the date of  observations, and the MJD\footnote{The number reported is actually not the MJD, but MJD $\pm$ 1 day. This number will update at midnight local time in order to remain the same as far as the reducer compute the reduction during day-time and during the same day.} when the reduction was performed. If a  standard star was observed the same night, a tar file of automatic  reductions for the standard frames will also be produced. The tar file  for standard prereduced frames will all start with "STD", e.g.:  \begin{small}  \begin{verbatim}  LCO2013A-003_fts_20130727_56503.tar.gz  STD_fts_20130727_56503.tar.gz  \end{verbatim}  \end{small}  Each tar file will contain the following files:  \begin{small}  \begin{verbatim}  ESO323G077_offset_fts_20130727_red_2.0_56505_1.fits (Trimmed raw red part of the science frame)  ESO323G077_offset_fts_20130727_blue_2.0_56505_1.fits (Trimmed raw blue part of the science frame)  arc_ESO323G077_fts_20130727_red_2.0_56505_1.fits (Trimmed raw red part of the arc frame)  arc_ESO323G077_fts_20130727_blue_2.0_56505_1.fits (Trimmed raw blue part of the arc frame)  flatESO323G077_offset_fts_20130727_red_2.0_56505_1.fits (Trimmed raw red part of the flat frame)  flatESO323G077_offset_fts_20130727_blue_2.0_56505_1.fits (Trimmed raw blue part of the flat frame)  ttESO323G077_offset_fts_20130727_red_2.0_56505_1.fits (rectified red part of the science frame)  ttESO323G077_offset_fts_20130727_blue_2.0_56505_1.fits (rectified blue part of the science frame)  ttarc_ESO323G077_fts_20130727_red_2.0_56505_1.fits (rectified red part of the arc frame)  ttarc_ESO323G077_fts_20130727_blue_2.0_56505_1.fits (rectified blue part of the arc frame)  ttflatESO323G077_offset_fts_20130727_blue_2.0_56505_1.fits (rectified blue part of the flat frame)  ttflatESO323G077_offset_fts_20130727_red_2.0_56505_1.fits (rectified red part of the flat frame)  nttESO323G077_offset_fts_20130727_red_2.0_56505_1.fits (flat-field corrected red part of the science frame)   ttESO323G077_offset_fts_20130727_blue_2.0_56505_1_2df.fits (2D flux calibrated blue frame)  ttESO323G077_offset_fts_20130727_red_2.0_56505_1_2df.fits (2D flux calibrated red frame)  nttESO323G077_offset_fts_20130727_red_2.0_56505_1_2df.fits (2D flat-field corrected, flux calibrated red frame)  nttESO323G077_offset_fts_20130727_merge_2.0_56505_1_2df_ex.fits (fast reduction 1D spectrum)  \end{verbatim}  \end{small}  In summary, the extension ``\emph{2df}" indicates a flux calibrated  spectrum, the prefix ``\emph{tt}" indicates that the frame has been  geometrically \emph{transformed} along x- and y-axes, ``\emph{n}"  indicates that the frame has been flat field corrected. The typical  science name is composed (in order) of object name, telescope,  observation date, ``blue" or ``red" (indicating second or first order),  slit width, and MJD date when the reduction was performed.  The tar file also includes extra files to help the user understand  if the observations were performed correctly. It includes a pdf file  with the acquisition image and first guiding images,  together with some useful plots with information on the guiding and the  flux of the guiding star during the full exposure. An example of the  summary pdf file is shown in Fig. \ref{fig:summer}.