Omega CAM Data Flow System
Omega CAM Data Flow System
OmegaCAM
Approved by:
Konrad Kuijken, OmegaCAM PI.
CHANGE RECORD
ing Templates.
Reworded sentence about DFS-pipeline – 5.10 On site quick look analysis.
Reworded sentence about modules – 6.1 Data reduction software require-
ments.
Rotator offset angle – 4.4 Observing Templates.
Use plots for analysis – req.571.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 4
TABLE of CONTENTS
1 INTRODUCTION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.1 Scope of this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.2 Applicable documents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
1.3 Reference documents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
1.4 Abbreviations and Acronyms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
2 SCIENTIFIC REQUIREMENTS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.1 Scientific requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.2 DFS requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
3 INSTRUMENT CONCEPT- Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
3.1 Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
3.2 Focal plane geometry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
3.3 CCD details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
3.4 Filters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
3.5 Control electronics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
3.6 Instrument Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
4 OBSERVING MODES and STRATEGIES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.1 Observing Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4.2 Observing Strategies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
4.3 Filtering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
4.4 Observing Templates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
4.5 Field correctors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
5 BASELINE CALIBRATION REQUIREMENTS . . . . . . . . . . . . . . . . . . . . . . . . . 41
5.0 Documentation system, Odoco . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
5.1 Functional Checks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
5.2 Detector Electronics specific Calibrations . . . . . . . . . . . . . . . . . . . . . . . . . . 48
5.2.1 Req.– CCD read noise - doit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
5.2.2 Req.– Hot pixels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
5.2.3 Req.– CCD gain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
5.2.4 Req.– Electromagnetic Compatibility . . . . . . . . . . . . . . . . . . . . . . . . 50
5.2.5 Req.– Electrical cross talk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
5.3 Detectors specific calibrations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
5.3.1 Req.– CCD Dark Current - doit . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 5
URD OmegaCAM
1.0 Introduction
2.0 Scientific Requirements
3.0 Instrument Concepts
4.0 Observing Strategies
5.0 Calibration requirements
6.0 Data reduction
7.0 Preparatory Programmes
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 8
1 INTRODUCTION
OmegaCAM is planned as the first instrument for the VLT Survey Telescope
(VST) on ESO’s Paranal site. It is expected to operate for a period of ten years,
and at least during the first 3-5 years of operations of the VST the OmegaCAM
is foreseen to be the only instrument on this telescope. OmegaCAM is a 16,384
x 16,384 pixel (16k x 16k) imaging camera which will image a field of 1 square
degree of sky.
The instrument is envisaged to execute dedicated observing programmes defined
by individual users or teams. About 2/3 of the available observing time will be
allocated by ESO’s OPC. The remaining time is labeled as guaranteed time for
the consortia involved in the construction of the telescope and the camera. Both
small dedicated programmes, and bulk wide field sky surveys, are expected.
The VST and OmegaCAM are built to provide an observing facility for the
purpose of selecting targets for follow-up observations at the VLT, but also
to conduct stand-alone observing programmes that require wide-field imaging.
The camera and its associated data reduction will facilitate accurate photom-
etry and astrometry over its entire field of view, following the requirements on
the VST and its instrumentation. Primary Performance Characteristics for the
VST wide-angle CCD camera are laid out in the Memorandum of Understand-
ing (MoU) between OmegaCAM and ESO in Section A.4.1, while guidelines for
its implementation in ESO’s Data Flow System (DFS) are given in A.4.2 of the
MoU which in turn refers to VLT-SPE-ESO-19000-1618.
NOVA-ISC MoU
PI
source lists
Figure 1
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 11
2 SCIENTIFIC REQUIREMENTS
8 - astrometry with an internal accuracy of 0.01-0.0200 rms (goal) and 0.0500 rms
(formal), an accuracy of 0.100 rms with respect to an external standard and
an absolute accuracy of 0.2-0.300 rms (goal) and 100 rms (formal value).
9 - 1% accuracy in flat fielding
10 - multi-color photometry
11 - narrow band imaging
12 - four observing modes: stare (single exposures), jitter (few pixels shifts be-
tween sub-exposures), dither (shifts larger than the largest gaps in the CCD
mosaic) and SSO - solar system objects, facilitating non-siderial tracking
13 - 10-12 filters available on-line
14 - accurate photometric calibration of all broad-band filters to a level of 0.01
mag rms (goal) and 0.05 mag rms (formal) in the zero point in instru-
mental magnitudes and 10% in the color transformation terms from the
instrumental to the Johnson-Cousin standard photometric system
15 - astrometric and photometric performance monitored and administrated
throughout the life time of the instrument; certain data items related to
these calibrations need to be delivered separately to the consortium. Specifi-
cations of these items are given in a separate Interface control document be-
tween ESO-DMD and the OmegaCAM consortium [VST-SPE-OCM-23100-
3551]
16 - observing programs must allow for new inclusions or modifications on a
day by day basis
17 - if required, raw, observational data must be made available to the propo-
nents, for analysis within 2-3 working days
18 - the “pipeline data reduction must be able to fully reduce an average day
worth of science and calibration exposures within 12 hours elapsed time, op-
erator preparation of the execution shall not exceed half an hour” following
the specification of Annex A.4.1 of the MoU.
19 - observing (scheduling), calibration and data reduction stategies should
support the following type of survey strategies :
— Basic observing modes on single fields
— Deep integrations of single fields
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 17
The rest of this Section provides further details and justifications for this list.
Note on req. 12:
Wide area coverage and deep integration on single fields, usually require that the
gaps in the CCD mosaic are covered by the combination of several exposures
(≥ 5) with a dithering larger than the maximum gap in the CCD mosaic.
For some programmes (e.g. variability monitoring, weak lensing), it is more
important that at corresponding positions in the sky the PSF shows a minimum
variation. In this case, the best strategy is to obtain multiple exposures with
only a small jittering to remove bad pixels.
Note on Sc. Req. 13:
Because of flexible scheduling, the need to be able to monitor transient or vari-
able objects in several filters, and the measurement of atmospheric extinction,
the number of filters available on-line must be on the order of a dozen. 5 of
these are required for the continuous maintenance of the photometric scale at
4 key bands (see Section 5.6).
Note on Sc. Req. 14:
Accurate calibration to the Johnson-Cousin standard photometric system is
strictly required by many stellar population studies. Required accuracy for such
programmes is 0.01 mag. (Also many other programs, even those not using
standard filters, will require a calibration link to a standard photometric system.)
To provide the necessary infrastructure for this goal a proper monitoring of the
sky conditions, in particular of the extinction coefficient, is required, next to the
continuous monitoring of the overall responsivity variations of the instrument.
Data acquisition and baseline calibration plan shall be designed to achieve the
goal, but this will not be provided by the standard pipeline, which is required to
achieve the nominal 5% photometric accuracy. Additional dedicated off-ESO-
pipeline data-analysis will be required to qualify 1% accuracy.
Note on Sc. Req. 15, (i):
A major fraction of the observing time will be spent on wide area surveys in dif-
ferent filters. Some of the projects may require several years to be completed.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 18
light specific topics of interest for our communities and which were not pre-
sented in the VST science case documents. Though in some cases the research
strategy of these projects will need to be refined following the most recent ad-
vances in the field, they can still serve as examples of the scientific problems to
be addressed with OmegaCAM. Here, we summarize various scientific projects
which are anticipated for the VST/OmegaCAM and we identify a set of science
driven requirements on the instrument, its operations and its data reduction
system. These projects can be taken as use cases for the OmegaCAM project.
Clearly, also these special operations will need additional arrangements, in which
balances have to be found between services provided by ESO and ad hoc data
reductions done by the user.
D. Scientific case: A wide-area proper motion survey
In order to locate and study intrinsically faint stars, a deep wide-field survey
(∼ 100 square degrees) in two colors will be conducted on a regular basis so as
to select those objects with high proper motions. Down to faint absolute mag-
nitude limits, this will allow all objects with halo kinematics within a distance
of 100pc in the directions surveyed to be located.
For example, if a significant population of halo white dwarfs exists, one such
object should be found by this survey per square degree, even if their cooling
ages are 16 Gyr. A proper motion survey is the only way to detect intrinsically
faint stars from the ground: at faint apparent magnitudes, galaxies dominate
the counts to such an extent that faint-star counts are virtually impossible.
Only by pre-selecting objects with proper motions can galaxies be eliminated,
and the faint end of the stellar luminosity function reliably studied.
Special requirement on Instrument – 0.0100 accuracy in relative astrom-
etry
at redshifts above 2.5, ≥ 50× more than presently known. These data, and
with follow-up VLT observations, will allow comparative studies of the evolu-
tion of the luminosity density, star-formation activity, oxygen abundances, and
luminosity function in several redshift intervals. Analyses of such data will also
constrain the models for the formation and evolution of galaxies as well as those
for the formation of structure. Statistically complete sets of these objects will
be selected for detailed spectroscopic follow-up with the VLT in order to study
the evolution of the scaling relations of spiral and elliptical galaxies in the field
and in clusters.
• E4. Quasars and AGNs:
The reconstruction of spectral energy distributions as well as surveys of vari-
ability will allow the identification of a large number of AGNs and QSOs over a
large redshift range. This data will constrain the formation epoch of QSOs, and
will serve as a set of faint, optically selected AGNs that will be needed to solve
the longstanding debate on the origin of the X-ray background. Moreover, with
these data, the role of the surrounding density on the AGN phenomenon can be
reliably studied. Finally, the survey will identify a large number of QSOs that
are good targets to study the large-scale structure by the aid of Lyα absorption
systems. All of these projects will need VLT follow-up spectroscopy.
• E5. Weak lensing on different mass scales:
The survey will provide the data to study the distribution of luminous and
dark matter on various scales (10 h−1 Mpc down to 10 h−1 kpc) via lens-
ing techniques. The mass selected (i.e., lensing selected) sample of clusters
and groups of galaxies can directly be compared with N-body simulations of
structure formation, avoiding the usual assumptions about mass-to-light ratios,
luminosity-temperature relation of clusters, etc. We will measure the mass-to-
light ratio of clusters, its scatter, and its dependence on the cluster mass, and
we can quantify any bias caused by the traditional optical clusters selection.
Statistically, we will also be able to measure small density fluctuations by the
large-scale structure (‘cosmic shear’) and thus constrain the amplitude and
shape of the power spectrum directly.
F. Scientific case: Discovering new Solar system objects
OmegaCAM is expected to make a large inroad in solar system astronomy. A
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 25
belief commonly held is that the entire solar system has been inventoried – new
comets and asteroids will continue to be found and catalogued, but these are
just other members of the principal solar system populations. Recent years have
seen this view sharply challenged. The outer solar system (in particular from
Neptune outward) is now known to contain the Kuiper Belt, a vast population of
cold primitive bodies, of which the Pluto-Charon binary is the most well known
member. Two new irregular satellites of Uranus were discovered as recently as
1997, and there is theoretical evidence that the inner solar system still harbours
undiscovered populations in the form of terrestrial and Venus trojans. It is clear
that our inventory of the solar system is far from complete, and this situation
needs to be rectified if we ever hope to understand solar system formation as
a general, galactic-wide phenomenon.
• F1. Kuiper belt objects:
A solar system survey that the OmegaCAM is particularly well equipped to
carry out is the search for the largest (brightest) Kuiper Belt objects. The size
distribution for the Kuiper Belt is only well established between 21 ≤ mR ≤ 26,
since this magnitude region is well suited to conventional telescopes and CCDs.
However, at brighter magnitudes, the surface density drops rapidly so that very
large sky coverage is needed for positive detections. In spite of the difficulties,
it is essential to extend the size distribution to large sizes (bright magnitudes)
because this is the most informative area regarding theories of planetary growth.
The numbers and sizes of the largest bodies in the Kuiper Belt will provide
strong constraints on the ”runaway growth” stage of accretion in the outer solar
system, and should shed light on the still unsolved problem of the accretion of
the outer planets.
Since the objects of interest are bright (mR ∼ 20), such a survey could be
carried out during bright time. A sky coverage of ∼ 1000 deg2 at mR ∼ 20 can
be achieved in 1 year with ∼ 5 hours of observation each month. Extrapolating
from the known size distribution, the survey is expected to yield ∼ 20 Kuiper
Belt objects brighter with mR ∼ 20 in 1 year. With this rate, one could equal
Clyde Tombaugh’s survey (the largest outer solar system survey to date) in
merely 1.5 years. Such a survey would answer the intriguing question whether
other ”Plutos” (bodies in the 1000 km-radius range) exist. Even without the
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 26
The urgency of fast data reduction when dealing with Trojans of the terrestrial
planets: in the extreme case, a Venusian Trojan will have moved 1.6 deg in 24
hours and will be difficult to recover with common CCD cameras. It should be
easily recoverable, however, with wide-field cameras like OmegaCAM. For this
reason, a survey for very fast moving objects such as near-Earth asteroids and
terrestial Trojans will necessarily include follow-up time roughly 24 hrs after the
discovery observations.
Special requirement – Provide users access to the raw data within 24
hours within Chile
limits on the optical depth in very short-duration events, which do not require
follow-up per se. However, there are microlensing events all the time in each
field, and it is likely some of these will be useful to study in real time with
VLT (spectroscopically). In that case it is necessary to search for these events,
which requires to analyse ALL data of those 2 weeks in near-real time. The
programme could combine a microlensing search for brown dwarfs with a transit
search for hot jupiters in the same fields.
Solar system Objects: Open Time up to 2-3 nights/month with 60
frames/night.
As already indicated by the several SSO oriented use cases described in Section
2.1 there are a number of programmes which need a fast turn around time.
Although the interest for such programmes is great we have not assigned much
GT time to this and it is very difficult to estimate the usage or anticipate on
OPC allocations for this mode. One possible OT proposal relayed to us asks
for typically 5 nights/month for this mode for which roughly half of the data
require the 2-4 day cycle.
Two SSO programs that need fast follow-up:
(1) Search for Near-Earth asteroids: this has 2 levels of turn-around time. The
objects really nearby and not yet discovered need immediate follow-up obser-
vations, basically during the same night or within 1-2 nights after discovery.
Somewhat more distant objects objects in the asteroid belt require a turn -
around time of around two weeks.
The searches must be done in both cases on the whole data set. The exposures
will have 5-10 min integration time. The shorter the turn-around cycle time is
the better.
(2) Search for Kuiper Belt Objects and MBOSSes: a few epochs per object
need to be observed. Turn-around times up to the order of one month could
be allowed, but it is preferably done within one week; this also depends on
the survey method (one or two exposures per field) and how one combines the
survey with other scientific programmes. Typical exposure times for this search
will be 10-15 min with few images per field per night.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 30
3.1 Description
OmegaCAM is a wide field optical imager, featuring a 4 × 8 mosaic of 4k × 2k
pixels CCD’s for a total imaging area of 16k × 16k pixels. It will cover the
VST field of view of 1◦ × 1◦ and at the same time it will adequately sample
the best seeing foreseen at Paranal. The standard observing mode is with a
two-lens field corrector. In addition, a single lens plus atmospheric dispersion
corrector can be used.
The instrument features a two-blade photometric shutter. An exposure is
started by moving the blade that obscures the CCD’s to a rest position, and
finished by moving the other blade from its rest position to the position that
obscures the CCD’s.
The focal plane geometry of the CCD’s is given in section 3.2 and the Omega-
CAM filters are described in section 3.4.
gnetted field of the VST is 1.47 degrees, or 372mm in diameter. The planned
array with gaps fits in the field.
Fig 3.2 Sketch of layout of CCD arrays. Units of X and Y axes are in mm.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 33
3.4 Filters
The OmegaCAM filters are to be decided on jointly by the VST, OmegaCAM
consortium and ESO. ESO has set up a VST/OmegaCAM Instrument Science
Team (IST) for advise on such issues.
Discussions between VST and OmegaCAM have resulted in the following list of
filters:
• Broad band (6 filters)
Given the importance of the Sloan survey in the North, the rather large
width of g’ for stellar work, and the desireability to maintain small colour
terms with respect to the standard Johnson system for many applications,
the top priority broad band filter set is:
– 2 Johnson B, V
– 4 Sloan u’ g’ r’ i’
The broad-band filters will be monolithic. The narrow-band filters are seg-
mented, made up of two halves. A scheme where each half is made with a
different passband is under investigation. Half the array would then be illumi-
nated through one passband, half through the other. After a second exposure
with the camera rotated through 180 degrees, the whole field will have been
covered through both passbands, which can serve as each other’s off-band
image.
In addition a composite filter, comprising a u’, B, V, and i’ quadrant for rapidly
obtaining photometry measurements is envisioned. For details see section 5.6
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 34
Note that the f/5.5 beam is transfered to f/6 in front of the filters due to the
corrector optics.
Note that the fast beam makes it impossible to define truly rectangular filter
profiles. A relative wavelength spread of at least 0.4% is unavoidable. At
5000Å, for instance, this represents a 20Å broadening of any filter profile.
Thus, an O[III] filter with a FWHM of 50Å= 3000km/s, has a flat part of
40Å= 2400km/s. For Hα filter with FWHM 60Å= 2600km/s, only 46Å=
2000km/s is flat.
For this reason it is not useful to define rectangular filter transmissivity profiles
for the narrow-band filters. This may reduce the number of coatings, and hence
the cost, of the filters.
Mode– Dither N= will be operated with N pointings on the sky, with offsets
matching the maximum gap between arrays, i.e. ∼ 380 pixels (∼ 80 arcsec). In
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 37
Mode– Jitter N= will be normally operated with N=3-5 pointings, with quite
small offsets (∼ 5 pixels). Maximum N = 11. Mode– Jitter N= is optimized
for observations which require maximum homogeneity of the context map, and
for which the acquisition of information in the wide CCD gaps is not critical.
Mode– Jitter N= will have a minimum of discontinuous variations of the PSF
over the field of view; also all the data from a single sky pixel originate from a
single CCD chip.
Mode– Stare N= will have one fixed pointing position, but the same position
of the sky might be re-observed subsequently (N>1). Mode– Stare N= can
be used to take all kinds of snapshots or calibration frames, but will also be
the main workhorse for monitoring optical transients or fast moving objects.
Facilities for direct on-line comparison of single Mode– Stare N=2 frames
both for variable target monitoring and for instrument qualification monitoring
will be an important aspect of this mode.
Mode– Mosaic N= will facilitate surveys that aim to image areas of the sky
larger than 1◦ diameter, or which for any other reason want to combine data
from two adjacent partly overlapping fields. The prime characteristics of this
mode are:
– the coordination of the definition of a set of pointings on the sky - in the
OB planning
– the combination of the data from different fields into one data product
In principle, this mode should be handled by the de-dithering (=co-addition)
process, (this can be interpreted as a requirement on the co-addition code,
namely produce an output image which is the rectangle of the overlapping
area of several input images). If the co-addition (particularly the set of quality
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 38
control parameters) and the source extraction methods are handled correctly,
this mode will form a natural extension of the dither mode and does not require
additional developments. Maximum image size supported for this mode is TBD;
for mosaiced source lists the maximum covered sky area is unconstrained and
data volumes could well run into the Tbyte regime. It is not planned for the
standard DFS pipeline to produce mosaiced images.
Mode– SSO N= will support the data taking of Solar system objects with
a non-siderial tracking of the telescope. No-autoguiding is required for this
mode as in general the uncertainties of the predicted angular velocities of yet
to be discovered objects are larger than the expected jitter of the telescope
when the autoguiding is disabled. This mode resembles very much the Mode–
Stare N=, however the wanted quick (<24 hour) data reduction for many fast
moving targets implies that the DFS pipeline will not support the processing of
these data fully. However, for observations which require a slower response (4
times 24 hour or longer) or which only require de-biasing and flatfielding, the
standard pipeline can be configured to handle these data.
schedule
Strategy– Mosaı̈c maps areas of the sky larger than 1◦ , which is essentially
an item for the scheduling, as the pipeline has to produce uniform quality
data anyway. The combination of various field centers into one image is not
considered a standard pipeline task.
4.3 Filtering
OmegaCAM employs the following type of filters (see Section 3.4 for details):
- Broad-band filters (Johnson B,V and Sloan set)
- Intermediate band (e.g. Stromgren and deep sky filters 200A)
- narrow band ( e.g. O[III], Hα )
A set of keyfilters will be defined which will be used for the photometric cal-
ibration. These keybands will be used for monitoring the instrument and the
atmosphere at timescales from hours up to years. The keyfilters will be used
for standard, beginning of the night checks, the monitoring of the atmospheric
extinction and for a variety of trend analyses relating to the photometric cal-
ibration of the instrument. The photometric system of the instrument shall
be continuously maintained at these keybands. One composite keyfilter will
be available, which will contain in each quadrant a different passband, namely
the four different keybands. The composite filter will be extensively used for
quick checks, extinction measurements and other monitoring of the photometric
system.
The observing modes related to the photometric calibration (req.’s 5.6) will
employ the concept of keyfilters. The other filters (Userbands) will be cross
calibrated versus the keyfilters (see req.5.6.5). Monitoring of the atmospheric
extinction will be done with the keyfilters (req.562).
The 4 keyfilters are Sloan u’ and i’ and Johnson B and V.
on the requirements as set out in the present document. The observation modes
described in the previous section imply three basic OTs for science observations.
- TSF– OCM img obs dither
Observe with N pointings (default 5) in the sky, with offsets > maximum
gap between detectors (> 750 pixels) between exposures.
- TSF– OCM img obs jitter
Observe with N pointings (2-5) in the sky, with small offsets (≈ 5 pixels)
between exposures.
- TSF– OCM img obs stare
Observe N (default 1) exposures with one fixed pointing position.
For observations near Zenith the two-lens corrector will be preferred because of
its higher throughput. At larger zenith distance (value depends on wavelength),
the ADC will yield better imaging performance.
text contains various descriptions for both Template Signature Files (TSF’s)
which define the creation of the observation blocks (OB) and for the off-line
data analysis. Overall priorities have been defined (essential, very important,
desirable) and are specified under the item priority.
The chosen items for the descriptions of the requirements (req.’s) match well
to the items needed for the recipes for DFS data reductions. In section 6.1
complete listings of both the req. items and the recipe items are given. The
req.’s as listed in the Odoco will eventually evolve into the deliverable recipe’s.
The Odoco is designed to provide a comprehensive and accessible documenta-
tion system of the various activities that relate to the OmegaCAM calibrations.
It serves a variety of purposes, and facilitates the extraction of text from the
Odoco data base into complete documents. The Odoco can provide the follow-
ing documents:
1. A listing of the Baseline OmegaCAM Calibration Requirements. Odoco
contains an up-to-date listing of all the baseline requirements for the Omega-
CAM calibrations, i.e. for each requirement (req.) the text under the items:
Objective, When performed/frequency, Required accuracy, Priority.
See section 5 of the URD.
2. Full documentation of the OmegaCAM calibration plan. A detailed
description of all the OmegaCAM calibration requirements and their imple-
mentations. See Section 5 of the Calibration Plan. Summary sections (two
digit sections) have been introduced for a variety of calibration activities:
e.g. detector specific calibrations, photometric calibrations etc. A general
overview of the OmegaCAM calibrations can be obtained by printing the
summary sections of the Odoco. In order to further ease the readability of
this document, both each requirement and each calibration analysis proce-
dure text item begins with a ’one-liner’ stating the overall idea.
3. A description of the Template Signature File necessary to produce
observation blocks, TSF’s. When a requirement can not be fulfilled by
means of data analysis of observations made for another requirement, Odoco
contains a detailed description of the instrument configuration and proce-
dures under the items Sources, observations and TSF, (TSF, Template
Signature File). Note, the term selfstanding has an important meaning:
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 43
As Odoco can provide various documents with a different filtering of the source
of information, each printout contains a table, listing the selection criteria.
Also, the status of the printout is marked (formal issue, or private workcopy).
Each printout contains this section.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 44
5.5 Astrometric
5.5.1 Focal plane position of camera CalFile– 551
5.5.2 Telescope Pointing
5.5.3 Telescope and rotator tracking
5.5.4 PSF anisotropy CalFile– 554
5.5.5 The astrometric solution - doit SeqFile– 634(CR)
5.5.6 Astrometry - Guide CCD’s CalFile– 556
5.6 Photometric
5.6.1 Shutter timing
5.6.2 Photometric monitoring CalFile– 562(uBVi)
5.6.3 Zeropoint key bands doit CalFile– 563Z,I
5.6.4 Zeropoint user bands CalFile– 564
5.6.5 Filter band pass - user− >key CalFile– 565
5.6.6 Rotation angle - ADC, rotator
5.6.7 Linearity
5.6.8 Detection limit
5.6.9 Secondary standards CalFile– 569
5.7 Alignment
5.7.1 Camera focus/tilt
5.7.2 Ghosts - ADC
5.8 Telescope
5.9 End to end tests
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 48
Pairs of zero-second bias exposures are used. The rms scatter √ of the dif-
ferences between two exposures is computed and divided by 2. Monitor
variations with trend analysis. This is the first order daily health check.
When performed/frequency:
daytime- Commissioning, during all operations: daily health check.
Required accuracy, constraints:
Readout noise less than 5e− .
Variation in readout noise w.r.t. previous readout noise less than 0.5e− .
These are lab values. The corresponding limits in ADU can be calculated
using the e− /ADU conversion factor from req.523.
Priority:
essential
5.2.2 Req. — Hot pixels
Objective:
Determine CCD bad/hot pixels.
5σ outliers in the master bias frame are bad-hot pixels. These pixels should be
recorded and ignored (assigned a weight of 0) in dedithering and dejittering.
For this purpose the bad/hot pixel map is used to assign a weight of zero to
the affected pixels in the weight map (req.546). The search for hot pixels
would also identify traps.
When performed/frequency:
daytime- Commissioning, in RP twice per week.
Required accuracy, constraints:
Number of hot pixels to be determined by experience/lab values. The total
number of bad pixels (hot pixels + cold pixels) is less than 80000. Difference
in number of hot pixels w.r.t. the previous version, less than 100.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 50
Priority:
essential
5.2.3 Req. — CCD gain
Objective:
Determine CCD gain and variation with time
Determine the conversion factor between the signal in ADU’s supplied by the
readout electronics and the detected number of photons (in units e− /ADU)
and monitor variations in time.
The gain factors are needed to convert ADU’s in raw bias-corrected frames
to the number of electrons, i.e. detected photons.
Take two series of 20 dome flatfield exposures with wide range of exposure
times. Derive the rms of the differences of two exposures taken with sim-
ilar exposure (integration time). Exposure differences of pairs should not
exceed 4%. The regression of the square of these values with the mean
level yields the conversion factor in e− /ADU (assuming noise dominated by
photon shot noise). Compare with previous measurements, as a qualification
(trend analyis).
When performed/frequency:
daytime- Commissioning, in RP once week.
Required accuracy, constraints:
Accuracy: In units of e− /ADU, from lab values or found empirically. Trend
analysis better than 1%. On-site quality check.
Quality check: Difference with previous version less than 10%.
Priority:
essential
5.2.4 Req. — Electromagnetic Compatibility
Objective:
Verify whether any external source (e.g. dome drives, control systems) is not
interfering in the CCD overall detector system, leading to additional, mostly
non-white noise.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 51
Technical specifications require less than 20% effect on read-out noise, for ex-
ternal interference and less than 10% effect on read-noise for internal Omega-
CAM interference.
If electronic interference occurs then this will put constraints on the operation
of the instrument. For example, if interference occurs during movement of
the telescope, one cannot read the CCDs and move the telescope at the
same time,.
Interference is detected by measuring the read noise (req.521) under opera-
tional conditions. This means doing bias measurements while the telescope
and/or dome are moving.
When performed/frequency:
Day time; Commissioning; once a year; every time a major system change
has been made; To be determined by experience
Required accuracy, constraints:
Difference between read noise under operational conditions and the standard
read noise measurement should be smaller than 20% for external and 10%
for internal causes of interference.
Priority:
essential
5.2.5 Req. — Electrical cross talk
Objective:
Although crosstalk is not detectable in the WFI, and only one part per CCD
is used, the sharing of one FIERA by 16 CCD’s opens up the possibility of
cross talk.
Observe a bright (mag 5-8) star at 16 different chips (1 FIERRA serves 16
chips).
When performed/frequency:
Nighttime Commissioning.
Required accuracy, constraints:
10−5
Priority:
desirable
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 52
When performed/frequency:
Commissioning and when dark current is measured.
Required accuracy, constraints:
better than 1 ADU/cm2 /hour
Priority:
desirable
5.3.3 Req. — CCD Linearity
Objective:
Characterize the linearity of the system over the full dynamic range of the
A/D converter.
Both the overall absolute linearity of the system and the pixel-to-pixel vari-
ation in linearity are of interest.
The overall linearity of the system can be obtained by measuring the counts
as a function of exposure time for a series of dome flats. The data to use
for this can be the same as for the measurement of the Gain (req.523, q.v.)
The pixel-to-pixel variation in the linearity is obtained by dividing a flatfield
with a mean exposure level of more than 30000 ADU by a flatfield with an
exposure level of less than 1000 ADU. Pixels that deviate more than 5σ from
the mean, in this divided image, have an anomalously high nonlinearity. This
map of nonlinear pixels may be used in conjunction with the hot and cold
pixel maps to produce a map of bad pixels.
In addition, during a cloudy night, once per year, the linearity will be checked
by taking various exposures with a variety of exposure times on the dome
screen.
When performed/frequency:
daytime- Commissioning, in RP once per month, dark dome test once/year
Required accuracy, constraints:
better than 1% on the photometric scale
Priority:
essential
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 54
The calibration lamp system contains two sets of 4 commercial 12-24V halo-
gen lamps each. Each set is operated independently. Each set is stabilized
in current supply (one unit for whole set). Lamps are switched on/off with a
gradual increase/decrease of the current over a timespan of 3-5 minutes. Im-
plementation TBC. When operated this way, the nominal lamp instabilities are
expected to be of the order of 0.05%/hour for a timespan of 200 hours of lamp
operations (private comm. Philips Labs). For a nominal 1-2 hour/day of oper-
ations the lamp instability is expected to be of the order 1.5-3 % per month.
The lamp instabilities are expected to be strictly linear after 100 hours of oper-
ations. When operating two sets at different rates, say one set 1 hour/day the
other set at say 1 hour/two weeks a full characterization of the lamp stability
can be achieved at accuracies better than a few percent on a monthly basis.
Also continuity after failiure of one lamp can be obtained. The accuracy is
better than required as also other factors, like dust on the lamps and back-
ground light will affect the effective illumination of the screen. Altogether, the
system is expected to provide control over the illumination of the screen with
an accuracy better than 5-10%, which will be used for a daily health check
on the overal throughput/health of the detectors (req. 547 Quick detector
responsivity and health check). This activity provides a deliberate redundancy
with flatfield measurements on the dome screen (req. 542 Flat field – dome
key bands–doit), in order to provide the necessary cross-check in the off-line
calibration analysis procedures. Next to the health checks taken during the
night, a standard health check using a photometric standard field (also provid-
ing the absolute photometry is specified in req. 562 Photometric Calibration
– Monitoring). The system of lamps, flatfields measurements, quick checks
using the lamps and health checks on the sky on photometric standard fields is
designed to support the photometric calibration of a Survey System, for many
years to come. The system provides redundancy faciltating cross-checks and
has a typical maintenance/update frequency once/month.
The calibration of science data can be divided in three steps.
1 Removing the effects of bias and differential gain.
2 Relating the overall gain, and hence counts S(x, y) to a photometric scale
3 Relating the x, y coordinates to an astrometric reference system.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 57
The raw science and standard images record S(x, y) counts in pixel x, y, that
are related to the incident photon flux I(x, y, λ) by:
R
S(x, y) = b(x, y) + G g(x, y, λ)I(x, y, λ)dλ,
with G the ADU conversion factor, g(x, y, λ) the quantum efficiency or gain
as function of position and wavelength, and b(x, y) the bias offset.
The photometric and astrometric calibration (steps 2 and 3) are the subject of
Sections 5.5 and 5.6, respectively. Here we list the calibration data necessary to
remove the effects of bias and gain variation over the image. These calibration
data include:
• Bias to subtract residual pattern in the bias offset.
• Flatfields to correct for non-uniform gain.
• Fringe maps to remove the fringe-patterns
• Weight maps to determine the relative contribution of each pixel when
image data are combined,
A first-order approximation of the bias level in an image is provided by the
median of the overscan region. A more accurate determination of the bias
offset takes into account the following two effects: i) the bias level grows to
its asymptotic level in the first few hundred lines, and ii) the bias level depends
on the total signal in a given line. Therefore, an initial bias correction—the
overscan correction, is applied by averaging the overscan pixels for each line,
and subtracting this value from that line. Also, experience with the WFI has
shown the presence of residual patterns in the bias offset over the image area.
Under the assumption that these patterns are also present in OmegaCAM data
its characterization by means of a master bias frame is specified in req.541.
The gain, g(x, y, λ), incorporates the wavelength-dependent pixel-to-pixel vari-
ation in transmissivity of the different lightpaths through the telescope optics,
filters and detectors. The gain can be approximated with
g(x, y, λ) = gDQE (λ)gf f (x, y),
with gf f (x, y) the pixel-to-pixel variation in the gain, and gDQE (λ) the over-
all detector quantum efficiency (zeropoint), at gf f = 1, which is subject to
photometric calibration (Section 5.5).
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 58
As the readout noise dominates the rms scatter in the bias frames, while
the shotnoise of the sky background dominates the rms scatter on the sky
images, which is nominally much larger than the readout noise, it is sufficient
to characterize
√ the bias value at individual pixels with an accuracy of (readout
noise/ 10).
A comparison with a previous master bias frame will be done as an evaluation
of the overall health of the instrument and the quality of the data. This will
thus measure short-term variations. Long term variations can be assessed
using trend analysis.
A comparison of the mean level with laboratory values will be used as an
overall quality check.
When performed/frequency:
daytime- Commissioning, in RP initially daily. Later the frequency is to be
determined by experience.
Required accuracy, constraints:
The required
√ accuracy per pixel in the master bias frame is “nominal read-
outnoise/ 10”.
For the quality check: Deviation of the mean level of master bias (bias level)
from lab values < 10%.
Priority:
essential
5.4.2 Req. — Flat-field - dome key bands + user bands - doit
Objective:
Determine master dome flat frame for both Keybands and Userbands.
During the lifetime of OmegaCAM the dome flatfields shall be measured for
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 62
Priority:
essential
5.4.3 Req. — Flat-field - twilight
Objective:
Determine master twilightflat frame, using observations of the twilight sky.
Twilightflat observations will be attempted for each passband that is ob-
served during that night. If insufficient twilight time is available then the
twilightflat observations are taken preferably in the previous or subsequent
night. In addition twilightflats of the 4 keybands will be taken at least once
a week.
In order to minimize the spatial gradient in the sky brightness, the observa-
tions need to be made on the solar circle, i.e. the great circle through the
zenith and the sun’s position, at a zenith distance of about 20◦ in the solar
antidirection. Preferably, the field of view does not include stars brighter
than TBD magnitude.
When performed/frequency:
Evening and morning twilight.
An attempt will be made to observe twilightflats for all bands observed during
the night. For all observed bands, twilightflats will be observed within a
maximum of 2 nights. In addition, twilightflats for the keybands will be
obtained at least once a week, irrespective of whether keybands were used
for science observations during that week.
Required accuracy, constraints:
Mean levels should be approximately 20000 ADU.
Priority:
essential
5.4.4 Req. — Flat-field - night sky
Objective:
Create Night Sky flat frame.
The flatfield that most closely reproduces the actual gain variation of the sci-
ence and standard observation, can be obtained by averaging a large number
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 64
tinguished from sources. The image itself can, therefore, not be used to
determine the background. However, given the fact that most observations
are taken in jitter or dither mode, the information of several images can be
combined to determine a background. This average should include enough
observations to properly exclude contamination from sources, and, because
the standard jitter/dither patterns only include 5 pointings, one background
computation per jitter/dither is probably not sufficiently accurate. On the
other hand, because the fringing pattern varies with time and telescope po-
sition, a straight mean (the supersky) over an entire nights worth of data is
also not usable.
A suitable strategy to construct a fringed background image, usable for sub-
traction, thereby removing the fringe pattern, remains to be determined. If
the fringe pattern is stable over the night, a decomposition of the night-sky
flat in an additive and multiplicative term is feasable. The assumption that
the high-frequency spatial component in the night-sky flat are fringes, while
the lowest frequency components represent gain variations has been used
with reasonable success.
When performed/frequency:
Commissioning and when long wave science frames are taken.
Priority:
very important
5.4.6 Req. — Flat-field - master flat and weight map
Objective:
Determine the master flatfield, to be used to correct for the pixel-to-pixel
gain variation from the raw image data. Also use this flatfield to create a
master weight map, to be used when co-adding image data.
Four different measures of the variation in the gain are available: the dome
flat (req.542), the twilight flat (req.543), the night-sky flat (req.544) and
the illumination correction (req.548). A suitable choice of the final master
flatfield, based on a combination of one or more of these flatfields, and,
optionally, the illumination correction will
A method whereby the dome flat is used to measure the pixel-to-pixel (small-
scale) variation, and either the twilight or night-sky flat is used to measure
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 66
The equivalent of this req. on the sky is provided by req. 562 Photometric
Calibration - Monitoring
When performed/frequency:
Commissioning, daytime, every day of operations both during CP and RP.
Required accuracy, constraints:
1%
Priority:
very important
5.4.8 Req. — Illumination correction
Objective:
Characterize the illumination correction.
The zeropoint is determined individually for each CCD in req.563. The
gain variation over individual chips is characterized by the twighlight and
sky flatfields (req.533 and req.534) under the assumption of an ideal flat
illumination over the field of view. In practice this ideal flat illumination
can be affected by stray light (sky concentration) and the flatfield has to be
corrected for this.
An initial verification that this effect is indeed present will be obtained when
constructin g catalogues of secondary standards (req.569). In case it is
found to have an amplitude over a single chip larger than 1% the effect has
to be characterized by measurements of a standard field. The master flatfield
(req.546) will apply this information when needed.
When performed/frequency:
Verification of effect during commissioning. Measurement, during RP, once/month
Required accuracy, constraints:
better than 1% for the amplitude over a single CCD.
Priority:
essential
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 68
the flexure of the telecope and its instrument. The latter items need to be
determined for each pointing separately. This method can be robust and has
less degrees of freedom facilitating accurate astrometry with a small amount
of data points. It is, however, tightly fixed to the instrumental geometry. A
geometric model must be obtained and associated parameter values must be
determined before standard astrometric reduction can be done.
Both methods will make use of an astrometric reference catalog. Current
catalogs have positional accuracies that are not extremely high on the scale of
the field of view of OmegaCAM. To achieve higher positional accuracy within
a given pointing set and to allow accurate co-addition without degrading the
PSF the astrometric solution will make use of the overlap among the pointing
set.
The methods can be applied both to the main camera CCD chips and to the
guide CCDs, as the latter can be viewed as a auxiliary CCDs of the main camera.
The requirements outlined here determine the calibration data necessary to
perform an astrometric solution using prior knowledge of instrument specific
characteristics.
The algorithm for the derivation of the astrometric solution is detailed in Section
7.3, while its use is detailed in seq.– 634.
5.5.1 Req. — Position of Camera in focal plane
Objective:
Determine the position of the chips with respect to the rotator axis of the
telescope. This is part of the static astrometric calibration of the camera. It
involves the determination of the chip position, scale, and orientation with
respect to a perfect pixel plane. This has to be done with the ADC in and
out.
This procedure produces the astrometric pre-solution. In fact, the expected
pointing and other a-priori positional offsets are expected to be small; hence
the standard astrometric solution can already be obtained without a pre-
solution. However, a first inspection and verification of the pre-solution is a
task to initialize the system.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 70
When performed/frequency:
Each mechanical change of the camera. Each user supplied filter, once a
year.
Required accuracy, constraints:
Internal precision: 0.3 pixel. External precision limited by reference catalog
Priority:
Desirable
5.5.2 Req. — Telescope Pointing and offsetting
Objective:
Verify the pointing and the offsetting of the telescope for both optical con-
figurations (ADC in and out).
The pointing model is provided independent of the OmegaCAM S/W, but a
verification of both the pointing and the offsetting accuracy is required.
Perform on-site spot checks of the pointing model. The data from the Guider
CCD can be used for this.
Also in the data reduction pipeline, as a standard check in the astrometric
solution, the pointing error is determined.
When performed/frequency:
Commissioning, after each change of the pointing model, and to be deter-
mined by experience.
Required accuracy, constraints:
1 arc second
Priority:
Very important
5.5.3 Req. — Telescope and Field Rotator tracking
Objective:
Verify that the rotator performs properly and simultaneously that the tele-
scope is tracking correctly.
Up to Zenith distances of 60 degrees and wind speed of 18 m/s with a
dynamical component of 30%, the free tracking of the telescope shall be
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 71
better than 0.2 arcsec rms. With closed-loop autoguiding, the rms deviation
shall not exceed 0.05 arcsec
Two methods will fulfill this requirement.
First, check at various telescope positions the global performance of the
rotator plate which is driven by the pointing model. When the rotator plate
is not performing optimal, the objects are elongated in a circular pattern
(concentric rings) with the rotator plate axis at the center. This inspection
is closely related to the determination of the point spread function.
Second, check for the tracking of the telescope to find functional dependency
with telescope position. This is purely a verification. As an internal check,
do this for each OmegaCAM observing mode. Similar to the rotator plate
inspection the point spread function is used as the measuring tool. When
the telescope is not tracking correctly the shapes of stellar objects are sys-
tematically elongated. The amount of elongation may not exceed a certain
value, corresponding to the basic tracking requirements given above.
These two functional checks are merged into one analysis as they essentially
use the same technique for verification and because they are coupled. Non-
conform tracking can cause non-conform rotation.
The offset information from the Guider CCD’s is another element in the
functional check. When offsets for guide stars are becoming too large, rotator
plate errors or telescope tracking errors are apparent as different patterns of
offsets during an exposure time.
When performed/frequency:
Commissioning, at each change of the pointing model, in RP to be deter-
mined by experience. In CP check once with the ADC in and out.
Required accuracy, constraints:
First method: 1 arcsecond in the dependencies. Second method 0.1 pixel
dimension or 0.1 FWHM
Priority:
very important
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 72
Iobs,X = ge (0)ge (t)gsel.e (X)×gdqe (0, N, X)gdqe (t, N, X)×gf f (week, N, X)×Iref,X
Colour term:
The primary standard stars have been measured with presumably the same filter
passbands, but with CCD detectors which have a different relative spectral
responsivity. This implies that the effective gDQE (0, N, X) when observing
these primary stars depends on the colour of these stars: gDQE (0, N, X, X −x).
The photometric calibration involves the solution of the general equation above
along a different path, with different unknowns, and different knowns.
The initialization of photometric calibration is to carefully process backwards
and forwards through the basic equation. Particularly the settling of the sec-
ondary standards, which cover a larger field of view than the primary standards
is tricky. On one hand the preparatory programme will provide this informa-
tion, on the other hand OmegaCAM calibrations can self-calibrate the secondary
standards, which has the advantage that it avoids the extra bootstrapping via
another telescope and detector system.
Normalizations:
gf f (week, N ) unity at central pixel of each chip N
ge (0) and ge (t) multiplication factor of standard extinction curve represented
by gsel.e (X)
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 76
5.6.3 Zeropoint u’ B V i’ u’ V
Eq. 1 (❈) ❈ ❈ ❈
B i’
Eq. 2 ❈ ❈
per chip!
zeropoint
Eq. 3 ❈ ❈
Eq. 8 ❈ ❈
Eq. 8 ❁
υυυ
i j k υ ?
❁
5.4.2 Flat−field u’ B V i’ u’ V
B i’
Dome ❈ ❈ ❈ ❈
υυυ
i j k υ ?
❁
lamp
shutter blade movement directions. Illumination level shall be such that the
CCD’s are at about 60% to 80% full well for the 10 sec exposure. Exposure
times will have to be evaluated during Commissioning.
When performed/frequency:
Commissioning, once per 3 month, further to determined by experience.
Daytime
Required accuracy, constraints:
Timing error less than 0.2%.
Priority:
desirable
5.6.2 Req. — Photometric Calibration - monitoring
Objective:
Monitor any short term variability related to the transparency of the at-
mosphere (atmospheric extinction) or due to instrumental instabilities (e.g.
effective DQE) with a minimum sampling of at least 3 times/night. This
provides a daily overall health check of the instrument and detectors. A
further trend analysis has to provide information on long term stability.
The variation (r.m.s.) of the flux detected by the autoguider shall also be
used as an indicator (put in the FITS header) of the sky conditions. This is
to be done for each science observation.
This monitoring is done on a standard polar field, which will be repeatedly
observed at the beginning, middle and end of the night with the compos-
ite key filter (u’, B, V and i’ band), irrespective of the passbands used for
the science observations. The observations are done in the standard config-
uration, with the two-lens corrector. A direct comparison of the measured
intensity of the stars with reference values is used to qualify the overal condi-
tions of instrument and atmosphere, the actual zeropoint (both unit airmass
extinction and instrument DQE) being determined by req.563. The com-
posite filter will provide simultaneous measurements of the sky brightness in
these bands, thus providing an accurate spectrum with a spectral resolution
R of roughly 5.
The comparison of the observed signal with the expected signal from stan-
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 79
dard stars in each of the four quadrants will lead to the determination of
the product of the atmospheric extinction (= ge (0) × ge (t) × gst.e (X), (with
gst.e (X) the gain of the standard extinction curve at passband X ) and the
overall effective DQE (gDQE ) of the detector system including the optics.
As req.563 solves both gDQE and gst.e (X) × ge (0), a comparison with these
measures gives ge (t), the variation of the overall gain during the night. The
thus derived values of ge (t) at t = beginning, middle and end of the night
(could be more if the observer so wishes) provides the required monitoring.
Excursions from the standard extinction curve, due to extraordinary meteo-
rological conditions, can be traced by computing the standard deviation of
observed minus standard curve values in the various bands.
The sky spectrum shall be derived on line from the data, as a quality check on
the health of the instrument and the clearness of the atmosphere, as clouds
or cirrus will be immediately notable in the spectral shape. A reference table
containing the expected sky brightness (and thus colour) as function of lunar
phase will be used in the evaluation of the data.
The repetitive measurements on the same field, with the same filter will also
be used in trend analysis to monitor the overall long term stability of the
instrumentation and atmosphere. The redundancy of these measurements
with req. 563 zeropoint and req. 542 Flat field -dome will be used as a
cross-check on the validity of the photometric system.
In addition, the repetitive nature of these observations, make them ideally
suited for the health check as specified in requirement 3.7.3.4 of the Technical
Specification. In order to facilitate rapid analysis at Paranal an additional fast
analysis recipe is proposed, based on a predefined catalog of standard objects
in each CCD. This recipe assumes that the pointing accuracy, achieved when
guiding, is better than 6 arcsec. The recipe identifies regions of interest in
each CCD for each object in the input catalog. These regions are then
extracted after which a simple moment analysis of the brightest object in
the region will determine total flux in ADU, position and FWHM for each
object of interest, as well as the background flux in ADU.
Fulfilling or fulfilled by:
Selfstanding; a corresponding requirement on detector level is
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 80
This list appears rather complete and no additional requirements are specified.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 87
The following end-to-end tests (i.e. observational data which employ many
different aspects of the system and which can be used to trace reproducibility)
have been specified:
The second list gives the requirements for which on-site analysis is desir-
able/most practical (listed in order of priority). On-site, these activities will
output go/no-go flags.
In the lists above the req.’s which produce a CalFile– are marked with a *.
These req.’s have also to be processed off-line at ESO HQ (e.g. DFS pipeline,
DFS operations, calibration pipeline, QC1, Quality control, trendanalysis).
DFS-pipeline modules, extracted from the off-line ESO HQ version, (including
thosee used for calibration pipeline and QC1) could fulfill these task on-site
with relative limited extra effort. Such modules will run with a stripped Calfile-
date base As a desirable side effect, this creates the possibility to also quickly
verify any other req.’s with extracted DFS-pipeline modules in the case of
un-expected events.
The filling of the calibration database (CalFile– )should however be exclusively
handled by the off-line pipeline at HQ.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 89
Seq631- Initialisation
ESO-Archive
Sybase Seq632- bias + flat f
raw science data Seq633- weights
20-30 Tb/yr
Seq634- astrometry
Seq635- photometry 1 Tb/yr
SeqFile 631 632 633 634 635 636
Seq636- Co-addition only descriptors
calibrated /co-added image
MD
15 Tb/yr ESO - D
MD
ESO - D A CENT
ERS
/ DAT
USERS
Source extraction Source lists
TERS
/ DATA CEN 3-5 Tb/yr
USERS
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 90
• Support for a Quality Control System The consortium will provide the
necessary routines/procedures, as components of the DFS pipeline infras-
tructure, but not for QC0 which is generic for all VLT compliant instruments
and which will be provided by ESO. The integration of the quality control
routines will be done under ESO responsibility. The execution of quality
control will be done on at least two ‘platforms’ within the context of the
DFS. Currently, the DFS infrastructure does not support the storage of QC
parameters, neither its trend analysis. It is highly desirable to improve upon
this situation.
with expected values. These checks include: i) check that global illumi-
nation (median) is within a range expected for that observation (seq.–
631 ), and ii) check that image quality (PSF) is consistent with seeing
(to detect tracking problems, for instance, seq.– 633)
- post-calib off-line quality check of CalFile– .
The CalFile– produced by the calibration pipeline should be checked for
validity as specified in the req.s before being put into the Calibration
data base, thus securing that only valid CalFile– sare used by the image
pipeline. Trend analysis will be the main tool for monitoring the validity
of CalFile– s.Trend analysis is run outside the pipeline. It is used as a
tool to monitor the behaviour of the instrument. The results of trend
analyis are not used to interpolate entries in the db to be fed back to
the pipeline.
- post-image off-line quality check of reduced science data.
The final characterization of the quality of the reduced science data
includes the following items.
- Validity of the processing operations.
- Quality of the processed data (sensitivity and resolution)
- Photometric check (consistency between different CCDs)
By comparing the quality of the processed data, with the quality of the
input data, the validity of the processing steps can be assessed. By
comparing the quality of the processed data with the expectations as
determined by the ETC and seeing-statistics, overall performance of the
instrument and ambient observing conditions can be determined.
Example: a powerful check on the astrometry, seeing, image quality,
tracking rotator, tracking alt-az, co-addition is given in seq.– 636 which
for Mode– dither N=and Mode– jitter N=compares the PSF over the
FOV between the input and output images.
II The image pipeline applies the calfiles to raw science data, to produce
astrometrically and photometrically calibrated science data. The image
pipeline is designed to operate as much as possible as a single process
(in spite of its many sub-processes, as a black box, with a minimum
of storage of intermediate results in order to constrain the OmegaCAM
data storage requirements within acceptable volumes, and to further fa-
cilitate parallel processing on external platforms with a minimum of in-
terdependence). The sequential steps of the image pipeline are specified
in Section 6.3 and are named seq.– and involve:
- Image arithmetic (de-bias, flat field)
- Cosmic ray and bad pixels correction
- Image statistics
- Astrometric solutions
- Image combination (co-addition)
- Flux calibration
The integration of the pipeline will be done under ESO responsibility.
Part of the Data Reduction Software is a set of instrument sample data and cal-
ibration data to be processed as representative cases. Results of the processing
of such data in a test environment will also be delivered.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 95
Coding standards:
The software developments shall be made in ANSI C, according to programming
conventions, data structures, and low-level functionalities provided by ESO. A
list will be established further (low-level) ESO-provided functionalities.
The complete description of a recipe includes:
1. Definition
2. General description
2.1 Context of utilisation
2.2 Observing procedure
2.3 Calibration data
2.4 Resulting data format
2.5 Expected pre-processing, post-processing
2.6 Pipeline calibration
3. Mathematical description
3.1 Mathematical justification
3.2 Error propagation/evaluation
3.3 Articles publication
4. Pseudo-code
5. Validation
Of course, this only applies for ”complex” recipes, there is no need to produce
a so detailed algorithmic description for trivial tasks.
As examples of high-level algorithm description, the calibration and operation plans for already
existing VLT instruments are a good reference. The instrument scientist tried in each case to
describe the process to apply to both calibration and observation data, to produce acceptable
and useful pipeline products.
The recipe description above matches well to the more formal Odoco format
employed here for the subsequent documentation of both the basic require-
ments, the implementation and data analysis of req.’s. The present set of all
Odoco items reads:
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 96
Title
Objective oneliner + description
Fulfilling or fulfilled by when selfstanding there is a TSF
When performed/frequency
Sources, observations, instrument configurations
Inputs dependencies CalFile– ,pre-processing
Outputs CalFile– ,post-processing
Required accuracy, constraints
Estimated time needed both for observing and data reduction
Priority desirable, very important, essential
TSF - name
Recipe - name
CA description of calibration analysis (also mathematical, error propagation)
Needed Functionalities
CAP implementation of calibration analysis (or pseudo code)
Status of Req. management tool
FLAG management tool
A good example of algorithmic documentation is given in the document: ”Infrared jitter imaging
data reduction algorithms”
http://www.eso.org/projects/dfs/papers/jitter99/
The coding standards and recommendations followed by ESO and external
consortia is a set of rules issued by the C programming community. It can be
found on the Web from:
Recommended C Style and Coding Standards
http://www.apocalypse.org/pub/u/paul/docs/cstyle/cstyle.htm
The pipeline software shall be exportable to POSIX-compliant systems. In the
case of OmegaCAM, because the target platform is based on Linux (Beowulf
clusters), this requirement could be narrowed down to: the software shall be
running on Linux workstations. However, making POSIX-compliant software in
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 97
general and not attaching the software to any system’s specifics is a good idea
to preserve portability in the future.
On-line documentation for this software shall be in HTML format.
Additional documents:
[2] Recommended C Style and Coding Standards see URL above.
[3] ”ISAAC calibration plan” by PA Duc and JG Cuby VLT-PLA-ESO-14100-
1384
[4] ”Infrared jitter imaging data reduction algorithms” see URL above.
The standard software needed to execute the pipeline consists of the following
packages:
- FITS data reduction–eclipse, LDACtools, cfitsio.
- Source extraction–Sextractor.
- Astrometry–LDACtools.
- Co-addition–SWARP.
The consortium will support and maintain the LDACtools. eclipse is a package
maintained by ESO. All other packages are in common use. These packages
provide for all computationally expensive operations to be performed on the
data. All these packages are written in C.
To integrate this set of sophisticated data reduction and analysis tools, the
consortium currently uses the Python scripting language. This language pro-
vides a high level easy-to-maintain glue. All recipes and procedures are written
using this language as a layer on top of the aforementioned packages, provid-
ing transparent, common interfaces to these diverse packages. Prototypes of
the recipes will be delivered to ESO using Python. It is recognized that final
delivery may require recoding these in C.
The consortium prepares for a scripting of the pipeline modules offering all
required functionalities with a generic database interface. To this interface
functional programming (files) or object oriented (objects) databases could be
attached. These modules can be integrated by ESO in its DFS environment,
without using these interfaces.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 98
Internally, the Consortium uses CVS for its versioning control of code, recipe’s,
dictionaries and documentation and it considers to use Objectivity for storing
and distributing all calibration and source-list data.
An Interface document specifying all data items to be forwarded by ESO to the
Consortium is planned for (FDR).
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 99
ABSOLUTE MAXIMUM
- Crowded fields
- 0.5 arcsec seeing
- reliable source decomposition on 2.5 arcsec scale
576 sources per square arcmin
23 times more than the nominal example → 184 - 276 Mbyte /field
10h night (20 -30 CO-ADDED fields) → 3.7 - 8.3 Gbyte/night
(when not using co-added frames factor 5 more)
So, a run of 10 nights on crowded field can result in 10 x 8.3 x 5 = 0.4 Tb of
source data on non co-added frames
few observing runs end up in Tb regime
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 101
the DFS pipeline, the recipes for the individual seq’s are to be combined into
one recipe for each Observing template (so-called superscripts). An overview
of the data flow within a recipe is given in Fig. 6.3.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 103
Ingest,
images statistics, Raw
Archive validation science data
seq631
Cal 541
Bias
de-Bias and flatfield
Reduced
Cal 546 science data
seq632
Flatfield
Cal 523
ADU conv.
Make individual
weights Reduced
Cal 546W weights
seq633
Weight
Dedithered
science data
Coadd science data
Dedithered
seq636
weights
Dedithered
context
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 104
The recipe Science Stare differs from the recipes Science Jitter and Science Dither
in that the co-addition step (seq.– 636)is not included. Furthermore, Sci-
ence Dither produces one co-added image combining data from all chips, while
Science Jitter produces one co-added image per chip.
Operations seq.– 632-seq.– 635 are performed on individual chips. The format
of the raw data will be one FITS file per observation including the data for 32
chips in 32 extensions. seq.– 631 separates these raw data in FITS files for
individual chips. Only in seq.– 636 the data from individual chips are combined.
Note that seq.– 631-seq.– 636 can also be used within various recipes for the
calibration pipeline.
Clearly, the image pipeline will determine parameter values which are specific
for individual raw data frames or their 32 CCD frames, and these could be
viewed as transient calibration data. Most of this transient calibration data
is uninteresting or could be easily re-constructed, while other data have per-
sistent scientific value (such as seeing, PSF, astrometric solution, zeropoint,
sky-brightness, etc.), while other data have potential, but unspecified, value
for trend analysis or trouble-shooting. Output files of the image pipeline (flat-
fielded data, astronomically calibrated data, individual weight maps, etc.) are
called SeqFile– ’s, e.g. SeqFile– 633 individual weight map. The image data
recorded in a SeqFile– may be discarded when the data is no longer needed.
Care has been taken to propagate intermediate information from the headers of
the SeqFile– ’s to header of the pipeline product, whenever appropriate. The
ESO-DMD - OmegaCAM Interface control document discusses in more detail
the requirements for maintaining this intermediate informaation.
Both the image pipeline and the calibration pipeline shall obey the accuracies
and errors as listed in Section 5. Propagation of errors shall be computed,
where applicable.
ID VST-SPE-OCM-23100-3050
NOVA - Kapteyn Institute OmegaCAM
Issue VERSION 1.1
Date 29 Oct 2001
USM – OaPd URD
Page 105