Internal Calibration Accuracy
An Analysis of 2MASS Internal Photometric Calibration Accuracy and Comparative Accuracy of Night Zero Point Offset Algorithms




Executive Summary

The 2MASS Calibration Scan data have been used to investigate the internal accuracy of 2MASS photometric calibration with four different nightly zero point offset determination algorithms. The method employed was to consider each calibration field in turn as a test particle and to rederive the nightly zero point offsets excluding the test-field. The test-field observations were then recalibrated using the new nightly calibration fits, and the residuals between the true photometric offsets for the field and the new fits were evaluated. The four algorithms used to fit the new nightly zero point offsets were: 1) constant, 2) linear with time, 3) quadratic with time, and 4) piecewise.

Examination of the residuals for all of calibration fields used in turn indicate the minimum net residuals are achieved using the piecewise fit for the J-band, and the constant fit for H-band and Ks-band.

The overal RMS of the distribution of residuals for all calibration fields provides a measure of the net calibration accuracy for the survey. Using the optimal fitting algorithms described above, the net residuals in the J, H and Ks bands are 0.017, 0.015 and 0.012 mags, respectively.

I. Introduction

Because each 2MASS calibration field was observed between several hundred and several thousand times during the survey, we can use the calibration field measurements themselves as "test-particles" to examine the net calibration accuracy for the survey. We can also investigate different algorithms for determining the best functional form for the nightly zero point offset fits.

Photometric calibration for 2MASS survey observations is accomplished using hourly observations (bi-hourly early in the survey) of one of 35 calibration fields that are distributed along the celestial equator and at declinations near +/-30o. The instantaneous photometric zero point offset for each calibration scan is determined by taking the mean difference between the "catalog" magnitudes and the instrumental photometry of of 10-50 primary and secondary standard stars in each field, corrected for atmospheric extinction. The photometric zero point offset for any time during the night is determined using fits to the instantaneous offsets from the observations of each calibration field. For the preliminary 2MASS processing, the fits to the nightly zero point offsets were restricted to be linear with time for the J-band, and constant for the night in H and Ks. Survey scans were then calibrated by applying the proper zero point offset for their time of observation and appropriate extinction corrections.

Because their is always an instantaneous measure of the zero point offset for each calibration scan, the offset fit values can be compared to the true offsets to guage the accuracy of the calibration fit. Some preliminary work examining the overall calibration accuracy using the calibration scan residuals is presented in Nightly Photometric Zero Point Uncertainties. John Carpenter has performed an analysis of different calibration fitting algorithms applied to repeated survey observations of the Orion and Chameleon I regions that suggests that better accuracy can be achieved using higher order fits to the nightly offsets than were used during preliminary processing.

This document describes an analysis that uses the complete set of 2MASS calibration data derived from the preliminary processing to estimate the overall calibration accuracy of the survey, and to examine different algorithms for fitting the nightly zero point offsets.

II. Procedure

The inputs for this analysis are the nightly CALMON output summaries, the qDATEh.cal files. Along with the overall nightly calibration nformation, these files contain the mean zero point offset measured using the primary and secondary standard star photometry for each calibration scan. in a given night. Corrected for atmospheric extinction, these define the "true" zero point offset, within the limits of the photometric measurement accuracy. The *.cal files also contain other relevant parameters for each scan such as the airmass, UT times, hour angles, etc..

Using each calibration field in turn as a test field, new nightly zero point fits were made for each night, excluding the measurements of the test field. The zero point offset fits made were

  1. constant over the night,
  2. linear with time,
  3. quadratic with time, and
  4. piecewise (piecewise is a linear fit between adjacent calibration scans).

To minimize the impact of measurement errors of individual stars or scans, the nightly fit were made to the average extinction-corrected instantaneous zero point offsets for all six scans of a calibration field that comprise each calibration set. The sophisticated rejection algorithms used by CALMON were not employed in this analysis, so there may still be occasional outliers. The fits were unwieghted, and the linear and quadratic fits were made using simple least-squares polynomial fitting. The piecewise fits were made as linear fits between adjacent calibration sets. The restrictions applied to the data allowed into the analysis are as follows:

Once new zero point fits were made for each night, the value of the zero point offset appropriate for the time of each test field observation was determined. The residuals between the average true instantaneous offset for each test cal set, corrected for atmospheric extinction, and the offset determined from the nightly fits were then tabulated (residual = True Offset - Fit). An observation of a test calibration field was used in a given night only if it was bounded by photometric observations of other calibration fields. That is to say, calibration fits were interpolated only, and not extrapolated. The median and RMS for all of the residuals for each calibration field were then determined, and histograms of their distributions were constructed.

III. Results

a. Residuals for each calibration field

The table below gives for each field the number of calibration sets used in the analysis, and the median and RMS residuals for the constant, linear, quadratic and piecewise nightly fits. The number of residual measurements available for each cal field ranged from a minimum of 32 (90330) to a maximum of 343 (90013). Equatorial calibration fields have the largest number of usable observations. All median and RMS values are in magnitudes. Also provided are links to plots showing the histograms of the residuals. In each of the plots the heavy black curve shows the histogram of residuals to the constant zero point fits, the red shaded curve shows the linear fit residuals, the green shaded curve shows the quadratic fit residuals, and the blue curve shows the piecewise fit residuals.

Table 1. Median and RMS of distribution of residuals between true zero point offsets and fits
FIELD           CONSTANT             LINEAR             QUADRATIC           PIECEWISE 
    Nobs    median      rms     median      rms     median      rms     median      rms
90021
J    212  -0.00045   0.01970  -0.00010   0.01386  -0.00065   0.01404   0.00035   0.01448  Plot
H    212  -0.00255   0.01069  -0.00130   0.01087  -0.00150   0.01227  -0.00125   0.01273  
Ks   212  -0.00235   0.00996  -0.00075   0.01050   0.00015   0.01151   0.00010   0.01239  

90294
J    177  -0.00820   0.01964  -0.00790   0.01499  -0.00790   0.01447  -0.00760   0.01353  Plot
H    177  -0.00980   0.02760  -0.01170   0.02744  -0.01020   0.02751  -0.01020   0.02791  
Ks   177  -0.01130   0.01405  -0.01160   0.01446  -0.01060   0.01435  -0.01030   0.01471  

90004
J    269  -0.00460   0.02499  -0.00440   0.02105  -0.00300   0.01947  -0.00450   0.01842  Plot
H    269  -0.00110   0.01805  -0.00150   0.01790  -0.00130   0.01789  -0.00090   0.01820  
Ks   269   0.00230   0.01739   0.00210   0.01738   0.00210   0.01722   0.00200   0.01723  

90301
J    119  -0.00120   0.02083   0.00050   0.01608  -0.00060   0.01383   0.00010   0.01248  Plot
H    119   0.00630   0.01251   0.00660   0.01308   0.00580   0.01378   0.00700   0.01342  
Ks   119   0.00310   0.00952   0.00340   0.00970   0.00290   0.00966   0.00350   0.00998  

90247
J    105   0.00840   0.01676   0.00530   0.01755   0.00410   0.01678   0.00540   0.01734  Plot
H    105   0.00480   0.01019   0.00510   0.01783   0.00470   0.01759   0.00390   0.01923  
Ks   105   0.00870   0.00872   0.00710   0.01623   0.00720   0.01619   0.00700   0.01751  

90533
J    141   0.00320   0.02041   0.00480   0.01689   0.00570   0.01624   0.00620   0.01575  Plot
H    141   0.00610   0.01082   0.00460   0.01119   0.00520   0.01144   0.00510   0.01150  
Ks   141   0.00340   0.00958   0.00250   0.01028   0.00240   0.01037   0.00250   0.01054  

90191
J    174  -0.00915   0.01683  -0.00940   0.01448  -0.00885   0.01502  -0.00805   0.01453  Plot
H    174  -0.00750   0.01077  -0.00795   0.01131  -0.00650   0.01195  -0.00710   0.01287  
Ks   174  -0.00240   0.00845  -0.00260   0.00907  -0.00315   0.01133  -0.00315   0.01216  

90013
J    302   0.00450   0.01977   0.00140   0.01431   0.00190   0.01331   0.00335   0.01269  Plot
H    302  -0.00275   0.00972  -0.00385   0.01013  -0.00350   0.01086  -0.00305   0.01136  
Ks   302   0.00080   0.00737  -0.00110   0.00748  -0.00165   0.00801  -0.00210   0.00869  

90121
J     43   0.01460   0.01955   0.01010   0.01743   0.01060   0.01538   0.01090   0.01625  Plot
H     43   0.00730   0.01511   0.00750   0.01468   0.00790   0.01420   0.00890   0.01454  
Ks    43   0.00810   0.01206   0.00640   0.01063   0.00550   0.01112   0.00650   0.01090  

90161
J    118  -0.00230   0.01880  -0.00510   0.01296  -0.00440   0.01204  -0.00570   0.01100  Plot
H    118  -0.00200   0.01101  -0.00090   0.01062  -0.00115   0.01059  -0.00110   0.01039  
Ks   118   0.00380   0.01078   0.00415   0.01057   0.00365   0.01046   0.00260   0.01017  

90312
J    165   0.01460   0.02353   0.01380   0.01889   0.01180   0.01946   0.01200   0.01819  Plot
H    165   0.00400   0.01372   0.00280   0.01352   0.00310   0.01420   0.00260   0.01400  
Ks   165   0.00150   0.01249   0.00150   0.01364   0.00090   0.01371   0.00040   0.01412  

92026
J    207   0.00170   0.01799   0.00270   0.01558   0.00250   0.01419   0.00130   0.01427  Plot
H    207  -0.00330   0.01102  -0.00320   0.01105  -0.00390   0.01041  -0.00340   0.01021  
Ks   207  -0.00260   0.00848  -0.00280   0.00907  -0.00210   0.00938  -0.00260   0.00925  

90067
J    340   0.00050   0.01867  -0.00135   0.01567  -0.00345   0.01482  -0.00405   0.01406  Plot
H    340   0.00240   0.01131   0.00275   0.01232   0.00330   0.01229   0.00260   0.01249  
Ks   340   0.00025   0.00989   0.00165   0.01018   0.00195   0.00996   0.00190   0.01017  

90091
J     40   0.00235   0.01864   0.00490   0.01517   0.00225   0.01654   0.00225   0.01534  Plot
H     40  -0.00025   0.00622   0.00005   0.00606   0.00190   0.00623  -0.00030   0.00731  
Ks    40  -0.00440   0.00825  -0.00010   0.00807  -0.00035   0.00883  -0.00085   0.00907  

92397
J    193  -0.00770   0.02151  -0.00600   0.01792  -0.00550   0.01679  -0.00460   0.01655  Plot
H    193   0.00000   0.01014  -0.00040   0.01056  -0.00060   0.01085  -0.00050   0.01185  
Ks   193   0.00100   0.00979   0.00090   0.00969  -0.00070   0.01027  -0.00070   0.01111  

90217
J    130  -0.01425   0.01760  -0.00945   0.01670  -0.00690   0.01568  -0.00700   0.01620  Plot
H    130   0.00475   0.01102   0.00335   0.01144   0.00230   0.01225   0.00245   0.01284  
Ks   130  -0.00015   0.00772  -0.00060   0.00774  -0.00010   0.00834   0.00005   0.00892  

90266
J    127  -0.00180   0.02057   0.00510   0.01707   0.00290   0.01670   0.00160   0.01642  Plot
H    127  -0.00490   0.01059  -0.00220   0.01059  -0.00240   0.01102  -0.00210   0.01137  
Ks   127  -0.00580   0.01123  -0.00250   0.01088  -0.00200   0.01104  -0.00170   0.01098  

90860
J    208  -0.00015   0.01847  -0.00045   0.01583   0.00215   0.01685  -0.00020   0.01709  Plot
H    208  -0.00260   0.01357  -0.00130   0.01344  -0.00245   0.01355  -0.00305   0.01395  
Ks   208  -0.00485   0.01268  -0.00290   0.01348  -0.00220   0.01390  -0.00320   0.01435  

90867
J     82   0.00300   0.01847   0.00750   0.01725   0.00830   0.01477   0.00905   0.01490  Plot
H     82   0.00045   0.01210  -0.00075   0.01181  -0.00050   0.01205   0.00090   0.01225  
Ks    82  -0.00120   0.01570  -0.00090   0.01660  -0.00030   0.01638  -0.00085   0.01654  

90273
J    139  -0.01900   0.02879  -0.01700   0.02153  -0.01510   0.02137  -0.01320   0.02078  Plot
H    139  -0.01220   0.01553  -0.01650   0.01655  -0.01590   0.01634  -0.01540   0.01659  
Ks   139   0.00110   0.00608  -0.00190   0.00732  -0.00200   0.00736  -0.00210   0.00827  

90272
J    100  -0.00560   0.01480  -0.00585   0.01086  -0.00665   0.01192  -0.00570   0.01230  Plot
H    100  -0.00090   0.00997  -0.00200   0.00895  -0.00220   0.01107  -0.00235   0.01114  
Ks   100   0.00330   0.01096   0.00290   0.01085   0.00290   0.01337   0.00325   0.01310  

90868
J    233  -0.00540   0.02140  -0.00020   0.01618   0.00240   0.01615   0.00220   0.01633  Plot
H    233   0.00170   0.01103   0.00140   0.01038   0.00080   0.01121   0.00210   0.01169  
Ks   233  -0.00540   0.01315  -0.00540   0.01239  -0.00370   0.01237  -0.00360   0.01291  

90565
J    256   0.00170   0.02097   0.00480   0.01878   0.00455   0.01841   0.00555   0.01950  Plot
H    256   0.01190   0.01298   0.01020   0.01420   0.00900   0.01403   0.00990   0.01420  
Ks   256   0.00660   0.00937   0.00335   0.00958   0.00325   0.01024   0.00280   0.01045  

90009
J     86  -0.00650   0.01855  -0.00925   0.01525  -0.00990   0.01482  -0.00795   0.01441  Plot
H     86  -0.00760   0.00944  -0.00820   0.01131  -0.00805   0.01157  -0.00815   0.01090  
Ks    86  -0.00775   0.01077  -0.00905   0.01240  -0.00835   0.01212  -0.00810   0.01077  

90330
J     32   0.01075   0.01333   0.00505   0.01146   0.00590   0.01266   0.00850   0.01170  Plot
H     32   0.00715   0.01130   0.00450   0.00878   0.00220   0.01014   0.00245   0.00997  
Ks    32   0.01135   0.00862   0.00670   0.00935   0.00775   0.01079   0.00775   0.01292  

90279
J     52  -0.01085   0.01918  -0.01400   0.01109  -0.01205   0.01185  -0.01545   0.01273  Plot
H     52   0.00515   0.01050   0.00865   0.01216   0.00770   0.01254   0.00585   0.01384  
Ks    52   0.01550   0.01324   0.01580   0.01542   0.01665   0.01590   0.01205   0.01539  

90182
J     39  -0.00210   0.01698   0.00330   0.01315   0.00330   0.01270   0.00190   0.01345  Plot
H     39   0.00410   0.00713   0.00740   0.00755   0.00630   0.00702   0.00640   0.00694  
Ks    39   0.00080   0.00757   0.00480   0.00781   0.00490   0.00830   0.00420   0.00938  

90547
J     54   0.01190   0.02820   0.00905   0.02513   0.00585   0.02495   0.00335   0.02530  Plot
H     54   0.00955   0.02320   0.00365   0.02027   0.00495   0.01969   0.00305   0.01847  
Ks    54   0.01125   0.01993   0.01085   0.01970   0.00815   0.01930   0.01025   0.01989  

90808
J    157   0.00330   0.01762   0.00310   0.01498   0.00060   0.01531   0.00100   0.01674  Plot
H    157  -0.00170   0.01125  -0.00210   0.01224  -0.00230   0.01268  -0.00330   0.01412  
Ks   157   0.00830   0.00990   0.00770   0.01057   0.00650   0.01134   0.00640   0.01189  

90234
J    148   0.01880   0.02235   0.01775   0.01574   0.01610   0.01541   0.01315   0.01486  Plot
H    148  -0.00745   0.01093  -0.00585   0.01147  -0.00665   0.01162  -0.00805   0.01286  
Ks   148  -0.00465   0.01136  -0.00470   0.01151  -0.00605   0.01209  -0.00675   0.01325  

90813
J    128   0.00895   0.01702   0.00665   0.01299   0.00545   0.01322   0.00360   0.01390  Plot
H    128   0.00570   0.01287   0.00555   0.01230   0.00580   0.01369   0.00475   0.01453  
Ks   128  -0.00015   0.01000   0.00070   0.01020  -0.00060   0.01056  -0.00040   0.01138  

92409
J     65  -0.00220   0.02059   0.00150   0.01458   0.00130   0.01239   0.00280   0.01161  Plot
H     65  -0.00030   0.00915  -0.00030   0.01165  -0.00080   0.01089   0.00060   0.01096  
Ks    65  -0.00450   0.00802  -0.00270   0.00965  -0.00270   0.00839  -0.00140   0.00833  

92202
J    259   0.00690   0.01968   0.00630   0.01537   0.00640   0.01429   0.00610   0.01378  Plot
H    259  -0.00080   0.01159  -0.00030   0.01567  -0.00030   0.01549  -0.00090   0.01534  
Ks   259  -0.00220   0.00942   0.00010   0.00989   0.00010   0.00984  -0.00100   0.01039  

90893
J    277   0.00200   0.01893   0.00180   0.01557   0.00070   0.01484   0.00020   0.01418  Plot
H    277   0.00120   0.01108   0.00140   0.01109   0.00220   0.01130   0.00290   0.01158  
Ks   277  -0.00370   0.01084  -0.00230   0.01062  -0.00160   0.01106  -0.00180   0.01149  

90290
J     57  -0.00590   0.01914  -0.00380   0.01399  -0.00340   0.01392  -0.00340   0.01360  Plot
H     57   0.00750   0.00884   0.00730   0.00957   0.01050   0.00986   0.00950   0.01135  
Ks    57  -0.00080   0.00707  -0.00070   0.00892  -0.00160   0.01013  -0.00070   0.01145  

b. Ensemble Residuals

Table 2 below lists the median and RMS of the residuals to the four different fits for the ensemble of all calibration test fields. Also provided are links to the residual distribution histograms.

Examination of the plots and statistics shows that the ensemble distributions show no net zero point offsets, indicating that the residual offsets for individual calibration fields are more or less random and sum to zero. The RMS of the distributions provides a measure of the overall accuracy in each band, and indicates the best of the four fits. For J-band, the minimum residual dispersion is achieved for the piecewise fit, and is 0.01685 mags. The minimum dispersion in the H- and Ks-bands are 0.01404 and 0.01170 mags, respectively, and are achieved for the constant nightly fits. In some sense, this is really the worst-case estimate because this procedure rederives the calibration at the maximum time separation from other calibration scans. Normal survey observations are taken closer in time to the adjacent calibration sets than consecutive calibration sets.

Table 2. Median and RMS of distribution of residuals between true zero point offsets and fits for all fields
FIELD           CONSTANT             LINEAR             QUADRATIC           PIECEWISE
    Nobs    median      rms     median      rms     median      rms     median      rms
ALL
J   5234   0.00015   0.02152   0.00040   0.01773   0.00020   0.01704   0.00020   0.01685  Plot
H   5234   0.00020   0.01404  -0.00010   0.01463   0.00000   0.01482   0.00010   0.01515  
Ks  5234  -0.00030   0.01170  -0.00010   0.01204  -0.00010   0.01227  -0.00020   0.01264  

ALL X>1.8
J    163   0.00830   0.02367   0.00540   0.01969   0.00660   0.01917   0.00490   0.01931  Plot
H    163   0.01020   0.01762   0.00920   0.01685   0.00740   0.01609   0.00690   0.01618  
Ks   163   0.00330   0.01353   0.00180   0.01337   0.00170   0.01302   0.00210   0.01368  

ALL NEAR X>1.8
J    303  -0.00020   0.02270  -0.00090   0.01951  -0.00330   0.01882  -0.00300   0.01805  Plot
H    303  -0.00120   0.01413  -0.00230   0.01474  -0.00290   0.01478  -0.00360   0.01480  
Ks   303   0.00010   0.01295  -0.00130   0.01292  -0.00130   0.01359  -0.00180   0.01347  

IV. Airmass Effects

a. Ensemble Residuals

A concern with the higher-order zero point fits, in particular the piecewise fit, is that small errors in the extinction coefficient on a particular night might bias the calibration of the survey scans adjacent to high airmass calibration observations. The second and third entries in Table 2 address this concern. The second entry lists the median and RMS residual distributions for all of the calibration fields observed at an airmass >1.8. The minimum RMS values are achieved for the quadratic fits in all bands. There are also small offsets in each band that may suggest slight over or underestimates in the extinction corrections for all bands. However, only a few calibration fields were ever observed at very high airmasses during the survey because of their distribution on the sky. Thus, the apparent net biases could be the result of small catalog magnitude biases or time-dependent extinction coefficient errors. This is examined in more detail below.

The third set of entries in Table 2 address the concern that if a piecewise fit is used, and there is an error in the extinction coefficient, then survey scans adjacent to high airmass calibration scans might have a biased calibration applied. These entries show the median and RMS residual statistics for all test calibration scans that were immediately adjacent to calibration sets having an airmass >1.8. The minimum RMS values are achieved for the piecewise fits in J, constant fit in H, and linear fit in Ks, just as in the general case looking at all scans. The dispersion levels with the best fits are only marginally larger than the general case, and the net biases are extremely small and probably insignificant.

b. Residual extinction effects

Figures 1a-1c below show the zero point residuals for each calibration set plotted as a function of the mean airmass of the set. For J-band, the residuals are those with respect to the piecewise fits, and for H and Ks the residuals are with respect to the linear fits. Figure 1a shows all cal sets together, and 1b and 1c show the northern and southern observatory data separately. In these plots, individual cal sets are shown as black crosses, and the red bars shows the mean zero point residuals in 0.1 airmass bins. The vertical error bars on the mean residuals denote the RMS (i.e.population sigma) of the residuals in each bin.

Figure 1a - Zero point residuals for all calibration sets plotted as a function of the mean airmass of the set. Red bars show the mean offsets in 0.1 airmass bins.

Figure 1b - Zero point residuals for Northern calibration sets plotted as a function of the mean airmass of the set. Red bars show the mean offsets in 0.1 airmass bins.

Figure 1c - Zero point residuals for Southern calibration sets plotted as a function of the mean airmass of the set. Red bars show the mean offsets in 0.1 airmass bins.

If the coefficients used during preliminary processing systemmatically under or overcorrected for atmospheric extinction, then we might expect the residuals to increasingly deviate from zero with increasing airmass. The slope of the deviation would provide the correction to the extinction coefficients, in magnitudes/airmass.

A small deviation is seen in the northern J-band residuals, consistent with a correction of 0.05-0.07 mags/airmass. The northern H and Ks residuals appear consistent with no deviation. However, the southern residuals show increasing deviation out to an airmass of ~1.8, and then turn over becoming nearly zero at larger airmasses. The deviation in the southern Ks residuals is small, but the effect is quite pronounced in the J and H bands.

The global calibration analysis suggests that the extinction coefficients vary seasonally. If all calibration fields were observed uniformly all year, then such variations would tend to inflate the dispersion in the residuals evenly. However, because of their distribution on the sky and the calibration scheduling strategy, calibration fields are observed at preferred times and only a small number of fields are ever observed at very large airmasses. For example, of the 35 calibration sets in this analysis observed from Mt. Hopkins with X>1.8, 14 of those sets are field 92202. The second most observed high airmass field from Mt. Hopkins is 92397 with 9 instances. Both of these are relatively low declination "equatorial" fields (~-11o). Similarly, of the 61 high airmass fields observed from CTIO (X>1.8), 43 are of field 90067 (M67), an "equatorial" field at a declination of +11o. The second field most often observed from CTIO at high airmass was 90565, with only 10 instances used in this analysis.

The M67 field was observed at high airmass from CTIO preferentially during early January and February and late November, whereas it was observed at lower airmasses more uniformly during the year. Figure 2 shows the southern residuals plotted as a function of airmass, as in Figure 1c, but the sets corresponding to field 90067 are indicated in green. The plot shows clearly that the apparent high airmass turnover in the ensemble residuals is attributable to the observations of field 90067. Because 90067 was observed at high airmasas during specific months, seasonal variations in the extinction coefficients can lead to the unusual structure seen in the residual plot.

Figure 2 - Zero point residuals for Southern calibration sets plotted as a function of the mean airmass of the set. Red bars show the mean offsets in 0.1 airmass bins. Observations of calibration field 90067 are indicated in green.


Last Update - 5 March 2001
R. Cutri - IPAC