# Simultaneous ultra-high contrast imaging and determination of time-dependent, non-common path aberrations in the presence of detector noise

###### Abstract

Ground-based ultra-high contrast imaging, as required for direct imaging of exoplanets and other solar systems, is limited by difficulty of separating the planetary emission from the effects of optical aberrations that are not compensated by the adaptive optics (AO) system, so-called “non-common path aberrations” (NCPAs). Simultaneous ( millisecond) exposures by the science camera and the AO system enable the use of “phase diversity” to estimate both the NCPAs and the scene via a processing procedure first described by the author (R. Frazin 2013, ApJ, 767, article id. 21). This method is fully compatible with more standard concepts used in long-exposure high-contrast imaging, such as angular differential imaging and spectral deconvolution. Long-exposure methods find time-dependent NCPAs, such as those caused by vibrations, particularly challenging. Here, an NCPA of the form of is considered. It is shown that, when sampled at millisecond time-scales, the image plane data are sensitive to , and , and, therefore such NCPAs can be simultaneously estimated with the scene. Simulations of observations with ms exposure times are reported. These simulations include substantial detector noise and a sinusoidal NCPA that places a speckle exactly at the location of a planet. Simulations show that the effects of detector noise can be mitigated by mixing exposures of various lengths, allowing estimation of the planet’s brightness.

Simultaneous ultra-high contrast imaging and determination of time-dependent, non-common path aberrations in the presence of detector noise

Richard A. Frazin

Dept. of Atmospheric, Oceanic and Space Sciences, University of Michigan, Ann Arbor, MI 48108

^{0}

^{0}footnotetext: E-mail: rfrazin _at_ umich.edu

Keywords: exoplanet, adaptive optics, short-exposure imaging, image processing

## 1 Introduction

The most promising method for ground-based exoplanet imaging and spectroscopy at contrast levels (planet-to-star brightness ratio) of or smaller combines high-order adaptive optics (AO) with a stellar coronagraph. A stellar coronagraph is a telescopic imaging system designed to block the light from a star on the optical axis while only having minimal effect on the portion of the image surrounding the star [1]. Above the atmosphere, where the star presents the telescope with a flat wavefront, even a relatively simple coronagraph, such as the one on the Advanced Camera for Surveys on the Hubble Space Telescope, can reject the starlight with an efficiency of about .[2] However, on the ground, the AO system does an imperfect job of correcting for the atmospheric distortion, leading to far lower rejection ratios, even allowing the majority of the starlight to pass at times when the Strehl ratio is low.^{*}^{*}*The Strehl ratio is usually defined as the ratio of peak intensity intensity in the image plane divided by the peak intensity that would be seen if the incoming wavefront were perfectly flat. Typically, the AO system operates at visible wavelengths, while the science camera in the coronagraph captures images in the near-infrared (IR) at wavelengths of about 1.2 m or longer. Observing in the near-IR improves the needed contrast ratios and is required for spectroscopy of key molecules such as acetylene (CH) and methane. The residual wavefront from the AO system, called the “AO residual,” creates speckles in the image plane that scintillate at millisecond time-scales. If the post-AO imaging system were free of diffraction effects and optical aberrations, the amplitude of the speckle oscillations would be a smoothly decreasing function of distance from the center (until the distance corresponding to maximum spatial frequency of the AO correction is reached). In this circumstance, a long-exposure image would have a smooth halo coming from a time-average of the stellar speckles, and subtracting it from a science image to reveal the planetary emission would be a straightforward matter. The most common term for any post-AO aberration (i.e., an aberration that is non sensed by the AO system) is “non-common path aberration” (NCPA). Diffraction rings (or the equivalent, depending on the pupil geometry) and NCPAs interact with the AO residual, creating enhanced speckle amplitudes where the diffracted field is large. This effect has been dubbed “pinned speckle.”[3] Thus, in a real optical system, the speckle amplitude can have a complicated structure, and to the extent that the NCPAs and pupil diffraction are unknown, the resulting long-exposure background is difficult to subtract. Due to a variety of mechanical stresses on the telescope caused by, for example, winds and temperature gradients, the aberrations are never precisely known and vary temporally over a wide range of time-scales ranging from high-frequency vibrations to hours. The resulting speckles have been given the name “quasi-static speckles” due to their temporal variability, and several authors have shown that they are the major limitation in high-contrast imaging.[4, 5] Observing modes with contemporary high-contrast imaging systems, such as Project 1640, [6] the Gemini Planet Imager and SPHERE,[7, 8] involve exposure times ranging from several to tens of minutes. In such observations, the pinned speckles appear as bright points since their time-averaged intensities are enhanced compared to the smooth background. However, at millisecond-time scales, these speckles scintillate, providing much information about the NCPAs.

As the speckle overwhelms the faint planetary emission, dominating the photon noise by orders of magnitude,[10] post-processing of the images is necessary for ground-based high-contrast science, even with coronagraphic optics. Since quasi-static speckles can be present over long periods of time (perhaps hours), long integration times do not significantly improve the achievable contrast. Thus far, three types of post-processing concepts have been utilized to remove speckles from the images. These are spectral deconvolution (SD), angular differential imaging (ADI), and locally optimized combination of images (LOCI). SD takes advantage of the fact that the point spread function (PSF) scales with wavelength, so observations at two or more wavelengths allow for some speckle suppression.[11, 12]. SD is not well suited to dealing with differential aberrations that cause the PSF to loose correlation at differing wavelengths.[13] ADI takes advantage of the diurnal field rotation that occurs over the course of the night when the instrument rotator is turned off (Cassegrain focus) or adjusted to maintain instrument alignment (Nasmyth focus), so that the planet appears to rotate relative to the star and the PSF.[14] Thus, to the extent that speckles do not evolve as the image rotates around the pointing center, correction can be achieved. LOCI uses the concept of a “reference image,” defined as any image whose subtraction from the target image would reduce the signal from the speckles while preserving the signal from the desired object. LOCI can take advantage of reference images at different wavelengths and/or field-of-view rotations, thus incorporating the capabilities SD and ADI, as well as polarization differences. Non-simultaneous observations of “naked” stars or simultaneous observations of off-axis stars may also be used to produce reference images. (For a general discussion of LOCI see [15].) Finding a good reference image to subtract is a challenge due to the temporal variability of the speckle and wavelength- (or polarization-) dependent effects, making it nearly impossible to find a single image with the same speckles as the target. In LOCI, one starts with a set of reference images and subtracts a linear combination of them, , from the target image to get the final science image. The “local” nature of LOCI comes from the fact that the coefficients are chosen independently for each of a number of subregions within the target image. In the original conception, [15] choose the to minimize the total squared intensity of the subregion, while the more sophisticated variant of [16] chooses them via Karhunen-Loève (a.k.a., principle components) transformation.

The current generation of high-contrast efforts is rapidly approaching the limits of its assumptions and the level of information contained in long-exposure images. The only major source of information that is not being utilized is the random encoding of the NCPAs by the atmosphere on millisecond time-scales. Exploiting this source of information requires optimal processing of the data taken by the wavefront sensor (WFS) and the science camera operating in millisecond exposure mode.

## 2 Information Content of Millisecond Exposures

The idea of using millisecond exposures for ultra-high contrast imaging, such as is required for exoplanet science, has been given little attention, mostly due to the fact that all of the current high-contrast efforts are based on long exposures. The power of millisecond exposure analysis comes from two facts: 1) most of the atmospheric motion is nearly frozen on that time-scale and 2) the wavefront sensor (WFS) provides a great deal of information about the AO residual. The key point is that at every millisecond the AO residual presents new random wavefronts. When combined with knowledge of the wavefront, each millisecond exposure provides more information about the NCPAs.

Using the WFS and millisecond images from the science camera has been dubbed “random phase diversity,” and it has been explored by [9] (henceforth, Paper I) and [17]. In long-exposure imaging, far less information is available, as one only sees the average of all of the speckles, making the data from the WFS of little utility. Showing a stellar coronagraph simulation result from Paper I, Fig. 1 shows time series of the intensity seen in a single pixel of the science camera. The dotted curve illustrates how the AO residual modulates the stellar speckle (which, for this pixel, is enhanced by a sinusoidal NCPA) at a cadence of 1 ms. The solid curve shows the much weaker modulation of the planetary light in the same pixel. These two time-series, the planetary intensity and the speckle intensity, are quite different in character, with the speckle having an approximately exponential probability density function (PDF), while the PDF of the planetary intensity is somewhat localized around its non-zero mean.[18, 9] This can be understood as follows: The planetary time-series is stabilized by the AO system, as the flat part of the planet’s wavefront is responsible for its intensity at this position in the image plane. However, this star’s speckle is entirely due to the random, non-flat part of the star’s wavefront (the coronagraph removes the flat part) and, hence, it is much more volatile.

Long-exposure observations have difficulty distinguishing amplitude NCPAs from phase NCPAs. Consider pupil plane NCPA (upstream of the coronagraph) of the form , where is pupil plane coordinate vector, is the vector spatial frequency of the aberration, is the spatial phase, and is the complex amplitude of the aberration.^{†}^{†}†Thus, the pre-coronagraph, pupil plane field is modified by this NCPA via multiplication: , where would be the field without this NCPA. The imaginary part of the NCPA corresponds to an error in the wavefront amplitude and the real part corresponds to a phase error. However, millisecond observations clearly separate these effects, as is illustrated in Fig. 2, which simulates four different sinusoidal NCPAs all using the same AO residual as input. These four NCPAs all have same spatial frequency , which places the two indicated speckles at a distance of about from the center, were is the wavelength. The top panels correspond to real NCPAs ( is purely real), differing only in the phase angle . The bottom panels correspond to purely imaginary NCPAs ( is purely imaginary), again differing only in the phase angle . Of course, if the AO residual were precisely zero, all four of these NCPAs would lead to exactly the same two identical speckles. Standard long-exposure images cannot distinguish between these aberrations, although one could solve for them using well-calibrated offsets of the AO system’s deformable mirror,[19] in a manner similar to the procedures given in Paper I.

Vibrations pose a particularly challenging problem to high-contrast astronomy. Since they are sensitive to specific conditions such as wind and thermal state of the system, they are difficult to characterize with reference images. Consider a vibration giving rise to an NCPA given by the form , where is the vibration frequency and is the time. Clearly, at millisecond time-scales, this NCPA will manifest a modulation in the science camera that depends on . Fig. 3 shows stellar coronagraph simulations similar to those in Paper I demonstrating that the intensity time-series of the speckle associated with this NCPA is indeed strongly dependent on .

## 3 Estimation Procedures

Paper I used an analytical model of a stellar coronagraph and assumed knowledge of the wavefront (from the wavefront sensor) to provide a framework for simultaneously estimating the NCPAs and planetary emission. Slightly extending this framework to include time-dependent aberrations, assume that the NCPA has a pupil plane representation of the form:

(1) |

where is the number of terms required and are basis functions. Orthogonality of the is not be assumed, allowing considerable freedom in the choice of basis functions. For convenience, the coefficients are placed into the vector . Similarly, the planetary image , where the vector is the image plane coordinate, can be expressed as a series expansion:

(2) |

where is the number of terms needed, and the are basis functions (they can be as simple as square pixels), and the coefficients can be placed into the vector . Assuming the NCPAs are small enough for the linearization to be valid (this should be a good approximation for aberrations that are not large enough to be immediately obvious), the measured intensity at the science camera in the image plane is given by the equation:

(3) |

where the superscripts and denote complex conjugation and transposition respectively, represents noise in the measurment, and the , , and functions depend on the AO residual at time as well as the telescope aperture function. Paper I gives expressions for all of these functions. is a scalar function representing speckles due to the AO residual. is a vector function accounting for the interaction of the aberration with the AO residual and represents most of the “pinned” speckle. is a matrix function (which also includes for some “pinning”) that accounts for 2nd order interaction of the NCPAs. Its importance depends on the amplitude of the NCPAs, but is likely to be amenable to linearization even if it cannot be taken to be negligible. is called the “planetary intensity kernel” and is a vector function describing the contribution of the planetary image to the measured intensity.

Eq. (3) forms the basis for estimation of the NCPA coefficients and the planetary image coefficients . As is a scalar function of and , it must be sampled on a spatio-temporal grid, forming a three-dimensional data set, and numerical methods can be applied to estimate and , as described in Paper I. Note that since represents convolution of the planetary image with the instantaneous PSF (excluding NCPAs, since they are not important for the planetary component of the image), the spatial sampling can be arranged so that this term corresponds to a Toeplitz matrix block, which can be treated with FFT-based methods. The scale of the numerical compuation may not be small as a sampling of the image plane at 1000 Hz for only 1 minute yields about 246 million data values, however Kalman filters and related sequential processing algorithms should be able to reduce the computational burden.

## 4 Simulations Including Detector Noise

One of the potential difficulties associated with millisecond exposure observations is detector readout noise. Paper I included shot noise but did not consider detector noise, so, the first result also including both types of noise is given here. Since the number of detector noise counts is proportional to the number of reads, the detector noise is much less of a problem at low cadence. Of course, long integrations greatly compromise the ability to estimate the NCPA coefficients in Eq. (3), so the most effective observation mode would likely combine exposures of various durations in a single estimation of the image coefficients and NCPA coefficients . The estimation problem based on combined exposures of various durations is based on time-integration of Eq. (3). Thus, for the observations corresponding, to 1 ms, Eq. (3) is integrated over 1 ms, and for a 10 s observation, the equation is integrated over 10 s. In this way, the same formalism can be utilized for any mixture of exposure durations. The required time-integrations require the knowledge of the AO residual from the wavefront sensor. This avoids assuming that the time-average of the AO residual is given by a known structure function.

The simulations reported here were run using the model and procedures in Paper I with the following parameters: The NCPAs in the simulations included 10 high-order Zernike modes and a sinusoid with a spatial frequency exactly corresponding to the location of a planet (creating a speckle there), for a total of 11 terms in Eq. (1). Since these simulations did not include reference images, diurnal field rotation, or multiple wavelengths, estimating the correct planetary brightness with long-exposure processing would not be possible in the presence of the imposed NCPAs. The separation of the planet and the star was set to . The contrast ratio of the planetary and stellar brightness was , and the stellar intensity was ph/ms, thus, the planetary intensity was 10 ph/ms. The time-average of the planet’s intensity at the center of its Airy disk was 0.51 ph/ms/pixel and that of the star’s light at the same position was 21.7 ph/ms/pixel (note that when the NCPAs were turned off, the time average intensity of the star’s speckle at that position decreased to 18.4 ph/ms/pixel, so, the NCPAs needed to be accurately estimated to have a chance to correctly estimate the planet’s intensity). The simulations used 2000 ms exposures with phase screens (representing the AO residuals) measured by the WFS on the AEOS Adaptive Optics System.[20] When standard deviation of the detector readout noise was set to 6.5 ph/pixel/read (corresponding to a mean of 42 photons per read), processing all 2000 exposures gave the correct planet intensity with an error bar of 17%. However, integrating the first 300 ms as a single exposure (with only the noise from a single detector read in that time) and treating the remaining 1700 exposures independently (with 1700 detector reads) gave the correct planetary intensity with an error bar of 10%. This shows that a strategy of mixed exposure times can mitigate the effects of detector noise. When the detector noise was turned off, the error bar decreased to 4.4% for the mixed exposure case and 3.9% for all-short-exposure case, as is expected, since there should be no advantage to long exposures when there is no detector noise. In all cases the NCPA coefficients were estimated to better than 1% accuracy. Integrated over the image plane, the time-average stellar intensity was about photons/ms, meaning that, on the average, the coronagraph removed only about of the starlight (the coronagraph is not effective when the wavefront is not flat). Even though much of starlight still arrives at the science camera, the coronagraph is still a vital piece of hardware for ground-based, high-contrast since it suppresses the zero-order diffraction and is an important source of modulation of the speckle at millisecond time-scales.

## 5 Conclusion

This paper has discussed millisecond cadence exposures in the science camera combined with simultaneous data from the wavefront sensor for the purpose of simultaneous exoplanet imaging and estimation of NCPAs. This mode of operation has the useful potential to detect both amplitude and phase NCPAs as well as time-dependent NCPAs caused by vibrations [see Figs. 2 and 3]. The amplitudes of these aberrations can be estimated in the framework given in Paper I.[9] In addition, this paper gives results for simulations that include the effects of detector noise and shows that observation sequences that combine various exposure lengths can mitigate its effects.

Millisecond imaging in the science camera may have the potential to revolutionize ground-based exoplanet imaging, but a number practical issues need to be explored first. These include the effects of uncertainties in wavefront sensor measurements, detector noise, chromatic effects, and others, some of which are listed in Paper I. It is important to recognize that short-exposure analysis is fully compatible with ADI and SD, as well as methods that require additional hardware to achieve phase diversity, since they can all be used in short-exposure mode. Short exposures are also compatible with (and probably useful for) “electric field conjugation,” a technique in which the deformable mirror (DM) is adjusted in order minimize the intensity in a specific region of the image plane, thereby increasing the contrast.[19] Indeed, NCPAs determined via reference images or other types of long exposure analysis could be used a statistical priors on the estimation of the NCPAs with millisecond exposure data. Thus, many current efforts are quite applicable to the millisecond exposure paradigm.

## Acknowledgments

The author would like to thank Olivier Guyon and Peter Lawson for their encouragement.

## References

- [1] Sivaramakrishnan, A., Koresko, C. D., Makidon, R. B., Berkefeld, T., and Kuchner, M. J., “Ground-based Coronagraphy with High-order Adaptive Optics,” ApJ 552, 397–408 (May 2001).
- [2] Krist, J. E., Ardila, D. R., Golimowski, D. A., Clampin, M., Ford, H. C., Illingworth, G. D., Hartig, G. F., Bartko, F., Benítez, N., Blakeslee, J. P., Bouwens, R. J., Bradley, L. D., Broadhurst, T. J., Brown, R. A., Burrows, C. J., Cheng, E. S., Cross, N. J. G., Demarco, R., Feldman, P. D., Franx, M., Goto, T., Gronwall, C., Holden, B., Homeier, N., Infante, L., Kimble, R. A., Lesser, M. P., Martel, A. R., Mei, S., Menanteau, F., Meurer, G. R., Miley, G. K., Motta, V., Postman, M., Rosati, P., Sirianni, M., Sparks, W. B., Tran, H. D., Tsvetanov, Z. I., White, R. L., and Zheng, W., “Hubble Space Telescope Advanced Camera for Surveys Coronagraphic Imaging of the AU Microscopii Debris Disk,” AJ 129, 1008–1017 (Feb. 2005).
- [3] Bloemhof, E. E., “Anomalous intensity of pinned speckles at high adaptive correction,” Optics Letters 29, 159–161 (Jan. 2004).
- [4] Boccaletti, A., Riaud, P., Baudoz, P., Baudrand, J., Rouan, D., Gratadour, D., Lacombe, F., and Lagrange, A.-M., “The Four-Quadrant Phase Mask Coronagraph. IV. First Light at the Very Large Telescope,” PASP 116, 1061–1071 (Nov. 2004).
- [5] Martinez, P., Kasper, M., Costille, A., Sauvage, J. F., Dohlen, K., Puget, P., and Beuzit, J. L., “Speckle temporal stability in XAO coronagraphic images. II. Refine model for quasi-static speckle temporal evolution for VLT/SPHERE,” A&A 554, A41 (June 2013).
- [6] Oppenheimer, B. R., Beichman, C., Brenner, D., Burruss, R., Cady, E., Crepp, J., Hillenbrand, L., Hinkley, S., Ligon, E. R., Lockhart, T., Parry, I., Pueyo, L., Rice, E., Roberts, L. C., Roberts, J., Shao, M., Sivaramakrishnan, A., Soummer, R., Vasisht, G., Vescelus, F., Wallace, J. K., Zhai, C., and Zimmerman, N., “Project 1640: the world’s first ExAO coronagraphic hyperspectral imager for comparative planetary science,” in [Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series ], Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series 8447 (July 2012).
- [7] McBride, J., Graham, J. R., Macintosh, B., Beckwith, S. V. W., Marois, C., Poyneer, L. A., and Wiktorowicz, S. J., “Experimental Design for the Gemini Planet Imager,” PASP 123, 692–708 (June 2011).
- [8] Beuzit, J.-L., Feldt, M., Dohlen, K., Mouillet, D., Puget, P., Wildi, F., Abe, L., Antichi, J., Baruffolo, A., Baudoz, P., Boccaletti, A., Carbillet, M., Charton, J., Claudi, R., Downing, M., Fabron, C., Feautrier, P., Fedrigo, E., Fusco, T., Gach, J.-L., Gratton, R., Henning, T., Hubin, N., Joos, F., Kasper, M., Langlois, M., Lenzen, R., Moutou, C., Pavlov, A., Petit, C., Pragt, J., Rabou, P., Rigal, F., Roelfsema, R., Rousset, G., Saisse, M., Schmid, H.-M., Stadler, E., Thalmann, C., Turatto, M., Udry, S., Vakili, F., and Waters, R., “SPHERE: a planet finder instrument for the VLT,” in [Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series ], Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series 7014 (Aug. 2008).
- [9] Frazin, R. A., “Utilization of the Wavefront Sensor and Short-exposure Images for Simultaneous Estimation of Quasi-static Aberration and Exoplanet Intensity,” ApJ 767, 21 (Apr. 2013).
- [10] Racine, R., Walker, G. A. H., Nadeau, D., Doyon, R., and Marois, C., “Speckle Noise and the Detection of Faint Companions,” PASP 111, 587–594 (May 1999).
- [11] Marois, C., Doyon, R., Racine, R., and Nadeau, D., “Efficient Speckle Noise Attenuation in Faint Companion Imaging,” PASP 112, 91–96 (Jan. 2000).
- [12] Sparks, W. B. and Ford, H. C., “Imaging Spectroscopy for Extrasolar Planet Detection,” ApJ 578, 543–564 (Oct. 2002).
- [13] Marois, C., Doyon, R., Nadeau, D., Racine, R., Riopel, M., Vallée, P., and Lafrenière, D., “TRIDENT: An Infrared Differential Imaging Camera Optimized for the Detection of Methanated Substellar Companions,” PASP 117, 745–756 (July 2005).
- [14] Marois, C., Lafrenière, D., Doyon, R., Macintosh, B., and Nadeau, D., “Angular Differential Imaging: A Powerful High-Contrast Imaging Technique,” ApJ 641, 556–564 (Apr. 2006).
- [15] Lafrenière, D., Marois, C., Doyon, R., Nadeau, D., and Artigau, É., “A New Algorithm for Point-Spread Function Subtraction in High-Contrast Imaging: A Demonstration with Angular Differential Imaging,” ApJ 660, 770–780 (May 2007).
- [16] Soummer, R., Pueyo, L., and Larkin, J., “Detection and Characterization of Exoplanets and Disks Using Projections on Karhunen-Loève Eigenimages,” ApJ 755, L28 (Aug. 2012).
- [17] Codona, J. L. and Kenworthy, M., “Focal Plane Wavefront Sensing Using Residual Adaptive Optics Speckles,” ApJ 767, 100 (Apr. 2013).
- [18] Gladysz, S., Yaitskova, N., and Christou, J. C., “Statistics of intensity in adaptive-optics images and their usefulness for detection and photometry of exoplanets,” Journal of the Optical Society of America A 27, A260000–A75 (Nov. 2010).
- [19] Thomas, S. J., Give’On, A. A., Dillon, D., Macintosh, B., Gavel, D., and Soummer, R., “Laboratory test of application of electric field conjugation image-sharpening to ground-based adaptive optics,” in [Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series ], Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series 7736 (July 2010).
- [20] Roberts, Jr., L. C. and Neyman, C. R., “Characterization of the AEOS Adaptive Optics System,” PASP 114, 1260–1266 (Nov. 2002).