Abstract
We report on a method to increase the spatial resolution in a compact lensless microscope. A compact side illumination is fabricated to illuminate the sample with a collimated beam by diffraction from a volume phase grating. The wavelength of a semi-conductor laser source (vertical-cavity surface-emitting laser) is tuned with the injection current to alter the illumination direction by wavelength selective diffraction from the volume phase grating. The angle tuning is such that several subpixel shifted digital inline holograms are obtained. The stack of holograms is then processed in a pixel super-resolution reconstruction algorithm. The amplitude of the sample is reconstructed with subpixel resolution over a large field of view (FOV). The technique is demonstrated on a 1951 USAF test target. A resolution of , over a FOV of , is demonstrated for a device of height. The original pixel size was 5.2 μm demonstrating the subpixel resolution.
© 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
The resolution of lensless imaging devices is limited by the pixel size of the camera chip ( micrometers) and the reconstruction algorithm. Indeed, Claus et al. [1] showed that, since the real resolution limitation comes from the numerical aperture (NA) of the detector subtending the object, it can be taken into account in the reconstruction algorithm of the holograms to show object details smaller than the detector pixel size. To increase this resolution, several lensless techniques in microscopy have been proposed. Subpixel perspective sweeping microscopy uses images taken at several illumination angles. Between two illumination angles, the shadows of the sample move over a subpixel distance. Then a highly resolved image is reconstructed numerically. This approach is particularly interesting for samples with a high confluence. A resolution of 660 nm with a 2.2 μm pixel size over a field of view (FOV) has been reported with an on-chip device [2,3]. However, in this technique, the illumination is on top of the sample which obstructs its view. Another way to increase the resolution is to use optofluidics. Cui et al. [4] and Zheng et al. [5] used a flow of objects in a microfluidic channel with submicrometer holes placed along the channel. Several projection images are taken, as the object moves with the flow, with a complementary metal oxide semi-conductor camera of 9.9 μm pixel size. Then a highly resolved image is reconstructed numerically. A resolution of 750 nm has been reported.
Finally, in digital inline holography, the increase in resolution has been investigated by using several subpixel shifted holograms on the camera to retrieve a highly resolved hologram processed in a pixel super-resolution algorithm [6–11]. This technique has been proposed with incoherent illumination to create speckle free images; however, the compactness of the imager is then compromised, since a rather large distance (several centimeters) is needed between the source and the sample to obtain enough spatial coherence. The subpixel shifts are induced by changing either the wavelength of the source by several tens of nanometers [8] or the position of the source on top of the sample [6,7,9–11].
In this Letter, we present a compact digital lensless inline holographic imager where subpixel shifts are created by changing the injection current of a vertical-cavity surface-emitting laser (VCSEL). The final reconstructed image has a lateral resolution smaller than the pixel size.
A compact lensless imager performing phase retrieval has already been presented by the authors [12], but it had a resolution limited by the pixel size of the camera. Here a side illumination system is constructed with a prism onto which a volume phase grating is recorded in a 70 μm thick photopolymer (Covestro BAYFOL HX) whose refractive index is similar to that of the prism (1.485 versus 1.52, respectively). The beam from the VCSEL is reflected by total internal reflection (TIR) at the photopolymer-air interface. Indeed, the critical angle at the interface between the photopolymer and the prism is , and the beam’s incident angle is with an angular spread of the VCSEL of . The TIR occurs at the photopolymer-air interface, since the critical angle at the interface between the photopolymer and air is . This ensures that the zero order of the incident beam does not go to the camera. The signal beam coming from the top is transmitted at the photopolymer-air interface due to the 60 deg prism. The recording scheme is shown in Fig. 1. The signal beam has been chosen to be collimated in order to obtain a collimated diffracted beam while using the VCSEL readout depicted in Fig. 2. The recording process is detailed in [12].
Moreover, in order to better control the signal beam direction (to avoid refraction at the output of the prism), a recording prism, with the same characteristics of the prism, is added on top of the prism. Index matching oil is added between the two prisms. This is shown in Fig. 1.
The volume hologram is illuminated by a VCSEL (Vixar 680S, NA0.21), which produces a collimated diffracted beam illuminating the sample. Figure 2 is a sketch of the device. The employed monochrome camera has a 5.2 μm pixel size (Thorlabs DCC1545M).
When the injection current of the light source is changed, it induces a wavelength change of the light. This is shown in Fig. 3 which shows the wavelength shift with respect to the VCSEL driving current.
The change of wavelength results in a slight change in the diffracted angle from the grating. The volume grating has been recorded with a collimated beam and, since the wavelength change is very small (0.044%), the diffraction results in a small angular change with negligible deviation from a plane wave. This creates a shift of the hologram on the camera, which depends on the distance between the sample and the camera. Figure 4 illustrates this situation. The digital hologram depends also on the wavelength; however, since the maximum wavelength change is smaller than 0.5 nm, this change is negligible in the reconstruction process.
The shift of each hologram is estimated using the hologram taken with the lowest driving current as reference. The algorithm [13] first estimates roughly the shift by cross-correlation and fast Fourier transform and then refines it using upsampling of the discrete Fourier transform in the neighborhood of the first estimation.
Table 1 shows the estimated hologram shifts, obtained with the algorithm above, in horizontal and vertical directions at the camera plane with respect to the wavelength shifts for a sample-camera distance of . This distance has been chosen to obtain a compact device and to provide a maximum shift of one full pixel at the same time.
The change of the illumination angle induces a shift in the Fourier domain; however, since the maximum angular shift is , this change is negligible in the reconstruction process.
Ten digital inline holograms are recorded, corresponding to one per driving current of the VCSEL. The stack of holograms is then processed in a pixel super-resolution algorithm [14] to reconstruct a highly resolved hologram that is then backpropagated [15].
A comparison between the resolution of the amplitude reconstructed image obtained with 10 subpixel shifted holograms and the resolution obtained with 1 hologram taken with a high dynamic range (HDR) is shown in Fig. 5. The HDR image uses as many holograms as the one reconstructed with the proposed method, which makes the contrast (hence, the resolution) comparison more correct.
A resolution of over a FOV of is demonstrated using a camera with pixels of 5.2 μm. The resolution is improved approximatively by a factor of two. Increasing the sampling rate, therefore, the number of images would result in a higher resolution gain. Unfortunately, this would also result in a longer acquisition time. In order to further increase the resolution without increasing the number of samples, in the future we will consider the introduction of a regularizer, e.g., total variation [16], in the current super-resolution algorithm. Ultimately, the improvement in resolution is limited by the NA of the detector subtending the object and by noise. The gray scale corresponds to intensity values.
The noisy background that can be observed in the reconstructed image is mainly due to two sources. The first one is the nonuniformity of the diffracted beam itself, especially because of the substrate of the photopolymer used to fabricate the gratings. The second is the twin image that creates unwanted diffraction patterns around the features. Indeed, in inline digital holography, the real and virtual images are superimposed with the DC term in the spectrum of the hologram. Therefore, one image (real or virtual) cannot be isolated before backpropagation. It is a well-known problem in inline holography, and it could be tackled using more image acquisition and processing [17–22]. This is out of the scope of this Letter, which has the objective of demonstrating pixel super-resolution. However, if the presented technique is combined with phase retrieval, the twin image problem can be solved in the phase retrieval process [17,20].
Two USAF 1951 test targets were superimposed and imaged simultaneously. One was situated at from the camera, and the second one was situated at from the camera. Since the samples are highly absorbing, the smallest features were placed at different locations on the camera in and directions to avoid the overlapping of large absorbing features. Figure 6 shows a sketch of the experiment.
A comparison between the resolution of the reconstructed amplitude obtained with 10 subpixel shifted holograms for both depth planes is shown in Fig. 7. Since the subpixel shifts depend on the distance between the sample and the camera, two sets of shifts were computed, one per object-camera distance. The two reconstructions of the hologram were carried out separately. Finally, the reconstructed holograms were propagated with the corresponding object-camera distance.
The same resolution is obtained for both targets. This resolution corresponds to the one obtained with the same number of holograms and only one sample between the camera and the prism (see Fig. 5). This shows that the same resolution increase can be obtained at different depths of a sample.
The presented device offers a large FOV of and a resolution of (four more groups are resolved compare to a reconstruction with only one hologram on 1951 USAF test target). The increase of resolution is obtained without any mechanical shifts and by using a cheap and efficient light source. This technique could be combined with digital off-axis holography design, such as in [23], to also obtain the phase of the sample with high resolution.
Acknowledgment
The authors would like to thank Prof. Pascal Frossard at EPFL for helpful discussions on the super-resolution algorithm.
REFERENCES
1. D. Claus and J. M. Rodenburg, Appl. Opt. 54, 1936 (2015). [CrossRef]
2. G. Zheng, S. A. Lee, Y. Antebi, M. B. Elowitz, and C. Yang, Proc. Natl. Acad. Sci. USA 108, 16889 (2011). [CrossRef]
3. A. C. Sobieranski, F. Inci, H. C. Tekin, E. Comunello, A. Von Wangenheim, and U. Demirci, 27th SIBGRAPI Conference on Graphics, Patterns and Images (2014), pp. 274–281.
4. X. Cui, L. M. Lee, X. Heng, W. Zhong, P. W. Sternberg, D. Psaltis, and C. Yang, Proc. Natl. Acad. Sci. USA 105, 10670 (2008). [CrossRef]
5. S. A. Lee, G. Zheng, S. Yang, and C. Yang, IEEE Winter Topicals (WTM) (2011), pp. 93–94.
6. W. Luo, A. Greenbaum, Y. Zhang, and A. Ozcan, Light Sci. Appl. 4, e261 (2015). [CrossRef]
7. A. C. Sobieranski, F. Inci, H. C. Tekin, M. Yuksekkaya, E. Comunello, D. Cobra, A. von Wangenheim, and U. Demirci, Light: Sci. Appl. 4, e346 (2015). [CrossRef]
8. W. Luo, Y. Zhang, A. Feizi, Z. Göröcs, and A. Ozcan, Light: Sci. Appl. 5, e16060 (2016). [CrossRef]
9. W. Bishara, U. Sikora, O. Mudanyali, T.-W. Su, O. Yaglidere, S. Luckhart, and A. Ozcan, Lab Chip 11, 1276 (2011). [CrossRef]
10. W. Bishara, T.-W. Su, A. F. Coskun, and A. Ozcan, Opt. Express 18, 11181 (2010). [CrossRef]
11. A. Greenbaum, W. Luo, B. Khademhosseinieh, T.-W. Su, A. F. Coskun, and A. Ozcan, Sci. Rep. 3, 1717 (2013). [CrossRef]
12. M. Rostykus, F. Soulez, M. Unser, and C. Moser, Opt. Express 25, 4438 (2017). [CrossRef]
13. M. Guizar-sicairos, S. T. Thurman, and J. R. Fienup, Opt. Lett. 33, 156 (2008). [CrossRef]
14. M. Elad and H. Y. Or, IEEE Trans. Image Process. 10, 1187 (2001). [CrossRef]
15. J. W. Goodman, Introduction to Fourier Optics, 3rd ed. (W. H. Freeman, 2005).
16. L. I. Rudin, S. Osher, and E. Fatemi, Phys. D Nonlinear Phenom. 60, 259 (1992). [CrossRef]
17. L. Denis, C. Fournier, T. Fournel, and C. Ducottet, Wavelets XI, SPIE’s Symposium on Optical Science and Technology, M. Papadakis, A. F. Laine, and M. A. Unser, eds., (2005), paper 59140J.
18. B. M. Hennelly, D. P. Kelly, N. Pandey, and D. Monaghan, China-Ireland Information and Communications Technologies Conference (2009).
19. G. Koren, F. Polack, and D. Joyeux, J. Opt. Soc. Am. A 10, 423 (1993). [CrossRef]
20. G. Liu and P. D. Scott, J. Opt. Soc. Am. A 4, 159 (1987). [CrossRef]
21. C. Cho, B. Choi, H. Kang, and S. Lee, Opt. Express 20, 22454 (2012). [CrossRef]
22. T. Latychevskaia and H.-W. Fink, Phys. Rev. Lett. 98, 233901 (2007). [CrossRef]
23. M. Rostykus and C. Moser, Opt. Express 25, 16652 (2017). [CrossRef]