Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Liquid crystal lens set in augmented reality systems and virtual reality systems for rapidly varifocal images and vision correction

Open Access Open Access

Abstract

The major challenges of augmented reality (AR) systems and virtual reality (VR) systems are varifocal images for vergence-accommodation conflict (VAC) and vision corrections. In this paper, we design a liquid crystal (LC) lens set consisting of three LC lenses for varifocal images and vision corrections in AR and VR. Four operating modes of such a LC lens set present three electrically tunable lens powers: 0, -0.79 diopters, -2 diopters, and -3.06 diopters by means of manipulation of polarization of incident light using electrically tunable half-wave-plates. The response time is fast(< 50 ms). We also demonstrate AR and VR systems by adopting the LC lens set to exhibit functions of varifocal images and vision corrections which enable to solve VAC as well as vision problem in AR and VR.

© 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

Corrections

Yi-Hsin Lin, Ting-Wei Huang, Hao-Hsin Huang, and Yu-Jen Wang, "Liquid crystal lens set in augmented reality systems and virtual reality systems for rapidly varifocal images and vision correction: erratum," Opt. Express 30, 28250-28250 (2022)
https://opg.optica.org/oe/abstract.cfm?uri=oe-30-15-28250

1. Introduction

Augmented reality (AR) combines computer-generated virtual images with surroundings. The optical engines in AR are designed to projected virtual images. Virtual reality (VR) is people who see projected virtual images when the distance between the projection lens and a display (a liquid crystal display or an organic light-emitting diode) is less than a focal length of the projection lens. In 2021 AR Optics Academic Forum, Meta FRL, chief scientist, Dr. Michael Abrash, said that the ultimate goal of AR and VR are eyeglass-looks, power consumption of the system less than 1 watt, light weight (<70 g), and socially acceptable appearance. However, AR or VR wearable devices still suffer from two main problems related to human eyes: vergence-accommodation conflict (VAC) and the vision corrections [16]. When human eyes intend to see a real object, the movement of both the eyes is triggered by the stereoscopic disparity, and the eyeballs start to rotate (vergence) toward the object of interest. Subsequently, the crystalline lenses of two eyes start to change their curvatures, which leads to a change in the focal length (i.e., accommodation) until the eyes see the object of interest clearly. Two dimensional images with disparity in AR and VR are generated for a binocular view to realize three dimensional experiences. When the mismatch between vergence and accommodation is large, people feel visual discomfort and fatigue [7]. In monovision, when the virtual image does not coincide with a real object, the eyes have to accommodate constantly in order to see both of the real object and the projected virtual image. This is so-called a registration problem (or focus rivalry). The registration problem occurs only in AR optical systems, and the solutions proposed to address this problem can also be used to help in the VAC problem [6]. Generally, the optical elements in the current AR and VR systems provide fixed optical properties, resulting in the virtual image located at a fixed location which leads to unavoidable VAC. Tunability in optical systems could help to achieve VAC-free AR/VR systems. As to vision correction, people have different eye conditions, but the designs of AR/VR systems are not tailored to all people. It needs tunable optics in AR/VR systems. Therefore, VAC-free AR/VR systems with vision correction should be developed.

In literatures, many research groups proposed tunable optics to solve VAC and vision correction in AR/VR. [5,6,811] The focal surface approach uses a spatial light modulator (SLM) as a freeform optics in order to provide arbitrary depth of image plane; however, the image quality of the projected image is limited by the resolution of the SLM [12]. A digitally switchable multi-focal lens is proposed by using SLM and freeform optics [13]. Both of the resolution of the SLM and the fabrication of the freeform lens limit the performance. Implementing a tunable plate can shift the image plane by changing the optical path length, but this approach generates limited range of the image depth as well as extra optical wavefront aberrations [14]. The light field approach provides a true 3 dimensional image, but its resolution degrades intrinsically [1517]. For tunable lenses approach, the current gradient-index liquid crystal lenses present slow response time (∼1 sec) or small lens powers for shifting the image plane [6,1823]. In 2009, G. D. Love et. al. cleverly proposed a high-speed switchable lens using two ferroelectric liquid-crystal(LC) polarization switches and two birefringent calcite lenses for the original purpose of a volumetric stereoscopic display [24]. The first polarizer produces vertically polarized light that is either rotated or not by the first ferroelectric LC polarization switch. The first lens focuses the two polarization states differently. A second ferroelectric LC switch and lens produce two more possible focal lengths for each of the first polarization states creating four focal states in all. Later on, many papers demonstrated different kind of tunable lenses based on the principle of a polarization controller combined with a passive anisotropic lens [2530]. However, to date, no tunable optical elements could fit both AR/VR systems. In this paper, we develop a LC lens set whose focal length is rapidly tunable (<50 msec) and it shows 4 operating modes with 4 lens powers. The maximum lens power is ∼ 3.06 diopters. Moreover, it could be used in both of AR and VR systems to provide functions of VAC-free as well as vision correction. The design and mechanism of the LC lens set are discussed. The performance of AR and VR systems adopted with the LC lens set is also demonstrated for proof-of-concept. The impact of this study is to inspire researchers to develop tunable optics for AR/VR systems.

2. Operating principles

The structure and operating principle of the LC lenses are depicted in Figs. 1(a) to 1(c). The structure of a LC lens consists of three glass substrates, two indium-tin-oxide (ITO) layers, four alignment layers, a layer of nematic LC, a lens (i.e., plano-convex glass lens) and one LC polymeric layer, as illustrated in Fig. 1(a). The LC layer, so-called twisted nematic (TN) LC cell or TN cell, functions as a tunable half-wave plate for the purpose of switching polarizations of light. In the LC layer, the LC molecules near the top and bottom glass substrates are aligned along x-direction and z-direction, respectively. The LC molecules are then rotated gradually from x-direction to z-direction from top to bottom of the TN cell. Without the external electric field, the z-linearly polarized light incident to the LC layer is converted to x-linearly polarized light. This is because the excitation of linearly polarized x-eigen-mode in the twist of LC molecules when the incident light is linearly polarized z-eigen-mode. The x-linearly polarized light then propagates to the LC polymeric layer. The lens power of the LC polymeric layer is related to the polarization of light. The x-linearly polarized light is diverged because of a negative lens power (PLC) resulting from the summation of a positive lens power of the lens and a negative lens power of the LC polymeric layer. PLC then equals to (ng-n’e)/R < 0, where R is the radius of curvature of the lens, n’e is extraordinary refractive index of LC polymeric layer, and ng is refractive index of the lens (ng < n’e). The LC lens then functions as a negative lens at V = 0. When the voltage(V) exceeds the threshold voltage (Vth) a lot, the LC molecules are reoriented along y-direction and then the z-linearly polarization remains. For the z-linearly polarized light, PLC then equals to (ng-n’o)/R, where n’o is ordinary refractive index of LC polymeric layer. The z-linearly polarized light is still collimated because ng ∼n’o, as depicted in Fig. 1(c). Thus, no focusing effect at V>>Vth. The difference of the lens powers between V = 0 and V>>Vth is Δn’/R, where Δn’ is the birefringence of the LC polymeric layer (i.e., Δn’ = n’e-n’o). Therefore, the LC lens has two different lens powers.

 figure: Fig. 1.

Fig. 1. (a) Structure of the LC lens. Red arrows indicate the rubbing direction of the alignment layers. (b) The LC lens is a negative lens at V = 0. (c) No focusing effect of the LC lens at V>>Vth. The LC polymeric layer functions as a passive anisotropic lens. When three LC lenses stack together, 4 LC modes are displayed: (d) LC mode 0, (e)LC mode 1, (f) LC mode 2, and (g) LC mode 3.

Download Full Size | PDF

Four LC modes could be operated when we use three LC lenses and one polarizer (we call “LC lens set”). Three LC lenses (Lens A, Lens B and Lens C) are stacked together, and one polarizer is attached for the purpose of z-linearly polarized incident light, as depicted in Figs. 1(d)–1(g). In Fig. 1(d), three LC lenses turn on (V>> Vth), the z-linearly polarized light propagates through three LC lenses without changing polarization and then the LC lens set exhibits no focusing effect. In Fig. 1(e), only lens C turns on, z-linearly polarized light is switched to x-linearly polarization after passing through lens A and then is switched back to z-linearly polarization. The lens power equals (ng-n’e)/R. Similarly, when only the lens B turns on, z-linearly polarized light is switched to x-linearly polarization after passing through two lenses (lens A and lens B) and then is switched back to z-linearly polarization. The lens power is 2x(ng-n’e)/R (Fig. 1(f)). When both of lens B and lens C turn on, z-linearly polarized light is switched to x-linearly polarization, the lens power is 3x(ng-n’e)/R (Fig. 1(g)). Here, the operation modes in Figs. 1(d)–1(g) are called “LC mode 0”, “LC mode 1”, “LC mode 2”, and “LC mode 3”, respectively.

The basic of AR or VR systems is the image formation. Assume the system has a lens and a LC lens set as depicted in Fig. 2. The objective distance is p, image distance is q, the focal length of the lens is f and the focal length of the LC lens set is fLC. The image formation for such a system follows Eq. (1) [6]:

$$\frac{1}{p} + \frac{1}{q} = \frac{1}{f} + \frac{1}{{{f_{LC}}}}\;. $$

We project the virtual image in a AR or VR system which means q < 0. When fLC is infinite (i.e. lens power = 1/ fLC =0), the image formation turns out:

$$\frac{1}{p} + \frac{1}{{q\mathrm{^{\prime}}}} = \frac{1}{f}\;$$

 figure: Fig. 2.

Fig. 2. The image system consists of a lens and a LC lens.

Download Full Size | PDF

Because of the virtual image in a AR or VR, q’<0 and that requires p < f. From Eqs. (1) and (2), we could obtain Eq. (3):

$$\frac{1}{q} - \frac{1}{{q\mathrm{^{\prime}}}} = \frac{1}{{{f_{LC}}}}. $$

When the lens power of the LC lens set (1/ fLC) > 0, this means: $\frac{1}{q} - \frac{1}{{q\mathrm{^{\prime}}}}\mathrm{> }0$ which also indicates $|q |\mathrm{> }|{q^{\prime}} |$ . When we operate the LC lens set as a positive lens, the virtual image is away from the lens ($|q |\mathrm{> }|{q^{\prime}} |$). Similarly, When we operate LC lens set as a negative lens, the virtual image is close to the lens ($|{q^{\prime}} |\mathrm{> }|q |$). This means the virtual images in AR or VR system are going to move close to the eyes when the LC lens set is operated from LC mode 0 to LC mode 3. For the vision correction in AR or VR system, the LC lens set is operated as a negative lens for myopia. Thus, the LC lens set could help in varifocal images in both of AR and VR systems and vision correction for myopia.

The fabrication of sample in Fig. 1(a) includes two parts: one is fabrication of TN cell and the other one is the part of the LC polymeric layer. For the TN LC cell, the nematic LC (Merck, E7, Δn = 0.2255) was sandwiched between two ITO glass substrates coated with rubbed polyimide layers (Nissan 7492) which were mechanically buffed and the glass substrates were assembled in an anti-parallel fashion with respect to the rubbing direction. The thickness of the LC layer was 8 microns. As to the LC polymeric layer, we prepared a flat glass substrate and a plano-convex glass lens (BK7) with a lens power of + 4.75 diopters (D) and a radius of curvature of 108 mm. The flat glass substrate and a plano-convex glass lens were coated with mechanically buffered polyimide layers as alignment layers. The rubbing directions at the flat glass substrate and a plano-convex glass lens were arranged in an anti-parallel fashion. We then used the one drop filling method [31] to sandwich nematic LC (Merck, MLC-2144, Δn = 0.2493 for λ = 589.3 nm at 21°C,), reactive mesogen (RM257, Δn = 0.18 for λ = 633nm, Merck) and photoinitiator (IRG-184, Merck) at a ratio of 20:79:1 wt% between the flat glass substrate and the plano-convex glass lens. We exposed the UV light (λ = 365 nm) to the sample for photo-polymerization. After photo-polymerization, we attached the TN cell with the sample of the LC polymeric layer. The thicknesses in the center of the LC polymeric layer and in the peripheral region were around ∼10 µm and ∼ 473 µm, respectively. The aperture size of the LC lens is 20 mm. After we prepared three LC lenses, we stacked them together with a polarizer as a LC lens set. The calculated the lens powers are -0.037 D at V>>Vth and -1.35D at V = 0 based on the parameters of sample fabrication: ng = 1.514, n’e = 1.66, and n’o = 1.518, R = 0.108 m.

3. Experiments and discussion

Before we assembled TN cell to the sample of the LC polymeric layer, we measured the voltage-dependent transmission of the TN cell. The light source was He-Ne laser (Meredith Instruments, HNH-10-633, λ= 633 nm). The TN cell was placed between two crossed polarizers in which one of the transmissive axes was parallel to z-axis and a photodetector (Newport, model 2031) was used to record corresponding transmission. The measured result is shown in Fig. 3(a). The transmission starts to drop after the applied voltage exceeds the threshold voltage (Vth= 0.5 Vrms, f= 1000 Hz). The transmission drops to 0 as V> 2.5 Vrms which means the z-linearly polarized light is converted to x-linearly polarized light. The small up and down between 0.5 Vrms and 1.3 Vrms is because the TN cell does not satisfy the Mauguin condition [31,32]. Mauguin parameter(u): $u = 2 \cdot d \cdot {{\Delta \textrm{n}} / \lambda }$=5.67. To satisfy the Mauguin condition, $u$ should >>1. The measured response times of TN, rise time and decay time, are depicted in Figs. 3(b) and 3(c). We turned on and off applied voltage from 0 to 10 Vrms and 10 Vrms to 0. The rise time is around 1.5 ms and decay time is around 45 ms. Such response times are fast enough to switch varifocal images of AR and VR which could help solving VAC problem. After we assembled TN cell to the sample of the LC polymeric layer in order to construct the LC lens in Fig. 1(a), we measured the lens power of the LC lens by converting the measured wavefronts. The system of wavefront measurement consists of a laser (a diode pumped solid state laser, λ = 532 nm), a single mode fiber to form a point source, a solid lens with a focal length of 20 cm for converting the point source into a collimated light, a linear polarizer to control the polarization of incident plane wave, a pair of homogeneous index lenses (focal length: 26.7 cm and 6.3 cm) as relay optics, and a Shack-Hartmann wavefront sensor (WFS150-7AR, Thorlabs). The samples of the LC lens were placed at the front focal plane of the relay optics. In the measurement, the results from the wavefront sensor were fitted using the first 21 Zernike polynomials (i = 0-20) corresponding to 5th order Zernike coefficients with ANSI (American National Standards Institute) standard. The lens power is obtained using equation: ${\bar{P}_{LC}} ={-} {{4\sqrt {3 \cdot } {c_4}} / {{r^2}}}$, where c4 is the Zernike coefficient for i = 4 [33]. The lens power is defined as a reciprocal of a focal length with the unit of diopter (D) or m-1. The measured wavefronts of the LC lens at V = 0 and V = 10 Vrms (f = 1kHz) are shown in Figs. 3(d) and 3(e). The measured lens powers are -1.12 D at V = 0 and +0.09 D at 10 Vrms. The change of the lens power is 1.21 D. This sample denotes as Lens B. We prepared two more LC lenses which changes to the lens power are 1.09 D (–0.96 D at 0V and +0.13 D at 10 Vrms) and 1.06 D (-0.98 D at 0V and +0.08 D at 10 Vrms). These two lenses are denoted as Lens A and Lens C, respectively. The lens powers are smaller than the theoretical calculation due to fabrication errors of the polymeric layers. The corresponding optical path differences (OPD) of three LC lenses from cross sections of wavefront measurements are depicted in Fig. 3(f). When the TN cell turns off, the z-lineay polarized light is converted to x-linearly polarized light which is an extraordinary wave(e-wave) to the LC polymeric layer. Similarly, the z-linearly polarized light is ordinary wave(o-wave) to the LC polymeric layer as the TN cell turns off. In Fig. 3(f), we can see three LC lenses have closed OPD (50∼55 microns) at 10 Vrms but slight difference at V = 0. This is due to the variations in thickness of the polymeric layers.

 figure: Fig. 3.

Fig. 3. (a) Voltage dependent transmission of TN cell. (b) is rise time and (c) is decay time of the TN cell. Measured wavefronts of the LC lens at (d)V = 0 and (e)V = 10 Vrms. (f) Optical path difference of three LC lenses from cross sections of wavefront measurements. e-wave means V = 0 of a TN cell (solid lines) and o-wave means V = 10 Vrms of a TN cell (dotted lines).

Download Full Size | PDF

Thereafter, we attached three LC lenses with a polarizer together as a LC lens set and then the wavefronts for operating 4 different modes are shown in Figs. 1(d)–1(g). The results are shown in Figs. 4(a) to 4(d). Four LC modes display -2.75 D for the LC mode 3, -1.80D for the LC mode 2, -0.79D for the LC mode1, and +0.32D for the LC mode 0. When we add the results of three LC lenses directly from Fig. 3(f), the calculated four LC modes are -3.06 D for the LC mode 3, -2.00 D for the LC mode 2, -0.79D for the LC mode1, and +0.30D for the LC mode 0. Figure 4(e) shows OPD of the LC lens set from cross sections of wavefront measurements (solid lines) and OPD from adding the results of three LC lenses in Fig. 3(f) (dotted lines). Compared the lens powers of the LC lens set and the lens powers from addition of three individual LC lens, the lens powers, calculated from the Zernike coefficient c4, are slightly different. From Fig. 4(e), we can see the variation of wavefronts and this results from the assembly error of three lenses.

 figure: Fig. 4.

Fig. 4. Measured wavefront of the LC lens set (three LC lenses). (a) LC Mode 3: V = 0 in Lens A, and V = 10 Vrms in both of Lens B and Lens C. (b) LC Mode 2: V = 0 in both Lens A and Lens C, and V = 10 Vrms in Lens B. (c) LC Mode 1: V = 0 in both Lens A and Lens B, and V = 10 Vrms in Lens C.(d) LC Mode 0: V = 10 in three lenses.(e) Optical path difference (OPD) of the LC lens set from cross sections of wavefront measurements(solid lines) and from adding the results of three LC lenses in Fig. 2(f) (dotted lines).

Download Full Size | PDF

To further demonstrate that the LC lens set could provide electrically tunable varifocal virtual image and vision correction in both of AR and VR system, we set up a simple VR system for proof-of-concept. We used a camera, a solid lens with a lens power of 20 D (i.e. focal length of 5 cm), the LC lens set and a cell phone (Apple, iphone 12). The cell phone was placed 4.65 cm (less than focal length of the solid lens) away from the LC lens set. We input many “NYCU” on the cell phone screen. In order to identify the locations of virtual images at different LC modes, we also placed several papers printed with words and then adjusted the locations of the papers till the camera saw the clear images on the papers. Figures 5(a) to 5(d) exhibit the performance of the virtual images at four LC modes. The locations of four virtual images are 68.17 cm for LC mode 0, 38.97 cm for LC mode 1, 25.47 cm for LC mode 2, and 19.67 cm for LC mode 3. The changes of lens power is 3.62 D (1/0.1967-1/0.6817 = 3.62) which is larger than the measurement of 3.06 D. This is because the effective aperture size we see from camera is less than 20 mm. The effective aperture size is calculated∼ 18.4 mm based on lens power inversely proportional to squared aperture size. From Figs. 5(a) to 5(d), the 4 virtual image planes are electrically switchable with fast response time (∼50 ms). The fast-switching varifocal images are able to solve the VAC problem. In Fig. 5, the image sharpness could be further optimized by reducing the image ghost caused by multiple reflections, which mainly originates from between air and glass interface (see Figs. 1(d)–1(g)), with anti-reflection coating. In addition, since the TN cell does not well satisfy the Mauguin condition for λ= 633 nm), it is prone to high wavelength dispersion caused by internal reflections and causes the color shifting effect. As a result, we can observe color-dependent magnification in Fig. 5 . The aberration in Fig. 5 is from large lens power of the solid lens (20D).

 figure: Fig. 5.

Fig. 5. Varifocal testing of VR. Recorded images at (a) LC mode 0, (b) LC mode 1, (c) LC mode 2, and (d) LC mode 3.

Download Full Size | PDF

To demonstrate the LC lens set is able to help in vision correction in VR, we also set up the similar VR system, depicted in Fig. 6(a). The LC lens set was attached to the solid lens and a convex lens was placed in front of the camera. At first, without the convex lens, we adjusted the camera till we saw the clear image on the cell phone. Then we placed a convex lens in front of camera in order to mimic myopia eye. We used a convex lens with lens powers of +1D and then the blurred image was observed in Fig. 6(b). Thereafter, we observed clear image in Fig. 4(e) after the LC lens set was operated in LC mode 1. This means the LC lens set at LC mode 1 could correct myopia with 1D and it indicates the lens power of the LC lens set at LC mode 1 is around -1D. Similarly, we used different convex lenses with lens powers of +2.5D, and +3.5D while the LC lens set was at LC mode 0. The images were shown in Figs. 6(c) and 6(d). The images are more blurred as the lens power of the convex lens increases (Figs. 6(b) to 6(d)). Then the LC lens set was operated in LC mode 2, and LC mode 3, the images turned out clear in Figs. 6(f) and 6(g), respectively. This means the lens powers of the LC lens set at LC mode 2 and LC mode 3 are around -2.5D and -3.5 D, respectively. We can see that the LC lens set could be used for vision correction. From Figs. 6(b) to 6(g), the lens powers of the LC lens set (-1D, -2.5, and -3.5D) are larger than those from the wavefront measurement. This is also because of the effective aperture size is around 18.4 mm, not 20 mm. When we calculate the lens powers for the aperture size of 18.4 mm, the lens powers turn out 3.61 D for LC mode 3, 2.36 D for LC mode 2, 0.93 D for LC mode 1 which are close to the lens powers of the convex lenses used in Fig. 6.

 figure: Fig. 6.

Fig. 6. (a) Experimental setup for vision correction of VR. We use a camera and a convex lens to mimic a myopia eye. In LC mode 0, the recorded images as convex lens is (b) + 1D, (c) +2.5D, and (d) +3.5D. The blurred images in (b), (c), and (d) are corrected after the LC lens set is operated at (e) LC mode 1, (f) LC mode 2, and (g) LC mode 3, respectively.

Download Full Size | PDF

To demonstrate the varifocal imaging of the LC lens set in AR, we set up a simple AR system, as illustrated in Fig. 7(a). The AR system consists of a microLED display (JBD, JBD5UM720PG, active area: 0.31 inch, resolution: 1280 × 720, 5000ppi, λ=525nm), the LC lens set, a solid lens with lens power of 20 D, a beam splitter, and a camera. The distance between the microLED and the solid lens should be less than the focal length of the solid lens in order to satisfy the image formation of a virtual image. We placed several targets at 532 cm (new year scroll), 76, cm(tiger), 38 cm (cabbage) and 26 cm(dolls). In Fig. 7(b), the camera was set to see the images located at 532 cm away from the beamsplitter without the LC lens set. When we put the LC lens set to the setup and the LC lens set was at LC mode 0, the camera saw both the new year scroll and projected virtual image “NYCU 534cm” clearly. The image distance was 534 cm by adding 2 cm, the distance between the beamsplitter and the solid lens. We then adjusted the camera in order to see the dolls at 26 cm clearly (Fig. 7(c)). Since the virtual image was still located at the 532 cm, the virtual image was blurred in Fig. 7(c). After the LC lens set was operated at LC mode 3 and we input words “NYCU 28 cm” to the microLED display, we saw both of cabbage and “NYCU 28 cm” were clear in Fig. 7(d). This indicates both of the cabbage and “NYCU 28 cm” (the real object and the virtual image) were located in 26 cm away from the beamsplitter. The image distance was 28 cm. The change of the lens power of the LC lens set is 3.38D (1/0.28-1/5.34 = 3.38) which is close to the experimental result of 3.06 D. In Figs. 7(e) to 7(h), we adjusted camera to see the real objects at 4 locations and then the LC lens set were operated at LC mode 0, LC mode 1, LC mode 2, and LC mode 3, respectively. From Figs. 7(e) to 7(h), we were able to rapidly switch virtual images at 4 locations to realize the varifocal function in AR.

 figure: Fig. 7.

Fig. 7. (a)Experimental setup for varifocal testing of AR. (b) Recorded images at LC mode 0. The real image and virtual image(“NYCU 534 cm”) located at 532 cm are clear. (b) We adjust camera till the dolls are clear, but the virtual image is blurred. (d) To see the clear virtual image, LC lens set is operated at LC mode 3. Both of the dolls and the virtual image(“NYCU 28cm”). The virtual image is at 532 cm, 76 cm, 38 cm, and 26 cm as the LC lens set is operated at (e)LC mode 0, (f) LC mode 1, (g) LC mode 2, and (h) LC mode 3, respectively.

Download Full Size | PDF

To demonstrate LC lens set is also able to perform vision correction in AR, we used the same AR setup, but we changed the position of the LC lens set (Fig. 8(a)). In addition, we also placed a convex lens in front of camera for the purpose of mimicking an eye with myopia. In the beginning, we set camera to see the object located at 532 cm (new year scroll). The images of new year scroll and the virtual image (“NYCU 534 cm”) were blurred in Fig. 8(b) after we put the convex lens of +1D to the experimental setup. However, the tiger became clear because the image plane shifted to where the tiger is. After we turned on the LC lens set at LC mode 1, the blurred images of the new year scroll and “NYCU 534 cm” became clear again. Similarly, the blurred images at 532 cm would become clear again by operating of LC lens set at LC mode 2 and LC mode 3 (Figs. 8(f) and 8(g)) when the images were blurred causing by convex lenses in Figs. 8(c) and 8(d). From above, the vision correction in this AR system could be realized. From Figs. 8(b) to 8(g), it indicates the LC lens set are around -1D, -2.5D and -3.5D when the LC lens set is operated at LC mode 1, LC mode 2, and LC mode 3, respectively. This is close to the results in Fig. 6.

 figure: Fig. 8.

Fig. 8. (a) Experimental setup for vision correction of AR. We use a camera and a convex lens to mimic a myopia eye. In LC mode 0, the recorded images as convex lens is (b) + 1D, (c) +2.5D, (d) +3.5D. The blurred images in (b), (c), and (d) are corrected after the LC lens set is operated at (e) LC mode 1, (f) LC mode 2, and (g) LC mode 3, respectively.

Download Full Size | PDF

From above, the LC lens set with 4 operated modes could be applied to both of AR and VR systems for varifocal images as well as vision corrections. The response time is less than 50 msec which is faster than the response time of the typical response time of GRIN LC lens ∼ couple hundreds msec to 1 sec [19]. Fast response time is a requirement of varifocal images for the purpose of solving VAC. To further understand how tunable optics with fast response time could improve viewer comfort (or solve VAC), the paper published by Paul V. Johnson et. al. explained the mechanism well [8]. As to how large of the lens power of a tunable lens is enough for varifocal images in VR, X. Hu and H. Hua also explained that the lens power of 3D is enough for varifocal images in VR to solve VAC [34]. In terms of the vision corrections, according to statistical analysis of European Eye Epidemiology Consortium, the lens power of -3D already covers 81.6% of myopia people in Europe [35]. As a result, the LC lens set we proposed in this paper is good for solve VAC in AR/VR as well as vision problem for most of myopia people. To further enlarge the lens powers, more LC lens could be used in a LC lens set, but the tradeoff is the transmittance due to multiple interfaces. To achieve a certain lens power, we can use more LC cells to reduce the thickness of each LC layer for increasing the order parameter of LC and then reduce the light scattering effect. However, when we keep cascading the LC cells for a larger lens power, the overall scattering effect could increase.

4. Conclusion

We design a LC lens set consisting of three LC lenses for varifocal images and vision corrections in both of AR and VR systems. Four operating modes of such a LC lens set could exhibit electrically tunable three lens powers: 0 diopter, -0.79 diopter, -2 diopters, and -3.06 diopters by means of manipulation of polarization of incident light using tunable half wave plate (i.e., TN cell). The response time is fast < 50 ms compared to the typical GRIN LC lens (∼1 sec). We also demonstrate how to apply the LC lens set to both of AR and VR systems to display functions of varifocal images and vision corrections. The tunable range and the response time are suitable for varifocal images. The range of lens powers could cover most of population of myopia in Europe. The fast-switching LC lens set has great potential not only in applications of AR/VR, but also applications of detection in Advanced Driver Assistance Systems (ADAS) and surveillance system.

Funding

Ministry of Science and Technology, Taiwan (110-2112-M-A49-024, 110-2218-E-A49-019-MBK).

Acknowledgments

The authors are indebted to Mr. Yi-Siang Tsai for technical assistances.

Disclosures

The authors declare no conflicts of interest

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. D. M. Hoffman, A. R. Girshick, K. Akeley, and M. S. Banks, “Vergence–accommodation conflicts hinder visual performance and cause visual fatigue,” J. Vis. 8(3), 33 (2008). [CrossRef]  

2. O. Cakmakci and J. P. Rolland, “Head-worn displays: a review,” J. Disp. Technol. 2(3), 199–216 (2006). [CrossRef]  

3. J. P. Rolland and O. Cakmakci, “Head-worn displays: the future through new eyes,” Opt. Photonics News 20(4), 20–27 (2009). [CrossRef]  

4. S. K. Feiner, “Augmented Reality: A New Way of Seeing,” Sci. Am. 286(4), 48–55 (2002). [CrossRef]  

5. B. Kress, Optical architectures for augmented-, virtual-, and mixed-reality headsets (SPIE, 2020).

6. Y. J. Wang and Y. H. Lin, “Liquid crystal technology for vergence-accommodation conflicts in augmented reality and virtual reality systems: a review,” Liq. Cryst. Rev. 9(1), 35–64 (2021). [CrossRef]  

7. T. Shibata, J. Kim, D. M. Hoffman, and M. S. Banks, “The zone of comfort: predicting visual discomfort with stereo displays,” J. Vis. 11(8), 11 (2011). [CrossRef]  

8. P. V. Johnson, J. A. Parnell, J. Kim, C. D. Saunter, G. D. Love, and M. S. Banks, “Dynamic lens and monovision 3D displays to improve viewer comfort,” Opt. Express 24(11), 11808–11827 (2016). [CrossRef]  

9. S. Liu, Y. Li, and Y. Su, “Multiplane displays based on liquid crystals for AR application,” J. Soc. Inf. Disp. 28(3), 224–240 (2020). [CrossRef]  

10. T. Zhan, J. Xiong, J. Zou, and S. T. Wu, “Multifocal displays: review and prospect,” PhotoniX 1(1), 10 (2020). [CrossRef]  

11. C. Chang, K. Bang, G. Wetzstein, B. Lee, and L. Gao, “Toward the next-generation VR/AR optics: a review of holographic near-eye displays from a human-centric perspective,” Optica 7(11), 1563–1578 (2020). [CrossRef]  

12. N. Matsuda, A. Fix, and D. Lanman, “Focal surface displays,” ACM Trans. Graph. 36(4), 1–14 (2017). [CrossRef]  

13. X. Wang, Y. Qin, H. Hua, Y. H. Lee, and S. T. Wu, “Digitally switchable multi-focal lens using freeform optics,” Opt. Express 26(8), 11007–11017 (2018). [CrossRef]  

14. Y. J. Wang, Y. H. Lin, O. Cakmakci, and V. Reshetnyak, “Varifocal augmented reality adopting electrically tunable uniaxial plane-parallel plates,” Opt. Express 28(15), 23023–23036 (2020). [CrossRef]  

15. B. Lee, “Three-dimensional displays, past and present,” Phys. Today 66(4), 36–41 (2013). [CrossRef]  

16. H. Huang and H. Hua, “Effects of ray position sampling on the visual responses of 3D light field displays,” Opt. Express 27(7), 9343–9360 (2019). [CrossRef]  

17. D. Kim, S. Lee, S. Moon, J. Cho, Y. Jo, and B. Lee, “Hybrid multi-layer displays providing accommodation cues,” Opt. Express 26(13), 17170–17184 (2018). [CrossRef]  

18. H. Ren and S. T. Wu, Introduction to Adaptive Lenses (Wiley, 2012).

19. Y. H. Lin, Y. J. Wang, and V. Reshetnyak, “Liquid crystal lenses with tunable focal length,” Liq. Cryst. Rev. 5(2), 111–143 (2017). [CrossRef]  

20. Y. H. Lin and H. S. Chen, “Electrically tunable-focusing and polarizer-free liquid crystal lenses for ophthalmic applications,” Opt. Express 21(8), 9428–9436 (2013). [CrossRef]  

21. H. S. Chen, Y. J. Wang, P. J. Chen, and Y. H. Lin, “Electrically adjustable location of a projected image in augmented reality via a liquid crystal lens,” Opt. Express 23(22), 28154–28162 (2015). [CrossRef]  

22. Y. J. Wang, P. J. Chen, X. Liang, and Y. H. Lin, “Augmented reality with image registration, vision, correction and sunlight readability via liquid crystal devices,” Sci. Rep. 7(1), 433 (2017). [CrossRef]  

23. Y. J. Wang and Y. H. Lin, “An optical system for augmented reality with electrically tunable optical zoom function and image registration exploiting liquid crystal lenses,” Opt. Express 27(15), 21163–21172 (2019). [CrossRef]  

24. G. D. Love, D. M. Hoffman, P. J. Hands, J. Gao, A. K. Kirby, and M. S. Banks, “High-speed switchable lens enables the development of a volumetric stereoscopic display,” Opt. Express 17(18), 15716–15725 (2009). [CrossRef]  

25. H. S. Chen, Y. H. Lin, A. K. Srivastava, V. G. Chigrinov, C. M. Chang, and Y. J. Wang, “A large bistable negative lens by integrating a polarization switch with a passively anisotropic focusing element,” Opt. Express 22(11), 13138–13145 (2014). [CrossRef]  

26. H. S. Chen, Y. H. Lin, C. M. Chang, Y. J. Wang, A. K. Srivastava, J. T. Sun, and V. G. Chigrinov, “A polarized bifocal switch based on liquid crystals operated electrically and optically,” J. Appl. Phys. 117(4), 044502 (2015). [CrossRef]  

27. T. Zhan, Y. H. Lee, and S. T. Wu, “High-resolution additive light field near-eye display by switchable Pancharatnam–Berry phase lenses,” Opt. Express 26(4), 4863–4872 (2018). [CrossRef]  

28. S. Moon, C.-K. Lee, S.-W. Nam, C. Jang, G.-Y. Lee, W. Seo, G. Sung, H.-S. Lee, and B. Lee, “Augmented reality near-eye display using Pancharatnam-Berry phase lenses,” Sci. Rep. 9(1), 6616 (2019). [CrossRef]  

29. S. Mukherjee, Z. Yuan, Z. Sun, A. Li, C. Kang, H. S. Kwok, and A. K. Srivastava, “Fast refocusing lens based on ferroelectric liquid crystals,” Opt. Express 29(6), 8258–8267 (2021). [CrossRef]  

30. J. Xiong and S. T. Wu, “Planar liquid crystal polarization optics for augmented reality and virtual reality: from fundamentals to applications,” eLight 1(1), 3 (2021). [CrossRef]  

31. D. K. Yang and S. T. Wu, Fundamentals of liquid crystal devices (Wiley, 2006).

32. P. Yeh and C. Gu, Optics of Liquid Crystal Display, 2ed (Wiley, 2010).

33. G. M. Dai, Wavefront optics for vision correction (SPIE, 2008).

34. X. Hu and H. Hua, “High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics,” Opt. Express 22(11), 13896–13903 (2014). [CrossRef]  

35. K. M. Williams, V. J. M. Verhoeven, P. Cumberland, G. Bertelsen, C. Wolfram, G. H. S. Buitendijk, A. Hofman, C. M. van Duijn, J. R. Vingerling, R. W. A. M. Kuijpers, R. Höhn, A. Mirshahi, A. P. Khawaja, R. N. Luben, M. G. Erke, T. von Hanno, O. Mahroo, R. Hogg, C. Gieger, A. Cougnard-Grégoire, E. Anastasopoulos, A. Bron, J.-F. Dartigues, J.-F. Korobelnik, C. Creuzot-Garcher, F. Topouzis, C. Delcourt, J. Rahi, T. Meitinger, A. Fletcher, P. J. Foster, N. Pfeiffer, C. C. W. Klaver, and C. J. Hammond, “Prevalence of refractive error in Europe: the European Eye Epidemiology (E(3)) Consortium,” Eur. J. Epidemiol. 30(4), 305–315 (2015). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (8)

Fig. 1.
Fig. 1. (a) Structure of the LC lens. Red arrows indicate the rubbing direction of the alignment layers. (b) The LC lens is a negative lens at V = 0. (c) No focusing effect of the LC lens at V>>Vth. The LC polymeric layer functions as a passive anisotropic lens. When three LC lenses stack together, 4 LC modes are displayed: (d) LC mode 0, (e)LC mode 1, (f) LC mode 2, and (g) LC mode 3.
Fig. 2.
Fig. 2. The image system consists of a lens and a LC lens.
Fig. 3.
Fig. 3. (a) Voltage dependent transmission of TN cell. (b) is rise time and (c) is decay time of the TN cell. Measured wavefronts of the LC lens at (d)V = 0 and (e)V = 10 Vrms. (f) Optical path difference of three LC lenses from cross sections of wavefront measurements. e-wave means V = 0 of a TN cell (solid lines) and o-wave means V = 10 Vrms of a TN cell (dotted lines).
Fig. 4.
Fig. 4. Measured wavefront of the LC lens set (three LC lenses). (a) LC Mode 3: V = 0 in Lens A, and V = 10 Vrms in both of Lens B and Lens C. (b) LC Mode 2: V = 0 in both Lens A and Lens C, and V = 10 Vrms in Lens B. (c) LC Mode 1: V = 0 in both Lens A and Lens B, and V = 10 Vrms in Lens C.(d) LC Mode 0: V = 10 in three lenses.(e) Optical path difference (OPD) of the LC lens set from cross sections of wavefront measurements(solid lines) and from adding the results of three LC lenses in Fig. 2(f) (dotted lines).
Fig. 5.
Fig. 5. Varifocal testing of VR. Recorded images at (a) LC mode 0, (b) LC mode 1, (c) LC mode 2, and (d) LC mode 3.
Fig. 6.
Fig. 6. (a) Experimental setup for vision correction of VR. We use a camera and a convex lens to mimic a myopia eye. In LC mode 0, the recorded images as convex lens is (b) + 1D, (c) +2.5D, and (d) +3.5D. The blurred images in (b), (c), and (d) are corrected after the LC lens set is operated at (e) LC mode 1, (f) LC mode 2, and (g) LC mode 3, respectively.
Fig. 7.
Fig. 7. (a)Experimental setup for varifocal testing of AR. (b) Recorded images at LC mode 0. The real image and virtual image(“NYCU 534 cm”) located at 532 cm are clear. (b) We adjust camera till the dolls are clear, but the virtual image is blurred. (d) To see the clear virtual image, LC lens set is operated at LC mode 3. Both of the dolls and the virtual image(“NYCU 28cm”). The virtual image is at 532 cm, 76 cm, 38 cm, and 26 cm as the LC lens set is operated at (e)LC mode 0, (f) LC mode 1, (g) LC mode 2, and (h) LC mode 3, respectively.
Fig. 8.
Fig. 8. (a) Experimental setup for vision correction of AR. We use a camera and a convex lens to mimic a myopia eye. In LC mode 0, the recorded images as convex lens is (b) + 1D, (c) +2.5D, (d) +3.5D. The blurred images in (b), (c), and (d) are corrected after the LC lens set is operated at (e) LC mode 1, (f) LC mode 2, and (g) LC mode 3, respectively.

Equations (3)

Equations on this page are rendered with MathJax. Learn more.

1 p + 1 q = 1 f + 1 f L C .
1 p + 1 q = 1 f
1 q 1 q = 1 f L C .
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.