Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Design and fabrication of a compact off-axis see-through head-mounted display using a freeform surface

Open Access Open Access

Abstract

Head-mounted display (HMD) has been widely used in many fields, and most existing HMDs are complex and typically non-aesthetically pleasing. In this paper, a novel compact, lightweight and wearable off-axis HMD with freeform surface is reported. It is challenging to achieve large field of view (FOV) and maintain compact structure simultaneously for this type system. In this design, the compact off-axis HMD consists of a tilted ellipsoid combiner and a four pieces relay lenses. It offers a diagonal FOV of 30°, and an exit pupil diameter of 7 mm. No diffractive surfaces are used, thus avoiding the effect of stray light and ghost image in previous designs. The x-y polynomial freeform surface is adopted in the relay lens for improving the image quality and minimizing the structure size. Analytical expressions to determine the initial structure of HMD has been given, while structure constrains, optimization strategy and tolerance analysis are also described in details. The optical system is easy to manufacture by ordinary method which is beneficial for mass production. Further, a prototype of this compact HMD is successfully implemented with good imaging performance. The compact structure of HMD makes it well suited for integrating a normal glass, significantly advancing the application of HMD in people’s daily life.

© 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

1. Introduction

In recent years, technological advancements, especially the emergence of various HMDs, have made augmented reality (AR) more feasible in people’s daily life [1–4]. For AR applications, the HMD works in a see-through model which superimposes a virtual image on the real-world scene, and therefore allows the users to see the virtual image of the digital information and real-world scene simultaneously, even 3D display with focus cues [5–7]. The see-through HMD immerses the user by providing digital image information, and has gained wide popularity in many fields (i.e., military, education, medical and tourism, et al). Nowadays, a series of HMDs have been commercially available, such as Google Glasses [8], Microsoft Hololens [9], Epson Moverio [10,11] and Lumus DK50 [12] et al.

As the commercial products, the HMDs are expected to be compact and light but without sacrificing their performance, which is a challenging task for the HMD designers. Different approaches have been developed by both academia and industry to optimize the design of HMDs [13]. For instance, Cheng et al proposed a HMD design using freeform surface prism [14, 15]. Amitai et al used partial reflecting surfaces on a waveguide plate [16, 17]. Microsoft, Sony and BAE have adopted the diffractive or holographic waveguide plate [18–20]. Besides, the off-axis combiner type HMD has stood out with large FOV and pupil size. In 2010, Zheng et al reported an off-axis see-through HMD with 40° × 30° FOV and 70 mm eye relief by using x-y polynomial surface [21]. In 2015, Wang et al developed a lightweight, see through HMD which is composed of a 7-pieces coaxial relay lens group and a freeform surface combiner, achieving a 40° × 30° FOV and 15 mm exit pupil diameter [22]. However, limitations are found with these reported HMDs. First, the freeform surface prisms, typically with five freeform surfaces, are complex and difficult to design and fabricate. Second, waveguide HMD has a limited FOV, largely because of the stray light or chromatic aberrations [23]. Moreover, the triangular or trapezoids microstructures in the waveguide are hard to manufacture [24]. The aforementioned off-axis combiner HMDs are very complex-structured and bulky. More critically, the structures of above HMDs deviate from the “normal glass”, and they are typically non-aesthetically pleasing, making them impractical for everyday use [25].

To design a normal glass alike HMD, Cakmakci et al designed and fabricated a compact off-axis combiner-based HMD which can be packaged inside of the glass frame [26]. It contains a freeform mirror and a diffractive optical element with an 8 mm pupil and a 20° diagonal FOV. McGuire et al proposed a compact off-axis HMD prototype with 20° FOV which use 5 optical elements in the relay lens, and another optical design of 40° diagonal FOV with freeform and diffractive surfaces [27]. However, the FOV of existing compact off-axis HMDs prototype is small (20° diagonal), which is not sufficient for the AR applications. The diffractive surface causes unwanted stray light which decreases the imaging quality. Moreover, few literatures are available for constructing a starting point for such compact off-axis HMDs, which is important for the freeform optical system optimization. Overall, it is challenging to design a compact off-axis combiner HMD with a large FOV, low F-number, and maintain compact structure simultaneously for this type system. In order to solve these problems and design a normal glass HMD, we present a new optical design for the compact off-axis HMD.

In this paper, we present a compact off-axis combiner HMD using freeform surfaces a diagonal FOV of 30°, an exit pupil diameter of 7 mm, and an eye relief of 30 mm. This design does not use the diffractive surfaces, thus avoiding the effect of stray light and ghost image in previous designs. Based on the paraxial optical theory, the coaxial initial optical structure is established to facilitate off-axis freeform system design [28, 29]. We use the rotational symmetric lens group in the relay lens and simple tilt combiner to reduce the volume and manufacture difficulty. Further, the method how to determine surface type of each surface in the optical system is explained in detail. An x-y polynomial surface, which is close to a 0.39 in. OLED (organic light emitting display), is used to lower the F-number, expand the FOV and compensate the off-axis aberrations. The structure constrains, optimization strategy and tolerance analysis are discussed in detail. Based on the tolerance analysis results, the optical system can be fabricated and alignment by ordinary method. We also demonstrate the performance of the prototyped optical system. The compact structure of HMD makes it well suited for integrating a normal glass, significantly advancing the application of HMD in people’s daily life.

2. Design of compact off-axis augmented reality glass

2.1 System specifications

Figure 1 shows the two-dimensional optical layout of the off-axis compact HMD optics in the YOZ plane. There are two ray paths in the system. The first ray path is for the projection system through which the image on the microdisplay is magnified and projected into user’s eye. The second ray path is the see-through system through which a real scene is viewed directly by the eye. The overall optical system consists of a tilted combiner (a half-mirror), a relay lens and an OLED screen. The light emitted from the OLED screen passes through the relay lens and then is reflected by the combiner into the user’s eye. The overall system is set to be symmetric about the YOZ plane, but not the XOZ plane.

 figure: Fig. 1

Fig. 1 Layout of the off-axis compact HMD optical system.

Download Full Size | PDF

In the design, the combiner is a tilted ellipsoid surface which is easy to fabricate. However, the tilt combiner with optical power breaks the symmetry of the optical system, and introduces large aberrations, such as coma, astigmatism and distortion [30, 31]. To balance the serious aberrations, freeform surface is employed in the relay lens. The relay lens consists of 2 plastics lenses and an achromatic doublet lenses. The first plastics lens with aspherical surfaces is applied to correct the field aberrations. Since the color aberration is a shape-independent aberration, the achromatic doublets lenses can be used to reduce the color aberration. The achromatic doublets lenses and the aspherical lens share a common axis which makes the lens mounting easier. The second plastics lens with freeform surface is tilted, decentered, and placed close to OLED screen to balance the residual aberrations between the tilt combiner and the screen. The other surface of the second plastics lens is a simple sphere surface, which benefits the freeform surface manufacture. The interior surface of the combiner is coated with a half reflection film, allowing the ray from the outside real-world scene to transmit through and being incident to the user’s eye, coinciding both the virtual image and the real scene image for the user. Since we aim to design a compact HMD similar to a normal glass, we have strictly designed the geometry shape and constrained the volume of the HMD. Besides, to minimize the volume of the HMD, the parts of the optical lenses where no rays pass through will be removed in the fabrication process.

The OLED (SONY, 1024 × 768 pixels, 7.9 μm pixel size and 500 cd/m2 peak brightness) screen is selected as the image source. OLED uses polymers which emit light in response to an electric current, making a unique display with self-emissive light without added illumination units, significantly decreasing the volume of the HMD. For most applications of a compact see-through HMD, the FOV is typically around 25 to 40 degrees [13, 24, 32]. However, too large FOV will cause eyestrain because the eyes must scan a large angle [33, 34]. In our design, a diagonal full FOV of 30° has been chosen to balance the FOV and potential eye fatigue for the users. The effective focal length (EFL) is calculated as 19 mm based on the OLED size and full FOV. The specifications of the optical system are listed in Table 1.

Tables Icon

Table 1. Specifications of the ultra-compact off-axis HMD

2.2 Structure constrains

In order to make the compact off-axis HMD wearing comfortable, the frame and size constrains should be carefully considered. Structure constrains are required to ensure that the HMD can be worn by most people like a normal glass, and that all the rays across the fields can be traced without obstruction. Figure 2 illustrates the structure constrains to be considered in binocular configuration. As shown in Fig. 2, the P and P’ denote the center of the left and right pupil, respectively. A and B denote the maximum field of the OLED in positive and negative Y direction, respectively. C is the intersection points of the marginal ray of max field in positive Y direction with the extension line of PP’. D denotes the intersection points of the chief ray of center field with the combiner surface. Since the relay lens are placed at the left and right sides of the user head, and near the users’ ears, the rays between relay and tilt combiner should not be blocked by the head. The distance between C and P is controlled to adapt the size of human head.

 figure: Fig. 2

Fig. 2 The frame constrains of the HMD in binocular configuration.

Download Full Size | PDF

Based on the physical structure mentioned above, the structure constrains are defined as:

{zD-zA70yP-yC25yD-yB60

where all the Y, Z coordinates in the equations are referenced to the global coordinate system, for which the origin is located at the center of the exit pupil.

2.3 Design of the initial structure

A compact off-axis HMD system may be tentatively optimized from an existed patent by putting constraint conditions in an optical software package. However, after numerous tries, we found, the existing off-axis HMD patents with large volume are far from the compact design optimum point, which would result in a drastic change of the structure and the surfaces, and consequently, lead to low design efficiency and even failure. Thus, a reasonable initial is rather important in the design process. We begin the design from a coaxial system with spherical surfaces, as shown in Fig. 3. The system contains the stop, combiner, relay lens and image plane. There is an intermediate image between the combiner and relay lens.

 figure: Fig. 3

Fig. 3 Sketch of a coaxial HMD system.

Download Full Size | PDF

Based on the paraxial optical theory and the reflecting imaging formula:

1l'+1l=2r

For l=, the relationship among focal length, surface curvature and magnification can be established as:

fc'=r/2
f'=βfc'
where r is the radius of the combiner mirror, βis the magnification of relay, fc' and f' are the focal length of combiner and whole system, respectively.

According to the effective focal length specifications (EFL = 19 mm), and to balance the size of optical structure and the aberrations, the magnification of relay isβ=1. The radius of the combiner can be obtained r = 38 mm from Eq. (4). Based on the geometry aberration theory, when a stop is set at the center of the spherical mirror, the Seidel coefficients of the coma, astigmatism, distortion and color aberration are all zeroes which are beneficial for constructing an initial coaxial structure. Based on this advantage, the distance between the stop and the mirror is 38 mm. The relay lens is to imaging the intermediate image onto the image plane, and correcting the aberrations introduced by the combiner. A 4 pieces patented design with 1x magnification in CODE V database (Japan patent 60_4963 850207) has been selected as the relay lens to match the spherical combiner. After scaling the relay lens, we combine the spherical mirror and the relay lens to construct the coaxial initial structure of the HMD and shown in Fig. 4. The pupil diameter is 4 mm, and the EFL is 19 mm. The initial detailed parameters of the optical system are shown in Table 2.

 figure: Fig. 4

Fig. 4 Layout of coaxial initial structure.

Download Full Size | PDF

Tables Icon

Table 2. Initial configuration parameters

2.4 Optimization

The optical system is optimized in optical design software package CODE V. During the optimization process, four wavelengths of 486.1, 546, 587.6, and 656.3nm are used to optimize and evaluate the image quality [14]. Due to the YOZ plane symmetry of the system, the system has to be optimized over half of the full FOV sampled in rectangular grid. The merit function is built by evaluating the transverse ray aberration. The structure constrains mentioned above are defined to avoid unwanted obscuration in the ray path. The effective focal lengths in both the tangential and sagittal planes are constrained to be 19 mm. The coordinates of rays striking the image plane are constrained to control the distortion. The following parameters are set as variables in the optimization:(1) the radius, (2) the thickness and air gap, (3) the coefficients of the aspherical and freeform surfaces, (4) decenter in Y and Z directions, and (5) tilt about X axis.

It is challenging to optimize an initial coaxial system to obtain an off-axis freeform system. The tilt combiner with optical power breaks the symmetry of the optical system, and introduces large aberrations, such as coma, astigmatism and distortion. The surface type of the optical system should be complex to compensate these aberrations. Thus, how to determine the surface type of each optical element in the optical system is a significant issue.

Generally, the freeform combiner half-mirror is good at correcting the high-order aberrations since it is located near the aperture stop [22, 35]. However, if the freeform combiner is used, both the interior and exterior surfaces are needed to be freeform profiles to ensure the undistorted view through the combiner which make the freeform lens difficult to fabricate and increase the cost. The ellipsoid surface is preferred to represent the combiner surface, since when the pupil is located at one conic focus of the ellipsoid surface, the ellipsoid surface does not introduce the astigmatism. If one conic focus is at the pupil, and another conic focus is at the pupil of relay lens, the spherical aberration can be eliminated [36, 37]. Moreover, the ellipsoid combiner is easy to fabricate comparing with the freeform combiner.

The achromatic doublets lenses are used to correct the color aberrations, so that the surface type of the achromatic doublets lenses are spherical surfaces in our design for easy fabrication. To making the lens mounting easier, the achromatic doublets lenses and the lens 2 share a common axis in our design. A rotationally symmetric surface type is preferred to represent the surface type of lens 2. Considering the fabrication and cost of lens 2, even aspherical surface type is selected which has been widely used in optical system.

However, the large off-axis aberrations introduced by the tilt combiner are difficult to control with traditional components such as an aspheric lens. Freeform surface is non-symmetric surface, and it is suitable for correcting these aberrations. The common freeform surface are x-y polynomial surface and Zernike polynomial surface. Compared to the Zernike polynomial, x-y polynomial surfaces are easier to process due to the consistence with the numerical control (NC) optical expression form [38]. The x-y polynomial surface has been applied successfully in many optical system [39–43]. Thus, the x-y polynomial surface type is selected in our paper. The other surface of the single lens 1 is a simple sphere surface, which benefits the freeform surface manufacture.

A progressive strategy is adopted in the design. The whole design procedure is divided into two steps, as illustrated in Fig. 5. At the beginning of the optimization procedure, the design goal is to remove the obscuration and obtain a reasonable off-axis structure from the initial coaxial system. Only the biased fields along the tangential direction are sampled. The combiner and relay lens are tilted and decentered gradually to avoid obscuration in the optical path and meet the structure constrains with small pupil size. Meanwhile, the off-axis aberrations are increased. The surface type of the right surface of lens 1 and lens 2 are converted to even aspherical surface, and the materials of lens 1 and 2 are replaced with plastics material. The spherical combiner has been converted to the ellipsoid surface.

 figure: Fig. 5

Fig. 5 Design process of the off-axis compact HMD optical system.

Download Full Size | PDF

At the second step, the pupil size and FOV are enlarged, which introduces larger high-order aberrations that can be corrected with freeform surface, which offering more degrees of freedom. The aspherical surface of lens 1 is converted to a low order x-y polynomial surface with the least square algorithm [44]. As the optimization progresses, the pupil size and FOV are expanded to the specification values, and the higher order terms of x-y polynomial surface are gradually added to improve the imaging quality. Moreover, to ensure the manufacturability of the freeform surface, the local curvature constraints of the freeform surface during the optimization process are used to control the local curvature variation of freeform surface to avoid rapid surface shape changes. The x-y polynomial surface is expressed as:

z(x,y)=cr21+1(1+k)c2r2+i=1NAiEi(x,y),
where c is the curvature, r is the radial coordinate in lens units, k is the conic constant, N is the number of polynomial coefficients in the series and Ai is the coefficient on the polynomial term.

Due to the symmetry about the YOZ plane, the coefficients of the odd terms of x in x-y polynomial expression are zeroes. Considering the convergence rate in the optimization process and the manufacture difficulty, the highest order of the freeform surface is limited at 6-order polynomials in our design, which is sufficient based on an acceptable optical system performance [15], thus the expression is:

z(x,y)=cr21+1(1+k)c2r2+A3x0y1+A4x2y0+A6x0y2+A28x0y6,

2.5 Design results and performance analysis

After the optimization with x-y polynomial surfaces, a compact off-axis HMD is obtained. The system is illustrated in Fig. 6, which consists of an ellipsoid combiner and a 4-pieces relay lens group. The pupil stop is located 30 mm in front of the ellipsoid combiner. The ellipsoid combiner is tilted about the x-axis by 22.5°. The distance between the ellipsoid combiner mirror and the OLED screen is 67 mm in Z direction and 56 mm in Y direction. The 3D model of compact off-axis HMD and a human head is shown in Fig. 7. The overall structure of the HMD is very compact and simple, which is suitable for integrating a normal glass.

 figure: Fig. 6

Fig. 6 Ultimate structure of the compact HMD.

Download Full Size | PDF

 figure: Fig. 7

Fig. 7 The 3D model of the compact off-axis HMD with a model of human head.

Download Full Size | PDF

The optical performance of the optimized system is assessed at the following representative field angles for the four design wavelengths: (0°, 0°), (0°, ± 6°), (4.5°, 0°), (4.5°, ± 6°), (4.5°, ± 12°), (9°, ± 6°), (0°, ± 12°), (9°, ± 12°), (9°, 0°). In practical application, the pupil diameter of the human eye is 3 mm, and a 3 mm eye pupil is therefore selected for both centered and decentered pupils [14]. The modulation transfer function (MTF) values over the defined 15 fields for a centered 3 mm pupil at the spatial frequency of 64 cycles/mm, which correspond to the Nyquist frequency of the OLED, are shown in Fig. 8. The MTF performance is better than 0.2@64 cycles/mm over full field of view. The spot diagrams of the designed optical system are also shown in Fig. 9(a). The maximum RMS spot diameter over the field is 18μm, which can satisfy the resolution of the user. Figure 9(b) indicates the distortion of the designed compact HMD. The maximum distortion is 6.88% which is caused by the tilt combiner and difficult to correct in optical design process. However, the residual distortion can be corrected with digital method [14].

 figure: Fig. 8

Fig. 8 (a) MTF plot of the center fields; and (b) MTF plot of the marginal fields.

Download Full Size | PDF

 figure: Fig. 9

Fig. 9 (a) RMS spot diameter across the full fields; and (b) the distortion grid of the optical system.

Download Full Size | PDF

For the optical see-through path, the exterior surface of the tilt combiner should be designed to maintain the good image quality without distorting the real-world scene. We trace the rays from the real world to the pupil stop, and insert a perfect lens at the stop with an EFL equivalent to the human eye to focus the collimated rays. The exterior surface of the combiner is set to conic surface, and the radius and coefficient of the exterior surface are variables. The optimized combiner is shown in Fig. 10(a). The MTF plots and distortion grid are shown in Fig. 10(b) and 10(c), which demonstrate the optical performance of the optical see-through path.

 figure: Fig. 10

Fig. 10 The design of the see-through combiner (a) Layout; (b) MTF plot; and (c) distortion grid.

Download Full Size | PDF

To evaluate the manufacturability of the freeform surface, the local curvatures of the freeform surface along with x and y axis have been calculated and shown in Fig. 11. The local curvatures vary from 0.0158 to −0.0433. Comparing the fabricated freeform surfaces, our designed freeform surface has proper local curvature [15, 45, 46]. Thus, we can conclude that the freeform surface in this design is reasonable.

 figure: Fig. 11

Fig. 11 Local curvatures of the freeform surface: (a) x axis; and (b) y axis.

Download Full Size | PDF

The optical system parameters and the coefficients of even aspherical and x-y polynomial surfaces are detailed in Table 3 and Table 4, respectively.

Tables Icon

Table 3. Optical system parameters

Tables Icon

Table 4. Coefficients of even aspherical and freeform surfaces

3. Tolerance analysis

The tolerances determine the difficulty and cost of the fabrication and alignment for the optical system. The tolerances of the compact HMD are analyzed in CODE V using wavefront differential tolerancing (TOR) method. In our analysis, the radius, index, thickness, decenters in y and z directions, the element tilts and displacements in x and y directions, surface irregularity and surface sag are considered. The location of the OLED is used as the compensator to obtain the maximize performance at final assembly process. The MTF @ 64 cycles/mm is utilized as the nominal criterion.

By the TOR calculation in CODE V, the sensitivity of each tolerance over the fields with default tolerance values is obtained firstly. All tolerances are chosen based on nearly the same amount of degradation of the MTF in inverse sensitivity model after 5000 trials. We found five most sensitivity tolerance items among all the items, and they are listed in Table 5.

Tables Icon

Table 5. Five most sensitive tolerance items influencing the optical system

The five most sensitivity tolerance items are about the element alignment and freeform or aspherical surface profile. Therefore, the fabrication and alignment precision should be guaranteed. After adjusting all the tolerance items carefully, the overall tolerance items are conducted until the fabrication cost and the system performance reach a good tradeoff. The preliminary fabrication tolerances are listed in Table 6. Based on the tolerances listed in Table 6, we run a Monte Carlo simulation 1000 times, and use the normal distribution to analyze the MTF value @ 64 cycles/mm. The Monte Carlo analysis is a statistical model that is suitable to predict system performance. Figure 12 is the cumulative probability for different MTF values under the conditions in Table 6. There is an 80% probability that the MTF is higher than 0.15 @ 64 cycles/mm for all tolerances concerned and the image quality should be acceptable, which is verified by the experimental results in Section 4. According to the tolerances in Table 6, the optical elements fabrication and system alignment can be achieved by ordinary method which is beneficial for mass production and reducing the cost.

Tables Icon

Table 6. Tolerances of the compact off-axis of HMD

 figure: Fig. 12

Fig. 12 Cumulative probability of MTF values at different fields.

Download Full Size | PDF

4. Experimental test

The optical system is fabricated and implemented. Figure 13(a) shows the developed prototype of the compact off-axis HMD in binocular configuration. Comparing with a normal glass, the developed prototype has equivalent size, and better industry design will be completed in our future work to update the appearance of the prototype. Single point diamond technology (SPDT) is used for fabrication of the aspherical and freeform elements in the prototype. According to the tolerances listed in Table 6, the aspherical lenses and freeform lens can also be fabricated with injection molding technology to reduce the cost. The fabricated freeform lens is shown in Fig. 13(b), and the size of the freeform lens is 16 mm × 13 mm × 5 mm. The total weight of the five lenses is only 15.6 grams. The mechanical structure of the prototype is fabricated by 3D print technology.

 figure: Fig. 13

Fig. 13 (a) Prototype of the compact off-axis HMD; and (b) the fabricated freeform lens.

Download Full Size | PDF

To verify the image quality of the prototype of the compact off-axis HMD, a camera is located at the exit pupil of the optical system to capture the image. Figure 14(a) shows the image from the real world. The prewrapped virtual image is displayed on the OLED and a photo is taken at the exit pupil which is shown in Fig. 14(b). As shown in the figure, the minimum lines and graphics can be seen clearly in both see-through path and virtual image path. The distortion of the virtual image path has been well corrected by digital method. We also measure the MTF curves of the optical system to evaluate its optical performance for both the real world path and the virtual image path. The MTF values are calculated based on the images (Fig. 14(a) and 14(b)). The approach that we utilize to calculate the MTF values is explained in reference [47]. As shown in Fig. 14(c) and 14(d), the MTF amplitude values fall to 0.4 @ 50 cycles/mm for the real world path, and 0.15@ 64 cycles/mm for the virtual image path. The measure results prove our design and analysis.

 figure: Fig. 14

Fig. 14 The experiment demonstration: (a) the real scene through the combiner captured by camera; (b) the virtual image reflected by the combiner from the OLED captured by camera; (c) MTF curve of the real world path; and (d) MTF curve of the real world path.

Download Full Size | PDF

Moreover, an augmented reality image (a hawk on the table) captured by the camera is shown in Fig. 15, and the experiment test results demonstrate that the developed compact off-axis HMD have good image performance and compact structure.

 figure: Fig. 15

Fig. 15 Augmented reality experiment result captured at the pupil by the camera.

Download Full Size | PDF

5. Conclusions

In this paper, a novel compact, lightweight, and wearable off-axis HMD with 30° FOV, 7 mm exit pupil and 30 mm eye relief is designed and implemented. The HMD has very compact structure which is assembled as a normal glass. The initial structure design, structure constrains and optimization strategy are discussed in detail. The designed HMD consists of a tilt combiner and a four pieces relay lenses. The image quality of the virtual image path reveals an MTF lager than 20% @ 64 cycles/mm and the maximum distortion is 6.68% which has been corrected by digital prewrapped. The tolerance analysis, including sensitive analysis and Monte Carlo simulation, is comprehensively performed, and the results indicate that the compact HMD can be manufactured easily. Furthermore, the manufacturability of the freeform surface is also fully evaluated. Finally, a binocular compact off-axis HMD prototype is fabricated. The performance of the optical system has been experimentally tested and the results demonstrate the good performance of the compact off-axis HMD.

Funding

Beijing Municipal Science& Technology Commission (Y75X02A21N); Innovation Project of Chinese Academy of Sciences (CXJJ-16S043); Innovation Project of Academy of Opto-Electronics, Chinese Academy of Sciences (Y70B01A11Y).

References and links

1. H. Hua and B. Javidi, “Augmented Reality: Easy on the Eyes,” Opt. Photonics News 26(2), 26–33 (2015). [CrossRef]  

2. B. Kress, E. Saeedi, and V. Brac-de-la-Perriere, “The segmentation of the HMD market: Optics for smart glasses, smart eyewear, AR and VR headsets,” Proc. SPIE 9202, 92020D (2014).

3. D. W. F. van Krevelen and R. Poelman, “A survey of augmented reality technologies, applications and limitations,” Int. J. Virtual Real. 9, 1–20 (2010).

4. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. Macintyre, “Recent advances in augmented reality,” IEEE Comput. Graph. Appl. 21(6), 34–47 (2001). [CrossRef]  

5. C. Jang, K. Bang, S. Moon, J. Kim, S. Lee, and B. Lee, “Retinal 3D: augmented reality near-eye display via pupil-tracked light field projection on retina,” ACM Trans. Graph. 36(6), 190 (2017). [CrossRef]  

6. A. Maimone, A. Georgiou, and J. S. Kollin, “Holographic Near-Eye Displays for Virtual and Augmented Reality,” ACM Trans. Graph. 36(4), 85 (2017). [CrossRef]  

7. S. Lee, J. Cho, B. Lee, Y. Jo, C. Jang, D. Kim, and B. Lee, “Foveated retinal optimization for see-through near-eye multi-layer displays,” IEEE Access 6(1), 2170–2180 (2018). [CrossRef]  

8. Google Glasses, https://www.google.com/glass/start/.

9. Microsoft Hololens, https://www.microsoft.com/microsofthololens/en/us.

10. Smart glasses, websitehttp://www.epson.com/cgi-bin/Store/jsp/Landing/moverio-bt-200-smartglasses.do?ref=van_moverio_2014.

11. Optinvent, http://www.optinvent.com.

12. Lumus, http://www.lumus-optical.com.

13. O. Cakmakci and J. Rolland, “Head-worn displays: a review,” J. Disp. Technol. 2(3), 199–216 (2006). [CrossRef]  

14. D. Cheng, Y. Wang, H. Hua, and M. M. Talha, “Design of an optical see-through head-mounted display with a low f-number and large field of view using a freeform prism,” Appl. Opt. 48(14), 2655–2668 (2009). [CrossRef]   [PubMed]  

15. Q. Wang, D. Cheng, Y. Wang, H. Hua, and G. Jin, “Design, tolerance, and fabrication of an optical see-through head-mounted display with free-form surface elements,” Appl. Opt. 52(7), C88–C99 (2013). [CrossRef]   [PubMed]  

16. Y. Amitai, “Extremely compact high-performance HMD based on substrate-guided optical element,” SID 2004 Digest 35(1), 310–313 (2004). [CrossRef]  

17. Y. Amitai, “A two-dimensional aperture expander for ultra-compact, high-performance head-worn displays,” SID 2005 Digest 36(1), 360–363 (2005). [CrossRef]  

18. K. Aiki and S. Nakano, “Illumination optical device and virtual image display,” U. S. Patent 2010/0027289.

19. H. Mukawa, K. Akutsu, I. Matsumura, S. Nakano, T. Yoshida, M. Kuwahara, and K. Aiki, “A full color eyewear display using planar waveguides with reflection volume holograms,” J. Soc. Inf. Disp. 17(3), 185–193 (2009). [CrossRef]  

20. BAE Systems, https://www.baesystems.com/.

21. Z. Zheng, X. Liu, H. Li, and L. Xu, “Design and fabrication of an off-axis see-through head-mounted display with an x-y polynomial surface,” Appl. Opt. 49(19), 3661–3668 (2010). [CrossRef]   [PubMed]  

22. J. Wang, Y. Liang, and M. Xu, “Design of a see-through head-mounted display with a freeform surface,” J. Opt. Soc. Korea 19(6), 614–618 (2015). [CrossRef]  

23. Q. Wang, D. Cheng, Q. Hou, Y. Hu, and Y. Wang, “Stray light and tolerance analysis of an ultrathin waveguide display,” Appl. Opt. 54(28), 8354–8362 (2015). [CrossRef]   [PubMed]  

24. K. W. Zhao and J. W. Pan, “Optical design for a see-through head-mounted display with high visibility,” Opt. Express 24(5), 4749–4760 (2016). [CrossRef]   [PubMed]  

25. M. Guillaumee, S. P. Vahdati, E. Tremblay, A. Mader, G. Bernasconi, V. J. Cadarso, J. Grossenbacher, J. Brugger, R. Sprague, and C. Moser, “Curved holographic combiner for color head worn display,” J. Disp. Technol. 10(6), 444–449 (2014). [CrossRef]  

26. O. Cakmakci and J. Rolland, “Design and fabrication of a dual-element off-axis near-eye optical magnifier,” Opt. Lett. 32(11), 1363–1365 (2007). [CrossRef]   [PubMed]  

27. J. P. McGuire Jr., “Nest-generation head-mounted display,” Proc. SPIE 7618, 761804 (2010). [CrossRef]  

28. Y. Nie, R. Mohedano, P. Benítez, J. Chaves, J. C. Miñano, H. Thienpont, and F. Duerr, “Multifield direct design method for ultrashort throw ratio projection optics with two tailored mirrors,” Appl. Opt. 55(14), 3794–3800 (2016). [CrossRef]   [PubMed]  

29. T. Yang, J. Zhu, X. Wu, and G. Jin, “Direct design of freeform surfaces and freeform imaging systems with a point-by-point three-dimensional construction-iteration method,” Opt. Express 23(8), 10233–10246 (2015). [CrossRef]   [PubMed]  

30. H. Peng, D. Cheng, J. Han, C. Xu, W. Song, L. Ha, J. Yang, Q. Hu, and Y. Wang, “Design and fabrication of a holographic head-up display with asymmetric field of view,” Appl. Opt. 53(29), H177–H185 (2014). [CrossRef]   [PubMed]  

31. S. Lee, B. Lee, J. Cho, C. Jang, J. Kim, and B. Lee, “Analysis and implementation of hologram lenses for see-through head-mounted display,” IEEE Photonics Technol. Lett. 29(1), 82–85 (2017). [CrossRef]  

32. J. Chen, W. Cranton, and M. Fihn, “Example of HWD Architectures: Low-, Mid- and Wide- Field of View Designs,” in Handbook of Visual Display Technology, J. Chen, W. Cranton, and M. Fihn, ed. (Springer, 2012).

33. J. Pan and H. Hung, “Optical Design of a Compact See-Through Head-Mounted Display with Light Guide Plate,” J. Disp. Technol. 11(3), 223–228 (2015). [CrossRef]  

34. C. McLaughlin, K. Moffitt, and J. Pfeiffer, “Human factors guidelines for binocular near-to-eye displays,” SID 2003 Digest 34(1), 280–283 (2003). [CrossRef]  

35. Y. Nie, H. Gross, Y. Zhong, and F. Duerr, “Freeform optical design for a nonscanning corneal imaging system with a convexly curved image,” Appl. Opt. 56(20), 5630–5638 (2017). [CrossRef]   [PubMed]  

36. W. J. Cassarly and J. P. McGuire, “Light distribution apparatus and methods for illuminating optical system,” U.S. patent 7,206,133 (04/17/2007).

37. J. Yang, W. Liu, W. Lv, D. Zhang, F. He, Z. Wei, and Y. Kang, “Method of achieving a wide field-of-view head-mounted display with small distortion,” Opt. Lett. 38(12), 2035–2037 (2013). [CrossRef]   [PubMed]  

38. Q. Meng, W. Wang, H. Ma, and J. Dong, “Easy-aligned off-axis three-mirror system with wide field of view using freeform surface based on integration of primary and tertiary mirror,” Appl. Opt. 53(14), 3028–3034 (2014). [CrossRef]   [PubMed]  

39. R. Tang, B. Zhang, G. Jin, and J. Zhu, “Multiple surface expansion method for design of freeform imaging systems,” Opt. Express 26(3), 2983–2994 (2018). [CrossRef]   [PubMed]  

40. Q. Meng, H. Wang, K. Wang, Y. Wang, Z. Ji, and D. Wang, “Off-axis three-mirror freeform telescope with a large linear field of view based on an integration mirror,” Appl. Opt. 55(32), 8962–8970 (2016). [CrossRef]   [PubMed]  

41. M. Beier, J. Hartung, T. Peschel, C. Damm, A. Gebhardt, S. Scheiding, D. Stumpf, U. D. Zeitner, S. Risse, R. Eberhardt, and A. Tünnermann, “Development, fabrication, and testing of an anamorphicimaging snap-together freeform telescope,” Appl. Opt. 54(12), 3530–3542 (2015). [CrossRef]  

42. Y. Zhong, H. Gross, A. Broemel, S. Kirschstein, P. Petruck, and A. Tuennermann, “Investigation of TMA systems with different freeform surfaces,” Proc. SPIE 9626, 96260X (2015). [CrossRef]  

43. T. Yang, G. Jin, and J. Zhu, “Automated design of freeform imaging systems,” Light Sci. Appl. 6(10), e17081 (2017). [CrossRef]  

44. J. Zhu, W. Hou, X. Zhang, and G. Jin, “Design of a low F-number freeform off-axis three-mirror system with rectangular field-of-view,” J. Opt. 17(1), 015605 (2015). [CrossRef]  

45. C. Supranowitz, P. Dumas, T. Nitzsche, J. D. Nelson, B. Light, K. Medicus, and N. Smith, “Fabrication and metrology of high-precision freeform surfaces,” Proc. SPIE 8884, 888411 (2013). [CrossRef]  

46. Y. Liu, Y. Li, and Z. Cao, “Design of anamorphic magnification high-numerical aperture objective for extreme ultraviolet lithography by curvatures combination method,” Appl. Opt. 55(18), 4917–4923 (2016). [CrossRef]   [PubMed]  

47. M. Estribeau and P. Magnan, “Fast MTF measurement of CMOS imagers using ISO 12233 slanted-edge methodology,” Proc. SPIE 5570, 243–252 (2004). [CrossRef]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (15)

Fig. 1
Fig. 1 Layout of the off-axis compact HMD optical system.
Fig. 2
Fig. 2 The frame constrains of the HMD in binocular configuration.
Fig. 3
Fig. 3 Sketch of a coaxial HMD system.
Fig. 4
Fig. 4 Layout of coaxial initial structure.
Fig. 5
Fig. 5 Design process of the off-axis compact HMD optical system.
Fig. 6
Fig. 6 Ultimate structure of the compact HMD.
Fig. 7
Fig. 7 The 3D model of the compact off-axis HMD with a model of human head.
Fig. 8
Fig. 8 (a) MTF plot of the center fields; and (b) MTF plot of the marginal fields.
Fig. 9
Fig. 9 (a) RMS spot diameter across the full fields; and (b) the distortion grid of the optical system.
Fig. 10
Fig. 10 The design of the see-through combiner (a) Layout; (b) MTF plot; and (c) distortion grid.
Fig. 11
Fig. 11 Local curvatures of the freeform surface: (a) x axis; and (b) y axis.
Fig. 12
Fig. 12 Cumulative probability of MTF values at different fields.
Fig. 13
Fig. 13 (a) Prototype of the compact off-axis HMD; and (b) the fabricated freeform lens.
Fig. 14
Fig. 14 The experiment demonstration: (a) the real scene through the combiner captured by camera; (b) the virtual image reflected by the combiner from the OLED captured by camera; (c) MTF curve of the real world path; and (d) MTF curve of the real world path.
Fig. 15
Fig. 15 Augmented reality experiment result captured at the pupil by the camera.

Tables (6)

Tables Icon

Table 1 Specifications of the ultra-compact off-axis HMD

Tables Icon

Table 2 Initial configuration parameters

Tables Icon

Table 3 Optical system parameters

Tables Icon

Table 4 Coefficients of even aspherical and freeform surfaces

Tables Icon

Table 5 Five most sensitive tolerance items influencing the optical system

Tables Icon

Table 6 Tolerances of the compact off-axis of HMD

Equations (6)

Equations on this page are rendered with MathJax. Learn more.

{ z D - z A 70 y P - y C 25 y D - y B 60
1 l' + 1 l = 2 r
f c ' =r/2
f ' =β f c '
z(x,y)= c r 2 1+ 1(1+k) c 2 r 2 + i=1 N A i E i (x,y) ,
z(x,y)= c r 2 1+ 1(1+k) c 2 r 2 + A 3 x 0 y 1 + A 4 x 2 y 0 + A 6 x 0 y 2 + A 28 x 0 y 6 ,
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.