Abstract

Head-mounted displays (HMDs) are becoming increasingly popular as a crucial component of virtual reality (VR). However, contemporary HMDs enforce a simple optical structure due to their constrained form factor, which impedes the use of multiple lens elements that can reduce aberrations in general. As a result, they introduce severe aberrations and imperfections in optical imagery, causing visual fatigue and degrading the immersive experience of being present in VR. To address this issue without modifying the hardware system, we present a novel, to the best of our knowledge, software-driven approach that compensates for the aberrations in HMDs in real time. Our approach involves pre-correction that deconvolves an input image to minimize the difference between its after-lens image and the ideal image. We characterize the specific wavefront aberration and point spread function (PSF) of the optical system using Zernike polynomials. To achieve higher computational efficiency, we improve the conventional deconvolution based on hyper-Laplacian prior by adopting a regularization constraint term based on L2 optimization and the input-image gradient. Furthermore, we implement our solution entirely on a graphics processing unit (GPU) to ensure constant and scalable real-time performance for interactive VR. Our experiments evaluating our algorithm demonstrate that our solution can reliably reduce the aberration of the after-lens images in real time.

© 2024 Optica Publishing Group

Simplified design method for optical imaging systems based on aberration characteristics of optical-digital joint optimization

Yuanhang Wang, Xing Zhong, Zheng Qu, Qixiang Gao, Lei Li, and Chaoli Zeng
Appl. Opt. 63(4) 1066-1078 (2024)

4-K-resolution minimalist optical system design based on deep learning

Dexiao Meng, Yan Zhou, and Jian Bai
Appl. Opt. 63(4) 917-926 (2024)

Deep learning-based optical aberration estimation enables offline digital adaptive optics and super-resolution imaging

Chang Qiao, Haoyu Chen, Run Wang, Tao Jiang, Yuwang Wang, and Dong Li
Photon. Res. 12(3) 474-484 (2024)

Wave aberration corrections in PSF ellipticity measurements of astronomical telescopes using a multi-objective optimization

Tianxiao Xu, Jing Luo, Xu He, Chenghao Li, and Xiaohui Zhang
Appl. Opt. 63(3) 743-756 (2024)

Freeform OST-HMD system with large exit pupil diameter and vision correction capability

Dewen Cheng, Jiaxi Duan, Hailong Chen, He Wang, Danyang Li, Qiwei Wang, Qichao Hou, Tong Yang, Weihong Hou, Donghua Wang, Xiaoyu Chi, Bin Jiang, and Yongtian Wang
Photon. Res. 10(1) 21-32 (2022)