Abstract

Imaging through the wavy air–water surface suffers from severe geometric distortions, which are caused by the light refraction effect that affects the normal operations of underwater exploration equipment such as the autonomous underwater vehicle (AUV). In this paper, we propose a deep learning-based framework, namely the self-attention generative adversarial network (SAGAN), to remove the geometric distortions and restore the distorted image captured through the water–air surface. First, a K-means-based image pre-selection method is employed to acquire a less distorted image that preserves much useful information from an image sequence. Second, an improved generative adversarial network (GAN) is trained to translate the distorted image into the non-distorted image. During this process, the attention mechanism and the weighted training objective are adopted in our GAN framework to get the high-quality restored results of distorted underwater images. The network is able to restore the colors and fine details in the distorted images by combining the three objective losses, i.e., the content loss, the adversarial loss, and the perceptual loss. Experimental results show that our proposed method outperforms other state-of-the-art methods on the validation set and our sea trial set.

© 2020 Optical Society of America

Underwater ghost imaging based on generative adversarial networks with high imaging quality

Xu Yang, Zhongyang Yu, Lu Xu, Jiemin Hu, Long Wu, Chenghua Yang, Wei Zhang, Jianlong Zhang, and Yong Zhang
Opt. Express 29(18) 28388-28405 (2021)

Reconstruction of distorted underwater images using robust registration

Zhen Zhang and Xu Yang
Opt. Express 27(7) 9996-10008 (2019)

Super-resolution reconstruction of underwater polarized images with a fused attention mechanism

Liying Lang, Haoyi Feng, Jinghan Zhang, and Yajun Pang
Appl. Opt. 63(6) 1590-1599 (2024)

Underwater motion scene image restoration based on an improved U-Net network

Jianye Liu, Hu Luo, and Dawei Tu
Appl. Opt. 63(1) 228-238 (2024)

Underwater image enhancement using adaptive color restoration and dehazing

Tengyue Li, Shenghui Rong, Wenfeng Zhao, Long Chen, Yongbin Liu, Huiyu Zhou, and Bo He
Opt. Express 30(4) 6216-6235 (2022)