Abstract

Most feature-matching algorithms based on perspective images, such as scale-invariant feature transform (SIFT), speeded up robust features, or DAISY, construct their feature descriptors from the neighborhood information of feature points. Large nonlinear distortion results in different amounts of neighborhood information at different feature points within the fish-eye images, especially for the case when a feature pixel is at the central region and the corresponding feature pixel is at the periphery. In contrast, descriptor-Nets (D-Nets) is a feature-matching algorithm based on global information. It is more robust, but it is time-consuming. In this paper, we employ the SIFT detector to extract feature pixels, and then we propose a novel feature-matching strategy based on the D-Nets algorithm. We modify the linear descriptors in the traditional D-Nets algorithm and propose a curve descriptor based on the hemispheric model of a fish-eye image. In the traditional D-Nets algorithm, each feature point is described by all other pixels of the entire image, and complicated calculations cause slow matching speed. To solve this problem, we convert the traditional global D-Nets into a novel local D-Nets. In the experiment, we obtain image pairs from real scenery using the binocular fish-eye camera platform. Experimental results show that the proposed local D-Nets method can achieve more than 3 times the initial matching pixels, and the percentage of bad matching is reduced by 40% compared with the best performing method among the comparison methods. In addition, the matching pixel pairs obtained by the proposed method are evenly distributed, either in the center region with small distortion or in the peripheral region with large distortion. Meanwhile, the local D-Nets algorithm is 16 times less than that of the global D-Nets algorithm.

© 2020 Optical Society of America

Dense stereo fish-eye images using a modified hemispherical ASW algorithm

Yakun Zhang, Haibin Li, Wenming Zhang, and Cunjun Xiao
J. Opt. Soc. Am. A 38(4) 476-487 (2021)

Directional region-based feature point matching algorithm based on SURF

Qiangxian Huang, Tao Xiang, Zhihao Zhao, Kui Wu, Hongli Li, Rongjun Cheng, Liansheng Zhang, and Zhenying Cheng
J. Opt. Soc. Am. A 41(2) 157-164 (2024)

Wide-baseline stereo matching based on the line intersection context for real-time workspace modeling

Hyunwoo Kim, Sukhan Lee, and Yeonho Lee
J. Opt. Soc. Am. A 31(2) 421-435 (2014)

Invariant matching method for different viewpoint angle images

Min Chen, Zhenfeng Shao, Dongyang Li, and Jun Liu
Appl. Opt. 52(1) 96-104 (2013)

Retinal image registration via feature-guided Gaussian mixture model

Chengyin Liu, Jiayi Ma, Yong Ma, and Jun Huang
J. Opt. Soc. Am. A 33(7) 1267-1276 (2016)