Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Robust seam tracking via a deep learning framework combining tracking and detection

Not Accessible

Your library or personal account may give you access

Abstract

To address the problem of low welding precision caused by possible disturbances, e.g., strong arc lights, welding splashes, and thermally induced deformations, in complex unstructured welding environments, a method based on a deep learning framework that combines visual tracking and object detection is proposed. First, a welding image patch is directly fed into a convolutional long short-term memory network, which preserves the target’s spatial structure and is efficient in terms of memory use, with the aim of avoiding some disturbances. Second, we take advantage of features from various convolutional neural network layers and determine weld feature points through similarity matching among multiple feature layers. However, feeding in noisy images causes the tracker to accumulate interference information, which results in model drift. Thus, using a welding seam detection network, the object filter is periodically reinitialized to improve tracking accuracy and robustness. Experimental results show that the welding torch runs smoothly with a strong arc light and welding splash interference and that tracking error can reach $\pm {0}. 5 \;{\rm mm}$, which is sufficient to satisfy actual welding requirements. The advantages of our algorithm are validated through several comparative experiments.

© 2020 Optical Society of America

Full Article  |  PDF Article
More Like This
Learning Siamese networks for laser vision seam tracking

Yanbiao Zou, Jinchao Li, Xiangzhi Chen, and Rui Lan
J. Opt. Soc. Am. A 35(11) 1805-1813 (2018)

Weld feature extraction method based on inter-frame constraint and dynamic template

Zhen Mei, Lizhe Qi, Min Xu, and Yunquan Sun
J. Opt. Soc. Am. A 39(5) 771-781 (2022)

Oversaturated part-based visual tracking via spatio-temporal context learning

Wei Liu, Jicheng Li, Zhiguang Shi, Xiaotian Chen, and Xiao Chen
Appl. Opt. 55(25) 6960-6968 (2016)

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (14)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Tables (9)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (9)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.