A laser vision sensing method for seam tracking based on an improved TLD algorithm

DU Jianzhun; GAO Xiangdong; LI Yangjin; XIAO Xiaoting; SUN Yousong; LU Xinzhao

doi:10.7510/jgjs.issn.1001-3806.2021.03.004

LASER TECHNOLOGY > 2021 > 45(3): 292-297. > DOI: 10.7510/jgjs.issn.1001-3806.2021.03.004

DU Jianzhun, GAO Xiangdong, LI Yangjin, XIAO Xiaoting, SUN Yousong, LU Xinzhao. A laser vision sensing method for seam tracking based on an improved TLD algorithm[J]. LASER TECHNOLOGY, 2021, 45(3): 292-297. DOI: 10.7510/jgjs.issn.1001-3806.2021.03.004

Citation:

PDF (2521 KB)

A laser vision sensing method for seam tracking based on an improved TLD algorithm

1.
Guangdong Provincial Welding Engineering Technology Research Center, Guangdong University of Technology, Guangzhou 510006, China
2.
Guangdong Jingtai Civil Air Defense Projects Co. Ltd., Zhaoqing 526238, China

More Information

Received Date: July 12, 2020
Revised Date: August 31, 2020
Published Date: May 24, 2021

Graphical Abstract

Abstract

Abstract

In order to solve the problem of low positioning accuracy of the weld seam center based on line laser vision sensing, a seam tracking method based on an improved tracking-learning-detection (TLD) algorithm was adopted. The weld images were acquired in real time during the weld seam tracking. The TLD algorithm combining the tracker (tracking) and the detector (detection) was adopted to track weld feature points in real time and the online learning mechanism (learning) was adopted to update the classifier parameters, so as to improve the accuracy of seam tracking. On this basis, the region of interest (ROI) was intercepted from the laser stripe images, which greatly reduced the detector's search area. The effective feature points of the tracker were selected to improve the efficiency of the algorithm according to the characteristics of the light intensity distribution of the laser stripe in combination with the rectifying direction. The V-shaped weld and the lapped weld of the stainless steel plate were tracked. The results indicate that the location of the seam center can be achieved by tracking and detecting and the fusion weld tracking method can accurately extract weld feature points. The mean absolute tracking errors of both weld seams were 0.062mm and 0.052mm. This method provides the basis for improving the accuracy of weld seam tracking.
- image processing,
- seam tracking,
- TLD algorithm,
- laser vision

FullText(HTML)

References (23)

References

[1]	GU J, ZHANG L L, WANG J Ch. Application of machine vision in automatic welding[J]. Applied Laser, 2018, 38(6): 1038-1043(in Chinese). http://en.cnki.com.cn/Article_en/CJFDTotal-YYJG201806023.htm
[2]	DING Y Y, HUANG W, KOVACEVIC R. An on-line shape-match-ing weld seam tracking system[J]. Robotics and Computer-Integrated Manufacturing, 2016, 42: 103-112. DOI: 10.1016/j.rcim.2016.05.012
[3]	ZOU Y B, CHEN X Zh, GONG G J, et al. A seam tracking system based on a laser vision sensor[J]. Measurement, 2018, 127: 489-500. DOI: 10.1016/j.measurement.2018.06.020
[4]	GAO X D, LIU Y Y, LAN Ch Zh, et al. Laser-induced infrared characteristic analysis for evaluating joint deviation during austenitic stainless steel laser welding[J]. International Journal of Advanced Manufacturing Technology, 2017, 88(5/8): 1877-1888. DOI: 10.1007%2Fs00170-016-8892-x
[5]	SHEN H Y, LIN T, CHEN Sh B, et al. Real-time seam tracking technology of welding robot with visual sensing[J]. Journal of Intelligent and Robotic Systems, 2010, 59(3/4): 283-298. DOI: 10.1007/s10846-010-9403-1
[6]	GAO X D, CHEN Y Q, YOU D Y, et al. Detection of micro gap weld joint by using magneto-optical imaging and Kalman filtering compensated with RBF neural network[J]. Mechanical Systems and Signal Processing, 2017, 84: 570-583. DOI: 10.1016/j.ymssp.2016.07.041
[7]	MA N J, GAO X D, ZHOU X H, et al. Analysis of magneto-optical imaging characteristics of weld defects under magnetic field excitation[J]. Laser Technology, 2018, 42(4): 97-102(in Chinese).
[8]	LU X Q, GU D X, WANG Y D, et al. Feature extraction of welding seam image based on laser vision[J]. IEEE Sensors Journal, 2018, 18(11): 4715-4724. DOI: 10.1109/JSEN.2018.2824660
[9]	SHAO W J, HUANG Y, ZHANG Y. A novel weld seam detection method for space weld seam of narrow butt joint in laser welding[J]. Optics & Laser Technology, 2018, 99: 39-51. http://www.sciencedirect.com/science/article/pii/S003039921730693X
[10]	FAN J F, JING F Sh, FANG Z J, et al. Automatic recognition system of welding seam type based on SVM method[J]. The International Journal of Advanced Manufacturing Technology, 2017, 92(1/4): 989-999. DOI: 10.1007/s00170-017-0202-8
[11]	LIN Sh D, GAO X D, LI Y J, et al. Weld deviation prediction algorithm based on neural network compensation Kalman filter[J]. A-pplied Laser, 2018, 38(6): 940-945(in Chinese). http://en.cnki.com.cn/Article_en/CJFDTOTAL-YYJG201806008.htm
[12]	DU R Q, XU Y L, HOU Zh, et al. Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding[J]. International Journal of Advanced Manufacturing Technology, 2019, 101(5/8): 2135-2149.
[13]	ZOU Y B, ZHOU W L, WANG Y B. Laser vision seam automatic tracking based on probability continuous model[J]. Journal of Mechanical Engineering, 2017, 53(10): 70-78(in Chinese). DOI: 10.3901/JME.2017.10.070
[14]	ZOU Y B, CHEN T. Laser vision seam tracking system based on i-mage processing and continuous convolution operator tracker[J]. Optics and Lasers in Engineering, 2018, 105: 141-149. DOI: 10.1016/j.optlaseng.2018.01.008
[15]	MENG L, YANG X. A survey of object tracking algorithms[J]. Acta Automatica Sinica, 2019, 45(7): 1244-1260(in Chinese). http://en.cnki.com.cn/Article_en/CJFDTotal-MOTO201907003.htm
[16]	LIN Sh D, GAO X D, LI Y J, et al. Weld feature extraction and location based on corner detection and optical flow tracking[J]. Journal of Mechanical & Electrical Engineering, 2019, 36(4): 440-444(in Chinese).
[17]	MA B, LIN Sh D, ZHANG N F, et al. Weld seam tracking method based on slope characterization and Kalman filter[J]. Journal of Mechanical & Electrical Engineering, 2020, 37(2): 206-210(in Chin-ese).
[18]	ZOU Y B, WANG Y B, ZHOU W L. Research on line laser seam tracking method based on Guassian kernelized correlation filters[J]. Applied Laser, 2016, 36(5): 578-584(in Chinese). http://en.cnki.com.cn/Article_en/CJFDTOTAL-YYJG201605014.htm
[19]	ZOU Y B, LAN R, WEI X Zh, et al. Robust seam tracking via a deep learning framework combining tracking and detection[J]. A-pplied Optics, 2020, 59(14): 4321-4331. http://med.wanfangdata.com.cn/Paper/Detail/PeriodicalPaper_PM32400408
[20]	KALAL Z, MIKOLAJCZYK K, MATAS J. Tracking-learning-detection[J]. IEEE Transactions on Software Engineering, 2011, 34(7): 1409-1422. http://ieeexplore.ieee.org/document/6104061
[21]	MA B, GAO X D, ZHANG N F, et al. Research on 3-D reconstruction method of multi-layer single-pass arc additive manufacture surface[J]. Laser Technology, 2020, 44(3): 321-325(in Chinese). http://www.researchgate.net/publication/335738389_Research_on_3D_Reconstruction_Method_of_Multi-layer_Single-pass_Arc_Additive_manufacture_Surface
[22]	MAO X B, ZHOU X D, LIU Y H. Improved TLD object tracking algorithm based on fast feature points[J]. Journal of Zhengzhou University (Engineering Science Edition), 2018, 39(2): 1-5(in Chin-ese).
[23]	LI Ch M, BAI H Y, GUO H W, et al. Moving object detection and tracking based on improved optical flow method[J]. Chinese Journal of Scientific Instrument, 2018, 39(5): 249-256(in Chinese). http://en.cnki.com.cn/Article_en/CJFDTotal-YQXB201805030.htm

[1]	GONG Shuqing, ZHANG Guobao, ZHU Hongwei. Weld seam tracking method under strong noise based on kernel correlation filters[J]. LASER TECHNOLOGY, 2025, 49(2): 289-295. DOI: 10.7510/jgjs.issn.1001-3806.2025.02.021
[2]	XU Lianggang, SHI Lei, Chen Fengxiang, WANG Shichun, LONG Xin, WANG Di. Transmission line tower tilt detection algorithm based on laser point cloud[J]. LASER TECHNOLOGY, 2022, 46(3): 390-396. DOI: 10.7510/jgjs.issn.1001-3806.2022.03.015
[3]	SHENG Limin, TANG Xiahui, PENG Hao, PAN Jixing, PEI Yun, ZHU Haiyun. Research of on-line inspection of laser welding seam quality of cold rolled strips[J]. LASER TECHNOLOGY, 2015, 39(4): 437-442. DOI: 10.7510/jgjs.issn.1001-3806.2015.04.001
[4]	XIAO Changjiang, ZHANG Jingchao, WEI Yong, LI Xingyuan, HU Xueliang. Measurement of glass bubble size based on laser vision principle[J]. LASER TECHNOLOGY, 2015, 39(3): 391-394. DOI: 10.7510/jgjs.issn.1001-3806.2015.03.024
[5]	LIANG Wenbin, XIE Yuelei, PENG Chengcheng, WANG Taixing. A simple corner detection algorithm for laser marking[J]. LASER TECHNOLOGY, 2015, 39(2): 202-205. DOI: 10.7510/jgjs.issn.1001-3806.2015.02.012
[6]	WANG Qi-hua, LI Xi-zi. 3-D image construction based on self-calibration binocular vision algorithm[J]. LASER TECHNOLOGY, 2012, 36(3): 416-420.
[7]	GAO Shi-yi, YANG Yong-qiang, Yang Kai-zhen. Defect detection of laser welding seam of unequal-thickness blank based on structured light vision[J]. LASER TECHNOLOGY, 2011, 35(4): 440-443. DOI: 10.3969/j.issn.1001-3806.2011.04.002
[8]	GONG Shi-hua, YU Jun-feng, HUANG Yu, YANG Jian-zhong, WANG Ping-jiang. Study on 3-D joint seam tracking control in non-ferrous metal complicated curve surface laser welding[J]. LASER TECHNOLOGY, 2010, 34(5): 587-590,595. DOI: 10.3969/j.issn.1001-3806.2010.O5.004
[9]	LUO Yong, ZHANG Hua, LI Yue-hua, XIAO Min, XU Jian-ning. Research of TIG welding rapid prototyping laser vision detecting system[J]. LASER TECHNOLOGY, 2007, 31(4): 367-369.
[10]	PING Qing-wei, HE Pei-kun, ZHAO Bao-jun. Target detection algorithm of laser echo[J]. LASER TECHNOLOGY, 2004, 28(2): 218-220.

Cited By

Cited by

Periodical cited type(4)

1.	陈小燕，何余海. 基于激光视觉传感的布局规划方法研究. 激光杂志. 2024(02): 219-223 .
2.	田猛，高向东，谢岳轩，张艳喜. 焊接缺陷磁光成像噪声特征分析及处理算法. 激光技术. 2023(05): 646-652 . 本站查看
3.	辛锋，文如泉. 卡尔曼级联滤波的激光焊接轨迹跟踪研究与应用. 激光杂志. 2023(11): 204-208 .
4.	夏攀，马飞，王中任. 基于改进U-Net模型的焊缝特征提取. 激光与红外. 2022(08): 1259-1264 .

Other cited types(3)

Get Citation

PDF

XML

Article views (5) PDF downloads (6) Cited by(7)

Turn off MathJax

Article Contents

Abstract

References

A laser vision sensing method for seam tracking based on an improved TLD algorithm

Abstract

References

Related Articles

Cited by

Periodical cited type(4)

Other cited types(3)

Catalog

Links：

A laser vision sensing method for seam tracking based on an improved TLD algorithm

Abstract

References

Related Articles

Cited by

Periodical cited type(4)

Other cited types(3)

Catalog

Links：

Export File

Citation

Format

Content