CN104942404A - Dual-wavelength binocular vision seam tracking method and tracking system - Google Patents

Dual-wavelength binocular vision seam tracking method and tracking system Download PDF

Info

Publication number
CN104942404A
CN104942404A CN201510412801.3A CN201510412801A CN104942404A CN 104942404 A CN104942404 A CN 104942404A CN 201510412801 A CN201510412801 A CN 201510412801A CN 104942404 A CN104942404 A CN 104942404A
Authority
CN
China
Prior art keywords
fixed mount
seam
axis fixed
welding
video camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510412801.3A
Other languages
Chinese (zh)
Other versions
CN104942404B (en
Inventor
高向东
黄冠雄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong University of Technology
Foshan Nanhai Guangdong Technology University CNC Equipment Cooperative Innovation Institute
Original Assignee
Guangdong University of Technology
Foshan Nanhai Guangdong Technology University CNC Equipment Cooperative Innovation Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong University of Technology, Foshan Nanhai Guangdong Technology University CNC Equipment Cooperative Innovation Institute filed Critical Guangdong University of Technology
Priority to CN201510412801.3A priority Critical patent/CN104942404B/en
Publication of CN104942404A publication Critical patent/CN104942404A/en
Application granted granted Critical
Publication of CN104942404B publication Critical patent/CN104942404B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B23MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
    • B23KSOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
    • B23K9/00Arc welding or cutting
    • B23K9/12Automatic feeding or moving of electrodes or work for spot or seam welding or cutting
    • B23K9/127Means for tracking lines during arc welding or cutting
    • B23K9/1272Geometry oriented, e.g. beam optical trading
    • B23K9/1274Using non-contact, optical means, e.g. laser means

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Geometry (AREA)
  • Plasma & Fusion (AREA)
  • Mechanical Engineering (AREA)
  • Laser Beam Processing (AREA)

Abstract

The invention discloses a dual-wavelength binocular vision seam tracking method. The method comprises the steps including image acquisition, data processing, seam tracking and the like. The invention further discloses a tracking system for implementing the method. The system adopts a near-infrared and structured light dual-wavelength binocular vision sensing system, images of a molten pool and different wavelengths of seam area images with of seams are measured simultaneously and transmitted to a miniature industrial control computer, and the seam positions are measured accurately with a multi-information fusion algorithm and a seam image three-dimensional reconstruction algorithm; the miniature industrial control computer adopts the Kalman filter algorithm to perform optimal estimation on the seam tracking deviation state according to a seam position detection result, a servo driver drives a servo motor to move so as to control a 3-axis motion workbench to generate corresponding motion, a welding torch or a laser head is controlled for deviation correction, and the seams are tracked accurately. The system can eliminate hard light, splashing and electromagnetic interference on a welding site and improve the seam tracking accuracy and reliability.

Description

Dual wavelength binocular vision welding seam tracking method and tracking system
Technical field
The invention belongs to welding technology field, be specifically related to a kind of dual wavelength binocular vision welding seam tracking method and tracking system.
Background technology
Welding is the important process technology of manufacture field, has that condition of work is severe, workload is large and the various features such as quality requirement is high.Arc welding and Laser Welding are welding techniques comparatively conventional in welding industry, realize the important means that welding autocontrol is Automation of Welding using electric arc and laser beam as controlled device.Wherein, accurate weld joint tracking ensures the prerequisite of welding quality, namely must control in whole welding process laser beam or electric arc make its all the time with weld seam centering, otherwise will waste product be caused.For this reason, the position accurately automatically detecting weld seam is needed also to realize from motion tracking.
Because welding is a complicated heat processing technique technology, workpiece will produce thermal deformation in welding process, and in welding process, there will be the interference such as strong radiation, arc light, flue dust, splashing, make the accurate detection realizing position while welding in welding process quite difficult.Meanwhile, the weld seam path that the factors such as welder mechanism error, Fixture assembly error and the thermal deformation of welding process weldment cause is actually three-dimensional curve weld seam, relates to comparatively complicated three-dimensional curve tracking problem.And weld gap is little and do not have groove, coordinate not at same plane, automatically to identify and to measure difficulty very big.
The domestic and international acquisition for welding seam position information at present mainly concentrates on following several method: (1) structured light visual sensing method.Structured light visual sensing method is scanned by the three-dimensional curve weld seam of lasing light emitter emitting structural light to front end, molten bath, because the steel plate on weld seam and its both sides generally has difference in height, can form weld profile line under the irradiation of structured light, present the three-dimensional information of weld seam.The operation principle great majority of the Weld joint tracker of current industrial application are structured light visual sensing methods.But the method has it to be difficult to the defect overcome: for uniform thickness butt plates welding, generally effectively detector gap the weld seam of 0.15mm can only be greater than.Gap is less than to the weld seam of 0.15mm, usually needs before welding to open micro-groove in butt weld surface, be out of shape herein to make structured light.But this adds processing cost undoubtedly, reduces welding production efficiency.And for the weld seam of closed butt joint, square groove, structured light produces distortion hardly, so traditional Single wavelength structural light measurement method is difficult to identify and measure this kind of weld seam exactly.Add strong arc light and radiation interference, more easily make weld seam detection occur erroneous judgement.(2) infrared sensing method.The method is used for the weld seam recognition of arc welding or weldment back side sensing Laser Welding, welding pool and surrounding form certain temperature field and adjoint infra-red radiation, use thermal camera directly to take molten bath and obtain infrared thermal imagery, quantitative analysis is carried out to the arc-welding district infrared thermal imagery collected, the quantitative information that electric arc departs from weld seam can be obtained.Because violent molten bath and variations in temperature make to be difficult to obtain well-bedded infrared image, add infrared sensor and be subject to environmental disturbances, there is the problems such as precision is not high in this way.(3) through image method for sensing.The method utilizes video camera directly to take molten bath, by image processing and analyzing intensity profile, infers Weld pipe mill deviation information.Because the method directly obtains crater image, eliminate leading error to a great extent.But because the change violent and weld seam at molten bath place in molten bath melts, weld information is fallen into oblivion substantially, is therefore difficult to the characteristic sum rule fundamentally obtaining weld seam deviation.(4) other method.As utilized differential transformer as the sensor detecting vertical and horizontal direction deviation; According to weld gap, influential phenomenon is propagated to acoustic emission wave, utilize the weld inspection system of sound emission-Microprocessor S3C44B0X; Using electric arc sensor realizes detecting with the V-shaped weld of groove; Utilize current vortex method to detect weld seam, but accurately can not judge weld seam left-right deviation position; Supersonic sensing method needs the close contact of ultrasound transducer and welded sheet material, significantly limit ultrasonic sensor and is detecting the application in weld seam.Above method has limitation when detecting small―gap suture weld seam.
Summary of the invention
Main purpose of the present invention is the deficiency overcoming above-mentioned existing welding seam tracking method, provide a kind of accuracy of detection high, reliable, be simple and easy to, there is the dual wavelength visual sensing of certain versatility and the seam tracking system of three axle servo-drive.
For achieving the above object, the invention provides a kind of dual wavelength binocular vision welding seam tracking method, the method comprises the steps:
A. IMAQ: miniature Industrial Control Computer sends instruction makes structured light laser instrument launch the structured light being across weld seam; send instruction simultaneously and start near-infrared video camera, structured light camera operation; in welding process, synchronous coordination near-infrared video camera and structured light video camera gather the structure light image of molten bath zone infrared image and front end, molten bath weld seam respectively by image pick-up card, and are transferred in miniature Industrial Control Computer by the double-wavelength images of acquisition;
B. data processing: the structure light image of application Multi-information acquisition algorithm to molten bath zone infrared image and front end, molten bath weld seam processes, calculates position while welding and tracking correction amount accurately;
C. weld joint tracking: application card Kalman Filtering butt welded seam tracing deviation state carries out optimal estimation, find the relation between filtering evaluated error and measure error, moved by servo driver drives servomotor thus control three-axis moving workbench and produce corresponding motion, realize the accurate tracking of weld seam.
In such scheme, the near-infrared wavelength scope of described near-infrared video camera picked-up is 960-990nm; The visual structure optical wavelength range of described structured light video camera picked-up is 640-660nm.
For realizing the method, the invention also discloses a kind of dual wavelength binocular vision seam tracking system, this system comprises dual wavelength binocular vision detection system, three axle servo-drive seam tracking systems and miniature Industrial Control Computer, this dual wavelength binocular vision detection system comprises near-infrared video camera, structured light video camera, structured light laser instrument and sensor installing plate, described structured light video camera is arranged on the left front end of sensor installing plate, described near-infrared video camera is arranged on sensor installing plate right front ends, described structured light laser instrument is positioned in the middle of structured light video camera and near-infrared video camera, be arranged on sensor installing plate middle-end, described three axle servo-drive seam tracking systems comprise X-axis fixed mount, Y-axis fixed mount and Z axis fixed mount, described X-axis fixed mount upper surface is provided with welding bench, weldment is placed on described welding bench, X-axis servomotor is arranged on the right-hand member of described X-axis fixed mount, the lower front end of described Z axis fixed mount is connected with the middle rear end of X-axis fixed mount, Z axis servomotor is arranged on the top of described Z axis fixed mount, described Y-axis fixed mount is bolted on the right side of Z axis fixed mount, Y-axis servomotor is arranged on the rear end of described Y-axis fixed mount, sensor installing plate is arranged on the front end of Y-axis fixed mount, the described sensor installing plate back side is provided with reinforcement, welding torch or laser head installing plate are arranged on the right front ends of Y-axis fixed mount by hexagon socket head cap screw, welding torch or laser head are arranged on immediately below described welding torch or laser head installing plate.
In such scheme, described Z axis fixed mount right lateral surface has elongated hole, Z axis driven by servomotor Y-axis fixed mount moves up and down in described elongated hole, the adjustment of defocusing amount when can be regulated height or the laser weld of welding torch distance weldment by the upper-lower position controlling Y-axis fixed mount.
In such scheme, described Y-axis fixed mount left-hand face has elongated hole, and Y-axis driven by servomotor Y-axis fixed mount seesaws in described elongated hole, can realize correction by the front and back position controlling Y-axis fixed mount to welding torch or laser head.
In such scheme, described X-axis driven by servomotor is placed in the weldment side-to-side movement on welding bench, realizes the feeding of weldment.
In such scheme, application near infrared light (960-990nm) and visual structure light (640-660nm) obtain Molten Pool Shape and front end, molten bath weld information respectively, and realize recognition of welding seam position by dual wavelength binocular vision sensor information fusion technology.On the basis that position while welding is measured, set up welding torch or laser head servo control system, according to position while welding coordinate, control welding torch or laser head position and application card Kalman Filtering by servo drive system to control to make it align all the time and follow the tracks of weld seam, realize the weld joint tracking of arc welding or Laser Welding.
In such scheme, with docking, overlap joint, angle welding etc. for application, utilize the calibration of dual wavelength binocular vision sensor, biobelt filter properties, weld image strengthen, Molten Pool Shape Feature Extraction Technology, under severe industrial welding scene, accurately detect position while welding.When carry out overlap welding, fillet welding and comparatively wide arc gap butt plates welding time, be mainly transmitted into the visible deformation structured light of weld seam according to structured light laser instrument and detect position while welding by structured light video camera.When carrying out closed butt joint weldering, structured light not redeformation, now main according to the heat distribution feature acquisition position while welding in the near-infrared crater image of near-infrared video camera picked-up.By merging structure light welding seam image and the near-infrared crater image of different-waveband, realize measurement and the tracking of position while welding.
In such scheme, for the welded seam area under the molten bath zone under near infrared radiation and visual structure light radiation, utilize the feature of double-wavelength images, strengthen anti-arc light interference performance.Miniature Industrial Control Computer calculates binocular vision sensor surving coordinate, carries out weld image three-dimensional reconstruction, sets up position while welding measuring system.
In such scheme, set up welding torch or laser head three-axis moving and Weld Seam Tracking Control system, application card Kalman Filtering carries out state optimization estimation on this basis, Accurate Prediction weld excursion amount and offset direction, eliminates the random disturbances impact of process noise and measurement noises.According to information such as the side-play amount between weld seam and electric arc or laser head, offset direction and migration velocities, Accurate Prediction weld seam state also forms Weld joint tracker.
Compared with existing welding seam tracking method, the technical solution used in the present invention has following beneficial effect:
1) adopt near-infrared and structured light dual wavelength binocular vision method for sensing, obtain the welded seam area image of molten bath and weld seam different wave length, Measurement accuracy weld seam three-dimensional coordinate simultaneously.The method can overcome the strong arc light of welding scene, radiation, splashing and electromagnetic interference, improves fault-tolerance and the reliability of system;
2) vision tracker and servo-driver is merged, set up welding torch or laser head three-axis moving and Weld Seam Tracking Control model, application Kalman filtering algorithm, eliminate weld image noise to the impact of certainty of measurement, the departure between butt welded seam and welding torch or laser head, offset direction and migration velocity carry out state optimization estimation.For arc welding, the prediction correction realizing the welding torch determining arc position controls.For laser weld, the prediction correction realizing the laser head determining laser beam position controls.
Accompanying drawing explanation
Fig. 1 is stereochemical structure front view of the present invention.
Fig. 2 is stereochemical structure rearview of the present invention.
Fig. 3 is operating diagram of the present invention.
In figure: 1-Z axis servomotor, 2-Z axis fixed mount, 3-sensor installing plate, 4-structured light video camera, 5-structured light laser instrument, 6-weldment, 7-X-axis fixed mount, 8-Y-axis servomotor, 9-Y-axis fixed mount, 10-welding torch or laser head installing plate, 11-near-infrared video camera, 12-welding torch or laser head, 13-X-axis servomotor, 14-weld seam, 15-welding bench, 16-reinforcement.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, carry out clear, complete description to the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.This area ordinary person, not making the every other embodiment obtained under creative work prerequisite, all belongs to protection scope of the present invention.
Embodiment 1: dual wavelength binocular vision welding seam tracking method.
With reference to shown in Fig. 3, Fig. 3 is the operating diagram of dual wavelength binocular vision welding seam tracking method of the present invention.The method comprises the steps:
A. IMAQ: miniature Industrial Control Computer sends instruction makes structured light laser instrument launch the structured light being across weld seam; send instruction simultaneously and start near-infrared video camera, structured light camera operation; in welding process, synchronous coordination near-infrared video camera and structured light video camera gather the structure light image of molten bath zone infrared image and front end, molten bath weld seam respectively by image pick-up card, and are transferred in miniature Industrial Control Computer by the double-wavelength images of acquisition;
B. data processing: the structure light image of application Multi-information acquisition algorithm to molten bath zone infrared image and front end, molten bath weld seam processes, calculates position while welding and tracking correction amount accurately;
C. weld joint tracking: application card Kalman Filtering butt welded seam tracing deviation state carries out optimal estimation, find the relation between filtering evaluated error and measure error, moved by servo driver drives servomotor thus control three-axis moving workbench and produce corresponding motion, realize the accurate tracking of weld seam.
In such scheme, the present invention with docking, overlap joint, angle welding etc. for application, by technology such as the calibration of dual wavelength binocular vision sensor, the analysis of biobelt filter properties, weld image enhancing, Molten Pool Shape feature extraction, Multi-information acquisition and Kalman filterings, under severe industrial welding scene, accurately detect position while welding and realize weld joint tracking.
In such scheme, the present invention is directed to the molten bath zone under near infrared radiation and the welded seam area under visual structure light radiation, measure the welded seam area image of molten bath and weld seam different wave length simultaneously, extract the feature of double-wavelength images, merge the characteristic information obtained, accurately calculate weld seam three-dimensional coordinate.Miniature Industrial Control Computer calculates binocular vision sensor surving coordinate, carries out weld image three-dimensional reconstruction, sets up position while welding measuring system.Application Kalman filtering algorithm, eliminates weld image noise to the impact of certainty of measurement, and the departure between butt welded seam and electric arc or laser beam, offset direction and migration velocity carry out state optimization estimation, and the prediction correction realizing welding torch or laser head position controls.
In such scheme, the near-infrared wavelength scope of described near-infrared video camera picked-up is 960-990nm; The visual structure optical wavelength range of described structured light video camera picked-up is 640-660nm.
Embodiment 2: dual wavelength binocular vision seam tracking system.
Shown in seeing figures.1.and.2, a kind of dual wavelength binocular vision seam tracking system, comprise dual wavelength binocular vision detection system, three axle servo-drive seam tracking systems and miniature Industrial Control Computer, this dual wavelength binocular vision detection system comprises near-infrared video camera 11, structured light video camera 4, structured light laser instrument 5 and sensor installing plate 3, described structured light video camera 4 is arranged on the left front end of sensor installing plate 3, described near-infrared video camera 11 is arranged on sensor installing plate 3 right front ends, described structured light laser instrument 5 is positioned in the middle of structured light video camera 4 and near-infrared video camera 11, be arranged on sensor installing plate 3 middle-end, described three axle servo-drive seam tracking systems comprise X-axis fixed mount 7, Y-axis fixed mount 9 and Z axis fixed mount 2, described X-axis fixed mount 7 upper surface is provided with welding bench 15, weldment 6 is placed on described welding bench 15, X-axis servomotor 13 is arranged on the right-hand member of described X-axis fixed mount 7, the lower front end of described Z axis fixed mount 2 is connected with the middle rear end of X-axis fixed mount 7, Z axis servomotor 1 is arranged on the top of described Z axis fixed mount 2, described Y-axis fixed mount 9 is bolted on the right side of Z axis fixed mount 2, Y-axis servomotor 8 is arranged on the rear end of described Y-axis fixed mount 9, sensor installing plate 3 is arranged on the front end of Y-axis fixed mount 9, described sensor installing plate 3 back side is provided with reinforcement 16, welding torch or laser head installing plate 10 are arranged on the right front ends of Y-axis fixed mount 9 by hexagon socket head cap screw, welding torch or laser head 12 are arranged on immediately below described welding torch or laser head installing plate 10.
In such scheme, described Z axis fixed mount 2 right lateral surface has elongated hole, Z axis servomotor 1 drives Y-axis fixed mount 9 to move up and down in described elongated hole, the adjustment of defocusing amount when can be regulated height or the laser weld of welding torch distance weldment 6 by the upper-lower position controlling Y-axis fixed mount 9.
In such scheme, described Y-axis fixed mount 9 left-hand face has elongated hole, and Y-axis servomotor 8 drives Y-axis fixed mount 9 to seesaw in described elongated hole, can realize correction by the front and back position controlling Y-axis fixed mount 9 to welding torch or laser head 12.
In such scheme, described X-axis servomotor 1 drives weldment 6 side-to-side movement be placed on welding bench 15, realizes the feeding of weldment 6.
In such scheme, three-shaft linkage servo motion platform comprises X-axis fixed mount 7, X-axis workbench 15, Y-axis fixed mount 9, Z axis fixed mount 2, X-axis servomotor 13, Y-axis servomotor 8 and Z axis servomotor 1; Dual wavelength binocular vision sensing device comprises sensor installing plate 3 and the structured light video camera 4 be mounted thereon, structured light laser instrument 5 and near-infrared video camera 11, structured light video camera 4 is for obtaining the image of the structured light across weld seam, and near-infrared video camera 11 is for obtaining the weld pool dynamics image of welding process.Sensor installing plate 3 and Y-axis fixed mount 9 and welding torch or the fixing and linkage of laser head installing plate 10.Reinforcement 16 is connected with the rigidity of assurance device between sensor installing plate 3 and Y-axis fixed mount 9.Welding torch or laser head installing plate 10 are installed on Y-axis fixed mount 9 by hexagon socket head cap screw, the welding torch that can freely change or laser head 12 are installed on welding torch or laser head installing plate 10 by hexagon socket head cap screw, according to the characteristic such as material, thickness of welding, welding torch or laser head 12 can select laser welding system or welding torch.What install successively from the near to the remote according to the horizontal range with welding torch or laser head 12 is near-infrared video camera 11, structured light laser instrument 5 and structured light video camera 4, during installation near-infrared video camera 11 axis in vertical direction with an angle so that molten bath zone image can be obtained.In like manner, structured light video camera 4 and structured light laser instrument 5 are also installed to be its axis in vertical direction with an angle obtaining structure light image, and structure light image relative molten bath zone image has a leading amount in welding direction.
In such scheme, the operation principle of system is as follows: near-infrared video camera 11, structured light video camera 4, structured light laser instrument 5, welding torch or laser head 12 are connected with miniature Industrial Control Computer respectively with servo-driver.X-axis fixed mount 7 for welding feeding, Y-axis fixed mount 9 for the correction of welding torch or laser head 12, the adjustment of defocusing amount when Z axis fixed mount 2 is for regulating height or the laser weld of welding torch distance weldment 6.When using the present invention to carry out weld joint tracking, be positioned over by weldment 6 on welding bench 15, miniature Industrial Control Computer is coordinated to start near-infrared video camera 11, structured light video camera 4, structured light laser instrument 5, welding torch or laser head 12 and servo-driver work simultaneously.Utilize two waveband filter system, filtering veiling glare, gather near infrared light and structured light and ambient area information.Miniature Industrial Control Computer butt welded seam and crater image carry out dynamic range adjustment, and application image three-dimensional rebuilding method sets up position while welding measurement equation.According to position while welding metrical information, merge three axle Servo Drive Technology's, set up welding torch or laser head Motion Controlling Model.By the integration technology of weld seam visual information and welding torch or laser head linkage control system, realize the tracing control of weld seam.Set up the Weld Seam Tracking Control system with visual sensing and the displacement integration of welding torch space, adopt near infrared light and structured light dual wavelength binocular vision sensor to obtain molten bath and weld image, welding torch or laser head adopt the method for three axles (X, Y, Z) displacement control.Miniature Industrial Control Computer application card Kalman Filtering butt welded seam deviation carries out optimal estimation, is the timely FEEDBACK CONTROL parameter of correction campaign of welding torch or laser head 12, realizes the prediction correction that welding torch or laser head 12 move and controls.This system can overcome the high light of welding scene, radiation, splashing and electromagnetic interference, improves fault-tolerance and the reliability of system.
The above is preferred embodiment of the present invention, but the present invention should not be limited to the content disclosed in this embodiment and accompanying drawing, and the equivalence completed under not departing from spirit disclosed in this invention so every or amendment, all fall into the scope of protection of the invention.

Claims (8)

1. a dual wavelength binocular vision welding seam tracking method, is characterized in that, the method comprises the steps:
A) IMAQ: miniature Industrial Control Computer sends instruction makes structured light laser instrument (5) launch the structured light being across weld seam, send instruction simultaneously and start near-infrared video camera (11), structured light video camera (4) work, in welding process, synchronous coordination near-infrared video camera (11) and structured light video camera (4) gather the structure light image of molten bath zone infrared image and front end, molten bath weld seam respectively by image pick-up card, and are transferred in miniature Industrial Control Computer by the double-wavelength images of acquisition;
B) data processing: the structure light image of application Multi-information acquisition algorithm to molten bath zone infrared image and front end, molten bath weld seam processes, calculates position while welding and tracking correction amount accurately;
C) weld joint tracking: application card Kalman Filtering butt welded seam tracing deviation state carries out optimal estimation, find the relation between filtering evaluated error and measure error, moved by servo driver drives servomotor thus control three-axis moving workbench and produce corresponding motion, realize the accurate tracking of weld seam.
2. dual wavelength binocular vision welding seam tracking method according to claim 1, is characterized in that: the near-infrared wavelength scope that described near-infrared video camera (11) is absorbed is 960-990nm; The visual structure optical wavelength range that described structured light video camera (4) is absorbed is 640-660nm.
3. a dual wavelength binocular vision seam tracking system, comprise dual wavelength binocular vision detection system, three axle servo-drive seam tracking systems and miniature Industrial Control Computer, it is characterized in that: described dual wavelength binocular vision detection system comprises near-infrared video camera (11), structured light video camera (4), structured light laser instrument (5) and sensor installing plate (3), described structured light video camera (4) is arranged on sensor installing plate (3) left front end, described near-infrared video camera (11) is arranged on sensor installing plate (3) right front ends, described structured light laser instrument (5) is positioned in the middle of structured light video camera (4) and near-infrared video camera (11), be arranged on sensor installing plate (3) middle-end, described three axle servo-drive seam tracking systems comprise X-axis fixed mount (7), Y-axis fixed mount (9) and Z axis fixed mount (2), described X-axis fixed mount (7) upper surface is provided with welding bench (15), weldment (6) is placed on described welding bench (15), X-axis servomotor (13) is arranged on the right-hand member of described X-axis fixed mount (7), the lower front end of described Z axis fixed mount (2) is connected with the middle rear end of X-axis fixed mount (7), Z axis servomotor (1) is arranged on the top of described Z axis fixed mount (2), described Y-axis fixed mount (9) is connected to Z axis fixed mount (2) right side, Y-axis servomotor (8) is arranged on the rear end of described Y-axis fixed mount (9), sensor installing plate (3) is arranged on the front end of Y-axis fixed mount (9), described sensor installing plate (3) back side is provided with reinforcement (16), welding torch or laser head installing plate (10) are arranged on the right front ends of Y-axis fixed mount (9), welding torch or laser head (12) are arranged on immediately below described welding torch or laser head installing plate (10).
4. dual wavelength binocular vision seam tracking system according to claim 3, is characterized in that: described Z axis fixed mount (2) right lateral surface has elongated hole, and Z axis servomotor (1) drives Y-axis fixed mount (9) to move up and down in described elongated hole.
5. dual wavelength binocular vision seam tracking system according to claim 3, is characterized in that: described Y-axis fixed mount (9) left-hand face has elongated hole, and Y-axis servomotor (8) drives Y-axis fixed mount (9) to seesaw in described elongated hole.
6. dual wavelength binocular vision seam tracking system according to claim 3, is characterized in that: weldment (6) side-to-side movement that the driving of described X-axis servomotor (13) is placed on welding bench (15).
7. dual wavelength binocular vision seam tracking system according to claim 3, is characterized in that: described dual wavelength binocular vision detection system is connected with miniature Industrial Control Computer respectively by bus with three axle servo-drive seam tracking systems.
8. dual wavelength binocular vision seam tracking system according to claim 3, is characterized in that: the control system that described dual wavelength binocular vision detection system forms with three axle servo-drive seam tracking systems and miniature Industrial Control Computer is closed-loop control system.
CN201510412801.3A 2015-07-15 2015-07-15 Dual wavelength binocular vision welding seam tracking method and tracking system Active CN104942404B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510412801.3A CN104942404B (en) 2015-07-15 2015-07-15 Dual wavelength binocular vision welding seam tracking method and tracking system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510412801.3A CN104942404B (en) 2015-07-15 2015-07-15 Dual wavelength binocular vision welding seam tracking method and tracking system

Publications (2)

Publication Number Publication Date
CN104942404A true CN104942404A (en) 2015-09-30
CN104942404B CN104942404B (en) 2017-03-15

Family

ID=54157756

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510412801.3A Active CN104942404B (en) 2015-07-15 2015-07-15 Dual wavelength binocular vision welding seam tracking method and tracking system

Country Status (1)

Country Link
CN (1) CN104942404B (en)

Cited By (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105345237A (en) * 2015-12-10 2016-02-24 河北沧海核装备科技股份有限公司 Device and process method for automatically controlling welding seam shape in longitudinal submerged arc welding
CN105618927A (en) * 2016-03-16 2016-06-01 机械科学研究院哈尔滨焊接研究所 Straight weld pass strip electrode electroslag welding machine head device and welding method
CN105798430A (en) * 2016-05-27 2016-07-27 廊坊智通机器人系统有限公司 Laser visual monitoring system for real-time welding line tracking
CN105817743A (en) * 2016-05-27 2016-08-03 天津智通机器人有限公司 Double-vision automatic weld joint tracking device
CN106112207A (en) * 2016-08-17 2016-11-16 广东工业大学 Gas metal-arc welding 3D increases material repair apparatus and method for repairing and mending
CN106112318A (en) * 2016-07-13 2016-11-16 桂林航天工业学院 The online welding seam tracking method of a kind of view-based access control model and system
CN106141374A (en) * 2016-08-17 2016-11-23 广东工业大学 Non-consumable gas shielded arc welding 3D increases material repair apparatus and method for repairing and mending
CN106141436A (en) * 2016-08-17 2016-11-23 广东工业大学 Wire filling laser welding increases material repair apparatus and method for repairing and mending
CN106392348A (en) * 2016-12-02 2017-02-15 广东省智能制造研究所 Additive manufacturing method and additive manufacturing device for aluminum alloy based on laser-double-MIG composite heat source
CN106475664A (en) * 2016-12-27 2017-03-08 广东省智能制造研究所 A kind of stable precise vision seam tracking system
CN106513937A (en) * 2016-12-27 2017-03-22 广东省智能制造研究所 Stable precision vision weld seam tracking method
CN106695101A (en) * 2017-01-23 2017-05-24 青岛同日机械电子有限公司 High-frequency induction welding system based on binocular vision and multi-axis manipulator
CN106825914A (en) * 2017-03-13 2017-06-13 湘潭大学 A kind of integrated laser welding gun with welding line tracking function
CN106996741A (en) * 2017-03-24 2017-08-01 南通大学 Three-dimensional postwelding weld stress processing system based on machine vision
CN107020449A (en) * 2017-04-26 2017-08-08 苏州睿牛机器人技术有限公司 Weld seam tracking sensor and its welding seam tracking method
CN107132271A (en) * 2017-05-26 2017-09-05 广东工业大学 Structure light and magneto-optic imaging double-sensing appearance of weld and defect lossless detection method
CN107363424A (en) * 2017-09-06 2017-11-21 青岛科捷机器人有限公司 A kind of trailing type Scan orientation device and method for laser cutting head positioning
CN107414318A (en) * 2017-09-06 2017-12-01 青岛科捷机器人有限公司 A kind of fixed Scan orientation device and method for laser cutting head positioning
CN107433380A (en) * 2017-09-20 2017-12-05 嘉兴锐视智能科技有限公司 Weld tracker and method
CN107498152A (en) * 2017-09-06 2017-12-22 江苏菲达环保科技有限公司 A kind of large area metal plate tool structure automatic soldering device for being classified positioning
CN107984104A (en) * 2017-12-28 2018-05-04 广东工业大学 A kind of weld seam recognition tracks of device and automatic welding process equipment
CN107999917A (en) * 2018-01-09 2018-05-08 深圳市海目星激光智能装备股份有限公司 A kind of laser soldering equipment
CN108202185A (en) * 2018-01-17 2018-06-26 湘潭大学 A kind of pipe pipe based on double-sensing formula intersects intersection welding seam tracking
CN108544063A (en) * 2018-07-03 2018-09-18 广东工业大学 Gas metal-arc welding increases the device and method of material repairing
CN108856978A (en) * 2018-08-20 2018-11-23 南京理工大学 Corner joint penetration control method based near infrared binocular visual identity
CN109129477A (en) * 2018-08-21 2019-01-04 上海理工大学 A kind of 3 D positioning system based on binocular welding manipulator
CN109623162A (en) * 2019-01-31 2019-04-16 中国地质大学(武汉) A kind of two-dimensional laser engraving machine of view-based access control model servo and Kalman filtering compensation
CN109986171A (en) * 2019-05-20 2019-07-09 广东工业大学 A kind of weld and HAZ method, equipment and system
CN109986172A (en) * 2019-05-21 2019-07-09 广东工业大学 A kind of weld and HAZ method, equipment and system
CN110480127A (en) * 2019-08-12 2019-11-22 广东工业大学 A kind of seam tracking system and method based on structured light visual sensing
CN110877144A (en) * 2019-10-23 2020-03-13 佛山科学技术学院 Infrared on-line measuring device of welding temperature field
CN111570974A (en) * 2020-05-12 2020-08-25 湖北文理学院 Welding deviation measuring method and device based on synchronous drawing and automatic welding system
CN111745335A (en) * 2020-06-30 2020-10-09 歌尔科技有限公司 Spot welding machine head and spot welding device
CN111761274A (en) * 2020-05-29 2020-10-13 南京玄铁自动化科技有限公司 Automatic welding robot and multi-dimensional detection device thereof
CN111906767A (en) * 2020-07-03 2020-11-10 深圳了然视觉科技有限公司 Vision rectification mechanical arm based on binocular structured light and rectification method
CN112719723A (en) * 2020-12-16 2021-04-30 河钢股份有限公司承德分公司 Welding tool for high-strength wear-resistant steel
CN112809131A (en) * 2021-01-18 2021-05-18 湘潭大学 Laser adjustable elliptical tank weld joint tracking sensor
CN112846551A (en) * 2019-11-28 2021-05-28 湘潭大学 Rotary ultrasonic-electric arc combined type welding seam tracking method
CN113210805A (en) * 2021-05-11 2021-08-06 浙江清华长三角研究院 MIG welding deviation rectifying method based on industrial thermal imager and visible light camera double vision
CN113909689A (en) * 2021-11-10 2022-01-11 佛山市南海区广工大数控装备协同创新研究院 Method for extracting characteristics of pipeline welding groove of laser light strip
CN116117273A (en) * 2023-03-01 2023-05-16 广东工业大学 Self-adaptive feedforward welding deviation correcting device and method
CN118060670A (en) * 2024-03-08 2024-05-24 广东汉高科技有限公司 Automatic tracking method for welding seam and welding device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1600505A (en) * 2004-10-21 2005-03-30 上海交通大学 Servo binocular vision sensors on welding robot
CN101015917A (en) * 2007-03-08 2007-08-15 上海交通大学 Welding robot multifunctional double-eye visual sensor and calibration method thereof
CN101062529A (en) * 2006-04-25 2007-10-31 南京理工大学 Weld seam appearance, fused bath and seam near-infrared vision integral sensing checkout gear
CN101456182A (en) * 2007-12-12 2009-06-17 中国科学院自动化研究所 Intelligent robot welding device using large-scale workpiece
CN101486124A (en) * 2009-02-13 2009-07-22 南京工程学院 Multi-structured light binocular composite vision weld joint tracking method and device
CN201432160Y (en) * 2009-04-09 2010-03-31 南昌大学 Aluminum alloy automatic welding binocular vision molten pool monitoring sensor
CN102974918A (en) * 2012-11-26 2013-03-20 清华大学 Multi-spectral spectroscopic photography-based visual monitoring system
CN203156204U (en) * 2013-04-08 2013-08-28 广东工业大学 Supermicro gap butt welding seam magneto-optical imaging automatic detecting and tracking device
CN104741778A (en) * 2015-03-30 2015-07-01 中国石油天然气集团公司 Welding seam tracking and controlling system for combined welding

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1600505A (en) * 2004-10-21 2005-03-30 上海交通大学 Servo binocular vision sensors on welding robot
CN101062529A (en) * 2006-04-25 2007-10-31 南京理工大学 Weld seam appearance, fused bath and seam near-infrared vision integral sensing checkout gear
CN101015917A (en) * 2007-03-08 2007-08-15 上海交通大学 Welding robot multifunctional double-eye visual sensor and calibration method thereof
CN101456182A (en) * 2007-12-12 2009-06-17 中国科学院自动化研究所 Intelligent robot welding device using large-scale workpiece
CN101486124A (en) * 2009-02-13 2009-07-22 南京工程学院 Multi-structured light binocular composite vision weld joint tracking method and device
CN201432160Y (en) * 2009-04-09 2010-03-31 南昌大学 Aluminum alloy automatic welding binocular vision molten pool monitoring sensor
CN102974918A (en) * 2012-11-26 2013-03-20 清华大学 Multi-spectral spectroscopic photography-based visual monitoring system
CN203156204U (en) * 2013-04-08 2013-08-28 广东工业大学 Supermicro gap butt welding seam magneto-optical imaging automatic detecting and tracking device
CN104741778A (en) * 2015-03-30 2015-07-01 中国石油天然气集团公司 Welding seam tracking and controlling system for combined welding

Cited By (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105345237A (en) * 2015-12-10 2016-02-24 河北沧海核装备科技股份有限公司 Device and process method for automatically controlling welding seam shape in longitudinal submerged arc welding
CN105618927A (en) * 2016-03-16 2016-06-01 机械科学研究院哈尔滨焊接研究所 Straight weld pass strip electrode electroslag welding machine head device and welding method
CN105618927B (en) * 2016-03-16 2018-01-23 机械科学研究院哈尔滨焊接研究所 A kind of string bead band pole electroslag welding frame head apparatus and welding method
CN105798430A (en) * 2016-05-27 2016-07-27 廊坊智通机器人系统有限公司 Laser visual monitoring system for real-time welding line tracking
CN105817743A (en) * 2016-05-27 2016-08-03 天津智通机器人有限公司 Double-vision automatic weld joint tracking device
CN105798430B (en) * 2016-05-27 2018-09-21 廊坊智通机器人系统有限公司 A kind of laser vision monitoring system of real-time weld joint tracking
CN106112318B (en) * 2016-07-13 2017-10-20 桂林航天工业学院 The online welding seam tracking method and system of a kind of view-based access control model
CN106112318A (en) * 2016-07-13 2016-11-16 桂林航天工业学院 The online welding seam tracking method of a kind of view-based access control model and system
CN106141436A (en) * 2016-08-17 2016-11-23 广东工业大学 Wire filling laser welding increases material repair apparatus and method for repairing and mending
CN106141374A (en) * 2016-08-17 2016-11-23 广东工业大学 Non-consumable gas shielded arc welding 3D increases material repair apparatus and method for repairing and mending
CN106112207A (en) * 2016-08-17 2016-11-16 广东工业大学 Gas metal-arc welding 3D increases material repair apparatus and method for repairing and mending
CN106392348A (en) * 2016-12-02 2017-02-15 广东省智能制造研究所 Additive manufacturing method and additive manufacturing device for aluminum alloy based on laser-double-MIG composite heat source
CN106475664A (en) * 2016-12-27 2017-03-08 广东省智能制造研究所 A kind of stable precise vision seam tracking system
CN106513937A (en) * 2016-12-27 2017-03-22 广东省智能制造研究所 Stable precision vision weld seam tracking method
CN106513937B (en) * 2016-12-27 2019-02-19 广东省智能制造研究所 A kind of stable precise vision welding seam tracking method
CN106475664B (en) * 2016-12-27 2021-06-25 广东省智能制造研究所 Stable accurate vision welding seam tracking system
CN106695101A (en) * 2017-01-23 2017-05-24 青岛同日机械电子有限公司 High-frequency induction welding system based on binocular vision and multi-axis manipulator
CN106825914A (en) * 2017-03-13 2017-06-13 湘潭大学 A kind of integrated laser welding gun with welding line tracking function
CN106825914B (en) * 2017-03-13 2019-08-02 湘潭大学 A kind of integrated laser welding gun with welding line tracking function
CN106996741A (en) * 2017-03-24 2017-08-01 南通大学 Three-dimensional postwelding weld stress processing system based on machine vision
CN107020449A (en) * 2017-04-26 2017-08-08 苏州睿牛机器人技术有限公司 Weld seam tracking sensor and its welding seam tracking method
CN107132271A (en) * 2017-05-26 2017-09-05 广东工业大学 Structure light and magneto-optic imaging double-sensing appearance of weld and defect lossless detection method
CN107498152A (en) * 2017-09-06 2017-12-22 江苏菲达环保科技有限公司 A kind of large area metal plate tool structure automatic soldering device for being classified positioning
CN107414318A (en) * 2017-09-06 2017-12-01 青岛科捷机器人有限公司 A kind of fixed Scan orientation device and method for laser cutting head positioning
CN107363424A (en) * 2017-09-06 2017-11-21 青岛科捷机器人有限公司 A kind of trailing type Scan orientation device and method for laser cutting head positioning
CN107433380A (en) * 2017-09-20 2017-12-05 嘉兴锐视智能科技有限公司 Weld tracker and method
CN107984104A (en) * 2017-12-28 2018-05-04 广东工业大学 A kind of weld seam recognition tracks of device and automatic welding process equipment
CN107999917B (en) * 2018-01-09 2023-11-17 海目星激光科技集团股份有限公司 Laser soft soldering equipment
CN107999917A (en) * 2018-01-09 2018-05-08 深圳市海目星激光智能装备股份有限公司 A kind of laser soldering equipment
CN108202185A (en) * 2018-01-17 2018-06-26 湘潭大学 A kind of pipe pipe based on double-sensing formula intersects intersection welding seam tracking
CN108544063A (en) * 2018-07-03 2018-09-18 广东工业大学 Gas metal-arc welding increases the device and method of material repairing
CN108856978A (en) * 2018-08-20 2018-11-23 南京理工大学 Corner joint penetration control method based near infrared binocular visual identity
WO2020037803A1 (en) * 2018-08-20 2020-02-27 南京理工大学 Fillet joint penetration control method employing near-infrared binocular vision recognition
CN109129477A (en) * 2018-08-21 2019-01-04 上海理工大学 A kind of 3 D positioning system based on binocular welding manipulator
CN109623162A (en) * 2019-01-31 2019-04-16 中国地质大学(武汉) A kind of two-dimensional laser engraving machine of view-based access control model servo and Kalman filtering compensation
CN109986171A (en) * 2019-05-20 2019-07-09 广东工业大学 A kind of weld and HAZ method, equipment and system
CN109986172A (en) * 2019-05-21 2019-07-09 广东工业大学 A kind of weld and HAZ method, equipment and system
CN109986172B (en) * 2019-05-21 2021-03-16 广东工业大学 Welding seam positioning method, equipment and system
CN110480127A (en) * 2019-08-12 2019-11-22 广东工业大学 A kind of seam tracking system and method based on structured light visual sensing
CN110480127B (en) * 2019-08-12 2021-11-26 广东工业大学 Welding seam tracking system and method based on structured light vision sensing
CN110877144A (en) * 2019-10-23 2020-03-13 佛山科学技术学院 Infrared on-line measuring device of welding temperature field
CN112846551B (en) * 2019-11-28 2022-06-21 湘潭大学 Rotary ultrasonic-electric arc combined type welding seam tracking method
CN112846551A (en) * 2019-11-28 2021-05-28 湘潭大学 Rotary ultrasonic-electric arc combined type welding seam tracking method
CN111570974A (en) * 2020-05-12 2020-08-25 湖北文理学院 Welding deviation measuring method and device based on synchronous drawing and automatic welding system
CN111761274A (en) * 2020-05-29 2020-10-13 南京玄铁自动化科技有限公司 Automatic welding robot and multi-dimensional detection device thereof
CN111745335A (en) * 2020-06-30 2020-10-09 歌尔科技有限公司 Spot welding machine head and spot welding device
CN111906767A (en) * 2020-07-03 2020-11-10 深圳了然视觉科技有限公司 Vision rectification mechanical arm based on binocular structured light and rectification method
CN112719723A (en) * 2020-12-16 2021-04-30 河钢股份有限公司承德分公司 Welding tool for high-strength wear-resistant steel
CN112809131A (en) * 2021-01-18 2021-05-18 湘潭大学 Laser adjustable elliptical tank weld joint tracking sensor
CN112809131B (en) * 2021-01-18 2022-07-29 湘潭大学 Laser adjustable elliptical tank weld joint tracking sensor
CN113210805A (en) * 2021-05-11 2021-08-06 浙江清华长三角研究院 MIG welding deviation rectifying method based on industrial thermal imager and visible light camera double vision
CN113909689A (en) * 2021-11-10 2022-01-11 佛山市南海区广工大数控装备协同创新研究院 Method for extracting characteristics of pipeline welding groove of laser light strip
CN113909689B (en) * 2021-11-10 2024-04-05 佛山市南海区广工大数控装备协同创新研究院 Pipeline welding groove feature extraction method of laser light bar
CN116117273A (en) * 2023-03-01 2023-05-16 广东工业大学 Self-adaptive feedforward welding deviation correcting device and method
CN116117273B (en) * 2023-03-01 2024-04-19 广东工业大学 Self-adaptive feedforward welding deviation correcting device and method
CN118060670A (en) * 2024-03-08 2024-05-24 广东汉高科技有限公司 Automatic tracking method for welding seam and welding device

Also Published As

Publication number Publication date
CN104942404B (en) 2017-03-15

Similar Documents

Publication Publication Date Title
CN104942404A (en) Dual-wavelength binocular vision seam tracking method and tracking system
CN204818380U (en) Near -infrared and structured light dual wavelength binocular vision soldering joint tracking system
CN112059363B (en) Unmanned wall climbing welding robot based on vision measurement and welding method thereof
CN206263418U (en) A kind of real-time seam tracking system of six degree of freedom welding robot line laser
CN104588838B (en) A kind of automatic tracing control of welding gun on-line amending system and control method thereof
Yang et al. Advances techniques of the structured light sensing in intelligent welding robots: a review
CN107414253B (en) Welding seam tracking control device and method based on cross laser
US9259801B2 (en) Laser processing head and method for processing a workpiece by means of a laser beam
CN107511564B (en) Welding seam tracking device
CN202278307U (en) An adjustable double line structured light weld tracking visual sensing system
CN103273171B (en) Visual tracking monitoring system and method in automatic corrugated thin plate fillet weld welding
CN104209667B (en) Ultra micro gap butt weld magnetic rotation photoimaging automatic detection and tracking
CN207205619U (en) Ripple seam tracking system based on 3 D laser scanning
CN104084669A (en) Visual detecting method and device based on decoupling detection for circular seams
JPH09126726A (en) Method and device for monitoring and positioning processing beam for material to be processed or jet stream
CN203156204U (en) Supermicro gap butt welding seam magneto-optical imaging automatic detecting and tracking device
CN102029463A (en) Device for controlling deflection correction of MIG/MAG backing weld joint of pipe based on visual sensor
CN109822194A (en) A kind of weld tracker and welding method
CN105138022A (en) Visual tracking decoupling control method and apparatus of narrow welding seam
CN107378246A (en) A kind of method and system for correcting laser welding track
CN114473153A (en) Oil-gas long-distance pipeline welding system and method
CN202411631U (en) Real-time tracking device for longitudinal seam welding of welded pipe
CN102430842A (en) Welding pipe vertical seam welding real-time tracking device
US8509941B2 (en) Method and device for fine positioning of a tool having a handling apparatus
JP2020028889A (en) Weld control device, display controller, welding system, weld control method and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant