CN114841959A - Automatic welding method and system based on computer vision - Google Patents
Automatic welding method and system based on computer vision Download PDFInfo
- Publication number
- CN114841959A CN114841959A CN202210479154.8A CN202210479154A CN114841959A CN 114841959 A CN114841959 A CN 114841959A CN 202210479154 A CN202210479154 A CN 202210479154A CN 114841959 A CN114841959 A CN 114841959A
- Authority
- CN
- China
- Prior art keywords
- welding
- positioning point
- computer vision
- distance
- welded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/909—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30152—Solder
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Abstract
The invention discloses an automatic welding method and system based on computer vision, wherein the method comprises the following steps: acquiring welding positions and welding parameters in a database of a welding control system; determining a welding positioning point on a welding workpiece corresponding to the welding position by adopting a computer vision technology; and (4) performing automatic welding at the determined welding positioning points based on the welding parameters by adopting an automatic welding technology. The method can overcome the condition that welding fails due to inaccurate positioning points in the automatic welding process, and accurately obtains the target position to be welded by adopting a computer vision technology, thereby improving the success rate of welding.
Description
Technical Field
The invention relates to the technical field of automatic welding, in particular to an automatic welding method and system based on computer vision.
Background
With the development of electronic technology, electronic products are developed in the direction of multifunction, miniaturization and high reliability. The circuit is more and more complicated, and the product packing density is also more and more high, and manual welding can satisfy the requirement of high reliability, but hardly satisfies the high-efficient requirement of group welding simultaneously, therefore, has the automatic welding data of high efficiency to come up to the end.
However, when the positioning point is inaccurate in the automatic welding process and the welding fails, a solution that can accurately obtain the target position to be welded so as to improve the success rate of welding is needed.
Disclosure of Invention
The invention provides an automatic welding method and system based on computer vision, which aim to solve the problems in the prior art.
The invention provides an automatic welding method based on computer vision, which comprises the following steps:
s100, obtaining a welding position and a welding parameter in a database of a welding control system;
s200, determining a welding positioning point on the welding workpiece corresponding to the welding position by adopting a computer vision technology;
and S300, performing automatic welding on the determined welding positioning points based on the welding parameters by adopting an automatic welding technology.
Preferably, the S200 includes:
s201, moving automatic welding equipment to a welding position;
s202, a computer vision system arranged on automatic welding equipment collects image information of a welding position, analyzes the collected image information and obtains a welding positioning point on a welding workpiece;
s203, judging whether the welding positioning point is a given welding position, and if not, setting the welding positioning point as the optimized welding position;
and S204, replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
Preferably, the S202 includes:
s2021, the computer vision system carries out integration splicing calculation on the collected image information to form a three-dimensional image model of the position to be welded, and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position;
s2022, setting the first coordinate parameter of the position to be welded as a first welding positioning point;
s2023, moving the position of the computer vision system, re-collecting new image information after the position is adjusted, integrating, splicing and calculating the new image information to form a new three-dimensional image model of the position to be welded, and outputting a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point;
s2024, calculating a first distance between the first coordinate parameter and the welding position acquired from the database, and calculating a second distance between the second coordinate parameter and the welding position acquired from the database;
s2025, judging the relation between the first distance and the second distance, and if the first distance is smaller than the second distance, setting the first welding positioning point as a welding positioning point on the welding workpiece; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
Preferably, said S300 comprises, after:
s400, after welding is finished, acquiring images of a welding part by using a computer vision system, forming a welding quality detection image set based on the images, and constructing a detection three-dimensional model based on the welding quality detection image set;
s500, determining welding quality based on the detected three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
Preferably, the determining the welding quality based on the detected three-dimensional model in S500 includes:
s501, performing model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm, and performing comparison based on normal distribution of multi-dimensional variables of the model;
s502, after the initial comparison is finished, an iterative closest point algorithm is adopted for accurate comparison;
s503, calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the detected three-dimensional model and the closest point in the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
Preferably, the formula of the transformation matrix is as follows:
wherein (R, t) is a transformation matrix, R is a rotation matrix, t is a translation vector, w i As a weight of each point, p i To detect the ith point in the three-dimensional model, q i And the ith point in the new three-dimensional image model is represented by i, i is 1,2 … n, n is the number of points in the detected three-dimensional model, and argmin represents the value of the corresponding independent variable when the function takes the minimum value.
The invention provides an automatic welding system based on computer vision, comprising:
the acquisition module acquires welding positions and welding parameters in a database of the welding control system;
the positioning point determining module is used for determining a welding positioning point on the welding workpiece corresponding to the welding position by adopting a computer vision technology;
and the automatic welding module adopts an automatic welding technology to perform automatic welding at the determined welding positioning points based on the welding parameters.
Preferably, the positioning point determining module includes:
moving the sub-module, and moving the automatic welding equipment to a welding position;
the computer vision system is arranged on the automatic welding equipment and used for acquiring image information of a welding position and analyzing the acquired image information to obtain a welding positioning point on a welding workpiece;
the judgment optimization submodule judges whether the welding positioning point is a given welding position, and if not, the welding positioning point is set to be the optimized welding position;
and the storage submodule is used for replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
Preferably, the computer vision system comprises:
the computer vision system carries out integration splicing calculation on the acquired image information to form a three-dimensional image model of the position to be welded and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position;
the first welding positioning point setting submodule sets a first coordinate parameter of the position to be welded as a first welding positioning point;
the second welding positioning point setting submodule moves the position of the computer vision system, acquires new image information after the position is adjusted again, performs integration and splicing calculation on the new image information to form a new three-dimensional image model of the position to be welded, and outputs a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point;
the distance calculation submodule is used for calculating a first distance between the first coordinate parameter and the welding position acquired from the database and calculating a second distance between the second coordinate parameter and the welding position acquired from the database;
determining a submodule, judging the relation between the first distance and the second distance, and setting the first welding positioning point as a welding positioning point on the welding workpiece if the first distance is smaller than the second distance; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
Preferably, the method further comprises the following steps:
the detection module is used for acquiring images of a welding part by adopting a computer vision system after welding is finished, forming a welding quality detection image set based on the images and constructing a detection three-dimensional model based on the welding quality detection image set;
the detection optimization module is used for determining welding quality based on the detection three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
Preferably, the determining the welding quality based on the detection three-dimensional model in the detection optimization module comprises:
the initial comparison submodule is used for carrying out model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm and carrying out comparison on the basis of normal distribution of multi-dimensional variables of the model;
the accurate comparison submodule adopts an iterative closest point algorithm to perform accurate comparison after the initial comparison is finished;
the matrix calculation submodule is used for calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the detection three-dimensional model and the closest point in the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
Compared with the prior art, the invention has the following advantages:
the invention provides an automatic welding method and system based on computer vision, wherein the method comprises the following steps: acquiring welding positions and welding parameters in a database of a welding control system; determining a welding positioning point on a welding workpiece corresponding to the welding position by adopting a computer vision technology; and (4) performing automatic welding at the determined welding positioning points based on the welding parameters by adopting an automatic welding technology. The method can overcome the condition that welding fails due to inaccurate positioning points in the automatic welding process, and accurately obtains the target position to be welded by adopting a computer vision technology, thereby improving the success rate of welding.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a flow chart of a computer vision based automated welding method in an embodiment of the present invention;
FIG. 2 is a flowchart of a method for a computer vision system to obtain a welding location point on a welded workpiece according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an automatic welding system based on computer vision according to an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
The embodiment of the invention provides an automatic welding method based on computer vision, and please refer to fig. 1, the method comprises the following steps:
s100, obtaining a welding position and a welding parameter in a database of a welding control system;
s200, determining a welding positioning point on the welding workpiece corresponding to the welding position by adopting a computer vision technology;
and S300, performing automatic welding on the determined welding positioning points based on the welding parameters by adopting an automatic welding technology.
The working principle of the technical scheme is as follows: the scheme adopted by the embodiment is to obtain the welding position and the welding parameter in a database of the welding control system; determining a welding positioning point on a welding workpiece corresponding to the welding position by adopting a computer vision technology; and (4) performing automatic welding at the determined welding positioning points based on the welding parameters by adopting an automatic welding technology.
Computer vision is a science for researching how to make a machine "see", and further, it means that a camera and a computer are used to replace human eyes to perform machine vision such as identification, tracking and measurement on a target, and further image processing is performed, so that the computer processing becomes an image more suitable for human eyes to observe or transmitted to an instrument to detect.
Therefore, the scheme provided by the embodiment can overcome the condition that welding fails due to inaccurate positioning points in the automatic welding process, and the position of the target to be welded is accurately obtained by adopting a computer vision technology, so that the success rate of welding is improved.
The beneficial effects of the above technical scheme are: the method comprises the steps of obtaining welding positions and welding parameters in a database of a welding control system by adopting the scheme provided by the embodiment; determining a welding positioning point on a welding workpiece corresponding to the welding position by adopting a computer vision technology; and (4) performing automatic welding at the determined welding positioning point based on the welding parameters by adopting an automatic welding technology. By adopting a computer vision technology, the position of the target to be welded is accurately obtained, so that the success rate of welding is improved.
In another embodiment, the S200 includes:
s201, moving automatic welding equipment to a welding position;
s202, a computer vision system arranged on automatic welding equipment collects image information of a welding position, analyzes the collected image information and obtains a welding positioning point on a welding workpiece;
s203, judging whether the welding positioning point is a given welding position, and if not, setting the welding positioning point as the optimized welding position;
and S204, replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
The working principle of the technical scheme is as follows: the scheme adopted by the embodiment is that the automatic welding equipment moves to a welding position; a computer vision system arranged on the automatic welding equipment collects image information of a welding position and analyzes the collected image information to obtain a welding positioning point on a welding workpiece; judging whether the welding positioning point is a given welding position, if not, setting the welding positioning point as the optimized welding position; and replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
The beneficial effects of the above technical scheme are: the automatic welding equipment moves to the welding position by adopting the scheme provided by the embodiment; a computer vision system arranged on the automatic welding equipment collects image information of a welding position and analyzes the collected image information to obtain a welding positioning point on a welding workpiece; judging whether the welding positioning point is a given welding position, if not, setting the welding positioning point as the optimized welding position; and replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
In another embodiment, referring to fig. 2, the step S202 includes:
s2021, the computer vision system carries out integration splicing calculation on the collected image information to form a three-dimensional image model of the position to be welded, and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position;
s2022, setting the first coordinate parameter of the position to be welded as a first welding positioning point;
s2023, moving the position of the computer vision system, re-collecting new image information after the position is adjusted, integrating, splicing and calculating the new image information to form a new three-dimensional image model of the position to be welded, and outputting a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point;
s2024, calculating a first distance between the first coordinate parameter and the welding position acquired from the database, and calculating a second distance between the second coordinate parameter and the welding position acquired from the database;
s2025, judging the relation between the first distance and the second distance, and if the first distance is smaller than the second distance, setting the first welding positioning point as a welding positioning point on the welding workpiece; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
The working principle of the technical scheme is as follows: the scheme adopted by the embodiment is that the computer vision system carries out integration splicing calculation on the acquired image information to form a three-dimensional image model of the position to be welded and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position; setting a first coordinate parameter of the position to be welded as a first welding positioning point; moving the position of a computer vision system, re-collecting new image information after adjusting the position, performing integration splicing calculation on the new image information to form a new three-dimensional image model of the position to be welded, and outputting a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point; calculating a first distance between the first coordinate parameter and the welding position obtained from the database, and calculating a second distance between the second coordinate parameter and the welding position obtained from the database; judging the relation between the first distance and the second distance, and setting the first welding positioning point as a welding positioning point on the welding workpiece if the first distance is smaller than the second distance; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
The beneficial effects of the above technical scheme are: the computer vision system in the scheme provided by the embodiment is used for integrating, splicing and calculating the acquired image information to form a three-dimensional image model of the position to be welded, and outputting a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position; setting a first coordinate parameter of the position to be welded as a first welding positioning point; moving the position of a computer vision system, re-collecting new image information after adjusting the position, performing integration splicing calculation on the new image information to form a new three-dimensional image model of the position to be welded, and outputting a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point; calculating a first distance between the first coordinate parameter and the welding position obtained from the database, and calculating a second distance between the second coordinate parameter and the welding position obtained from the database; judging the relation between the first distance and the second distance, and setting the first welding positioning point as a welding positioning point on the welding workpiece if the first distance is smaller than the second distance; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
In another embodiment, the S300 is followed by:
s400, after welding is finished, collecting images of a welding part by using a computer vision system, forming a welding quality detection image set based on the images, and constructing a detection three-dimensional model based on the welding quality detection image set;
s500, determining welding quality based on the detected three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
The working principle of the technical scheme is as follows: the method adopts the scheme that after welding is finished, a computer vision system is adopted to collect images of a welding part, a welding quality detection image set is formed based on the images, and a detection three-dimensional model is constructed based on the welding quality detection image set; determining welding quality based on the detection three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
The beneficial effects of the above technical scheme are: after the welding is finished by adopting the scheme provided by the embodiment, a computer vision system is adopted to collect images of a welding part, a welding quality detection image set is formed based on the images, and a detection three-dimensional model is constructed based on the welding quality detection image set; determining welding quality based on the detection three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
In another embodiment, the determining the welding quality based on the detected three-dimensional model in S500 includes:
s501, performing model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm, and performing comparison based on normal distribution of multi-dimensional variables of the model;
s502, after the initial comparison is finished, an iterative closest point algorithm is adopted for accurate comparison;
s503, calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the detected three-dimensional model and the closest point in the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
The working principle of the technical scheme is as follows: the scheme adopted by the embodiment is that the welding quality determination based on the detection three-dimensional model comprises the following steps: carrying out model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm, and carrying out comparison on the basis of normal distribution of multi-dimensional variables of the model; after the initial comparison is completed, an iterative closest point algorithm is adopted for accurate comparison; calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the closest point in the three-dimensional model to be detected and the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
The beneficial effects of the above technical scheme are: determining the welding quality based on the detected three-dimensional model by adopting the scheme provided by the embodiment comprises the following steps: carrying out model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm, and carrying out comparison on the basis of normal distribution of multi-dimensional variables of the model; after the initial comparison is completed, an iterative closest point algorithm is adopted for accurate comparison; calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the closest point in the three-dimensional model to be detected and the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
In another embodiment, the present embodiment further provides an automatic welding system based on computer vision, referring to fig. 3, the system includes:
the acquisition module acquires welding positions and welding parameters in a database of the welding control system;
the positioning point determining module is used for determining a welding positioning point on the welding workpiece corresponding to the welding position by adopting a computer vision technology;
and the automatic welding module adopts an automatic welding technology to perform automatic welding at the determined welding positioning points based on the welding parameters.
The working principle of the technical scheme is as follows: the scheme adopted by the embodiment is that the acquisition module acquires the welding position and the welding parameters in a database of the welding control system; the positioning point determining module is used for determining a welding positioning point on the welding workpiece corresponding to the welding position by adopting a computer vision technology; and the automatic welding module adopts an automatic welding technology to perform automatic welding at the determined welding positioning points based on the welding parameters.
The beneficial effects of the above technical scheme are: the scheme provided by the embodiment is that the acquisition module acquires the welding position and the welding parameters in a database of the welding control system; the positioning point determining module is used for determining a welding positioning point on the welding workpiece corresponding to the welding position by adopting a computer vision technology; and the automatic welding module adopts an automatic welding technology to perform automatic welding at the determined welding positioning points based on the welding parameters.
In another embodiment, the localization point determining module comprises:
moving the sub-module, and moving the automatic welding equipment to a welding position;
the computer vision system is arranged on the automatic welding equipment and used for acquiring image information of a welding position and analyzing the acquired image information to obtain a welding positioning point on a welding workpiece;
the judgment optimization submodule judges whether the welding positioning point is a given welding position, and if not, the welding positioning point is set to be the optimized welding position;
and the storage submodule is used for replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
The working principle of the technical scheme is as follows: the scheme adopted by this embodiment is that the anchor point determining module includes: moving the sub-module, and moving the automatic welding equipment to a welding position; the computer vision system is arranged on the automatic welding equipment and used for acquiring image information of a welding position and analyzing the acquired image information to obtain a welding positioning point on a welding workpiece; the judgment optimization submodule judges whether the welding positioning point is a given welding position, and if not, the welding positioning point is set to be the optimized welding position; and the storage submodule is used for storing the optimized welding position in the database of the control system instead of the original welding position.
The beneficial effects of the above technical scheme are: the positioning point determining module adopting the scheme provided by the embodiment comprises: moving the sub-module, and moving the automatic welding equipment to a welding position; the computer vision system is arranged on the automatic welding equipment and used for acquiring image information of a welding position and analyzing the acquired image information to obtain a welding positioning point on a welding workpiece; the judgment optimization submodule judges whether the welding positioning point is a given welding position, and if not, the welding positioning point is set to be the optimized welding position; and the storage submodule is used for replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
In another embodiment, the computer vision system comprises:
the computer vision system integrates, splices and calculates the acquired image information to form a three-dimensional image model of the position to be welded and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position;
the first welding positioning point setting submodule sets a first coordinate parameter of the position to be welded as a first welding positioning point;
the second welding positioning point setting submodule moves the position of the computer vision system, acquires new image information after the position is adjusted again, performs integration and splicing calculation on the new image information to form a new three-dimensional image model of the position to be welded, and outputs a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point;
the distance calculation submodule is used for calculating a first distance between the first coordinate parameter and the welding position acquired from the database and calculating a second distance between the second coordinate parameter and the welding position acquired from the database;
determining a submodule, judging the relation between the first distance and the second distance, and setting the first welding positioning point as a welding positioning point on the welding workpiece if the first distance is smaller than the second distance; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
The working principle of the technical scheme is as follows: the present embodiment adopts a scheme that the computer vision system includes: the computer vision system integrates, splices and calculates the acquired image information to form a three-dimensional image model of the position to be welded and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position; the first welding positioning point setting submodule sets a first coordinate parameter of the position to be welded as a first welding positioning point; the second welding positioning point setting submodule moves the position of the computer vision system, acquires new image information after the position is adjusted again, performs integration and splicing calculation on the new image information to form a new three-dimensional image model of the position to be welded, and outputs a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point; the distance calculation submodule is used for calculating a first distance between the first coordinate parameter and the welding position acquired from the database and calculating a second distance between the second coordinate parameter and the welding position acquired from the database; determining a submodule, judging the relation between the first distance and the second distance, and setting the first welding positioning point as a welding positioning point on the welding workpiece if the first distance is smaller than the second distance; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
The beneficial effects of the above technical scheme are: the computer vision system adopting the scheme provided by the embodiment comprises: the computer vision system integrates, splices and calculates the acquired image information to form a three-dimensional image model of the position to be welded and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position; the first welding positioning point setting submodule sets a first coordinate parameter of the position to be welded as a first welding positioning point; the second welding positioning point setting submodule moves the position of the computer vision system, acquires new image information after the position is adjusted again, performs integration and splicing calculation on the new image information to form a new three-dimensional image model of the position to be welded, and outputs a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point; the distance calculation submodule is used for calculating a first distance between the first coordinate parameter and the welding position acquired from the database and calculating a second distance between the second coordinate parameter and the welding position acquired from the database; determining a submodule, judging the relation between the first distance and the second distance, and setting the first welding positioning point as a welding positioning point on the welding workpiece if the first distance is smaller than the second distance; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
In another embodiment, further comprising:
the detection module is used for acquiring images of a welding part by adopting a computer vision system after welding is finished, forming a welding quality detection image set based on the images and constructing a detection three-dimensional model based on the welding quality detection image set;
the detection optimization module is used for determining welding quality based on the detection three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
The working principle of the technical scheme is as follows: the scheme adopted by the embodiment further comprises: the detection module is used for acquiring images of a welding part by adopting a computer vision system after welding is finished, forming a welding quality detection image set based on the images and constructing a detection three-dimensional model based on the welding quality detection image set; the detection optimization module is used for determining welding quality based on the detection three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
The beneficial effects of the above technical scheme are: the scheme provided by the embodiment further comprises the following steps: the detection module is used for acquiring images of a welding part by adopting a computer vision system after welding is finished, forming a welding quality detection image set based on the images and constructing a detection three-dimensional model based on the welding quality detection image set; the detection optimization module is used for determining welding quality based on the detection three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
In another embodiment, the determining of the weld quality based on the inspection three-dimensional model in the inspection optimization module comprises:
the initial comparison submodule is used for carrying out model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm and carrying out comparison on the basis of normal distribution of multi-dimensional variables of the model;
the accurate comparison sub-module adopts an iterative closest point algorithm to carry out accurate comparison after the initial comparison is finished;
the matrix calculation submodule is used for calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the detection three-dimensional model and the closest point in the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
The working principle of the technical scheme is as follows: the scheme adopted by the embodiment is that the determination of the welding quality based on the detection three-dimensional model in the detection optimization module comprises the following steps: the initial comparison submodule is used for carrying out model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm and carrying out comparison on the basis of normal distribution of multi-dimensional variables of the model; the accurate comparison submodule adopts an iterative closest point algorithm to perform accurate comparison after the initial comparison is finished; the matrix calculation submodule is used for calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the detection three-dimensional model and the closest point in the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
The beneficial effects of the above technical scheme are: the method for determining the welding quality based on the three-dimensional detection model in the detection optimization module according to the scheme provided by the embodiment comprises the following steps: the initial comparison submodule is used for carrying out model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm and carrying out comparison on the basis of normal distribution of multi-dimensional variables of the model; the accurate comparison submodule adopts an iterative closest point algorithm to perform accurate comparison after the initial comparison is finished; the matrix calculation submodule is used for calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the detection three-dimensional model and the closest point in the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. An automatic welding method based on computer vision is characterized by comprising the following steps:
s100, obtaining a welding position and a welding parameter in a database of a welding control system;
s200, determining a welding positioning point on the welding workpiece corresponding to the welding position by adopting a computer vision technology;
and S300, performing automatic welding on the determined welding positioning points based on the welding parameters by adopting an automatic welding technology.
2. The computer vision based automated welding method of claim 1,
the S200 includes:
s201, moving automatic welding equipment to a welding position;
s202, a computer vision system arranged on automatic welding equipment collects image information of a welding position, analyzes the collected image information and obtains a welding positioning point on a welding workpiece;
s203, judging whether the welding positioning point is a given welding position, and if not, setting the welding positioning point as the optimized welding position;
and S204, replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
3. The computer vision based automated welding method of claim 2,
the S202 includes:
s2021, the computer vision system carries out integration splicing calculation on the collected image information to form a three-dimensional image model of the position to be welded, and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position;
s2022, setting the first coordinate parameter of the position to be welded as a first welding positioning point;
s2023, moving the position of the computer vision system, re-collecting new image information after the position is adjusted, integrating, splicing and calculating the new image information to form a new three-dimensional image model of the position to be welded, and outputting a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point;
s2024, calculating a first distance between the first coordinate parameter and the welding position acquired from the database, and calculating a second distance between the second coordinate parameter and the welding position acquired from the database;
s2025, judging the relation between the first distance and the second distance, and if the first distance is smaller than the second distance, setting the first welding positioning point as a welding positioning point on the welding workpiece; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
4. The computer vision based automated welding method of claim 3,
the step S300 is followed by:
s400, after welding is finished, acquiring images of a welding part by using a computer vision system, forming a welding quality detection image set based on the images, and constructing a detection three-dimensional model based on the welding quality detection image set;
s500, determining welding quality based on the detected three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
5. The computer vision based automated welding method of claim 4,
the determining the welding quality based on the detected three-dimensional model in S500 includes:
s501, performing model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm, and performing comparison based on normal distribution of multi-dimensional variables of the model;
s502, after the initial comparison is finished, performing accurate comparison by adopting an iterative closest point algorithm;
s503, calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the detected three-dimensional model and the closest point in the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
6. A computer vision based automated welding system, comprising:
the acquisition module acquires welding positions and welding parameters in a database of the welding control system;
the positioning point determining module is used for determining a welding positioning point on the welding workpiece corresponding to the welding position by adopting a computer vision technology;
and the automatic welding module adopts an automatic welding technology to perform automatic welding at the determined welding positioning points based on the welding parameters.
7. The computer vision based automated welding system of claim 6,
the anchor point determination module comprises:
moving the sub-module, and moving the automatic welding equipment to a welding position;
the computer vision system is arranged on the automatic welding equipment and used for acquiring image information of a welding position and analyzing the acquired image information to obtain a welding positioning point on a welding workpiece;
the judgment optimization submodule judges whether the welding positioning point is a given welding position, and if not, the welding positioning point is set to be the optimized welding position;
and the storage submodule is used for replacing the original welding position with the optimized welding position and storing the optimized welding position into a database of the control system.
8. The computer vision based automated welding system of claim 7,
the computer vision system includes:
the computer vision system integrates, splices and calculates the acquired image information to form a three-dimensional image model of the position to be welded and outputs a first coordinate parameter of the position to be welded in the three-dimensional image model; the position to be welded is the same as or different from the welding position;
the first welding positioning point setting submodule sets a first coordinate parameter of the position to be welded as a first welding positioning point;
the second welding positioning point setting submodule moves the position of the computer vision system, acquires new image information after the position is adjusted again, performs integration and splicing calculation on the new image information to form a new three-dimensional image model of the position to be welded, and outputs a second coordinate parameter of the position to be welded in the new three-dimensional image model; setting the second coordinate parameter as a second welding positioning point;
the distance calculation submodule is used for calculating a first distance between the first coordinate parameter and the welding position acquired from the database and calculating a second distance between the second coordinate parameter and the welding position acquired from the database;
determining a submodule, judging the relation between the first distance and the second distance, and setting the first welding positioning point as a welding positioning point on the welding workpiece if the first distance is smaller than the second distance; and if the first distance is greater than the second distance, setting the second welding positioning point as a welding positioning point on the welding workpiece.
9. The computer vision based automated welding system of claim 8,
further comprising:
the detection module is used for acquiring images of a welding part by adopting a computer vision system after welding is finished, forming a welding quality detection image set based on the images and constructing a detection three-dimensional model based on the welding quality detection image set;
the detection optimization module is used for determining welding quality based on the detection three-dimensional model, wherein the welding quality comprises whether a welding displacement phenomenon exists at a welding position, and the welding displacement phenomenon is caused by the fact that a welding positioning point and an actual welding point of a workpiece cannot be completely butted; and if the welding displacement phenomenon exists, determining an actual welding point based on the detection three-dimensional model, and replacing the coordinate parameter of the actual welding point with the welding position in the database.
10. The computer vision based automated welding system of claim 9,
the determining the welding quality based on the detection three-dimensional model in the detection optimization module comprises the following steps:
the initial comparison submodule is used for carrying out model initial comparison on the detected three-dimensional model and a new three-dimensional image model of the position to be welded by adopting a normal distribution transformation algorithm and carrying out comparison on the basis of normal distribution of multi-dimensional variables of the model;
the accurate comparison submodule adopts an iterative closest point algorithm to perform accurate comparison after the initial comparison is finished;
the matrix calculation submodule is used for calculating the distance between the minimum two points in the optimal theory to obtain a corresponding transformation matrix, determining a rotation matrix based on the transformation matrix, and determining the comparison result of the detection three-dimensional model and the closest point in the new three-dimensional image model of the position to be welded based on the rotation matrix; and determining the welding quality based on the comparison result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210479154.8A CN114841959B (en) | 2022-05-05 | 2022-05-05 | Automatic welding method and system based on computer vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210479154.8A CN114841959B (en) | 2022-05-05 | 2022-05-05 | Automatic welding method and system based on computer vision |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114841959A true CN114841959A (en) | 2022-08-02 |
| CN114841959B CN114841959B (en) | 2023-04-04 |
Family
ID=82567414
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210479154.8A Active CN114841959B (en) | 2022-05-05 | 2022-05-05 | Automatic welding method and system based on computer vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114841959B (en) |
Citations (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4998005A (en) * | 1989-05-15 | 1991-03-05 | General Electric Company | Machine vision system |
| US5904864A (en) * | 1997-11-26 | 1999-05-18 | Baltimore Aircoil Company, Inc. | Robotic welding |
| US20040124227A1 (en) * | 2001-02-14 | 2004-07-01 | Honda Giken Kogyo Kabushiki Kaisha | Welding condition monitoring device |
| JP2008132525A (en) * | 2006-11-29 | 2008-06-12 | Nachi Fujikoshi Corp | Teaching-position correcting system of welding-robot and teaching-position correcting method of welding-robot |
| JP2010179328A (en) * | 2009-02-04 | 2010-08-19 | Kobe Steel Ltd | Apparatus, method, program and system for position compensation |
| JP2013013921A (en) * | 2011-07-05 | 2013-01-24 | Hitachi Ltd | Automatic welding system and automatic welding method |
| CN103111721A (en) * | 2013-01-11 | 2013-05-22 | 上海电机学院 | Boiler piping line movable connecting piece welding method |
| CN104384762A (en) * | 2014-09-24 | 2015-03-04 | 上海第二工业大学 | Control system and control method for movement of welding machine |
| CN105427295A (en) * | 2015-11-12 | 2016-03-23 | 汪月银 | Welding seam based image identification method and image identification system |
| CN108465900A (en) * | 2017-02-23 | 2018-08-31 | 通用汽车环球科技运作有限责任公司 | System and method for object range detection and positioning |
| CN108747132A (en) * | 2018-07-24 | 2018-11-06 | 湖北书豪智能科技有限公司 | Autonomous welding robot vision control system |
| CN109816724A (en) * | 2018-12-04 | 2019-05-28 | 中国科学院自动化研究所 | Three-dimensional feature extracting method and device based on machine vision |
| CN110524580A (en) * | 2019-09-16 | 2019-12-03 | 西安中科光电精密工程有限公司 | A kind of welding robot visual component and its measurement method |
| CN110524581A (en) * | 2019-09-16 | 2019-12-03 | 西安中科光电精密工程有限公司 | A kind of flexible welding robot system and its welding method |
| CN110773840A (en) * | 2019-11-12 | 2020-02-11 | 湖北文理学院 | Welding deviation measuring method and device and automatic welding system |
| US20200082278A1 (en) * | 2018-09-12 | 2020-03-12 | Delta Electronics, Inc. | Soldering process parameter suggestion method and system thereof |
| CN111037039A (en) * | 2019-12-31 | 2020-04-21 | 上海森松制药设备工程有限公司 | Flat joint welding method, device, system and computer readable storage medium |
| WO2020137184A1 (en) * | 2018-12-27 | 2020-07-02 | 三菱電機株式会社 | Automatic welding system, method for manufacturing elevator cage parts, and automatic welding method |
| CN111596613A (en) * | 2020-05-18 | 2020-08-28 | 北京创想智控科技有限公司 | Welding deviation determination method, welding deviation determination device, electronic equipment and storage medium |
| CN112238304A (en) * | 2019-07-18 | 2021-01-19 | 山东淄博环宇桥梁模板有限公司 | Method for automatically welding small-batch customized special-shaped bridge steel templates by mechanical arm based on image visual recognition of welding seams |
| CN112756834A (en) * | 2021-01-25 | 2021-05-07 | 陕西帕源路桥建设有限公司 | Welding position control system of welding gun |
| CN112775975A (en) * | 2021-02-01 | 2021-05-11 | 重庆皮克索自动化科技有限公司 | Vision-guided multi-station robot welding deviation correcting device and method |
| CN112958959A (en) * | 2021-02-08 | 2021-06-15 | 西安知象光电科技有限公司 | Automatic welding and detection method based on three-dimensional vision |
| CN113920060A (en) * | 2021-09-09 | 2022-01-11 | 中国科学院自动化研究所 | Autonomous operation method and device for welding robot, electronic device, and storage medium |
| CN114092647A (en) * | 2021-11-19 | 2022-02-25 | 复旦大学 | Three-dimensional reconstruction system and method based on panoramic binocular stereo vision |
| CN114083129A (en) * | 2021-12-17 | 2022-02-25 | 吴小燕 | Three-dimensional visual tracking welding robot and control method thereof |
| CN114160921A (en) * | 2021-11-22 | 2022-03-11 | 湖北文理学院 | Welding control method and control device for welding robot and welding robot |
| CN114273826A (en) * | 2021-12-31 | 2022-04-05 | 南京欧睿三维科技有限公司 | Automatic identification method for welding position of large-sized workpiece to be welded |
-
2022
- 2022-05-05 CN CN202210479154.8A patent/CN114841959B/en active Active
Patent Citations (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4998005A (en) * | 1989-05-15 | 1991-03-05 | General Electric Company | Machine vision system |
| US5904864A (en) * | 1997-11-26 | 1999-05-18 | Baltimore Aircoil Company, Inc. | Robotic welding |
| US20040124227A1 (en) * | 2001-02-14 | 2004-07-01 | Honda Giken Kogyo Kabushiki Kaisha | Welding condition monitoring device |
| JP2008132525A (en) * | 2006-11-29 | 2008-06-12 | Nachi Fujikoshi Corp | Teaching-position correcting system of welding-robot and teaching-position correcting method of welding-robot |
| JP2010179328A (en) * | 2009-02-04 | 2010-08-19 | Kobe Steel Ltd | Apparatus, method, program and system for position compensation |
| JP2013013921A (en) * | 2011-07-05 | 2013-01-24 | Hitachi Ltd | Automatic welding system and automatic welding method |
| CN103111721A (en) * | 2013-01-11 | 2013-05-22 | 上海电机学院 | Boiler piping line movable connecting piece welding method |
| CN104384762A (en) * | 2014-09-24 | 2015-03-04 | 上海第二工业大学 | Control system and control method for movement of welding machine |
| CN105427295A (en) * | 2015-11-12 | 2016-03-23 | 汪月银 | Welding seam based image identification method and image identification system |
| CN108465900A (en) * | 2017-02-23 | 2018-08-31 | 通用汽车环球科技运作有限责任公司 | System and method for object range detection and positioning |
| CN108747132A (en) * | 2018-07-24 | 2018-11-06 | 湖北书豪智能科技有限公司 | Autonomous welding robot vision control system |
| US20200082278A1 (en) * | 2018-09-12 | 2020-03-12 | Delta Electronics, Inc. | Soldering process parameter suggestion method and system thereof |
| CN109816724A (en) * | 2018-12-04 | 2019-05-28 | 中国科学院自动化研究所 | Three-dimensional feature extracting method and device based on machine vision |
| WO2020137184A1 (en) * | 2018-12-27 | 2020-07-02 | 三菱電機株式会社 | Automatic welding system, method for manufacturing elevator cage parts, and automatic welding method |
| CN112238304A (en) * | 2019-07-18 | 2021-01-19 | 山东淄博环宇桥梁模板有限公司 | Method for automatically welding small-batch customized special-shaped bridge steel templates by mechanical arm based on image visual recognition of welding seams |
| CN110524580A (en) * | 2019-09-16 | 2019-12-03 | 西安中科光电精密工程有限公司 | A kind of welding robot visual component and its measurement method |
| CN110524581A (en) * | 2019-09-16 | 2019-12-03 | 西安中科光电精密工程有限公司 | A kind of flexible welding robot system and its welding method |
| CN110773840A (en) * | 2019-11-12 | 2020-02-11 | 湖北文理学院 | Welding deviation measuring method and device and automatic welding system |
| CN111037039A (en) * | 2019-12-31 | 2020-04-21 | 上海森松制药设备工程有限公司 | Flat joint welding method, device, system and computer readable storage medium |
| CN111596613A (en) * | 2020-05-18 | 2020-08-28 | 北京创想智控科技有限公司 | Welding deviation determination method, welding deviation determination device, electronic equipment and storage medium |
| CN112756834A (en) * | 2021-01-25 | 2021-05-07 | 陕西帕源路桥建设有限公司 | Welding position control system of welding gun |
| CN112775975A (en) * | 2021-02-01 | 2021-05-11 | 重庆皮克索自动化科技有限公司 | Vision-guided multi-station robot welding deviation correcting device and method |
| CN112958959A (en) * | 2021-02-08 | 2021-06-15 | 西安知象光电科技有限公司 | Automatic welding and detection method based on three-dimensional vision |
| CN113920060A (en) * | 2021-09-09 | 2022-01-11 | 中国科学院自动化研究所 | Autonomous operation method and device for welding robot, electronic device, and storage medium |
| CN114092647A (en) * | 2021-11-19 | 2022-02-25 | 复旦大学 | Three-dimensional reconstruction system and method based on panoramic binocular stereo vision |
| CN114160921A (en) * | 2021-11-22 | 2022-03-11 | 湖北文理学院 | Welding control method and control device for welding robot and welding robot |
| CN114083129A (en) * | 2021-12-17 | 2022-02-25 | 吴小燕 | Three-dimensional visual tracking welding robot and control method thereof |
| CN114273826A (en) * | 2021-12-31 | 2022-04-05 | 南京欧睿三维科技有限公司 | Automatic identification method for welding position of large-sized workpiece to be welded |
Non-Patent Citations (3)
| Title |
|---|
| JINLE ZENG 等: "A Weld Position Recognition Method Based on Directional and Structured Light Information Fusion in Multi-Layer/Multi-Pass Welding", 《SENSORS》 * |
| 杨飚 等: "基于正态分布变换与迭代最近点的快速点云配准算法", 《科学技术与工程》 * |
| 赵素娟: "激光视觉传感焊缝识别与自动跟踪系统", 《中国优秀硕士学位论文全文数据库 工程科技Ⅰ辑》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114841959B (en) | 2023-04-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6445814B2 (en) | Three-dimensional information processing apparatus and method | |
| CN102452081B (en) | Method and device for correcting system parameters of mechanical arm | |
| EP2033747A2 (en) | Robot simulation apparatus | |
| JPH11149558A (en) | Image processor | |
| CN115810133B (en) | Welding control method based on image processing and point cloud processing and related equipment | |
| JP2018136896A (en) | Information processor, system, information processing method, and manufacturing method of article | |
| US6519358B1 (en) | Parallax calculating apparatus, distance calculating apparatus, methods of the same, and information providing media | |
| CN114972421A (en) | Workshop material identification tracking and positioning method and system | |
| CN114581368B (en) | Bar welding method and device based on binocular vision | |
| CN114841959B (en) | Automatic welding method and system based on computer vision | |
| US20210243422A1 (en) | Data processing apparatus, data processing method, and program | |
| CN111598956A (en) | Calibration method, device and system | |
| CN114754695B (en) | Multi-view-field bridge deflection measuring device and method and storage medium | |
| CN114283081B (en) | Depth recovery method based on pyramid acceleration, electronic device and storage medium | |
| CN115194323A (en) | Positioning welding method of laser welding machine | |
| CN115311371A (en) | Calibration method for automatic measurement and marking system of double robots | |
| CN114638795A (en) | Multi-structure light measurement unit online measurement method and system | |
| KR20040034243A (en) | Method for detecting lane and system therefor | |
| CN114862816A (en) | Glitch detection method, system, and computer-readable storage medium | |
| CN114749848A (en) | Steel bar welding automatic system based on 3D vision guide | |
| CN113932712A (en) | Melon and fruit vegetable size measuring method based on depth camera and key points | |
| CN113989199A (en) | Binocular narrow butt weld detection method based on deep learning | |
| JP3906615B2 (en) | Recursive corresponding point search method, three-dimensional position measurement method using the same, these devices, and recording medium | |
| CN113642565B (en) | Object detection method, device, equipment and computer readable storage medium | |
| EP4280158A1 (en) | Method for detecting an object based on monocular camera, electronic device, and non-transitory storage medium storing the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |