CN110465944B - Method for calculating coordinates of industrial robot based on plane vision - Google Patents

Method for calculating coordinates of industrial robot based on plane vision Download PDF

Info

Publication number
CN110465944B
CN110465944B CN201910732148.7A CN201910732148A CN110465944B CN 110465944 B CN110465944 B CN 110465944B CN 201910732148 A CN201910732148 A CN 201910732148A CN 110465944 B CN110465944 B CN 110465944B
Authority
CN
China
Prior art keywords
coordinate system
industrial robot
visual
coordinates
robot coordinate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910732148.7A
Other languages
Chinese (zh)
Other versions
CN110465944A (en
Inventor
倪彬彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qixing Intelligent Technology Co Ltd
Original Assignee
Qixing Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qixing Intelligent Technology Co Ltd filed Critical Qixing Intelligent Technology Co Ltd
Priority to CN201910732148.7A priority Critical patent/CN110465944B/en
Publication of CN110465944A publication Critical patent/CN110465944A/en
Application granted granted Critical
Publication of CN110465944B publication Critical patent/CN110465944B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Numerical Control (AREA)
  • Manipulator (AREA)

Abstract

The application relates to the technical field of industrial robot manufacturing, and particularly provides a method for calculating coordinates of an industrial robot based on plane vision. When the industrial robot is pulled to a working point position, image acquisition is carried out through visual software, and a visual coordinate system is established according to acquired image information and defined as O-XYZ; and establishing an industrial robot coordinate system according to the determination of the visual coordinate system, and defining the industrial robot coordinate system to be O-X ' Y ' Z '. The established coordinate system of the industrial robot only translates relative to the visual coordinate system and does not rotate, only coordinate compensation parameters X0, Y0 and Z0 are needed to be calculated, complex matrix calculation is not needed to determine the coordinates of the industrial robot, and the conversion of the visual coordinates to the coordinates of the industrial robot can be realized through simple basic calculation, so that the calculation method of the coordinates of the industrial robot based on the plane vision is simplified, and the operation of non-programming personnel is easy.

Description

Method for calculating coordinates of industrial robot based on plane vision
Technical Field
The application relates to the technical field of industrial robot manufacturing, and particularly provides a method for calculating coordinates of an industrial robot based on plane vision.
Background
In the process of actually determining coordinate positioning based on vision, a complex conversion relation between a robot coordinate system and a vision coordinate system needs to be calculated, programming is complicated, complex matrix operation needs to be performed, and common technicians without knowledge are difficult to understand, and a lot of obstacles exist in actual operation. The national patent publication No. CN108444454A discloses a robot positioning method based on infrared lamp three-dimensional arrays, which is a robot positioning method based on infrared lamp three-dimensional arrays, a plurality of infrared lamp three-dimensional arrays with different arrangement modes are arranged in an environment, in the process of robot traveling, an infrared imaging device arranged on a robot shoots images of the infrared lamp three-dimensional arrays passing through a robot traveling route, the area where the infrared lamp three-dimensional arrays are located is determined based on the infrared lamp three-dimensional array images, the absolute position and the absolute direction angle of the robot are acquired, a relative direction angle is determined by an encoder and an inertial sensor arranged on the robot, the absolute position and the absolute direction angle of the robot are verified, the invention needs to carry out complex matrix operation to realize the robot positioning method based on the infrared lamp three-dimensional arrays, there is a drawback that it is difficult for a non-programmed ordinary technician to operate.
Disclosure of Invention
Aiming at the defects in the coordinate positioning process under the vision in the prior art, the technical problem to be solved by the application is that a non-programming common technician can easily convert the visual coordinate into the robot coordinate of actual operation, the application is based on the calculation method of the industrial robot coordinate under the plane vision, when the industrial robot is pulled to a working point, image acquisition is carried out through visual software, and a visual coordinate system is established according to the acquired image information and defined as the visual coordinate system O-XYZ; and establishing an industrial robot coordinate system according to the determination of the visual coordinate system, and defining the industrial robot coordinate system to be O-X ' Y ' Z '.
The application discloses a method for calculating coordinates of an industrial robot based on plane vision, which is characterized by comprising the following steps of:
step one, establishing a visual coordinate system: the industrial robot is pulled to a working point, image acquisition is carried out to obtain an image, a visual coordinate system is established according to the obtained image information, and the visual coordinate system is defined as O-XYZ;
step two, establishing an industrial robot coordinate system: establishing an industrial robot coordinate system according to the visual coordinate system obtained in the step one, defining the industrial robot coordinate system to be O-X ' Y ' Z ', only translating and not rotating the established industrial robot coordinate system relative to the visual coordinate system, and defining a point P as a point on the industrial robot coordinate system.
Step three, after the visual coordinate system and the industrial robot coordinate system are established, determining a conversion establishment relation between the visual coordinate system and the industrial robot coordinate system: the method is realized by rotating the visual coordinate system and the industrial robot coordinate system by different angles around different coordinate axes from the visual coordinate system to the industrial robot coordinate system.
Specifically, if P (X ', Y ', Z ') is a point in the robot coordinate system, the corresponding rotation matrix is obtained as follows:
rotation of theta about Z axis
Figure BDA0002160939810000021
Similarly, we can get β and ω rotations around the x and y axes, we can get:
Figure BDA0002160939810000022
Figure BDA0002160939810000023
obtaining a rotation matrix R1R2R3 for converting the visual coordinate system into the robot coordinate system
Because the robot coordinate system only translates relative to the visual coordinate system and does not rotate, the angles theta, omega and beta are 0 degrees,
Figure BDA0002160939810000024
can obtain the product
Figure BDA0002160939810000025
Then the transformation relationship can be obtained as
Figure BDA0002160939810000026
X0, Y0 and Z0 are coordinate compensation parameters,
Figure BDA0002160939810000027
according to the method, the conversion relation between the robot coordinate and the visual coordinate can be obtained only by calculating the coordinate compensation parameter, so that the robot coordinate is determined.
According to the method for calculating the coordinates of the industrial robot based on the planar vision, only the coordinate compensation parameters X0, Y0 and Z0 need to be calculated, complex matrix calculation is not needed to determine the coordinates of the industrial robot, and the coordinates of the industrial robot can be converted into the coordinates of the industrial robot through simple basic calculation, so that the method for calculating the coordinates of the industrial robot based on the planar vision is simplified, and is easy for non-programming personnel to operate.
Drawings
FIG. 1 is a schematic diagram of an industrial robot coordinate system establishing method based on planar vision rotating by an angle theta around a Z axis according to the application;
FIG. 2 is a schematic diagram of the method for establishing the coordinate system of the industrial robot based on planar vision, which rotates by an angle beta around the X axis;
fig. 3 is a schematic diagram of the industrial robot coordinate system establishing method based on planar vision rotating by an angle ω around the y-axis.
Detailed Description
Preferred embodiments of the present application will be described in detail below with reference to the accompanying drawings so that the advantages and features of the application can be more readily understood by those skilled in the art, and thus the scope of the application will be more clearly and clearly defined.
In fig. 1, fig. 2 and fig. 3, in the method for calculating coordinates of an industrial robot based on planar vision, after the industrial robot is drawn to a working point, the planar vision performs image acquisition, and establishes a visual coordinate system according to the acquired image information, which is defined as a visual coordinate system O-XYZ; and establishing an industrial robot coordinate system according to the determination of the visual coordinate system, and defining the industrial robot coordinate system to be O-X ' Y ' Z '. According to the method for calculating the coordinates of the industrial robot based on the planar vision, only translation and no rotation are needed to be established for the coordinate system of the industrial robot relative to the coordinate system of the visual robot, the conversion relation is determined without complex matrix calculation, and the conversion from the coordinate system of the visual robot to the coordinate system of the industrial robot can be realized through simple basic calculation, so that the method for calculating the coordinates of the industrial robot based on the planar vision is simplified, and is easy for non-programming personnel to operate.
The application discloses a method for calculating coordinates of an industrial robot based on plane vision, which is characterized by comprising the following steps of:
step one, establishing a visual coordinate system: the industrial robot is pulled to a working point, image acquisition is carried out to obtain an image, a visual coordinate system is established according to the obtained image information, and the visual coordinate system is defined as O-XYZ;
step two, establishing an industrial robot coordinate system: establishing an industrial robot coordinate system according to the visual coordinate system obtained in the step one, defining the industrial robot coordinate system to be O-X ' Y ' Z ', only translating and not rotating the established industrial robot coordinate system relative to the visual coordinate system, and defining a point P as a point on the industrial robot coordinate system.
Step three, after the visual coordinate system and the industrial robot coordinate system are established, determining a conversion relation between the visual coordinate system and the industrial robot coordinate system: the rotation between the visual coordinate system and the industrial robot coordinate system is realized by rotating different angles around different coordinate axes from the visual coordinate system to the industrial robot coordinate system.
Specifically, P (X ', Y ', Z ') is a point on the robot coordinate system, and then the corresponding rotation matrix is obtained as follows:
rotation θ about the Z axis:
Figure BDA0002160939810000031
similarly, we can get β and ω rotations around the x and y axes, we can get:
Figure BDA0002160939810000041
Figure BDA0002160939810000042
obtaining a rotation matrix R1R2R3 for converting the visual coordinate system into the robot coordinate system
Because the robot coordinate and the visual coordinate only do translation and do not rotate, the angles theta, omega and beta are 0 degrees,
Figure BDA0002160939810000043
can obtain the product
Figure BDA0002160939810000044
Then the transformation relationship can be obtained as
Figure BDA0002160939810000045
X0, Y0 and Z0 are coordinate compensation parameters,
Figure BDA0002160939810000046
according to the method, the conversion relation between the robot coordinate and the visual coordinate can be obtained only by calculating the coordinate compensation parameter, so that the robot coordinate is determined.
According to the method for calculating the coordinates of the industrial robot based on the planar vision, only the coordinate compensation parameters X0, Y0 and Z0 need to be calculated, complex matrix calculation is not needed to determine the coordinates of the industrial robot, and the coordinates of the industrial robot can be converted into the coordinates of the industrial robot through simple basic calculation, so that the method for calculating the coordinates of the industrial robot based on the planar vision is simplified, and is easy for non-programming personnel to operate.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.

Claims (1)

1. The method for calculating the coordinates of the industrial robot based on the plane vision is characterized by comprising the following steps of:
step one, establishing a visual coordinate system: the industrial robot is pulled to a working point, image acquisition is carried out to obtain an image, a visual coordinate system is established according to the obtained image information, and the visual coordinate system is defined as O-XYZ;
step two, establishing an industrial robot coordinate system: establishing an industrial robot coordinate system according to the visual coordinate system obtained in the step one, defining the industrial robot coordinate system as O-X 'Y' Z ', and defining the point P as the industrial robot coordinate system (X', Y ', Z');
step three, after the visual coordinate system and the industrial robot coordinate system are established, determining a conversion establishment relation between the visual coordinate system and the industrial robot coordinate system: rotating the visual coordinate system and the industrial robot coordinate system by different angles around different coordinate axes from the visual coordinate system to the industrial robot coordinate system;
and if P (X ', Y ', Z ') is a point in the robot coordinate system, obtaining a corresponding rotation matrix as follows:
rotation of theta about Z axis
Figure FDA0002732376510000011
Similarly, we can get β and ω rotations around the x and y axes, we can get:
Figure FDA0002732376510000012
Figure FDA0002732376510000013
obtaining a rotation matrix R1R2R3 for converting the visual coordinate system into the robot coordinate system
Because the robot coordinate system only translates relative to the visual coordinate system and does not rotate, the angles theta, omega and beta are 0 degrees,
Figure FDA0002732376510000014
can obtain the product
Figure FDA0002732376510000015
Then the transformation relationship can be obtained as
Figure FDA0002732376510000016
X0, Y0 and Z0 are coordinate compensation parameters,
Figure FDA0002732376510000021
according to the method, the conversion relation between the robot coordinate and the visual coordinate can be obtained only by calculating the coordinate compensation parameter, so that the robot coordinate is determined.
CN201910732148.7A 2019-08-09 2019-08-09 Method for calculating coordinates of industrial robot based on plane vision Active CN110465944B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910732148.7A CN110465944B (en) 2019-08-09 2019-08-09 Method for calculating coordinates of industrial robot based on plane vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910732148.7A CN110465944B (en) 2019-08-09 2019-08-09 Method for calculating coordinates of industrial robot based on plane vision

Publications (2)

Publication Number Publication Date
CN110465944A CN110465944A (en) 2019-11-19
CN110465944B true CN110465944B (en) 2021-03-16

Family

ID=68511667

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910732148.7A Active CN110465944B (en) 2019-08-09 2019-08-09 Method for calculating coordinates of industrial robot based on plane vision

Country Status (1)

Country Link
CN (1) CN110465944B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS60151712A (en) * 1984-01-19 1985-08-09 Hitachi Ltd Calibration system for robot visual coordinate system
CN104260112A (en) * 2014-09-18 2015-01-07 西安航天精密机电研究所 Robot hand and eye locating method
CN106054874A (en) * 2016-05-19 2016-10-26 歌尔股份有限公司 Visual positioning calibrating method and device, and robot
CN108000499A (en) * 2016-10-27 2018-05-08 广明光电股份有限公司 The programmed method of robot vision coordinate
CN108890636A (en) * 2018-07-06 2018-11-27 陕西大中科技发展有限公司 A kind of crawl localization method of industrial robot
CN109615662A (en) * 2018-12-04 2019-04-12 中冶赛迪工程技术股份有限公司 A kind of coordinate system scaling method, system, computer readable storage medium and equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS60151712A (en) * 1984-01-19 1985-08-09 Hitachi Ltd Calibration system for robot visual coordinate system
CN104260112A (en) * 2014-09-18 2015-01-07 西安航天精密机电研究所 Robot hand and eye locating method
CN106054874A (en) * 2016-05-19 2016-10-26 歌尔股份有限公司 Visual positioning calibrating method and device, and robot
CN108000499A (en) * 2016-10-27 2018-05-08 广明光电股份有限公司 The programmed method of robot vision coordinate
CN108890636A (en) * 2018-07-06 2018-11-27 陕西大中科技发展有限公司 A kind of crawl localization method of industrial robot
CN109615662A (en) * 2018-12-04 2019-04-12 中冶赛迪工程技术股份有限公司 A kind of coordinate system scaling method, system, computer readable storage medium and equipment

Also Published As

Publication number Publication date
CN110465944A (en) 2019-11-19

Similar Documents

Publication Publication Date Title
CN110370286B (en) Method for identifying rigid body space position of dead axle motion based on industrial robot and monocular camera
CN1250942C (en) Construction optical visual sense transducer calibration method based on plane targets
JP4191080B2 (en) Measuring device
CN107192331A (en) A kind of workpiece grabbing method based on binocular vision
KR20100084663A (en) Operation teaching system and operation teachine method
CN111801198A (en) Hand-eye calibration method, system and computer storage medium
CN109345587B (en) Hybrid vision positioning method based on panoramic vision and monocular vision
CN109807937A (en) A kind of Robotic Hand-Eye Calibration method based on natural scene
CN110702028B (en) Three-dimensional detection positioning method and device for orchard trunk
JPH03105602A (en) Remote monitoring system and remote monitoring
JP7250489B2 (en) Image processing device, its control method, and program
CN105374067A (en) Three-dimensional reconstruction method based on PAL cameras and reconstruction system thereof
Adallah et al. 3D point cloud analysis for automatic inspection of aeronautical mechanical assemblies
CN116026252A (en) Point cloud measurement method and system
CN110465944B (en) Method for calculating coordinates of industrial robot based on plane vision
JP2010078466A (en) Method and system for automatic marker registration
CN110962127A (en) Auxiliary calibration device for tail end pose of mechanical arm and calibration method thereof
CN117021059A (en) Picking robot, fruit positioning method and device thereof, electronic equipment and medium
CN110490934A (en) Mixing machine vertical blade attitude detecting method based on monocular camera and robot
CN113240751B (en) Calibration method for robot tail end camera
CN111699445A (en) Robot kinematics model optimization method and system and storage device
CN114859327A (en) Calibration method, device and equipment
JPH0675617A (en) Camera view point change system
CN111890352A (en) Mobile robot touch teleoperation control method based on panoramic navigation
Zhang et al. Research on object panoramic 3D point cloud reconstruction system based on structure from motion

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant