WO2023013698A1 - ロボット制御装置、ロボット制御システム、及びロボット制御方法 - Google Patents

ロボット制御装置、ロボット制御システム、及びロボット制御方法 Download PDF

Info

Publication number
WO2023013698A1
WO2023013698A1 PCT/JP2022/029851 JP2022029851W WO2023013698A1 WO 2023013698 A1 WO2023013698 A1 WO 2023013698A1 JP 2022029851 W JP2022029851 W JP 2022029851W WO 2023013698 A1 WO2023013698 A1 WO 2023013698A1
Authority
WO
WIPO (PCT)
Prior art keywords
robot
control unit
calibration
coordinate system
spatial information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/029851
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
フィデリア グラシア
敬之 石田
雅人 森
真洋 内竹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kyocera Corp
Original Assignee
Kyocera Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kyocera Corp filed Critical Kyocera Corp
Priority to US18/681,013 priority Critical patent/US20240246237A1/en
Priority to EP22853116.6A priority patent/EP4382258A4/en
Priority to JP2023540394A priority patent/JP7657936B2/ja
Priority to CN202280053883.5A priority patent/CN117813182A/zh
Publication of WO2023013698A1 publication Critical patent/WO2023013698A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/10—Program-controlled manipulators characterised by positioning means for manipulator elements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1679—Program controls characterised by the tasks executed
    • B25J9/1682—Dual arm manipulator; Coordination of several manipulators
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1679—Program controls characterised by the tasks executed
    • B25J9/1692—Calibration of manipulator
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39016—Simultaneous calibration of manipulator and camera
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • G05B2219/39024—Calibration of manipulator

Definitions

  • the present disclosure relates to a robot control device, a robot control system, and a robot control method.
  • a robot control device includes a control unit that controls a robot.
  • the control unit acquires the measurement position of the destination of the robot, acquires the measurement result of the position of the robot calculated based on the spatial information regarding the motion space of the robot acquired by the spatial information acquisition unit, It is determined whether or not to perform calibration of the robot based on the measurement position and the measurement result.
  • FIG. 1 is a block diagram showing a configuration example of a robot control system according to an embodiment
  • FIG. 1 is a schematic diagram showing a configuration example of a robot control system according to an embodiment
  • FIG. 4 is a schematic diagram showing an example of a difference between a sensor-based tip position and orientation and an image-based tip position and orientation
  • 4 is a flow chart showing an example procedure of a robot control method according to an embodiment
  • a robot control system 1 includes a robot 40 , a robot control device 10 and a spatial information acquisition section 20 .
  • the robot 40 operates in a predetermined motion space.
  • the space information acquisition unit 20 generates depth information of the motion space in which the robot 40 moves.
  • the spatial information acquisition unit 20 calculates the distance to the measurement point located on the surface of the object 50 existing in the motion space.
  • the distance from the spatial information acquisition unit 20 to the measurement point is also called depth.
  • Depth information is information about the depth measured for each measurement point. In other words, the depth information is information about the distance to the measurement point located on the surface of the object 50 existing in the motion space.
  • the depth information may be expressed as a depth map that associates the direction viewed from the spatial information acquisition unit 20 and the depth in that direction.
  • the spatial information acquisition unit 20 generates depth information of the motion space based on the (X, Y, Z) coordinate system.
  • the robot control device 10 operates the robot 40 based on the depth information generated by the space information acquisition section 20 .
  • the robot controller 10 controls and operates the robot 40 based on the (X_RB, Y_RB, Z_RB) coordinate system.
  • the (X_RB, Y_RB, Z_RB) coordinate system is also called the coordinate system of the robot 40 .
  • the (X, Y, Z) coordinate system is also called the coordinate system of the spatial information acquisition unit 20 .
  • the coordinate system of the robot 40 may be set as the same coordinate system as the coordinate system of the spatial information acquisition unit 20, or may be set as a different coordinate system.
  • the robot control device 10 converts the depth information generated in the coordinate system of the space information acquisition unit 20 into the coordinates of the robot 40. It is converted into a system and used.
  • the number of robots 40 and robot control devices 10 is not limited to one as illustrated, but may be two or more. As illustrated, the number of spatial information acquisition units 20 may be one for one motion space, or may be two or more. Each component will be specifically described below.
  • the robot control device 10 includes a control section 11 and a storage section 12 .
  • the storage unit 12 may be configured including an electromagnetic storage medium such as a magnetic disk, or may be configured including a memory such as a semiconductor memory or a magnetic memory.
  • the storage unit 12 may be configured as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).
  • the storage unit 12 stores various information, programs executed by the control unit 11, and the like.
  • the storage unit 12 may function as a work memory for the control unit 11 .
  • the control unit 11 may include at least part of the storage unit 12 .
  • the robot control device 10 may further include a communication device configured to be able to communicate with the spatial information acquisition unit 20 and the robot 40 by wire or wirelessly.
  • a communication device may be configured to be able to communicate with communication schemes based on various communication standards.
  • a communication device may be configured according to known communication technologies. A detailed description of the hardware of the communication device and the like is omitted.
  • the functions of the communication device may be realized by one interface, or may be realized by separate interfaces for each connection destination.
  • the control unit 11 may be configured to communicate with the spatial information acquisition unit 20 and the robot 40 .
  • the control unit 11 may be configured including a communication device.
  • the arm 42 may be configured as, for example, a 6-axis or 7-axis vertical articulated robot.
  • the arm 42 may be configured as a 3-axis or 4-axis horizontal articulated robot or SCARA robot.
  • Arm 42 may be configured as a 2-axis or 3-axis Cartesian robot.
  • Arm 42 may be configured as a parallel link robot or the like.
  • the number of axes forming the arm 42 is not limited to the illustrated one.
  • the end effector 44 may include, for example, a gripping hand configured to grip a work object.
  • the grasping hand may have multiple fingers. The number of fingers of the grasping hand may be two or more. The fingers of the grasping hand may have one or more joints.
  • the end effector 44 may include a suction hand configured to be able to suction a work target.
  • the end effector 44 may include a scooping hand configured to scoop the work object.
  • the end effector 44 may include a tool such as a drill, and may be configured to perform various machining operations such as drilling holes in a work object.
  • the end effector 44 is not limited to these examples, and may be configured to perform various other operations.
  • the robot 40 may further include sensors that detect the state of each component of the robot 40 .
  • the sensors may detect information regarding the actual position or orientation of each component of the robot 40 or the velocity or acceleration of each component of the robot 40 .
  • the sensors may detect forces acting on each component of the robot 40 .
  • the sensors may detect the current flowing through the motors that drive each component of the robot 40 or the torque of the motors.
  • the sensors can detect information resulting from the actual movement of robot 40 .
  • the robot control device 10 can grasp the actual operation result of the robot 40 by acquiring the detection result of the sensor. That is, the robot control device 10 can acquire the state of the robot 40 based on the detection result of the sensor.
  • the spatial information acquisition unit 20 acquires spatial information regarding the motion space of the robot 40 .
  • the spatial information acquisition unit 20 may photograph the motion space and acquire an image of the motion space as the spatial information.
  • the spatial information acquisition unit 20 may photograph an object 50 existing in the motion space, as illustrated in FIG. 2 .
  • the spatial information acquisition section 20 may be configured as a camera.
  • the spatial information acquisition section 20 may be configured as a 3D stereo camera.
  • the 3D stereo camera photographs an object 50 existing in the motion space, calculates the distance to a measurement point located on the surface of the object 50 existing in the motion space as depth, and generates depth information.
  • the spatial information acquisition unit 20 may be configured as a LiDAR (light detection and ranging).
  • the space information acquisition unit 20 may generate point group information in the motion space of the robot 40 and output it to the robot control device 10 . That is, the spatial information may be output in the form of point cloud data. In other words, the point cloud information may have spatial information.
  • the point group information is information on a set of measurement points located on the surface of the object 50 existing in the motion space, and is information including coordinate information or color information on each measurement point.
  • the point group information can also be said to be data representing the object 50 in the measurement space with a plurality of points. Since the spatial information is in the form of point cloud data, the data density can be made smaller than the spatial information based on the initial data acquired by the spatial information acquiring section 20 .
  • the control unit 11 of the robot control device 10 can acquire the state of the robot 40 based on the position and orientation of the mark 46 captured in the image captured by the space information acquisition unit 20, and can acquire the positional relationship between the robot 40 and the object 50. .
  • the control unit 11 acquires the state of the robot 40 based on a sensor of the robot 40 such as an encoder installed on the arm 42 or the like.
  • the state based on the sensor of the robot 40 expresses the position and orientation of the robot 40 with higher accuracy than the state based on the captured image of the spatial information acquisition unit 20 .
  • the control unit 11 can control the robot 40 in the motion space with high accuracy by matching the state of the robot 40 based on the captured image of the space information acquisition unit 20 with the state of the robot 40 based on the sensor of the robot 40.
  • the work of matching the state of the robot 40 based on the captured image of the spatial information acquisition unit 20 with the state of the robot 40 based on the sensor of the robot 40 is also called calibration.
  • the control unit 11 performs calibration so that the (X, Y, Z) coordinate system of the spatial information acquisition unit 20 matches the (X_RB, Y_RB, Z_RB) coordinate system of the robot 40 .
  • the control unit 11 may perform calibration using at least part of the FOV of the spatial information acquisition unit 20 as the calibration range 60 .
  • the control unit 11 performs calibration within the calibration range 60 shown in FIG.
  • a calibration range 60 is shown as a region surrounded by a two-dot chain line in FIG.
  • a calibration range 60 corresponds to a range in which the robot 40 is calibrated.
  • Calibration range 60 may include the work area of robot 40 .
  • the calibration range 60 may be the range where the working area of the robot 40 and the FOV overlap.
  • control unit 11 sets a point for performing calibration within the calibration range 60 .
  • the points for performing calibration are also referred to as calibration positions.
  • the control unit 11 moves the mark 46 of the robot 40 to the calibration position and causes the spatial information acquisition unit 20 to photograph the mark 46 .
  • the control unit 11 calculates the position and orientation of the mark 46 based on the image of the mark 46 .
  • the control unit 11 adjusts the position and orientation of the mark 46 based on the image so that the position and orientation of the mark 46 calculated based on the image match the position and orientation of the mark 46 determined based on the detection result of the sensor of the robot 40 .
  • Correct position and posture. Correction of the position and orientation of the mark 46 based on the image corresponds to calibration.
  • the position and orientation of mark 46 is also referred to as the tip position and orientation.
  • Calibration corresponds to correction of tip position and orientation.
  • a calibration position corresponds to a position for correcting the tip position and orientation.
  • control unit 11 may perform calibration as described below.
  • the control unit 11 generates control information for the robot 40 for moving the mark 46 of the robot 40 to the calibration position.
  • the control unit 11 operates the robot 40 based on the control information to move the mark 46 of the robot 40 to the calibration position.
  • the control unit 11 acquires an image of the mark 46 from the spatial information acquisition unit 20 .
  • the control unit 11 calculates the position and orientation of the mark 46 based on the image.
  • the position and orientation of the mark 46 calculated based on the image are also referred to as the tip position and orientation based on the image.
  • the control unit 11 calculates the position and orientation of the mark 46 determined based on the detection result of the sensor of the robot 40 .
  • the position and orientation of the mark 46 calculated based on the sensor detection results are also referred to as the tip position and orientation based on the sensor.
  • the control unit 11 compares the tip position/orientation based on the image and the tip position/orientation based on the sensor.
  • the control unit 11 corrects the tip position/orientation based on the image so that the tip position/orientation based on the image matches the tip position/orientation based on the sensor.
  • the control unit 11 may correct the algorithm for calculating the tip position/orientation based on the image.
  • the control unit 11 may correct the parameters included in the algorithm, or may correct the formula, table, or program. When a plurality of calibration positions are set, the control unit 11 moves the robot 40 to each calibration position, acquires an image of the mark 46 at each calibration position, and determines the tip position/orientation based on the image. to correct.
  • the control unit 11 generates control information for the robot 40 so as to move the robot 40 to the calibration position.
  • the control unit 11 generates, as a calibration item, information specifying the tip position/orientation when the robot 40 is moved to the calibration position and the recognition result of the mark 46 of the robot 40 .
  • the calibration item is, for example, information about coordinates.
  • the calibration item is, for example, coordinate information indicating the tip position and orientation based on the detection result of the sensor of the robot 40 when the robot 40 is moved to the calibration position, or is recognized by the spatial information acquisition unit 20. coordinate information indicating the position and orientation of the tip based on the recognition result of the mark 46.
  • the control unit 11 acquires, for example, information on the real field size of the spatial information acquisition unit 20 or information on the FOV from the spatial information acquisition unit 20 .
  • the control unit 11 sets the calibration range 60 based on the actual field of view size or FOV of the spatial information acquisition unit 20 and the work area of the robot 40 .
  • the controller 11 may set the calibration range 60 based on the position of the object 50 in the motion space of the robot 40 .
  • the control unit 11 may set the calibration range 60 based on the depth information or point group information of the object 50 detected by the spatial information acquisition unit 20 .
  • the shape of the calibration range 60 is set to a truncated quadrangular pyramid shape.
  • the shape of the calibration range 60 is not limited to these and may be set to various other shapes.
  • the control unit 11 matches the tip position/orientation based on the sensor of the robot 40 with the tip position/orientation based on the image of the spatial information acquisition unit 20 . Specifically, the controller 11 moves the robot 40 to the first position.
  • the control unit 11 generates control information for operating the robot 40 so that the mark 46 of the robot 40 assumes a predetermined position and posture, and controls the robot 40 based on the control information to move the robot 40 to the first position. move.
  • the first position may be a predetermined position included in the FOV of the spatial information acquisition section 20 .
  • the first position may be the center position of the FOV of the spatial information acquisition unit 20, for example.
  • the control unit 11 acquires an image of the mark 46 when the robot 40 moves to the first position, and calculates the position and orientation of the mark 46 as the tip position and orientation based on the image. Also, the control unit 11 calculates the tip position and orientation based on the sensor. Based on the comparison between the tip position/orientation based on the image and the tip position/orientation based on the sensor, the control unit 11 adjusts the position of the robot 40 so that the position of the robot 40 becomes the first position based on the detection result of the sensor in the image. Correct the control information. The control unit 11 moves the robot 40 based on the corrected control information so that the position of the robot 40 in the coordinate system of the robot 40 and the position of the robot 40 in the coordinate system of the space information acquisition unit 20 match. Update 40 states. In other words, it can be said that the control unit 11 updates the state of the robot 40 so that the position of the robot 40 becomes the first position in the image.
  • the control unit 11 determines that the robot 40 moves to the second position. Register the position as a calibration position. When registering the second position as the calibration position, the control unit 11 stores the tip position and orientation based on the sensor detection results of the robot 40 when the robot 40 is moved to the second position and the recognition results of the mark 46 of the robot 40 . may be generated as a plurality of calibration items that specify each of the tip position and orientation based on . If the second position is not registered as the calibration position, the control unit 11 may generate a new second position of a different position and determine whether the new second position can be registered as the calibration position.
  • a singular point corresponds to a posture of the robot 40 where the robot 40 is structurally uncontrollable. If the trajectory for operating the robot 40 includes a singular point, the robot 40 moves (runs away) at high speed near the singular point and stops at the singular point.
  • the singular points of the robot 40 are the following three types (1) to (3). (1) Points outside the work area when controlling the robot 40 to near the outer limits of the work area. (The work area is the area corresponding to the motion space of the robot 40.) (2) Points when controlling the robot 40 directly above and below the robot base even within the work area. (3) A point where the joint angle one before the tip joint of the arm 42 of the robot 40 is zero or 180 degrees (wrist alignment singular point).
  • the control unit 11 may determine that the state of the robot 40 is the state of singularity when the numerical value representing the state of the robot 40 matches the numerical value representing the state of singularity.
  • the control unit 11 may determine that the state of the robot 40 is the state of singularity when the difference between the numerical value representing the state of the robot 40 and the numerical value representing the state of singularity is less than a predetermined value.
  • the numerical value representing the state of the robot 40 may include, for example, the angle of the joint of the arm 42 or the torque of the motor that drives the robot 40 .
  • the control unit 11 performs calibration so that the tip position/orientation calibration item regarding the recognition result of the mark 46 matches the tip position/orientation calibration item regarding the detection result of the sensor of the robot 40 . Specifically, the controller 11 moves the robot 40 to the calibration position. The control unit 11 acquires the recognition result of the mark 46 of the robot 40 when the robot 40 moves to the calibration position by the space information acquisition unit 20 . The control unit 11 calculates the relative positional relationship of the tip position/orientation calibration item acquired as the recognition result of the mark 46 with respect to the tip position/orientation calibration item based on the sensor of the robot 40 . The relative positional relationship corresponds to the coordinate difference and angle difference between both calibration items.
  • the control unit 11 controls the spatial information acquisition unit so that the coordinate error and angle error corresponding to the relative positional relationship between the two calibration items are zero or close to zero (that is, the error is less than a predetermined value).
  • the coordinate system of 20 is corrected to match the coordinate system of robot 40 .
  • the control unit 11 matches the recognition result of the mark 46 when the robot 40 moves to the calibration position with the tip position/orientation specified by the sensor of the robot 40, thereby adjusting the relative positional relationship. can be calculated.
  • the control unit 11 detects that the coordinate system relationship specified by the calibration has changed. determine whether or not If the relationship of the coordinate system has not changed, the control unit 11 does not need to perform correction or calibration of the relationship of the coordinate system. On the other hand, if the coordinate system relationship has changed when the robot 40 is activated, the control unit 11 determines whether the coordinate system relationship can be corrected. If the relationship between the coordinate systems can be corrected, the control unit 11 corrects the relationship between the coordinate systems and does not perform calibration. If the relationship between the coordinate systems cannot be corrected, the control unit 11 re-specifies the relationship between the coordinate systems by performing recalibration.
  • the need for calibration may be determined when the robot 40 is stopped or when the robot 40 is started.
  • the time when the robot 40 stops is not limited to when it stops abnormally, and may be when the designated work is completed.
  • the time to activate the robot 40 is not limited to when it is activated after an abnormal stop, and may be when to start a designated work.
  • control unit 11 determines whether the relationship between the coordinate system of the robot 40 and the coordinate system of the spatial information acquisition unit 20 has changed, as described below. and determine if recalibration is necessary.
  • the control unit 11 acquires the recognition result of the mark 46 when the robot 40 is moved to the measurement position.
  • the control unit 11 calculates the position of the robot 40 as a measurement result based on the recognition result of the mark 46 .
  • the control unit 11 calculates the difference between the initial value of the measurement position and the measurement result. Since the control unit 11 moves the robot 40 to the measurement position based on the detection result of the sensor, the difference between the set measurement position itself and the measurement result is calculated without calculating the position of the robot 40 based on the sensor. You can
  • the control unit 11 acquires the detection result of the sensor when the robot 40 is moved to the measurement position, calculates and acquires the position of the robot 40 based on the sensor based on the detection result as the measurement position, and uses the calculated measurement position as the measurement position. As the initial value of the measurement position, a difference from the measurement result may be calculated.
  • the control unit 11 determines whether to correct the relationship of the coordinate system based on the difference between the initial value of the measurement position and the measurement result. For example, when the difference between the initial value of the measurement position and the measurement result is greater than a predetermined threshold value, the control unit 11 determines to correct the relationship of the coordinate system. When measurement results are acquired at a plurality of measurement positions, the control unit 11 determines to correct the relationship of the coordinate system when the difference between the initial value of at least one measurement position and the measurement result is greater than a predetermined threshold. . When the difference between the initial value of the measurement position and the measurement result is equal to or less than a predetermined threshold value, the control unit 11 determines that correction of the relationship between the coordinate systems and recalibration are not necessary.
  • the control unit 11 may appropriately set a predetermined threshold value.
  • the control unit 11 may set a predetermined threshold value, for example, based on the specifications of the positional accuracy during operation of the robot 40 .
  • control unit 11 may correct the coordinate system of the spatial information acquiring unit 20 so that the coordinate system of the spatial information acquiring unit 20 matches the coordinate system of the robot 40 .
  • the control unit 11 may correct the coordinate system of the robot 40 so that the coordinate system of the robot 40 matches the coordinate system of the spatial information acquisition unit 20 .
  • control unit 11 may correct the coordinate system of the spatial information acquisition unit 20 or the coordinate system of the robot 40 by rotating or translating them.
  • the control unit 11 may correct the coordinate system of the spatial information acquisition unit 20 or the coordinate system of the robot 40 by enlarging or reducing it.
  • the control unit 11 may correct distortion of the coordinate system of the spatial information acquisition unit 20 or the coordinate system of the robot 40 .
  • the control unit 11 may calculate the correction value of the measurement position based on the correction of the coordinate system.
  • the control unit 11 acquires the tip position and orientation of the robot 40 at one measurement position, and corrects the coordinate system not only in the translational direction but also in the rotational direction based on information such as the rotation angle representing the orientation of the mark 46. good.
  • a measurement position model 70 having the coordinates of the measurement position as vertices is defined.
  • the control unit 11 moves the robot 40 to each vertex (measurement position) of the measurement position model 70 and acquires the recognition result of the mark 46 .
  • the recognition result of the mark 46 acquired based on the (X, Y, Z) coordinate system of the spatial information acquisition unit 20 is matched with the (X_RB, Y_RB, Z_RB) coordinate system of the robot 40, the calculated measurement result is , is represented by a measurement result model 72 whose vertices are the coordinates of the measurement result.
  • the measurement position model 70 corresponds to the set measurement position itself or the initial value of the measurement position when the robot 40 is moved to the measurement position based on the detection result of the sensor.
  • the measurement result model 72 corresponds to the measurement result when matching the recognition result of the mark 46 when the robot 40 is moved to the measurement position with the (X_RB, Y_RB, Z_RB) coordinate system of the robot 40 .
  • the control unit 11 determines whether the relationship between the coordinate systems has changed. In the present embodiment, it is assumed that the coordinate system of the robot 40 and the coordinate system of the spatial information acquisition section 20 match each other due to calibration performed in advance. In the state illustrated in FIG.
  • the coordinate system of the spatial information acquisition unit 20 changes in the rotational direction and the translational direction with respect to the coordinate system of the robot 40 .
  • the control unit 11 may correct the coordinate system of the spatial information acquisition unit 20 in translational and rotational directions so that the coordinate system of the spatial information acquisition unit 20 matches the coordinate system of the robot 40 .
  • control unit 11 determines that the correction does not return the relationship of the coordinate system to the relationship at the time of execution of the previous calibration, and restarts the robot 40 . Determine that calibration is required.
  • the correction of the coordinate system described above may be executed when an abnormality occurs. Specifically, the correction of the coordinate system may be performed when restarting the robot 40 after the robot 40 stops abnormally. Further, the correction of the coordinate system may be executed when the (X, Y, Z) coordinate system of the spatial information acquiring section 20 changes due to the movement of the spatial information acquiring section 20 . Correction of the coordinate system is not limited to when an abnormality occurs, and may be performed when the robot 40 is activated.
  • the control unit 11 of the robot control device 10 may execute the robot control method including the procedure of the flowchart illustrated in FIG.
  • the robot control method may be implemented as a robot control program that is executed by a processor that configures the control unit 11 .
  • the robot control program may be stored on a non-transitory computer-readable medium.
  • the control unit 11 acquires the measurement position (step S1).
  • the controller 11 moves the robot 40 to the measurement position (step S2).
  • the control unit 11 acquires the recognition result of the mark 46 at the measurement position to which the robot 40 has moved (step S3).
  • the control unit 11 determines whether the recognition of the mark 46 is completed at all measurement positions (step S4). If recognition of the marks 46 has not been completed at all measurement positions (step S4: NO), the controller 11 returns to step S2.
  • step S5 determines whether the difference between the initial value of the measurement position and the measurement result is equal to or less than a predetermined threshold (step S5). If the difference between the initial value of the measured position and the measurement result is equal to or less than the predetermined threshold value (step S5: YES), the control unit 11 ends execution of the procedure of the flowchart of FIG.
  • step S5 If the difference between the initial value of the measured position and the measurement result is not equal to or less than a predetermined threshold (step S5: NO), that is, if the difference between the initial value of the measured position and the measurement result is greater than the predetermined threshold,
  • the coordinate system is corrected and the corrected position is calculated (step S6).
  • the controller 11 moves the robot 40 to the correction position (step S7).
  • the control unit 11 acquires the recognition result of the mark 46 at the corrected position to which the robot 40 has moved, and acquires the post-correction measurement result (step S8).
  • the control unit 11 determines whether the difference between the corrected position and the post-correction measurement result is equal to or less than a predetermined threshold (step S9). If the difference between the corrected position and the corrected measurement result is equal to or less than a predetermined threshold value (step S9: YES), the control unit 11 calculates a correction value based on the difference between the initial value of the measurement position and the measurement result, A calibration value is updated (step S10). A calibration value represents a relative positional relationship. After executing the procedure of step S10, the control unit 11 ends the execution of the procedure of the flowchart of FIG.
  • step S9 If the difference between the corrected position and the corrected measurement result is not equal to or less than a predetermined threshold value (step S9: NO), that is, if the difference between the corrected value of the measured position and the measurement result is greater than the predetermined threshold value, the control unit 11 controls the robot. 40 recalibration is required (step S11). After executing the procedure of step S11, the control unit 11 ends the execution of the procedure of the flowchart of FIG. The control unit 11 may perform recalibration of the robot 40 after performing the procedure of step S11.
  • the robot control device 10 and the robot control method according to the present embodiment when the robot 40 is activated or recovered from an abnormality, the difference between the measured position and the measurement result reaches a predetermined threshold value. The coordinate system is corrected if greater. Then, when the difference between the measured position after correction of the coordinate system and the measurement result is larger than a predetermined threshold value, it can be determined that recalibration is necessary. Conversely, it can be determined that recalibration is unnecessary when the difference between the measured position after correction of the coordinate system and the measurement result is equal to or less than a predetermined threshold value. By doing so, the workload can be reduced when an abnormality occurs.
  • Embodiments according to the present disclosure are not limited to any specific configuration of the embodiments described above. Embodiments of the present disclosure extend to any novel feature or combination thereof described in the present disclosure or any novel method or process step or combination thereof described. be able to.
  • robot control system 10 robot control device (11: control unit, 12: storage unit) 20 spatial information acquisition unit 40 robot (42: arm, 44: end effector, 46: mark) 50 object 60 calibration range 70 measurement position model 72 measurement result model

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Manipulator (AREA)
PCT/JP2022/029851 2021-08-03 2022-08-03 ロボット制御装置、ロボット制御システム、及びロボット制御方法 Ceased WO2023013698A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US18/681,013 US20240246237A1 (en) 2021-08-03 2022-08-03 Robot control device, robot control system, and robot control method
EP22853116.6A EP4382258A4 (en) 2021-08-03 2022-08-03 ROBOT CONTROL DEVICE, ROBOT CONTROL SYSTEM AND ROBOT CONTROL METHOD
JP2023540394A JP7657936B2 (ja) 2021-08-03 2022-08-03 ロボット制御装置、ロボット制御システム、及びロボット制御方法
CN202280053883.5A CN117813182A (zh) 2021-08-03 2022-08-03 机器人控制设备、机器人控制系统和机器人控制方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021-127715 2021-08-03
JP2021127715 2021-08-03

Publications (1)

Publication Number Publication Date
WO2023013698A1 true WO2023013698A1 (ja) 2023-02-09

Family

ID=85156017

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/029851 Ceased WO2023013698A1 (ja) 2021-08-03 2022-08-03 ロボット制御装置、ロボット制御システム、及びロボット制御方法

Country Status (5)

Country Link
US (1) US20240246237A1 (https=)
EP (1) EP4382258A4 (https=)
JP (1) JP7657936B2 (https=)
CN (1) CN117813182A (https=)
WO (1) WO2023013698A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023047591A1 (https=) * 2021-09-27 2023-03-30

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009125857A (ja) * 2007-11-22 2009-06-11 Mitsubishi Electric Corp ロボットのキャリブレーション装置及び方法
JP2020116717A (ja) 2019-01-28 2020-08-06 株式会社Ｆｕｊｉ ロボット制御システム

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1063317A (ja) * 1996-08-13 1998-03-06 Fanuc Ltd ロボット−視覚センサシステムにおける座標系結合方法
JP4298757B2 (ja) * 2007-02-05 2009-07-22 ファナック株式会社 ロボット機構のキャリブレーション装置及び方法
JP5561260B2 (ja) * 2011-09-15 2014-07-30 株式会社安川電機 ロボットシステム及び撮像方法
US9211643B1 (en) * 2014-06-25 2015-12-15 Microsoft Technology Licensing, Llc Automatic in-situ registration and calibration of robotic arm/sensor/workspace system
JP6396516B2 (ja) * 2017-01-12 2018-09-26 ファナック株式会社 視覚センサのキャリブレーション装置、方法及びプログラム
JP6860843B2 (ja) * 2017-02-20 2021-04-21 株式会社安川電機 ロボットシステム、ロボット制御装置、及びロボット制御方法
WO2018163450A1 (ja) * 2017-03-09 2018-09-13 三菱電機株式会社 ロボット制御装置およびキャリブレーション方法
JP7008942B2 (ja) * 2017-12-21 2022-01-25 株式会社安川電機 較正方法及び較正装置
JP2019119027A (ja) * 2018-01-10 2019-07-22 キヤノン株式会社 ロボットシステムの制御方法、およびロボットシステム
DE102018124595B4 (de) * 2018-10-05 2022-02-17 Carl Zeiss Industrielle Messtechnik Gmbh Vorrichtung zur Erfassung einer Position und Lage eines Endeffektors eines Roboters
JP7323057B2 (ja) * 2020-03-31 2023-08-08 日本電気株式会社 制御装置、制御方法、および、制御プログラム
US12311542B2 (en) * 2020-07-29 2025-05-27 Fanuc Corporation Robot system
US12115652B2 (en) * 2020-08-17 2024-10-15 Faro Technologies, Inc. Referencing pose manipulation system for marker based tracking of position measurement system
US11724407B2 (en) * 2021-01-18 2023-08-15 Xerox Corporation Target-free RGBD camera alignment to robots
CN116917087A (zh) * 2021-04-19 2023-10-20 发那科株式会社 程序生成装置和机器人控制装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009125857A (ja) * 2007-11-22 2009-06-11 Mitsubishi Electric Corp ロボットのキャリブレーション装置及び方法
JP2020116717A (ja) 2019-01-28 2020-08-06 株式会社Ｆｕｊｉ ロボット制御システム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4382258A4

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023047591A1 (https=) * 2021-09-27 2023-03-30
JP7680553B2 (ja) 2021-09-27 2025-05-20 ファナック株式会社 機構誤差パラメータを較正する較正装置および機構誤差パラメータの較正の必要性を判定する判定装置

Also Published As

Publication number Publication date
JPWO2023013698A1 (https=) 2023-02-09
EP4382258A4 (en) 2025-08-13
CN117813182A (zh) 2024-04-02
JP7657936B2 (ja) 2025-04-07
EP4382258A1 (en) 2024-06-12
US20240246237A1 (en) 2024-07-25

Similar Documents

Publication Publication Date Title
JP6966582B2 (ja) ロボットモーション用のビジョンシステムの自動ハンドアイ校正のためのシステム及び方法
CN112672860B (zh) 用于ar和数字孪生的机器人校准
JP6180087B2 (ja) 情報処理装置及び情報処理方法
CN106457562B (zh) 用于校准机器人的方法和机器人系统
JP6855492B2 (ja) ロボットシステム、ロボットシステム制御装置、およびロボットシステム制御方法
JP5949242B2 (ja) ロボットシステム、ロボット、ロボット制御装置、ロボット制御方法、およびロボット制御プログラム
JP2019098409A (ja) ロボットシステムおよびキャリブレーション方法
US20090228144A1 (en) Method For Calculating Rotation Center Point And Axis Of Rotation, Method For Generating Program, Method For Moving Manipulator And Positioning Device, And Robotic System
JP7657936B2 (ja) ロボット制御装置、ロボット制御システム、及びロボット制御方法
JP7583942B2 (ja) ロボット制御装置、ロボット制御システム、及びロボット制御方法
JP7844771B2 (ja) オブジェクトのカメラ画像からオブジェクトの場所を位置特定するための装置及び方法
JP7660686B2 (ja) ロボット制御装置、ロボット制御システム、及びロボット制御方法
CN116390834A (zh) 机器人系统
CN113733078B (zh) 机械臂精调控制量判读方法、计算机可读存储介质
JP2016203282A (ja) エンドエフェクタの姿勢変更機構を備えたロボット
JP2005186193A (ja) ロボットのキャリブレーション方法および三次元位置計測方法
US20220092290A1 (en) Image Recognition Method And Robot System
US20240346674A1 (en) Information processing device, information processing method, imaging device, and information processing system
JP7797664B2 (ja) ロボットを有するロボットシステム、及びロボットのキャリブレーション方法
US20260001728A1 (en) Workpiece removal device, workpiece removal method, and control device
WO2023013699A1 (ja) ロボット制御装置、ロボット制御システム、及びロボット制御方法
JP2020059064A (ja) ロボットツールセンターポジションのずれ検出装置及び検出方法
JP2021091070A (ja) ロボット制御装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22853116

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280053883.5

Country of ref document: CN

Ref document number: 2023540394

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 18681013

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022853116

Country of ref document: EP

Effective date: 20240304