Disclosure of Invention
The invention aims to solve the technical problem that in the prior art, a mechanical arm lacks the capability of automatically grabbing a pin seat and moving a pin to the pin seat in the process of continuously acquiring information, and provides a method and a system for automatically assembling a pin step by a robot and a double-arm robot.
The technical scheme for solving the technical problems is as follows:
according to a first aspect of the present invention there is provided a method of robotic automated step-wise assembly of a bolt comprising:
driving a first manipulator arranged on a robot body to clamp a pin to a first preassembly point located in a first manipulator base coordinate system;
driving a second robot arm mounted on the robot to grip a pin boss with an entrance to a second pre-assembly point located in a second robot arm base coordinate system;
when the pin seat is positioned at the second pre-assembly point, acquiring three-dimensional inlet information of the inlet in a base coordinate system of the second robot arm;
continuously detecting multi-dimensional force information of a pin wall on the pin seat in the second mechanical arm base coordinate system;
and driving the first mechanical arm to assemble the pin into the pin seat step by step from the first pre-assembly point according to the inlet three-dimensional information and the multi-dimensional force information.
According to a second aspect of the invention, a robot automatic step-by-step bolt assembling system is provided, which comprises a mechanical arm driving module, an information acquisition module and an information detection module;
the mechanical arm driving module is used for driving a first mechanical arm clamping pin arranged on a robot body to a first pre-assembly point located in a first mechanical arm base coordinate system; driving a second robot arm mounted on the robot body to grip a pin seat with an entrance to a second pre-assembly point located in a second robot arm base coordinate system;
the information acquisition module is used for acquiring inlet three-dimensional information of the inlet in the second robot arm base coordinate system when the pin seat is positioned at the second pre-assembly point;
the information detection module is used for continuously detecting multi-dimensional force information of the pin wall on the pin seat in the second mechanical arm base coordinate system;
the mechanical arm driving module is further used for driving the first mechanical arm to assemble the pin into the pin seat step by step from the first pre-assembly point according to the inlet three-dimensional information and the multi-dimensional force information.
According to a third aspect of the present invention there is provided a dual-arm robot for performing the robotic automated step-by-step assembly latching method of the first aspect.
The robot automatic step-by-step bolt assembling method, the system and the double-arm robot provided by the invention have the beneficial effects that: drive first robotic arm automatic clamp respectively and get pin seat to second preassembly point to first preassembly point and drive second robotic arm automatic clamp, realize that both arms press from both sides and get pin seat and pin, the pin seat need not artificial intervention and can fix on the workstation, has not only helped saving the cost of labor, has promoted the automatic ability and the efficiency of both arms assembly bolt again.
After the pin seat reaches the second pre-assembly point, the robot can acquire the three-dimensional inlet information, so that the robot can be prevented from acquiring the three-dimensional inlet information before the pin seat reaches the second pre-assembly point, and redundant information and the storage space occupied by the robot are reduced.
In the process of continuously detecting the multidimensional force information, the first mechanical arm can be driven to move the pin towards the pin seat step by step according to the inlet three-dimensional information and the multidimensional force information, then the first mechanical arm is driven to insert the pin into the pin seat according to the multidimensional force information, so that the pin and the pin seat are assembled into the pin step by the first mechanical arm, the preparation time of the multidimensional force information is favorably shortened, the information preparation is timely prepared for driving the pin and the pin seat to be assembled into the pin by step by the first mechanical arm, the time for moving the pin towards the pin seat is favorably shortened, the hole aligning efficiency and the assembling efficiency are improved, and therefore, the automatic step-by-step pin assembling efficiency of double arms is improved.
Example one
The embodiment of the invention provides a method for automatically assembling a bolt step by a robot, which comprises the following steps: driving a first manipulator arranged on a robot body to clamp a pin to a first preassembly point located in a first manipulator base coordinate system; driving a second mechanical arm arranged on the robot body to clamp the pin seat with the inlet to a second preassembly point in a base coordinate system of the second mechanical arm; when the pin boss is positioned at the second pre-assembly point, acquiring three-dimensional information of the inlet in a base coordinate system of the second robot arm; continuously detecting multi-dimensional force information of a pin wall on the pin seat in a base coordinate system of the second mechanical arm; and driving a first mechanical arm to assemble the pin into the pin seat step by step from a first pre-assembly point according to the inlet three-dimensional information and the multi-dimensional force information.
In some embodiments, driving the first robot gripper pin to the first pre-assembly point and the second robot gripper to the second pre-assembly point in a serial fashion, as shown in fig. 1a-1e, helps to ensure the reliability of driving the arms.
In some embodiments, as shown in fig. 1f-1i, driving the first robot arm to grip the pin to the first pre-assembly point and the second robot arm to grip the pin holder to the second pre-assembly point in a parallel manner helps to ensure the driving efficiency of both arms, the efficiency of moving the pin to the first pre-assembly point and the efficiency of moving the pin holder to the second pre-assembly point.
In some embodiments, as shown in FIGS. 1a-1c and 1f-1g, acquiring portal three-dimensional information and continuously detecting multi-dimensional force information in a serial manner may reduce redundant information and its occupancy of the robot's storage space.
In some embodiments, as shown in fig. 1d-1e and 1h-1i, acquiring three-dimensional information of the inlet and continuously detecting multi-dimensional force information in a parallel manner can shorten the preparation time of the multi-dimensional force information and timely prepare information for driving the first mechanical arm to assemble the pin into the pin seat step by step.
In some embodiments, as shown in fig. 1a-1i, during the continuous detection of the multidimensional force information, the first robot arm may be driven step by step according to the three-dimensional information of the entry and the multidimensional force information to move the pin towards the pin seat, and then the first robot arm is driven according to the multidimensional force information to insert the pin into the pin seat until the pin reaches the bottom of the pin on the pin seat, so that the automatic assembly of the pin and the pin seat into the pin by the two arms is completed, and the detection of the multidimensional force information is stopped, thereby improving the hole aligning efficiency and the assembling efficiency, and improving the automatic step-by-step assembly efficiency of the two arms.
In some embodiments, the force sensor may comprise a six-dimensional force sensor, the multi-dimensional force information comprises six-dimensional force information, and the six-dimensional force value may be expressed as:
[+2N +5N +18N +1.2Nm +2.3Nm +0.6Nm]
wherein, +2N represents that the six-dimensional force sensor detects a pressure in the second robot arm base coordinate system in the forward direction along the x-axis, +5N represents that the six-dimensional force sensor detects a pressure in the second robot arm base coordinate system in the forward direction along the y-axis, +18N represents that the six-dimensional force sensor detects a pressure in the second robot arm base coordinate system in the forward direction along the z-axis, +1.2Nm represents that the six-dimensional force sensor detects a torque in the second robot arm base coordinate system in the forward direction along the x-axis, +2.3Nm represents that the six-dimensional force sensor detects a torque in the forward direction along the y-axis in the second robot arm base coordinate system, +0.6Nm represents that the six-dimensional force sensor detects a torque in the forward direction along the z-axis in the second robot arm base coordinate system, and wherein "+" represents the forward direction.
In some embodiments, the driving the first robot gripping pin to the first pre-assembly point as shown in fig. 1b-1i, specifically comprises: receiving a pin three-dimensional image shot by a 3D camera in a 3D camera coordinate system; identifying first three-dimensional information of a first grabbing point on the pin in a 3D camera coordinate system according to the three-dimensional image of the pin; converting the first three-dimensional information into second three-dimensional information in a first robot arm base coordinate system; driving the first mechanical arm to grab the pin according to the second three-dimensional information; acquiring first preset three-dimensional information used for representing a first preassembly point; and driving a second mechanical arm to clamp the pin seat from the first grabbing point to the first pre-assembly point according to the second three-dimensional information and the first preset three-dimensional information.
In some embodiments, the driving the second robot gripping pin holder to the second pre-assembly point, as shown in fig. 1b-1i, specifically comprises: receiving a pin boss three-dimensional image shot by a 3D camera in a 3D camera coordinate system; identifying third three-dimensional information of a second grabbing point on the pin wall in a 3D camera coordinate system according to the three-dimensional image of the pin seat; converting the third three-dimensional information into fourth three-dimensional information in a base coordinate system of the second mechanical arm; driving a second mechanical arm to grab the pin wall according to the fourth three-dimensional information; acquiring second preset three-dimensional information used for representing a second preassembly point; and driving a second mechanical arm to clamp the pin seat from the second grabbing point to a second pre-assembly point according to the fourth three-dimensional information and the second preset three-dimensional information.
In some embodiments, the robot is mounted on a support, and the central control machine is respectively in communication connection with the first mechanical arm, the second mechanical arm, the force sensor mounted on the tail end of the second mechanical arm, and the 3D camera; the central control machine is used for driving the first mechanical arm, the second mechanical arm, the force sensor and the 3D camera, the force sensor is used for continuously detecting multi-dimensional force information, and is further used for asynchronously driving and receiving a pin three-dimensional image, a pin seat three-dimensional image and an inlet three-dimensional image shot by the 3D camera.
The central control machine can respectively construct a bracket coordinate system based on prestored three-dimensional coordinate information corresponding to the bracket, a first mechanical arm base coordinate system based on prestored three-dimensional coordinate information corresponding to the first mechanical arm, a second mechanical arm base coordinate system based on prestored three-dimensional coordinate information corresponding to the second mechanical arm and a 3D camera coordinate system based on three-dimensional coordinate information of the 3D camera on the robot; let the frame coordinate system f be { o }f-xfyfzfLet the first robot base coordinate system br be { o }br-xbrybrzbrLet the base coordinate system bl of the second robot be { o }bl-xblyblzblLet the 3D camera coordinate system c be { o }c-xcyczc}。
In some embodiments, a first transformation equation is applied to convert the first three-dimensional information to the second three-dimensional information, the first transformation equation expressed as:
wherein p represents a first grasping point,
represents coordinate values along the x-axis in the first robot base coordinate system br in the second three-dimensional information,
represents coordinate values along the y-axis in the first robot base coordinate system br in the second three-dimensional information,
represents coordinate values along the z-axis in the first robot base coordinate system br in the second three-dimensional information,
fH
brrepresenting a homogeneous transformation equation of the first robot base coordinate system br with respect to the support coordinate system f,
fH
crepresenting a homogeneous transformation equation of the 3D camera coordinate system c with respect to the gantry coordinate system f,
represents coordinate values on the x-axis in the 3D camera coordinate system c in the first three-dimensional information,
represents coordinate values on the y-axis in the 3D camera coordinate system c in the first three-dimensional information,
represents coordinate values along the z-axis in the 3D camera coordinate system c in the first three-dimensional information.
In some embodiments, the third three-dimensional information is converted to fourth three-dimensional information using a second transformation equation, the second transformation equation expressed as:
wherein h represents the second grasping point,
indicating the coordinate value along the x-axis in the second robot base coordinate system bl in the fourth three-dimensional information,
indicating the coordinate value along the y-axis in the second robot base coordinate system bl in the fourth three-dimensional information,
indicating the coordinate value along the z-axis in the second robot base coordinate system bl in the fourth three-dimensional information,
fH
blrepresenting a homogeneous transformation equation of the second robot base coordinate system bl with respect to the support coordinate system f,
represents coordinate values on the x-axis in the 3D camera coordinate system c in the third three-dimensional information,
represents coordinate values along the y-axis in the 3D camera coordinate system c in the third three-dimensional information,
and represents coordinate values along the z-axis in the 3D camera coordinate system c in the third three-dimensional information.
In some embodiments, acquiring three-dimensional information of the portal in the second robot arm base coordinate system specifically includes: receiving an entrance three-dimensional image; identifying fifth three-dimensional information of any point in the entrance in a 3D camera coordinate system according to the entrance three-dimensional image; and applying a second transformation equation to convert the fifth three-dimensional information into entry three-dimensional information in the second robot arm base coordinate system.
The fifth three-dimensional information may be represented as:
where ha denotes the center of the circle in the inlet,
represents coordinate values on the x-axis in the 3D camera coordinate system c in the portal three-dimensional information,
represents coordinate values along the y-axis in the 3D camera coordinate system c in the portal three-dimensional information,
and represents coordinate values along the z-axis in the 3D camera coordinate system c in the portal three-dimensional information.
The three-dimensional information of the entrance is represented as:
wherein the content of the first and second substances,
indicating the coordinate value along the x-axis in the second robot base coordinate system bl in the fifth three-dimensional information,
indicating the coordinate value along the y-axis in the second robot base coordinate system bl in the fifth three-dimensional information,
and represents the coordinate value along the z-axis in the second robot base coordinate system bl in the fifth three-dimensional information.
In some embodiments, the step-by-step assembly of the pin into the pin holder by driving the first robot arm from the first pre-assembly point according to the three-dimensional information and the multi-dimensional force information of the inlet shown in fig. 1b to 1i specifically comprises: when the multi-dimensional force information does not accord with the preset lower limit condition, driving a first mechanical arm to gradually clamp the pin from a first pre-assembly point to be close to the inlet according to the inlet three-dimensional information, and giving a pin contact force positioned in the inlet to a pin wall on a pin seat; and when the multi-dimensional force information meets the preset lower limit condition, driving a first mechanical arm to insert the pin into the pin seat from the inlet according to the multi-dimensional force information.
As an optional embodiment, driving the first robot arm to gradually clamp the pin from the first pre-assembly point to the entrance according to the entrance three-dimensional information specifically includes: respectively acquiring a preset step length and first preset three-dimensional information; planning a motion path according to the entrance three-dimensional information and the first preset three-dimensional information; and driving the first mechanical arm step by step according to a preset step length to clamp the pin to be close to the inlet step by step along the motion path.
As an optional implementation, the step number is calculated according to the entrance three-dimensional information, the preset step length and the first preset three-dimensional information; and driving the first mechanical arm step by step according to the step number to clamp the pin to be close to the inlet.
In some embodiments, the preset lower limit condition, the preset step length, and the first preset three-dimensional information may include empirical values pre-stored in the central control machine, or may be obtained through training of a robot training model.
In some embodiments, the preset lower limit condition is represented as [ 000000 ], the preset step size is 0.1 mm; alternatively, the preset lower limit condition is represented as [ 0.10.10.1000 ], and the preset step size is 0.15 mm.
As an optional implementation manner, driving the first robot arm to insert the pin into the pin seat from the entrance according to the multidimensional force information specifically includes: respectively reading two-dimensional component information in two directions parallel to a plane where the inlet is located and one-dimensional component information in one direction perpendicular to the plane where the inlet is located from the multi-dimensional force information; driving the first mechanical arm to calibrate the posture of the pin along two directions parallel to the plane where the inlet is located according to the two-dimensional component information and a preset deflection calibration condition; and driving the first mechanical arm to insert the pin into the pin seat from the inlet along the direction vertical to the plane of the inlet according to the one-dimensional component information and the preset upper limit condition.
In some embodiments, the two-dimensional component information includes pressure and torque along the x-axis and pressure and torque along the y-axis in the second robot base coordinate system, and the one-dimensional component information includes pressure and torque along the z-axis in the second robot base coordinate system.
In some embodiments, the preset upper limit condition may include an empirical value pre-stored in a central control machine, or may be obtained through training of a robot training model, and the preset upper limit condition may include a pressure along the z-axis being between 2N and 5N, for example: 2N, 3N and 5N.
In some embodiments, the two directions parallel to the plane of the inlet are the direction along the x-axis and the direction along the y-axis in the second robot base coordinate system, respectively, and the direction along the positive x-axis and the positive direction along the y-axis may represent two directions perpendicular to each other on the inlet; one direction perpendicular to the plane of the inlet is along the z-axis in the second robot base coordinate system, and the direction along the z-axis may be a direction extending from the inlet to the pin bottom on the pin holder.
As an alternative embodiment, the preset skew calibration condition includes an offset calibration sub-condition and a tilt calibration sub-condition, and the driving of the first robot arm according to the two-dimensional component information and the preset skew calibration condition calibrates the attitude of the pin along two directions parallel to the plane where the entrance is located specifically includes: determining a first force component and a moment component in each direction parallel to the plane of the inlet from the two-dimensional component information respectively; driving the first robot arm alignment pin to offset distances in directions parallel to the plane of the entrance according to the respective first force components and the offset alignment sub-conditions; the first robot arm calibration pin is driven to calibrate the tilt angle in each direction parallel to the plane of the entrance according to each moment component and tilt calibration sub-condition.
In some embodiments, each direction parallel to the plane of the inlet represents a direction along the x-axis or a direction along the y-axis in the second robot base coordinate system, and the first force component may include a pressure resolved along the x-axis or a pressure resolved along the y-axis to represent a contact force imparted by the pin wall to the pin in the second robot base coordinate system, such as: -2N represents the pressure of the contact force along the x-axis decomposition; the moment component may include a torque corresponding to a pressure resolved along the x-axis or a torque corresponding to a pressure resolved along the y-axis, such as: 1.2Nm represents the torque value corresponding to the pressure resolved along the x-axis, where "-" represents the negative direction.
During the process that the pin is inserted from the entrance to the target position on the pin seat, the first mechanical arm can be driven to calibrate the position of the pin through each first force component, the offset calibration sub-condition, each moment component and the inclination calibration sub-condition so as to reduce the offset of the pin in the pin seat, thereby reducing the resistance of the pin seat on the pin and reducing the damage rate of the pin.
As an alternative embodiment, the offset calibration sub-condition includes a force offset threshold and a distance calibration constant, and the driving of the offset distance of the first robot arm calibration pin along each direction parallel to the plane of the entrance according to the respective first force component and the offset calibration sub-condition specifically includes: and judging whether the force value in each first force component is larger than a force offset threshold value, if so, driving the first mechanical arm to calibrate each offset distance according to the force direction and the distance calibration constant in each first force component, and if not, stopping driving the first mechanical arm to calibrate each offset distance.
In some embodiments, the force offset threshold may include an empirical value pre-stored in the central controller or trained by the robot training model, and may be set between 1N and 1.5N, for example: 1N, 1.2N and 1.5N.
In some embodiments, whether the force value is larger than the magnitude relation between the force offset threshold values or not can be judged in a circulating mode until the force value does not exceed the force offset threshold value, and the circulation is carried out until the force value is out of the circulation, so that the efficiency of gradually calibrating the pose of the pin in the entrance of the first mechanical arm is improved, and the continuity of inserting the pin into the pin base is ensured.
As an alternative embodiment, the tilt calibration sub-condition includes a moment tilt threshold and an angle calibration constant, and the driving of the tilt angle of the first robot arm calibration pin along each direction parallel to the plane of the inlet according to each moment component and the tilt calibration sub-condition specifically includes: and judging whether the moment value in each moment component exceeds a moment inclination threshold value, if so, driving the first mechanical arm to calibrate each inclination angle according to the moment direction and the distance calibration constant in each moment component, and if not, stopping driving the first mechanical arm to calibrate each inclination angle.
In some embodiments, the moment tilt threshold may include empirical values pre-stored in the central controller or trained by the robot training model, and may be set between 1Nm and 1.5Nm, for example: 1Nm or 1.3Nm or 1.5 Nm.
In some embodiments, the magnitude relation between the moment value and the moment inclination threshold value can be judged in a circulating mode until the moment value does not exceed the moment inclination threshold value, and the circulation is jumped out, so that the efficiency of gradually calibrating the pose of the pin in the entrance of the first mechanical arm is improved, and the continuity of inserting the pin into the pin seat is guaranteed.
As an optional implementation manner, driving the first robot arm to insert the pin into the pin seat from the inlet along a direction perpendicular to a plane where the inlet is located according to the one-dimensional component information and the preset upper limit condition specifically includes: determining a second force component from the one-dimensional component information; and judging whether the force value in the second force component is larger than a preset upper limit condition, if so, stopping driving the first mechanical arm to insert the pin into the pin seat from the inlet, and if not, continuously driving the first mechanical arm to insert the pin into the pin seat from the inlet.
In some embodiments, the second force component comprises a pressure along the z-axis, such as: pressure along the z-axis positive direction was 3.3N; when the positive pressure 3.3N along the z axis is greater than the preset upper limit condition 3N, the pin reaches the pin bottom on the pin seat in the shape of a cylinder; when the pressure 3.3N along the Z-axis forward direction is greater than the preset upper limit condition 3N, the situation that the pin does not reach the pin bottom is shown, the insertion stage is completed, the first mechanical arm is continuously driven to insert the pin to the pin bottom along the Z-axis forward direction, the driving mode is simple, and the efficiency of continuously driving the first mechanical arm is improved.
EXAMPLE III
The embodiment of the invention provides a double-arm robot which is used for executing the automatic step-by-step bolt assembling method of the robot in any one of the embodiment.
In some embodiments, as shown in fig. 3 and 4, the robot includes a robot body 1, a servo driving device 2, a first robot arm 3, a second robot arm 4, a 3D camera 5, and a force sensor 6; the servo driving device 2 is installed in an inner cavity of the robot body 1, the first mechanical arm 3 is installed on a shoulder on the left side of the robot body 1, the second mechanical arm 4 is installed on a shoulder on the right side of the robot body 1, the 3D camera 5 is installed on the head of the robot body 1, and the force sensor 6 is installed at the tail end of the second mechanical arm 4.
The servo drive 2 is in communication with the first robot arm 3, the second robot arm 4, the 3D camera 5 and the force sensor 6, respectively, and the force sensor 6 may comprise a six-dimensional force sensor.
And the servo driving device 2 is used for driving the first mechanical arm 3 to clamp and assemble the pin 7 step by step, driving the second mechanical arm 4 to clamp the pin seat 8 and driving the 3D camera 5 to shoot images, and the continuous driving force sensor 6 is used for detecting multi-dimensional force information.
In some embodiments, the servo driving device 2 may include a single driver for driving the first robot arm 3 gripping and assembling pins 7 step by step, driving the second robot arm 4 gripping pin holders 8, driving the 3D camera 5 to photograph an image, and the continuous driving force sensor 6 to detect multi-dimensional force information.
In some embodiments, the servo driving device 2 may be a single driver and may include dual drivers, which are a first driver and a second driver, respectively; the first driver is used for driving the first mechanical arm 3 to clamp and assemble the pin 7 and driving the second mechanical arm 4 to clamp the pin seat 8 step by step; and a second driver for driving the 3D camera 5 to capture an image and the continuous driving force sensor 6 to detect multi-dimensional force information.
In some embodiments, the servo drive may include a multi-driver including a first driver, a second driver, a third driver, and a fourth driver; a first driver for driving the first robot arm 3 to pick up and assemble the pin 7; the second driver is used for driving the second mechanical arm 4 to clamp the pin seat 8; a fourth driver for driving the 3D camera 5 to photograph an image; and a fourth driver for detecting multi-dimensional force information by the continuous driving force sensor 6.
The reader should understand that in the description of this specification, reference to the description of the terms "aspect," "alternative embodiments," or "some embodiments," etc., means that a particular feature, step, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention, and the terms "first" and "second," etc., are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second", etc., may explicitly or implicitly include at least one of the feature.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.