TW202118607A - Computer device and method for determinig coordinates for mechanical arm - Google Patents

Abstract

The present disclosure provides a method of determining position coordinates for a mechanical arm. When position coordinates of a reference position of one fixture of a plurality of fixtures, position coordinates of a middle position of the one fixture, and position coordinates of a target position of the one fixture are obtained, position coordinates of a reference position of any other fixture of the plurality of fixtures, position coordinates of a middle position of the other fixture, and position coordinates of the target position of the other fixture can be determined. The position coordinates of the reference position of each fixture of the plurality of fixtures, position coordinates of the middle position of each fixture, and the position coordinates of the target position of each fixture are used to control the mechanical arm. By using the present disclosure, time for determining those position coordinates is shortened without changing existing fixtures. The invention also provides a computer device for determining the position coordinates for the mechanical arm.

Description

Method for determining coordinates of mechanical arm and computer device

The invention relates to the technical field of vehicle management, in particular to a method for determining the coordinates of a mechanical arm and a computer device.

When factories use robotic arms to implement automated production, they usually control the robotic arms based on multiple absolute coordinate points. For example, before controlling the robot arm to reach the target position to perform the put or take operation, it is usually necessary to control the robot arm to reach a reference position first, then control the robot arm from the reference position to an intermediate position, and then control the robot arm to reach from the intermediate position The target position performs the put or fetch operation.

At present, the absolute coordinates corresponding to these operating points, namely the reference position, the intermediate position, and the target position, must be extracted by the cooperation of manual operations. Specifically, the mechanical arm is manually moved to each operating point, and then the absolute coordinates corresponding to each operating point are extracted by a computer device. However, the time to manually find each operating point may be as long as 30 minutes, which takes a long time and indirectly affects the production efficiency of the factory.

In view of the above, it is necessary to propose a method for determining the coordinates of a robotic arm and a computer device, which can shorten the time to find the position coordinates of the intermediate and target positions corresponding to each jig without changing the existing jig and environment, and at the same time Improve the flexibility of factory automation tangent.

The first aspect of the present invention provides a method for determining the coordinates of a robotic arm, which is applied to a computer device, and the method includes: a setting step of placing a target object provided with a marker on one of a plurality of jigs; and a first shooting step , Controlling the camera of the robotic arm to take a first photo including the marker, and obtaining the first position coordinates of the marker based on the first photo obtained by the shooting; the first calculation step is based on the The first position coordinate of the marker calculates the position coordinate of the reference position corresponding to the one of the fixtures; the first control step, based on the position coordinate of the reference position corresponding to the one of the fixtures, controls the movement of the robot arm To the reference position corresponding to the one of the jigs; the first moving step is to move the robotic arm from the reference position corresponding to the one of the jigs to the intermediate position corresponding to the one of the jigs; A reading step is to read the position coordinates of the current position of the robot arm from the three-dimensional coordinate system where the robot arm is located, and use the read position coordinates as the intermediate position corresponding to one of the jigs The second moving step is to move the robotic arm from the intermediate position corresponding to one of the fixtures to the target position corresponding to one of the fixtures; the second reading step is to move the robot arm from the intermediate position corresponding to one of the fixtures; Read the position coordinates of the current position of the robotic arm in the three-dimensional coordinate system where the arm is located, and use the read position coordinates as the position coordinates of the target position corresponding to one of the jigs, thereby obtaining the The position coordinates of the reference position corresponding to one of the jigs, the position coordinates of the intermediate position, and the position coordinates of the target position; the third moving step is to move the target object provided with the marker from the one of the jigs Move to another jig of the plurality of jigs; in the second shooting step, control the camera to take a second photo including the marker, and obtain all the photos based on the second photo obtained by the shooting. The second position coordinates of the marker; the second calculation step, based on the second position coordinates of the marker, calculate the position coordinates of the reference position corresponding to the other jig; the second control step, based on the other The position coordinates of the reference position corresponding to the jig control the robot arm to move to the reference position corresponding to the other jig; the third calculation step is based on the position coordinates of the reference position corresponding to the other jig , And the relative relationship between the position coordinates of the intermediate position corresponding to one of the fixtures and the position coordinates of the reference position corresponding to one of the fixtures to calculate the position coordinates of the intermediate position corresponding to the other fixture; And based on the position coordinates of the reference position corresponding to the other jig, and the relative position between the position coordinates of the target position corresponding to one of the jigs and the position coordinates of the reference position corresponding to the one jig Relational calculation of the position coordinates of the target position corresponding to the other jig; and the determining step, when it is determined that among the plurality of jigs, there are the position coordinates of the reference positions and the position coordinates of the intermediate positions corresponding to other jigs. When the position coordinates of the target position have not been obtained, the third moving step is triggered.

Preferably, in the first calculation step, the abscissa and ordinate of the position coordinate of the reference position corresponding to one of the jigs are the same as the abscissa and ordinate of the first position coordinate of the marker, so The vertical coordinate of the position coordinate of the reference position corresponding to one of the jigs is equal to the vertical coordinate of the first position coordinate of the marker plus the preset value d.

Preferably, in the third calculation step, the position coordinate of the reference position corresponding to one of the jigs is p0 (X ₀ , Y ₀ , Z ₀ ), and the intermediate position corresponding to the one of the jigs is The position coordinate is p1 (X ₁ , Y ₁ , Z _{1 ), the position coordinate p2 (X 2} , Y ₂ , Z ₂ ) of the target position corresponding to one of the fixtures, and the other fixture corresponds to The position coordinates of the reference position of the _{tool are p0' (X 0} ', Y ₀ ', Z ₀ '), and the position coordinates of the intermediate position corresponding to the other jig is p1' (X ₁ ', Y ₁ ', Z ₁ '), where X ₁ '= X ₀ '+( X ₁ -X ₀ ), Y ₁ '= Y ₀ ', Z ₁ '= Z ₀ '; the target position corresponding to the other fixture The position coordinates are p2' (X ₂ ', Y ₂ ', Z ₂ '), where X ₂ '= X ₀ '+(X ₂ -X ₀ ), Y ₂ = Y ₀ ', Z ₂ '= Z ₀ '.

Preferably, the method further includes the step of: controlling the obtained position coordinates of the reference position corresponding to each of the plurality of jigs, the position coordinates of the intermediate position, and the position coordinates of the target position. The robotic arm grabs the target object from the corresponding jig, or places the target object on the corresponding jig.

A second aspect of the present invention provides a computer device, the computer device includes a memory and a processor, the memory is used to store a plurality of modules, the plurality of modules are executed by the processor, the plurality of modules It includes: an execution module, which is used to control a camera of a mechanical arm to take a first photo including a marker, and to obtain the first position coordinates of the marker based on the first photo obtained by the shooting, wherein the marker The object is set on the target object, and the target object is placed on one of the multiple jigs; the execution module is also used to calculate the one of the jigs based on the first position coordinates of the marker The position coordinates of the corresponding reference position; the execution module is also used to control the robot arm to move to the one corresponding to the one of the fixtures based on the position coordinates of the reference position corresponding to the one of the fixtures Reference position; reading module, used to move from the reference position corresponding to one of the jigs to the intermediate position corresponding to one of the jigs from the three-dimensional Read the position coordinates of the current position of the robotic arm in the coordinate system, and use the read position coordinates as the position coordinates of the intermediate position corresponding to one of the jigs; the reading module is also used When the robotic arm moves from the intermediate position corresponding to the one of the fixtures to the target position corresponding to the one of the fixtures, the robotic arm is read from the three-dimensional coordinate system where the robotic arm is located The position coordinates of the current position, the read position coordinates are used as the position coordinates of the target position corresponding to one of the fixtures, thereby obtaining the position coordinates of the reference position corresponding to one of the fixtures, The position coordinates of the intermediate position, and the position coordinates of the target position; the execution module is also used to move the target object provided with the marker from one of the jigs to the plurality of jigs When the other jig is installed, the camera is controlled to take a second photo that includes the marker, and the second position coordinates of the marker are obtained based on the second photo obtained by the shooting; the execution model The group is also used to calculate the position coordinates of the reference position corresponding to the another fixture based on the second position coordinates of the marker; the execution module is also used to calculate the position coordinates of the reference position corresponding to the another fixture based on the second position coordinates of the marker The position coordinates of the reference position control the robot arm to move to the reference position corresponding to the another jig; the execution module is also used to base the position coordinates of the reference position corresponding to the another jig, And the relative relationship between the position coordinates of the intermediate position corresponding to one of the fixtures and the position coordinates of the reference position corresponding to one of the fixtures to calculate the position coordinates of the intermediate position corresponding to the other fixture; and Based on the position coordinates of the reference position corresponding to the other jig, and the relative relationship between the position coordinates of the target position corresponding to the one jig and the position coordinates of the reference position corresponding to the one jig Calculate the position coordinates of the target position corresponding to the other jig.

Preferably, the abscissa and ordinate of the position coordinate of the reference position corresponding to one of the jigs are the same as the abscissa and ordinate of the first position coordinate of the marker, and the one of the jigs corresponds to The vertical coordinate of the position coordinate of the reference position is equal to the vertical coordinate of the first position coordinate of the marker plus a preset value d.

Preferably, the position coordinate of the reference position corresponding to the one of the fixtures is p0(X ₀ , Y ₀ , Z ₀ ), and the position coordinate of the intermediate position corresponding to the one of the fixtures is p1(X ₁ , Y ₁ , Z _{1 ), the position coordinate p2 (X 2} , Y ₂ , Z ₂ ) of the target position corresponding to one of the fixtures, and the position coordinate of the reference position corresponding to the other fixture is p0 '(X ₀ ', Y ₀ ', Z ₀ '), the position coordinates of the middle position corresponding to the other jig is p1' (X ₁ ', Y ₁ ', Z ₁ '), where X ₁ '= X ₀ '+( X ₁ -X ₀ ), Y ₁ '= Y ₀ ', Z ₁ '= Z ₀ '; the position coordinate of the target position corresponding to the other fixture is p2' (X ₂ ', Y ₂ ', Z ₂ '), where X ₂ '= X ₀ '+(X ₂ -X ₀ ), Y ₂ = Y ₀ ', Z ₂ '= Z ₀ '.

Preferably, the execution module is further configured to: according to the obtained position coordinates of the reference position corresponding to each of the plurality of jigs, the position coordinates of the intermediate position, and the position coordinates of the target position , Control the robot arm to grab the target object from the corresponding jig, or place the target object on the corresponding jig.

The method and computer device for determining the coordinates of a robotic arm described in the embodiments of the present invention are achieved by placing a target object provided with a marker in one of a plurality of fixtures; controlling a camera of the robotic arm to take a picture The first photo of the marker is included, and the first position coordinates of the marker are acquired based on the first photo obtained by the shooting. The first position coordinates of the marker are calculated based on the first position coordinates of the marker. The position coordinates of the reference position; based on the position coordinates of the reference position corresponding to the one of the fixtures, control the robotic arm to move to the reference position corresponding to the one of the fixtures; move the robotic arm from the one The reference position corresponding to one jig is moved to the intermediate position corresponding to one of the jigs; the position coordinates of the current position of the robot arm are read from the three-dimensional coordinate system where the robot arm is located, and the read The position coordinates of is used as the position coordinates of the intermediate position corresponding to the one of the fixtures; the robot arm is moved from the intermediate position corresponding to the one of the fixtures to the target corresponding to the one of the fixtures Position; read the position coordinates of the current position of the robot arm from the three-dimensional coordinate system where the robot arm is located, and use the read position coordinates as the position coordinates of the target position corresponding to one of the jigs , Thereby obtaining the position coordinates of the reference position corresponding to the one of the fixtures, the position coordinates of the intermediate position, and the position coordinates of the target position; the target object provided with the marker is treated from the one of the The tool moves to another one of the plurality of tools; controls the camera to take a second photo that includes the marker, and obtains the image of the marker based on the captured second photo Second position coordinates; calculate the position coordinates of the reference position corresponding to the other jig based on the second position coordinates of the marker; control the position coordinates of the reference position corresponding to the other jig The robot arm moves to the reference position corresponding to the other jig; based on the position coordinates of the reference position corresponding to the other jig, and the position coordinates of the intermediate position corresponding to the one jig and the The relative relationship between the position coordinates of the reference position corresponding to one jig is calculated as the position coordinates of the intermediate position corresponding to the other jig; and based on the position coordinates of the reference position corresponding to the other jig, and The relative relationship between the position coordinates of the target position corresponding to one of the fixtures and the position coordinates of the reference position corresponding to one of the fixtures is calculated to calculate the position coordinates of the target position corresponding to the other fixture. Under the premise of changing the existing jig and environment, the time to find the position coordinates of the intermediate position and the target position corresponding to each jig is shortened, and the flexibility of factory automation tangent is improved.

In order to be able to understand the above objectives, features and advantages of the present invention more clearly, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other if there is no conflict.

In the following description, many specific details are explained in order to fully understand the present invention. The described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the present invention. The terms used in the specification of the present invention herein are only for the purpose of describing specific embodiments, and are not intended to limit the present invention.

Fig. 1 is an application environment diagram of a method for determining coordinates of a robotic arm provided by a preferred embodiment of the present invention.

In this embodiment, the method for determining the coordinates of the robotic arm can be applied to an application environment composed of a computer device 1, a robotic arm 2, and a plurality of jigs 31.

In this embodiment, the multiple jigs 31 are arranged in an array. The multiple jigs 31 may be included in one external jig 3. Of course, in other embodiments, other arrangements are also possible, for example, it does not need to be built into the external fixture 3. In this embodiment, both the external jig 3 and the jig 31 refer to a model tool that assists in controlling position or movement (or both).

In this embodiment, the computer device 1 can establish a wireless communication connection with the robotic arm 2. For example, the computer device 1 can establish a communication connection with the robotic arm 2 through a wireless router.

Please refer to FIG. 2 at the same time. In this embodiment, the robot arm 2 includes a base 21, an arm 22, a clamp 23, and a camera 24 set at the position of the clamp 23. The arm portion 22 is connected to the base 21, and the clamp 23 is provided at the front end of the arm portion 22. In this embodiment, when the user places the target object 40 on one of the jigs 31, the computer device 1 can control the camera 22 to aim at the jig 31 on which the target object 40 is placed to take pictures. In this embodiment, a marker 41 is provided on the target object 40. For example, the marker 41 can be pasted on the target object 40. The marker 41 may be ArUco Markers. Thus, when the computer device 1 obtains the photo of the target object 40 provided with the marker 41, the computer device 1 can obtain the position coordinates of the marker 41. The position coordinates of the marker 41 are also the coordinates of the marker in the three-dimensional coordinate system where the robotic arm 2 is located.

It should be noted that ArUco marker is a binary square marker, which consists of a wide black border and an internal binary matrix, which determines the ID. The black border is conducive to the rapid detection of the image, the binary code can verify the ID, and allows the application of error detection and correction technology. The size of ArUco Markers determines the size of the internal matrix. For example, a 4*4 ArUco Markers consists of 16 bits.

Specifically, the computer device 1 can use the OpenCV function library (ArUco Libray) to obtain the position coordinates of the marker 41 based on the photograph of the marker 41 obtained by shooting. It should be noted that ArUco Libray was developed by the Ava Group of the University of Cordoba (Spain).

In this embodiment, the target object 40 may be an object that the robotic arm 2 needs to grip from the jig 31 or an object that needs to be placed on the jig 31. The target object 40 can be any product such as a motherboard or other products.

In this embodiment, the three-dimensional coordinate system where the robot arm 2 is located may be based on the base 21 as the origin, the horizontal plane where the base 21 is located is the XOY plane, and the vertical direction is upward and perpendicular to the XOY plane. The direction is the Z axis.

Figures 3 and 4 are flowcharts of a method for determining the coordinates of a robotic arm provided by a preferred embodiment of the present invention.

In this embodiment, the method for determining the coordinates of the robot arm can be applied to a computer device. For a computer device that needs to determine the coordinates of the robot arm, the computer device can directly integrate the coordinates for the robot arm provided by the method of the present invention. Certain functions may be run on the computer device in the form of a software development kit (SDK).

As shown in FIG. 3 and FIG. 4, the method for determining the coordinates of the robot arm specifically includes the following steps. According to different requirements, the order of the steps in the flowchart can be changed, and some steps can be omitted.

In step S1, the user places the target object 40 provided with the marker 41 on one of the plurality of jigs 31, and moves the robot arm 2 so that the camera 24 can take pictures of it. A marker 41 on the target object 40 on a jig 31.

Preferably, the robot arm 2 is moved so that the camera 24 can photograph each of the multiple jigs 31.

In step S2, the computer device 1 controls the camera 24 to take a first photo including the marker 41, and obtains the first position coordinates of the marker 41 based on the first photo obtained by the shooting.

As mentioned above, the marker 41 can be ArUco Markers. Thus, the computer device 1 can use the OpenCV function library (ArUco Libray) to obtain the first position coordinates of the marker 41 based on the first photo of the marker 41 obtained by shooting. The first position coordinate of the marker 41 is also the coordinate of the marker 41 in the three-dimensional coordinate system where the robot arm 2 is located.

In step S3, the computer device 1 calculates the position coordinates of the reference position corresponding to one of the jigs 31 based on the first position coordinates of the marker 41.

It should be noted that the reference position corresponding to any jig 31 mentioned in this embodiment means that the robot arm 2 needs to place the target object 40 on the any jig 31, or needs to be treated from any jig 31. During the process of clamping the target object 40 on the tool 31, a position point that needs to be passed.

Taking the first position coordinates of the marker 41 as (X _m1 , Y _m1 , Z _m1 ) as an example, the position coordinates of the reference position corresponding to one of the jigs 31 may be (X _m1 , Y _m1 , Z _m1 + d). That is, the abscissa and ordinate of the position coordinate of the reference position corresponding to the one of the jigs 31 are the same as the abscissa and the ordinate of the first position coordinate of the marker 41, and the one of the jigs 31 corresponds to The vertical coordinate of the position coordinate of the reference position is equal to the vertical coordinate of the first position coordinate of the marker 41 plus the preset value d.

In this embodiment, the value of d is an empirical value. For example, d is equal to 30cm, 25cm, or other values. The value of d can be preset according to the operating environment and operating experience. Preferably, d is equal to 30 cm.

Step S4, the computer device 1 controls the robot arm 2 to move to the reference position corresponding to the one of the jigs 31 based on the position coordinates of the reference position corresponding to the one of the jigs 31.

In step S5, the user moves the robotic arm 2 from the reference position corresponding to one of the jigs 31 to the intermediate position corresponding to the one of the jigs 31.

It should be noted that the intermediate position corresponding to any jig 31 mentioned in this embodiment is different from the reference position corresponding to any jig 31.

It should be noted that the intermediate position corresponding to any jig 31 mentioned in this embodiment can be defined as that the robot arm 2 needs to place the target object 40 on the any jig 31 or needs to be treated from the any jig 31. A position point that the tool 31 needs to pass during the process of gripping the target object 40, and the position point is between the reference position and the target position.

In one embodiment, the intermediate position corresponding to the one of the fixtures 31 is directly below the reference position corresponding to the one of the fixtures 31, and the distance from the intermediate position corresponding to the one of the fixtures 31 is The reference position corresponding to one of the jigs 31 is a preset value such as 20 cm.

Step S6, the computer device 1 reads the position coordinates of the current position of the robot arm 2 (that is, the intermediate position corresponding to one of the jigs 31) from the three-dimensional coordinate system where the robot arm 2 is located , Using the read position coordinates as the position coordinates of the intermediate position corresponding to one of the jigs 31.

Step S7, the user moves the robotic arm 2 from the intermediate position corresponding to one of the jigs 31 to the target position corresponding to the one of the jigs 31.

It should be noted that the target position corresponding to any jig 31 mentioned in this embodiment can be defined as the robot arm 2 placing the target object 40 on the jig 31 or from the jig 31 The position point when the target object 40 is clamped. In other words, the target position corresponding to any one of the jigs 31 also refers to the position point at which the robot arm 2 performs the releasing operation or the grasping operation.

Step S8, the computer device 1 reads the position coordinates of the current position of the robot arm 2 (that is, the target position corresponding to one of the jigs 31) from the three-dimensional coordinate system where the robot arm 2 is located , Using the read position coordinates as the position coordinates of the target position corresponding to the one of the fixtures 31, so that the computer device 1 obtains the position coordinates of the reference position corresponding to the one of the fixtures 31, The position coordinates of the middle position and the position coordinates of the target position.

Step S9, the user moves the target object 40 provided with the marker 41 from one of the jigs 31 to the other jig 31 of the plurality of jigs 31, and moves the robot arm 2 The camera 24 can capture the marker 41 on the target object 40 placed on the other jig 31.

In step S10, the computer device 1 controls the camera 24 to take a second photo including the marker 41, and obtains the second position coordinates of the marker 41 based on the second photo obtained by the shooting.

Similarly, the computer device 1 can use the OpenCV library (ArUco Libray) to obtain the second position coordinates of the marker 41 based on the second photo of the marker 41 obtained by shooting. The second position coordinate of the marker 41 is also the coordinate of the marker 41 in the three-dimensional coordinate system where the robot arm 2 is located.

In step S11, the computer device 1 calculates the position coordinates of the reference position corresponding to the another jig 31 based on the second position coordinates of the marker 41.

Taking the second position coordinates of the marker 41 as (X _m2 , Y _m2 , Z _m2 ) as an example, the position coordinates of the reference position corresponding to the other jig 31 may be (X _m2 , Y _m2 , Z m2 _m2 +d). That is, the abscissa and ordinate of the position coordinate of the reference position corresponding to the other jig 31 are the same as the abscissa and ordinate of the second position coordinate of the marker 41, and the other jig 31 corresponds to The vertical coordinate of the position coordinate of the reference position is equal to the vertical coordinate of the second position coordinate of the marker 41 plus the preset value d.

As mentioned above, in this embodiment, the value of d is an empirical value. For example, d is equal to 30cm, 25cm, or other values. The value of d can be preset according to the operating environment and operating experience. Preferably, d is equal to 30 cm.

In step S12, the computer device 1 controls the robot arm 2 to move to the reference position corresponding to the other jig 31 based on the position coordinates of the reference position corresponding to the other jig 31.

Step S13, the computer device 1 is based on the position coordinates of the reference position corresponding to the other jig 31, and the position coordinates of the intermediate position corresponding to the one jig 31 and the reference corresponding to the one jig 31 The relative relationship between the position coordinates of the position is calculated based on the position coordinates of the intermediate position corresponding to the other jig 31; and the position coordinates based on the reference position corresponding to the other jig 31, and the one of the jigs The relative relationship between the position coordinates of the target position corresponding to 31 and the position coordinates of the reference position corresponding to one of the jigs 31 is calculated to calculate the position coordinates of the target position corresponding to the other jig 31.

Specifically, it is assumed that the position coordinate of the reference position corresponding to one of the jigs 31 is p0 (X ₀ , Y ₀ , Z ₀ ), and the position coordinate of the intermediate position corresponding to the one of the jigs 31 is p1 ( X ₁ , Y ₁ , Z _{1 ), the position coordinates p2 (X 2} , Y ₂ , Z ₂ ) of the target position corresponding to one of the fixtures 31, and the reference position corresponding to the other fixture 31 Is p0'(X ₀ ', Y ₀ ', Z ₀ '), then the position coordinates of the middle position corresponding to the other jig 31 is p1'(X ₁ ', Y ₁ ', Z ₁ '), where X ₁ '= X ₀ '+(X ₁ -X ₀ ), Y ₁ '= Y ₀ ', Z ₁ '= Z ₀ '; the target position corresponding to the other jig 31 The position coordinate is p2' (X ₂ ', Y ₂ ', Z ₂ '), where X ₂ '= X ₀ '+(X ₂ -X ₀ ), Y ₂ = Y ₀ ', Z ₂ '= Z ₀ '.

For example, suppose p0 (X ₀ , Y ₀ , Z ₀ ) is (1, 0, 0), p1 (X ₁ , Y ₁ , Z ₁ ) is (3, 0, 0), p2 (X ₂ , Y ₂ , Z ₂ ) is (6, 0, 0), p0' (X ₀ ', Y ₀ ', Z ₀ ') is (4, 5, 6), then X ₁ '=6, X ₂ '=9, you can calculate p1' as (6, 5, 6) and p2' (9, 5, 6).

In step S14, the computer device 1 determines whether the position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position corresponding to each of the plurality of jigs 31 have been obtained.

If the position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position corresponding to other jigs 31 have not yet been obtained, return to step S9, and obtain the corresponding positions of other jigs 31 according to steps S9-S13 The position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position.

In an embodiment, if the position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position corresponding to each of the plurality of jigs 31 have been obtained, the process can be ended or It may further include step S15.

In step S15, the computer device 1 controls the machine according to the obtained position coordinates of the reference position corresponding to each of the plurality of jigs 31, the position coordinates of the intermediate position, and the position coordinates of the target position. The arm 2 grabs the target object 40 from the corresponding jig 31 or places the target object 40 on the corresponding jig 31.

For example, suppose that the position coordinates of the reference position p0' corresponding to a certain fixture F is (4, 5, 6), the position coordinates of the intermediate position p1' are (6, 5, 6), and the target position p2' The position coordinates of is (9, 5, 6). When it is necessary to control the robotic arm 2 to grab the target object T from the fixture F, it is first based on the reference position p0' corresponding to the fixture F The position coordinates (4, 5, 6) are used to control the robot arm 2 to move to the reference position p0', and then the position coordinates based on the intermediate position p1' corresponding to the fixture F are (6, 5, 6) ), controlling the robot arm 2 to move from the reference position p0' to the intermediate position p1', and then based on the position coordinates of the target position p2' corresponding to the fixture F (9, 5, 6) , Control the robotic arm 2 to move from the intermediate position p1' to the target position p2', and then at the target position p2', control the robotic arm 2 to perform a grasping operation from the jig 31 Grab the target object 40.

According to the above description, the method for determining the coordinates of the robot arm in the embodiment of the present invention only obtains the position coordinates of the reference position corresponding to any jig 31, the position coordinates of the intermediate position, and the position coordinates of the target position. It is necessary to manually search for the position coordinates of the reference position of the other jig 31 to obtain the position coordinates of the intermediate position of the other jig 31 and the position coordinates of the target position. By using the present invention, there is no need to modify the existing jigs and environment, shorten the time to find the position coordinates of the intermediate position and the target position corresponding to each jig 31, and at the same time improve the flexibility of factory automation tangent.

The above-mentioned figures 3 and 4 describe the method for determining the coordinates of the robot arm of the present invention in detail. With reference to FIGS. 5 and 6, respectively, the functional modules of the software device for realizing the method for determining the coordinates of the robot arm and the realization of the coordinates of the robot The hardware device architecture of the determination method is introduced.

It should be understood that the embodiments are only for illustrative purposes, and are not limited by this structure in the scope of the patent application.

Referring to FIG. 5, it is a functional module diagram of a robot arm coordinate determination system 30 provided by a preferred embodiment of the present invention.

In some embodiments, the robot arm coordinate determination system 30 runs in a computer device. The robot arm coordinate determination system 30 may include multiple functional modules composed of code segments. The computer program codes of each program segment in the robot arm coordinate determination system 30 can be stored in the memory of the computer device and executed by at least one processor of the computer device to realize the robot arm coordinate determination (see Description of Figure 3 and Figure 4).

In this embodiment, the robot arm coordinate determination system 30 can be divided into multiple functional modules according to the functions it performs. The functional modules may include: an execution module 301 and a reading module 302. The module referred to in the present invention refers to a series of computer program segments that can be executed by at least one processor and can complete fixed functions, and are stored in a memory. In this embodiment, the functions of each module will be described in detail in subsequent embodiments.

In this embodiment, the user first places the target object 40 provided with the marker 41 on one of the plurality of jigs 31, and moves the mechanical arm 2 so that the camera 24 can take pictures The marker 41 on the target object 40 placed on one of the jigs 31.

Preferably, the robot arm 2 is moved so that the camera 24 can photograph each of the multiple jigs 31.

The execution module 301 controls the camera 24 to take a first photo including the marker 41, and obtains the first position coordinates of the marker 41 based on the first photo obtained by the shooting.

As mentioned above, the marker 41 can be ArUco Markers. Thus, the execution module 301 can use the OpenCV function library (ArUco Libray) to obtain the first position coordinates of the marker 41 based on the first photo of the marker 41 obtained by shooting. The first position coordinate of the marker 41 is also the coordinate of the marker 41 in the three-dimensional coordinate system where the robot arm 2 is located.

The execution module 301 calculates the position coordinates of the reference position corresponding to one of the jigs 31 based on the first position coordinates of the marker 41.

It should be noted that the reference position corresponding to any jig 31 mentioned in this embodiment means that the robot arm 2 needs to place the target object 40 on the any jig 31, or needs to be treated from any jig 31. During the process of clamping the target object 40 on the tool 31, a position point that needs to be passed.

Taking the first position coordinates of the marker 41 as (X _m1 , Y _m1 , Z _m1 ) as an example, the position coordinates of the reference position corresponding to one of the jigs 31 may be (X _m1 , Y _m1 , Z _m1 + d). That is, the abscissa and ordinate of the position coordinate of the reference position corresponding to one of the jigs 31 are the same as the abscissa and ordinate of the first position coordinate of the marker 41, and the one of the jigs 31 corresponds to The vertical coordinate of the position coordinate of the reference position is equal to the vertical coordinate of the first position coordinate of the marker 41 plus the preset value d.

In this embodiment, the value of d is an empirical value. For example, d is equal to 30cm, 25cm, or other values. The value of d can be preset according to the operating environment and operating experience. Preferably, d is equal to 30 cm.

The execution module 301 controls the robot arm 2 to move to the reference position corresponding to the one of the fixtures 31 based on the position coordinates of the reference position corresponding to the one of the fixtures 31.

The user moves the mechanical arm 2 from the reference position corresponding to one of the jigs 31 to the intermediate position corresponding to the one of the jigs 31.

It should be noted that the intermediate position corresponding to any jig 31 mentioned in this embodiment is different from the reference position corresponding to any jig 31.

It should be noted that the intermediate position corresponding to any jig 31 mentioned in this embodiment can be defined as that the robot arm 2 needs to place the target object 40 on the any jig 31 or needs to be treated from the any jig 31. A position point that the tool 31 needs to pass during the process of gripping the target object 40, and the position point is between the reference position and the target position.

In one embodiment, the intermediate position corresponding to the one of the fixtures 31 is directly below the reference position corresponding to the one of the fixtures 31, and the distance from the intermediate position corresponding to the one of the fixtures 31 is The reference position corresponding to one of the jigs 31 is a preset value such as 20 cm.

The reading module 302 reads the position coordinates of the current position of the robot arm 2 (that is, the intermediate position corresponding to one of the jigs 31) from the three-dimensional coordinate system where the robot arm 2 is located, The read position coordinates are used as the position coordinates of the intermediate position corresponding to one of the jigs 31.

The user moves the robotic arm 2 from the intermediate position corresponding to one of the jigs 31 to the target position corresponding to the one of the jigs 31.

It should be noted that the target position corresponding to any jig 31 mentioned in this embodiment can be defined as the robot arm 2 placing the target object 40 on the jig 31 or from the jig 31 The position point when the target object 40 is clamped. In other words, the target position corresponding to any one of the jigs 31 also refers to the position point at which the robot arm 2 performs the releasing operation or the grasping operation.

The reading module 302 reads the position coordinates of the current position of the robot arm 2 (that is, the target position corresponding to one of the jigs 31) from the three-dimensional coordinate system where the robot arm 2 is located, Using the read position coordinates as the position coordinates of the target position corresponding to one of the fixtures 31, the computer device 1 obtains the position coordinates and the middle of the reference position corresponding to the one fixture 31 The location coordinates of the location, and the location coordinates of the target location.

The user moves the target object 40 provided with the marker 41 from one of the jigs 31 to the other jig 31 of the plurality of jigs 31, and moves the robot arm 2 so that the camera 24 can photograph the marker 41 on the target object 40 placed on the other jig 31.

The execution module 301 controls the camera 24 to take a second photo including the marker 41, and obtains the second position coordinates of the marker 41 based on the second photo obtained by the shooting.

Similarly, the execution module 301 can use the OpenCV function library (ArUco Libray) to obtain the second position coordinates of the marker 41 based on the second photo of the marker 41 obtained by shooting. The second position coordinate of the marker 41 is also the coordinate of the marker 41 in the three-dimensional coordinate system where the robot arm 2 is located.

The execution module 301 calculates the position coordinates of the reference position corresponding to the another jig 31 based on the second position coordinates of the marker 41.

Taking the second position coordinates of the marker 41 as (X _m2 , Y _m2 , Z _m2 ) as an example, the position coordinates of the reference position corresponding to the other jig 31 may be (X _m2 , Y _m2 , Z m2 _m2 +d). That is, the abscissa and ordinate of the position coordinate of the reference position corresponding to the other jig 31 are the same as the abscissa and ordinate of the second position coordinate of the marker 41, and the other jig 31 corresponds to The vertical coordinate of the position coordinate of the reference position is equal to the vertical coordinate of the second position coordinate of the marker 41 plus the preset value d.

As mentioned above, in this embodiment, the value of d is an empirical value. For example, d is equal to 30cm, 25cm, or other values. The value of d can be preset according to the operating environment and operating experience. Preferably, d is equal to 30 cm.

The execution module 301 controls the robot arm 2 to move to the reference position corresponding to the other jig 31 based on the position coordinates of the reference position corresponding to the other jig 31.

The execution module 301 is based on the position coordinates of the reference position corresponding to the other jig 31, and the position coordinates of the intermediate position corresponding to the one jig 31 and the reference position corresponding to the one jig 31 The relative relationship between the position coordinates calculates the position coordinates of the intermediate position corresponding to the other jig 31; and the position coordinates based on the reference position corresponding to the other jig 31, and the position of the one jig 31 The relative relationship between the position coordinates of the corresponding target position and the position coordinates of the reference position corresponding to one of the jigs 31 is calculated to calculate the position coordinates of the target position corresponding to the other jig 31.

Specifically, it is assumed that the position coordinate of the reference position corresponding to one of the jigs 31 is p0 (X ₀ , Y ₀ , Z ₀ ), and the position coordinate of the intermediate position corresponding to the one of the jigs 31 is p1 ( X ₁ , Y ₁ , Z _{1 ), the position coordinates p2 (X 2} , Y ₂ , Z ₂ ) of the target position corresponding to one of the fixtures 31, and the reference position corresponding to the other fixture 31 Is p0'(X ₀ ', Y ₀ ', Z ₀ '), then the position coordinates of the middle position corresponding to the other jig 31 is p1'(X ₁ ', Y ₁ ', Z ₁ '), where X ₁ '= X ₀ '+( X ₁ -X ₀ ), Y ₁ '= Y ₀ ', Z ₁ '= Z ₀ '; the target position corresponding to the other jig 31 The position coordinate is p2' (X ₂ ', Y ₂ ', Z ₂ '), where X ₂ '= X ₀ '+(X ₂ -X ₀ ), Y ₂ = Y ₀ ', Z ₂ '= Z ₀ '.

For example, suppose p0 (X ₀ , Y ₀ , Z ₀ ) is (1, 0, 0), p1 (X ₁ , Y ₁ , Z ₁ ) is (3, 0, 0), p2 (X ₂ , Y ₂ , Z ₂ ) is (6, 0, 0), p0' (X ₀ ', Y ₀ ', Z ₀ ') is (4, 5, 6), then X ₁ '=6, X ₂ '=9, you can calculate p1' as (6, 5, 6) and p2' (9, 5, 6).

The execution module 301 determines whether the position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position corresponding to each of the plurality of jigs 31 have been obtained.

If the position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position corresponding to other jigs 31 have not yet been obtained, the user will remove the target object 40 provided with the marker 41 from the Said one of the jigs 31 is moved to the other jigs 31 of the plurality of jigs 31, and the robot arm is moved so that the camera can photograph the markers on the target object 40 placed on the other jigs 31 41. From this, the position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position corresponding to the other jigs 31 are obtained.

In one embodiment, if the position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position corresponding to each of the plurality of jigs 31 have been obtained, the module 301 is executed According to the obtained position coordinates of the reference position corresponding to each of the plurality of jigs 31, the position coordinates of the intermediate position, and the position coordinates of the target position, the robot arm 2 is controlled from the corresponding treatment Grasp the target object 40 on the tool 31 or place the target object 40 on the corresponding jig 31.

For example, suppose that the position coordinates of the reference position p0' corresponding to a certain fixture F is (4, 5, 6), the position coordinates of the intermediate position p1' are (6, 5, 6), and the target position p2' The position coordinates of is (9, 5, 6). When it is necessary to control the robotic arm 2 to grab the target object T from the fixture F, it is first based on the reference position p0' corresponding to the fixture F The position coordinates (4, 5, 6) are used to control the robot arm 2 to move to the reference position p0', and then the position coordinates based on the intermediate position p1' corresponding to the fixture F are (6, 5, 6) ), controlling the robot arm 2 to move from the reference position p0' to the intermediate position p1', and then based on the position coordinates of the target position p2' corresponding to the fixture F (9, 5, 6) , Control the robotic arm 2 to move from the intermediate position p1' to the target position p2', and then at the target position p2', control the robotic arm 2 to perform a grasping operation from the jig 31 Grab the target object 40.

According to the above description, the method for determining the coordinates of the robot arm in the embodiment of the present invention only obtains the position coordinates of the reference position corresponding to any jig 31, the position coordinates of the intermediate position, and the position coordinates of the target position. It is necessary to manually search for the position coordinates of the reference position of the other jig 31 to obtain the position coordinates of the intermediate position of the other jig 31 and the position coordinates of the target position. By using the present invention, there is no need to modify the existing jigs and environment, shorten the time to find the position coordinates of the intermediate position and the target position corresponding to each jig 31, and at the same time improve the flexibility of factory automation tangent.

Refer to FIG. 6, which is a schematic structural diagram of a computer device provided by a preferred embodiment of the present invention.

In a preferred embodiment of the present invention, the computer device 3 includes a storage 31 and at least one processor 32 that are electrically connected to each other.

Those skilled in the art should understand that the structure of the computer device 3 shown in FIG. 1 does not constitute a limitation of the embodiment of the present invention. The computer device 3 may also include more or less other hardware or software than shown in the figure. Or different component arrangements. For example, the computer device 3 may also include components such as a display screen.

In some embodiments, the computer device 3 includes a terminal that can automatically perform numerical calculation and/or information processing according to pre-set or stored instructions. Its hardware includes but is not limited to a microprocessor, a dedicated integrated circuit, Programmable gate arrays, word processors and embedded devices, etc.

It should be noted that the computer device 3 is only an example, and other existing or future electronic products that can be adapted to the present invention should also be included in the protection scope of the present invention and included here by reference.

In some embodiments, the storage 31 can be used to store program codes and various data of a computer program. For example, the storage 31 may be used to store the robot arm coordinate determination system 30 installed in the computer device 3, and realize high-speed and automatic program or data access during the operation of the computer device 3. The storage 31 may include a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable Read-Only Memory, PROM), and an erasable programmable read-only memory (Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically-Erasable Programmable Read-Only Memory (Electrically-Erasable Programmable Read-Only Memory, EEPROM), Compact Disc Read-Only Memory (CD-ROM) or other optical disk storage, magnetic disk storage, tape storage, or any other computer-readable storage medium that can be used to carry or store data .

In some embodiments, the at least one processor 32 may be composed of an integrated circuit. For example, it can be composed of a single packaged integrated circuit, or it can be composed of multiple packaged integrated circuits with the same function or with different functions, including one or more central processing units (CPU), micro-processing Combinations of processors, digital word processing chips, graphics processors, and various control chips. The at least one processor 32 is the control core (Control Unit) of the computer device 3, which uses various interfaces and lines to connect the various components of the entire computer device 3, by running or executing programs stored in the storage 31 or Modules and call data stored in the storage 31 to perform various functions of the computer device 3 and process data.

Although not shown, the computer device 3 may also include a power source (such as a battery) for supplying power to various components. Preferably, the power source may be logically connected to the at least one processor 32 through a power management device, so as to be realized by the power management device. Manage functions such as charging, discharging, and power management. The power supply may also include one or more DC or AC power supplies, recharging devices, power failure detection circuits, power converters or inverters, power supply status indicators and other arbitrary components. The computer device 3 may also include a variety of sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

It should be understood that the embodiments are only for illustrative purposes, and are not limited by this structure in the scope of the patent application.

The above-mentioned integrated unit realized in the form of a software function module can be stored in a computer readable storage medium. The above-mentioned software function module includes several instructions, which are used to make a computer device (can be a vehicle-mounted computer, etc.) or a processor execute part of the method described in each embodiment of the present invention.

In a further embodiment, with reference to FIG. 5, the at least one processor 32 can execute the operating device of the computer device 3 and various installed applications (such as the robotic arm coordinate determination system 30).

The storage 31 stores computer program codes, and the at least one processor 32 can call the computer program codes stored in the storage 31 to perform related functions. For example, each module described in FIG. 5 is a computer program code stored in the memory 31 and executed by the at least one processor 32, so as to realize the function of each module, such as determining a mechanical arm The coordinates.

In an embodiment of the present invention, the storage 31 stores a plurality of instructions, and the plurality of instructions are executed by the at least one processor 32 to determine the coordinates of the robotic arm.

Specifically, the method for the at least one processor 32 to execute the above-mentioned multiple instructions to determine the coordinates of the robotic arm is shown in conjunction with FIG. 3 and FIG. 4, and will not be repeated here.

In the several embodiments provided by the present invention, it should be understood that the disclosed computer-readable storage medium, device, and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation.

The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple networks Unit. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional modules in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be realized either in the form of hardware, or in the form of hardware plus software functional modules.

For those skilled in the art, it is obvious that the present invention is not limited to the details of the above exemplary embodiments, and the present invention can be implemented in other specific forms without departing from the spirit or basic characteristics of the present invention. Therefore, no matter from which point of view, the embodiments should be regarded as exemplary and non-restrictive. The scope of the present invention is defined by the appended patent scope and not by the above description, so it is intended to fall within All changes within the meaning and scope of the equivalent elements in the scope of the patent application are included in the present invention. Any reference signs in the scope of the patent application shall not be regarded as limiting the scope of the patent application involved. In addition, it is obvious that the word "including" does not exclude other elements or the singular number does not exclude the plural number. The multiple units or devices stated in the device patent application scope can also be implemented by one unit or device through software or hardware. Words such as first and second are used to denote names, but do not denote any specific order.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be Modifications or equivalent replacements are made without departing from the spirit and scope of the technical solution of the present invention.

1: computer device 2: Robotic arm 3: External fixture 31: Fixture 21: Pedestal 22: Arm 23: Fixture 24: Camera 40: target object 41: Marker 30: Robotic arm coordinate determination system 301: Execution module 302: read module 32: processor 31: Storage

In order to more clearly describe the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are merely It is an embodiment of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on the provided drawings without creative work. Fig. 1 is an application environment diagram of a method for determining coordinates of a robotic arm provided by a preferred embodiment of the present invention. Figure 2 shows the robotic arm and fixture. Figures 3 and 4 are flowcharts of a method for determining the coordinates of a robotic arm provided by a preferred embodiment of the present invention. Fig. 5 is a functional module diagram of a system for determining the coordinates of a robotic arm provided by a preferred embodiment of the present invention. FIG. 6 is a structural diagram of a computer device provided by a preferred embodiment of the present invention. The following specific embodiments will further illustrate the present invention in conjunction with the above-mentioned drawings.

no.

Claims (8)

A method for determining the coordinates of a mechanical arm applied to a computer device, wherein the method includes: The setting step is to place the target object with the marker on one of the multiple jigs; In the first shooting step, controlling the camera of the robotic arm to take a first photo including the marker, and obtaining the first position coordinates of the marker based on the first photo obtained by the shooting; The first calculation step is to calculate the position coordinate of the reference position corresponding to one of the jigs based on the first position coordinate of the marker; The first control step is to control the robot arm to move to the reference position corresponding to the one of the fixtures based on the position coordinates of the reference position corresponding to the one of the fixtures; The first moving step is to move the robotic arm from the reference position corresponding to one of the jigs to the intermediate position corresponding to the one of the jigs; The first reading step is to read the position coordinates of the current position of the robot arm from the three-dimensional coordinate system where the robot arm is located, and use the read position coordinates as the middle corresponding to one of the jigs. The position coordinates of the position; The second moving step is to move the robotic arm from the intermediate position corresponding to one of the jigs to the target position corresponding to the one of the jigs; The second reading step is to read the position coordinates of the current position of the robot arm from the three-dimensional coordinate system where the robot arm is located, and use the read position coordinates as the target corresponding to one of the jigs The position coordinates of the position, thereby obtaining the position coordinates of the reference position corresponding to one of the jigs, the position coordinates of the intermediate position, and the position coordinates of the target position; The third moving step is to move the target object provided with the marker from one of the jigs to another jig of the plurality of jigs; The second photographing step is to control the camera to take a second photograph including the marker, and obtain the second position coordinates of the marker based on the second photograph obtained by the photographing; The second calculation step is to calculate the position coordinates of the reference position corresponding to the another jig based on the second position coordinates of the marker; The second control step is to control the robot arm to move to the reference position corresponding to the other jig based on the position coordinates of the reference position corresponding to the other jig; The third calculation step is based on the position coordinates of the reference position corresponding to the other jig, and the position coordinates of the intermediate position corresponding to one of the jigs and the position coordinates of the reference position corresponding to the one jig The relative relationship between calculating the position coordinates of the intermediate position corresponding to the other jig; and the position coordinates based on the reference position corresponding to the other jig, and the target position corresponding to the one jig The relative relationship between the position coordinates and the position coordinates of the reference position corresponding to the one of the fixtures is calculated to calculate the position coordinates of the target position corresponding to the other fixture; and In the determining step, when it is determined that the position coordinates of the reference position, the position coordinates of the intermediate position, and the position coordinates of the target position corresponding to other jigs among the plurality of jigs have not yet been obtained, the third moving step is triggered . The method for determining the coordinates of a robotic arm as described in item 1 of the scope of patent application, wherein, in the first calculation step, the abscissa and ordinate of the position coordinates of the reference position corresponding to the one of the jigs are the same as those of the mark The horizontal coordinate and the vertical coordinate of the first position coordinate of the object are the same, and the vertical coordinate of the position coordinate of the reference position corresponding to one of the fixtures is equal to the vertical coordinate of the first position coordinate of the marker plus the preset value d . The method for determining the coordinates of a robotic arm as described in item 1 of the scope of patent application, wherein, in the third calculation step, the position coordinates of the reference position corresponding to one of the jigs are p0(X ₀ , Y ₀ , Z ₀ ), the position coordinate of the intermediate position corresponding to one of the fixtures is p1 (X ₁ , Y ₁ , Z ₁ ), and the position coordinate of the target position corresponding to one of the fixtures is p2 (X ₂ , Y ₂ , Z ₂ ), and the position coordinates of the reference position corresponding to the other jig is p0' (X ₀ ', Y ₀ ', Z ₀ '), the middle position of the other jig is The position coordinate is p1' (X ₁ ', Y ₁ ', Z ₁ '), where X ₁ '= X ₀ '+( X ₁ -X ₀ ), Y ₁ '= Y ₀ ', Z ₁ '= Z ₀ '; the position coordinate of the target position corresponding to the other fixture is p2' (X ₂ ', Y ₂ ', Z ₂ '), where X ₂ '= X ₀ '+(X ₂ -X ₀ ), Y ₂ = Y ₀ ', Z ₂ '= Z ₀ '. The method for determining the coordinates of a robotic arm as described in item 1 of the scope of patent application, wherein the method further includes the steps: According to the obtained position coordinates of the reference position corresponding to each of the plurality of jigs, the position coordinates of the intermediate position, and the position coordinates of the target position, the robot arm is controlled to grasp the corresponding jig Take the target object, or place the target object on the corresponding fixture. A computer device, wherein the computer device includes a storage and a processor, the storage is used to store a plurality of modules, the plurality of modules are executed by the processor, and the plurality of modules include: The execution module is used to control the camera of the robot arm to take a first photo including the marker, and to obtain the first position coordinates of the marker based on the first photo obtained by the shooting, wherein the marker is set On the target object, the target object is placed on one of the multiple jigs; The execution module is further configured to calculate the position coordinate of the reference position corresponding to the one of the jigs based on the first position coordinate of the marker; The execution module is further configured to control the robot arm to move to the reference position corresponding to the one of the jigs based on the position coordinates of the reference position corresponding to the one of the jigs; The reading module is used to read from the three-dimensional coordinate system of the robot arm when the robot arm moves from the reference position corresponding to the one of the jigs to the intermediate position corresponding to the one of the jigs Read the position coordinates of the current position of the robotic arm, and use the read position coordinates as the position coordinates of the intermediate position corresponding to one of the jigs; The reading module is also used for when the robot arm moves from the intermediate position corresponding to one of the jigs to the target position corresponding to the one of the jigs, from the three-dimensional Read the position coordinates of the current position of the robot arm in the coordinate system, and use the read position coordinates as the position coordinates of the target position corresponding to one of the fixtures, thereby obtaining one of the fixtures The position coordinates of the corresponding reference position, the position coordinates of the intermediate position, and the position coordinates of the target position; The execution module is further configured to control the camera to shoot when the target object provided with the marker moves from one of the jigs to another jig of the plurality of jigs A second photo including the marker, and obtaining the second position coordinates of the marker based on the second photo obtained by the shooting; The execution module is further configured to calculate the position coordinates of the reference position corresponding to the another jig based on the second position coordinates of the marker; The execution module is further configured to control the robot arm to move to the reference position corresponding to the another jig based on the position coordinates of the reference position corresponding to the another jig; The execution module is further configured to be based on the position coordinates of the reference position corresponding to the other jig, and the position coordinates of the intermediate position corresponding to the one jig and the reference corresponding to the one jig The relative relationship between the position coordinates of the position calculates the position coordinates of the intermediate position corresponding to the other fixture; and the position coordinates based on the reference position corresponding to the other fixture, and the one corresponding to the fixture The relative relationship between the position coordinates of the target position and the position coordinates of the reference position corresponding to one of the fixtures is used to calculate the position coordinates of the target position corresponding to the other fixture. The computer device described in item 5 of the scope of patent application, wherein the abscissa and ordinate of the position coordinate of the reference position corresponding to one of the jigs and the abscissa and ordinate of the first position coordinate of the marker are If the coordinates are the same, the vertical coordinate of the position coordinate of the reference position corresponding to one of the jigs is equal to the vertical coordinate of the first position coordinate of the marker plus the preset value d. The computer device described in item 5 of the scope of patent application, wherein the position coordinate of the reference position corresponding to one of the fixtures is p0 (X ₀ , Y ₀ , Z ₀ ), and the one of the fixtures corresponds to The position coordinate of the middle position of the is p1 (X ₁ , Y ₁ , Z ₁ ), the position coordinate of the target position corresponding to one of the fixtures is p2 (X ₂ , Y ₂ , Z ₂ ), and the other The position coordinate of the reference position corresponding to the fixture is p0' (X ₀ ', Y ₀ ', Z ₀ '), and the position coordinate of the intermediate position corresponding to the other fixture is p1' (X ₁ ', Y ₁ ', Z ₁ '), where X ₁ '= X ₀ '+( X ₁ -X ₀ ), Y ₁ '= Y ₀ ', Z ₁ '= Z ₀ '; the other fixture corresponds to The position coordinate of the target position is p2' (X ₂ ', Y ₂ ', Z ₂ '), where X ₂ '= X ₀ '+(X ₂ -X ₀ ), Y ₂ = Y ₀ ', Z ₂ '= Z ₀ '. As the computer device described in item 5 of the scope of patent application, the execution module is also used for: According to the obtained position coordinates of the reference position corresponding to each of the plurality of jigs, the position coordinates of the intermediate position, and the position coordinates of the target position, the robot arm is controlled to grasp the corresponding jig Take the target object, or place the target object on the corresponding fixture.

Images