CN208391427U - A kind of screw hole positioning of view-based access control model servo and lock unload screw device - Google Patents
A kind of screw hole positioning of view-based access control model servo and lock unload screw device Download PDFInfo
- Publication number
- CN208391427U CN208391427U CN201721641545.6U CN201721641545U CN208391427U CN 208391427 U CN208391427 U CN 208391427U CN 201721641545 U CN201721641545 U CN 201721641545U CN 208391427 U CN208391427 U CN 208391427U
- Authority
- CN
- China
- Prior art keywords
- screw
- mechanical arm
- screw hole
- positioning
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 claims abstract description 29
- 238000005259 measurement Methods 0.000 claims abstract description 11
- 230000005540 biological transmission Effects 0.000 claims abstract description 5
- 230000000007 visual effect Effects 0.000 claims description 31
- 238000004891 communication Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 3
- 210000000245 forearm Anatomy 0.000 abstract 1
- 230000004807 localization Effects 0.000 abstract 1
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 abstract 1
- 230000006870 function Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000009466 transformation Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000005314 correlation function Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000005389 magnetism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Landscapes
- Manipulator (AREA)
Abstract
The utility model relates to a kind of positioning of the screw hole of view-based access control model servo and lock to unload screw device, screw is unloaded for positioning screw hole and lock, including vision measurement module and control execution module, carries out data transmission and communicate by network between the vision measurement module and the control execution module；The vision measurement module includes binocular camera, coarse positioning camera and laser dotting device；The control execution module includes mechanical arm unit and computer, wherein the mechanical arm unit includes that large torque tightens rifle, mechanical arm forearm, mechanical arm large arm, mechanical arm control cabinet, pedestal and screw socket；The large torque tightens the end that rifle, the screw socket, the binocular camera and the laser dotting device are located at the mechanical arm unit.The utility model can largely improve the positioning accuracy of screw；It is that mobile vehicle increases working range using mechanical arm, can also be locked in the environment of worker's inconvenience and unload screw；It is proposed a kind of screw or screw hole localization method from point to surface.
Description
Technical Field
The utility model relates to a mechanical assembly technical field especially relates to a screw location and device of screw are unloaded to lock based on visual servoing.
Background
In the manufacturing process of mechanical equipment, each part needs to be assembled, the process flow of assembly directly influences the manufacturing efficiency of the equipment, and mounting screws are the most basic assembly process. The efficiency of screw assembly directly affects the efficiency of manufacturing. In addition, electronic products are rapidly developed and increasingly demanded, and therefore mass production is required. On the assembly line of electronic product, there are a lot of screws to lock and unload equally, and some operational environment spaces are narrow and small, or have strong magnetism, forceful electric power etc. and do not suit staff's operating conditions, and then influence lock and unload efficiency.
Chinese patent document No. CN102240902B discloses an automatic screw driving machine, the screw positioning device includes a die and a positioning slot which are connected, the die includes a die body and a clamping element hinged on the die body, and the clamping element realizes opening and closing actions in the vertical direction. However, the screw positioning device has more parts and complex structure, and the clamping element is vertically opened and closed, so that the occupied space in the vertical direction is large, a large insertion length needs to be reserved for the screwdriver to prevent interference, in addition, the clamping element does not clamp the screw by 360 degrees, the screw may have deflection ectopy, and the reliability of the automatic screw screwing machine is not high. Chinese patent application No. 201510352012.5 discloses a virtual screw positioning system and method, the method includes: shooting a global picture, and calculating position information of all screws or screw holes; the micro control unit transmits the position information of the screw or the screw hole to be locked to the controller; the controller moves the camera to a photographing position of a screw or a screw hole to be locked; triggering a camera to take a picture by the micro control unit; calculating again to obtain the corrected position information of the screw or the screw hole to be locked, and transmitting the corrected position information to the controller; and the servo motor controls the screw machine to move to the position of the screw or the screw hole to be locked according to the second control information. The method adopts a virtual instrument positioning technology, has the defect of low positioning precision compared with a coordinate calibration technology, and the whole process of the method is only positioned twice, namely rough positioning and secondary positioning respectively, so that the positioning times are too few, and the positioning precision is difficult to ensure.
Therefore, in order to solve the above problems and improve the production efficiency, it is necessary to provide a device to effectively realize the positioning of the screw hole and the locking and unlocking of the screw.
SUMMERY OF THE UTILITY MODEL
The utility model provides a screw or screw location and lock screw device of unloading based on visual servo can realize screw or screw location and utilize the terminal big moment of torsion of loading of arm unit to screw on the target work piece to screw lock the operation of unloading based on the picture that the camera was gathered under the complex environment. If a workpiece has a plurality of screws to be locked and unlocked, only two screws with obvious characteristics need to be positioned, and then the positions of other screws can be calculated through the relevant geometric relationship, so that the positioning precision and efficiency of the screws can be greatly improved.
In order to achieve the above purpose, the utility model adopts the following technical scheme: a screw positioning and screw locking and unlocking device based on visual servo is characterized by comprising a visual measurement module and a control execution module, wherein the visual measurement module and the control execution module are in data transmission and communication through a network; the vision measuring module comprises a binocular camera, a coarse positioning camera and a laser dotter; the control execution module comprises a mechanical arm unit and a computer, wherein the mechanical arm unit comprises a large-torque tightening gun, a mechanical arm small arm, a mechanical arm large arm, a mechanical arm control box, a base and a screw sleeve; the high-torque tightening gun, the screw sleeve, the binocular camera and the laser dotter are located at the tail end of the mechanical arm unit.
Furthermore, the computer is used for receiving and processing information and then generating a motion control instruction, the mechanical arm control box controls the motion of the mechanical arm unit by receiving the motion control instruction, a driving servo motor is arranged in the base, one end of the mechanical arm large arm is connected with the base, the other end of the mechanical arm large arm is connected with one end of the mechanical arm small arm, the other end of the mechanical arm small arm is connected with the binocular camera, and the high-torque tightening gun is connected with the screw sleeve.
Furthermore, the mechanical arm control box drives the servo motor to rotate according to the motion control instruction, so as to drive the large-torque tightening gun or the screw sleeve or the binocular camera or the laser dotter at the tail end of the mechanical arm unit to move towards the direction close to the target screw or the screw hole.
Furthermore, the coarse positioning camera is used for confirming position information of a target screw or a screw hole, a template matching method is adopted, similarity between the acquired image of the target screw or the screw hole and each screw or screw hole in the screw hole template is calculated based on the set screw hole template, so as to find the position of the target screw or the screw hole, and the center coordinate of the target screw or the screw hole based on the coarse positioning camera coordinate system is fitted.
Further, the center coordinates of the target screw or the screw hole in the coordinate system of the coarse positioning camera are converted into the center coordinates of the target screw or the screw hole in the coordinate system of the base in a rotating and translating manner.
Furthermore, the binocular camera is used for accurately positioning the target screw or screw hole, confirming the posture information of the target screw or screw hole, searching the target screw or screw hole by adopting a matching method based on region correlation, matching image windows of fixed size shot by the left camera and the right camera of the binocular camera, and measuring the correlation between the two image windows based on a similarity criterion.
Further, the method for confirming the region in the matching method based on the region correlation is to enlarge a local region with the target screw or the screw hole as a center of a circle, mark laser mark points on the local region by using the laser dotter, select three feature points from the laser mark points, and determine a plane by using the three feature points.
Further, when the high-torque tightening gun is aligned with the target screw hole, a screw placed in the high-torque tightening gun is screwed into the target screw hole.
Further, when the screw sleeve is aligned with the target screw, the target screw to be disassembled is disassembled.
Furthermore, the screw hole positioning and screw locking and unlocking device based on visual servo can be connected with terminal equipment, manual operation is added in real time, and remote real-time monitoring and regulation are achieved.
The utility model provides a beneficial effect that technical scheme brought is: (1) the screws are accurately positioned by using the two sets of cameras, so that the positioning accuracy of the screws can be improved to a great extent; (2) the mechanical arm is used as a movable carrier, so that the working range is enlarged, and the locking and unlocking work of screws can be carried out in an environment where workers are inconvenient to go; and (3) providing a point-to-surface screw or screw hole positioning method, firstly determining the specific position of one screw or screw hole, and then determining the position relation between the other screws or screw holes and the determined screw or screw hole.
Drawings
FIG. 1 is a schematic diagram of the apparatus of the present invention;
FIG. 2 is a schematic structural diagram of the device of the present invention;
FIG. 3 is a schematic diagram of the servo control of the apparatus of the present invention;
FIG. 4 is a diagram of the position relationship of the screw holes of the workpiece to be detected according to the present invention;
fig. 5 is a flow chart of the inventive device.
The reference numbers in the drawings: 1-a large-torque tightening gun, 2-a mechanical arm small arm, 3-a mechanical arm large arm, 4-a mechanical arm control box, 5-a computer, 6-a base and 7-a binocular CCD camera; 8-a screw or a screw hole to be locked and disassembled, 9-a workpiece to be overhauled, 10-a rough positioning camera, 11-a screw sleeve, 12-a laser dotter, 20-a vision measuring module, 30-a control execution module, 31-a mechanical arm unit, 40-a network, 50-a memory and 60-terminal equipment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, embodiments of the present invention will be further described below with reference to the accompanying drawings.
The utility model provides a screw location and lock screw device of unloading based on visual servo for screw and lock screw of location are unloaded, as shown in FIG. 1, screw location and lock screw device of unloading based on visual servo include visual measurement module 20 and control execution module 30, control execution module 30 includes arm unit 31 and computer 5, visual measurement module 20 with carry out data transmission and communication through network 40 between the control execution module 30.
As shown in fig. 2, the screw hole positioning and screw locking and unlocking device based on visual servo is schematically shown in the structural diagram, the visual measurement module 20 includes a binocular camera 7, a coarse positioning camera 10 and a laser dotting device 12, the position of the coarse positioning camera 10 relative to a workpiece 9 to be overhauled is determined, the binocular camera 7 is connected with the laser dotting device 12, only one camera of the binocular camera 7 is displayed in fig. 2, and the other camera is not displayed on the back. Preferably, the binocular camera 7 is a binocular CCD camera. The mechanical arm unit 31 comprises a large-torque tightening gun 1, a small mechanical arm 2, a large mechanical arm 3, a mechanical arm control box 4, a base 6 and a screw sleeve 11, wherein the power supply of the screw hole positioning and screw locking and unlocking device based on visual servo is arranged in the mechanical arm control box 4, a driving servo motor is arranged in the base 6, one end of the large mechanical arm 3 is connected with the base 6, the other end of the large mechanical arm 3 is connected with one end of the small mechanical arm 2, the other end of the small mechanical arm 2 is connected with a binocular camera 7, the large-torque tightening gun 1 is connected with the screw sleeve 11, and the large-torque tightening gun 1, the screw sleeve 11 or the laser dotting device 12 is located at the tail end of the mechanical arm unit 31. The workpiece 9 to be overhauled is provided with one or more screws or screw holes 8 to be locked and disassembled, the distribution of the one or more screws or screw holes 8 to be locked and disassembled on the workpiece 9 to be overhauled is uncertain, but the relative position of the screws or screw holes can be calculated to determine the physical deviation relationship of the screws or screw holes.
The screw positioning and screw locking and unlocking device based on visual servo can be further connected with other terminal equipment 60, manual operation is added in real time, and remote real-time monitoring and regulation and control are achieved, such as the working time and the working duration of the device are set. The screw positioning and screw locking and unlocking device based on visual servo and the terminal equipment 60 can carry out data transmission through the network 40, and data can also be stored in a third party to be convenient to fetch at any time and any place, such as the memory 50. The terminal device 60 includes, but is not limited to, a computer, a notebook, a tablet computer, a smart phone, a smart television, a smart game console, and a smart wearable device; wherein the wearable equipment of intelligence includes but not limited to intelligent wrist-watch, intelligent bracelet, intelligent glasses, intelligent head-mounted, intelligent clothing, intelligent shoes, intelligent accessory.
The rough positioning camera 10 is used for collecting an image of a target screw or a screw hole on the workpiece 9 to be overhauled, a center coordinate of the screw or the screw hole is fitted after the target screw or the screw hole is matched by a template method, the center coordinate is based on a coordinate system of the rough positioning camera 10, and then the center coordinate of the target screw or the screw hole based on the coordinate system of the rough positioning camera 10 is converted to the coordinate system based on the base 6. And all data information of the coordinates of the target screw or the screw hole is transmitted to the computer 5, the computer 5 generates a motion control instruction after comprehensively processing the data information, and transmits the motion control instruction to the mechanical arm control box 4, and the mechanical arm control box 4 controls the large-torque tightening gun 1, the mechanical arm small arm 2, the mechanical arm large arm 3 and the screw sleeve 11 to cooperate to complete the operation task of locking and unlocking the screw according to the motion control instruction.
Use the utility model discloses a method flow that screw location and lock unloaded the screw device and carry out screw location and lock and unload the screw based on visual servo, the concrete embodiment is shown in FIG. 5:
step 1: the visual servo-based screw hole positioning and screw locking and unlocking device initialization comprises the steps of setting the initialization positions of all parts, detecting whether the functions of all parts are normal, confirming whether circuits, communication and the like are normal and the like;
step 2: acquiring an image of the target screw or screw hole on the workpiece 9 to be overhauled by using the coarse positioning camera 10 to confirm position information of the target screw or screw hole, namely confirming that the target screw or screw hole is based on a central coordinate of the coarse positioning camera 10 in a coordinate system, converting the central coordinate of the target screw or screw hole based on the coarse positioning camera 10 in the coordinate system based on the base 6 to the central coordinate of the target screw or screw hole based on the coordinate system of the base 6 according to the relative position of the coarse positioning camera 10 and the base 6, and transmitting the position data to the computer 5;
and step 3: the computer 5 generates the motion control instruction after comprehensively processing the position data according to the received position data of the target screw or screw hole coordinate, and transmits the motion control instruction to the mechanical arm control box 4;
and 4, step 4: the mechanical arm control box 4 drives the servo motor to rotate according to the motion control instruction, so as to drive the large-torque tightening gun 1 or the screw sleeve 11 or the binocular camera 7 or the laser dotter 12 at the tail end of the mechanical arm unit 31 to move towards the direction close to the target screw or screw hole, calculate the difference between the current position and the target position, judge whether the difference is within the threshold range, if so, enter the step 5, and if not, return to the step 2;
and 5: when the high-torque tightening gun 1 or the screw sleeve 11 or the binocular camera 7 or the laser dotter 12 at the tail end of the mechanical arm unit 31 moves to a threshold range of a target position, the target screw or the screw hole enters a working range of the binocular camera 7 at the tail end of the mechanical arm unit 31, in order to ensure accurate positioning, the target screw or the screw hole is accurately positioned again by using binocular vision, and attitude information of the target screw or the screw hole is also determined;
step 6: according to the obtained position information and posture information of the target screw or screw hole, aligning the large-torque tightening gun 1 or the screw sleeve 11 to the screw or screw hole, and screwing the screw placed in the large-torque tightening gun 1 into the target screw hole or using the screw sleeve 11 to unload the target screw to be disassembled.
In the step 2, the rough positioning camera 10 is used to collect an image of the target screw or the screw hole on the workpiece 9 to be overhauled to confirm the position information of the target screw or the screw hole, and a template matching method is adopted for searching the target screw or the screw hole, specifically as follows:
searching a screw hole template in the acquired image (image to be matched) of the target screw or screw hole according to a certain sequence, wherein the screw hole template is preset, calculating the similarity s of each screw or screw hole in the image to be matched, searching the position of the target screw or screw hole, and defining the similarity s as a formula (1):
s(r，c)＝s{t(u，v)，f(r+u，c+v)；(u，v)∈T} (1)
wherein s represents a function, the parameter t (u, v) in the function represents the gray value of each point in the screw hole template, and f (r + u, c + v) represents the gray value of the corresponding area of the screw hole template in the image to be matched.
And calculating the sum (sad) of the absolute values of the gray difference between the screw hole template and the corresponding area in the image to be matched to obtain the similarity, wherein the sad is defined as the formula (2):
wherein n represents the number of screw holes in the screw hole template region. The matching similarity obtained by the above formula indicates that the screw template and the image to be matched are closer if the similarity is higher, and the obtained similarity value is 0 if the screw template is the same as the image to be matched; otherwise, it will be greater than 0.
After the target screw or the screw hole is matched by the method, the center coordinate of the target screw or the screw hole is fitted, and the center coordinate is based on the coordinate system of the coarse positioning camera 10 and is not based on the coordinate of the mechanical unit 31 in the coordinate system, so that the mechanical unit 31 cannot be directly controlled in motion according to the coordinate. Therefore, a coordinate transformation process is also required in order to transform the obtained center coordinates of the target screw or screw hole based on the coordinate system of the coarse positioning camera 10 to the coordinate system of the base 6. The essence of the coordinate transformation is to clear up the transformation relationship between the coordinate system of the coarse positioning camera 10 and the coordinate system of the base 6, and the transformation relationship can be obtained by rotating and translating.
The binocular camera 7 coordinates are arranged under (x, y, z) coordinates under the base 6 coordinate system, namely, a translation matrix is represented as follows: t ═ x, y, z)TThe rotation matrix is R, and the rotation matrix may be rotated by an angle θ (the specific angle is determined according to the relative position relationship between the coarse positioning camera 10 and the base 6) in the X-axis direction. Therefore, when the binocular camera 7 detects that the coordinates of the target screw or the screw hole are the point Pc＝[xc,yc,zc]In this case, the position of the target screw or screw hole is shown in formula (3) for the mechanical unit 31 for six-degree-of-freedom live working:
conversion to equation (4):
in the step 4, the high-torque tightening gun 1 or the screw sleeve 11 moves in a direction close to the target screw or the screw hole, a proportional control law is selected as a control algorithm, and a servo control schematic diagram is shown in fig. 4. Defining a kinematic error function EppObtaining the relative position information from the coarse positioning camera 10 by constructing a suitable kinematic error function for the difference between the current position and the target position of the end of the robot arm unit 31, and constructing a control law for the robot arm control box 4 to use the kinematic error function EppEventually converging to 0.
The end problem of the robot arm unit 31 can be expressed as: a fixed point with coordinates P at the end of the robot arm unit 31 is controlled by a control law to move to a stationary point S in the working space, which is called point-to-point positioning, and the kinematic error function E is in the base 6 coordinate systemppCan be expressed as formula (5):
Epp(Te，S，P)＝P-Te(S) (5)
Teis a controlled variable representing the current time position of the arm, and S, P is a positioning parameter. In the course of this positioning task,the estimation of the stationary point relative to the coordinate system of the rough positioning camera 10 is combined with the camera calibration and the kinematic information of the mechanical arm to obtain the estimation of the stationary point S relative to the coordinate system of the mechanical arm asWhereinThe pose relationship of the camera relative to the terminal coordinate system of the mechanical arm is determined through off-line calibration, and a proportional control law is selected as a control algorithm of the mechanical arm control box 4, so that the control quantity u can be expressed as a formula (6):
calculating the difference between the current position and the target position to which the large-torque tightening gun 1 or the screw sleeve 11 or the binocular camera 7 or the laser dotter 12 moves, namely calculating a kinematic error function EppDetermining the kinematic error function EppIf the threshold value is within the range of the threshold value, entering the stepAnd 5, if not, returning to the step 2. The motion control command changes correspondingly with the change of the kinematic error function value, and the robot control box 4 controls the end of the robot unit 31 to move to the target position. The control law allows the device to reach an equilibrium state, when it reaches the equilibrium state, the kinematic error function EppIs zero. The kinematic error function value may be communicated to the computer and affect the generation of the motion control command.
When the high-torque tightening gun 1 or the screw sleeve 11 or the binocular camera 7 or the laser dotter 12 at the tail end of the mechanical arm unit 31 moves to a threshold range of a target position, the target screw or the screw hole enters a working range of the binocular camera 7 of the mechanical arm unit 31, in order to ensure accurate positioning, the target screw or the screw hole is accurately positioned again by using binocular vision, and when the target screw or the screw hole is positioned again, a matching method based on region correlation is adopted for searching the target screw or the screw hole, image windows of fixed size shot by left and right cameras of the binocular camera 7 are matched in the method, and the similarity criterion is correlation measurement between the windows in two images. And when the similarity criterion is maximum, matching the corresponding pixel points in the search areas of the two images at the moment. The specific description is as follows:
left image I for two imageslRight image Ir,Pl(i, j) is a pixel point of the left image, Pr(i, j) is a pixel point of the right image, wherein i and j are respectively horizontal and vertical coordinates, the width of the related window V is (2w +1), and R (P)l) Is the sum pixel point P in the left imagel(i, j) related search areas. For each region d ═ d1，d2]T∈R(Pl) And (3) calculating:
formula (7)Wherein C (d) represents a region correlation function, the function psi represents a correlation function of two pixel values, k and l are respectively the horizontal and vertical coordinate offsets of the pixel points, PlThe parallax of (A) is in R (P)l) The vector d in which C (d) is maximized is shown in equation (8):
the output result is a corresponding left image IlAnd the parallax array of each pixel point is the parallax map.
The function ψ (u, v) represents a correlation function of two pixel values u, v, which can be shown as equation (9):
ψ(u，v)＝(u-v)2(9)
in step 2, the position information of the screw hole has been determined, but if the screw is to be unscrewed or locked, the posture information of the target screw or screw hole, that is, the orientation of the target screw or screw hole, must be determined so that the screw sleeve 11 is coaxial with the screw rod of the target screw, and the target screw may be unlocked.
Determining the posture information of the screw hole by using a disparity map method, wherein the local area of the target screw or the screw hole is small and is difficult to determine, so that a local area with the target screw or the screw hole as a circle center is enlarged, laser mark points are marked on the local area by using the laser dotting device 12 (shown in fig. 2), then three points with obvious characteristics are selected from a plurality of laser mark points, and the posture information of the local area where the target screw or the screw hole is located, namely the posture information of the target screw or the screw hole is determined by using a method of determining a plane by using three points. Or directly calculating the disparity map of the whole local area, and the specific calculation method is shown in the related contents.
In the step 6, after the end of the robot arm unit 31 is aligned with the target screw or screw hole, the high-torque tightening gun 1 starts to work, and screws previously set in the high-torque tightening gun 1 by a worker are screwed into the screw hole or screws to be disassembled are removed by using the screw sleeves 11. And a strong magnet is arranged in the screw sleeve 11, so that the screw can be firmly fixed, and the screw is prevented from falling off in the screw unloading process.
The method may further include a step of calculating center coordinates of the other screws or screw holes, that is, acquiring position information of the other screws or screw holes, according to a physical deviation relationship between the other screws or screw holes on the workpiece 9 to be repaired and the target screws or screw holes that have acquired the position information and the posture information. Assuming that the posture information of all the screws or screw holes on the workpiece 9 to be overhauled is consistent, based on the position information and the posture information of other screws or screw holes, the screw locking and unlocking operation can be executed according to the step 6.
Fig. 4 shows the relationship between any screw or screw hole M and the positioned screw or screw hole A, B:
the screw or screw hole M is based on a coordinate calculation formula (10) under a 7-coordinate system:
the calculation formula (11) for calculating the coordinates of any screw or screw hole is as follows:
wherein,is the origin of the camera coordinate system,is point A on the image objectThe coordinate (dx, dy) in physical coordinate system is the relative position of any screw or threaded hole with respect to the M screw or threaded hole.
The utility model provides a beneficial effect that technical scheme brought is: (1) the screws are accurately positioned by using the two sets of cameras, so that the positioning accuracy of the screws can be improved to a great extent; (2) the mechanical arm is used as a movable carrier, so that the working range is enlarged, and the locking and unlocking work of screws can be carried out in an environment where workers are inconvenient to go; and (3) providing a point-to-surface screw or screw hole positioning method, firstly determining the specific position of one screw or screw hole, and then determining the position relation between the other screws or screw holes and the determined screw or screw hole.
In this document, the terms front, back, upper and lower are used to define the components in the drawings and the positions of the components relative to each other, and are used for clarity and convenience of the technical solution. It is to be understood that the use of the directional terms should not be taken to limit the scope of the claims.
The features of the embodiments and embodiments described herein above may be combined with each other without conflict.
In summary, the present invention has been described in detail, but the scope of the present invention should not be limited thereto. But all the simple improvements, modifications and equivalent changes made according to the technical solutions of the present invention fall within the protection scope of the claims of the present invention.
Claims (10)
1. A screw positioning and screw locking and unlocking device based on visual servo is characterized by comprising a visual measurement module and a control execution module, wherein the visual measurement module and the control execution module are in data transmission and communication through a network; the vision measuring module comprises a binocular camera, a coarse positioning camera and a laser dotter; the control execution module comprises a mechanical arm unit and a computer, wherein the mechanical arm unit comprises a large-torque tightening gun, a mechanical arm small arm, a mechanical arm large arm, a mechanical arm control box, a base and a screw sleeve; the high-torque tightening gun, the screw sleeve, the binocular camera and the laser dotter are located at the tail end of the mechanical arm unit.
2. The screw positioning and locking and unlocking device based on visual servo of claim 1, wherein: the computer is used for receiving and processing information and then generating a motion control instruction, the mechanical arm control box controls the motion of the mechanical arm unit by receiving the motion control instruction, a driving servo motor is arranged in the base, one end of the mechanical arm large arm is connected with the base, the other end of the mechanical arm large arm is connected with one end of the mechanical arm small arm, the other end of the mechanical arm small arm is connected with the binocular camera, and the large-torque tightening gun is connected with the screw sleeve.
3. The screw positioning and locking/unlocking device based on visual servo of claim 2, wherein: the mechanical arm control box drives the servo motor to rotate according to the motion control instruction, and then drives the large-torque tightening gun or the screw sleeve or the binocular camera or the laser dotter at the tail end of the mechanical arm unit to move towards the direction close to the target screw or the screw hole.
4. The screw positioning and locking and unlocking device based on visual servo of claim 1, wherein: the rough positioning camera is used for confirming position information of a target screw or a screw hole, a template matching method is adopted, similarity between the collected image of the target screw or the screw hole and each screw or screw hole in the screw hole template is calculated based on the set screw hole template, the position of the target screw or the screw hole is searched, and center coordinates of the target screw or the screw hole based on a rough positioning camera coordinate system are fitted.
5. The screw positioning and locking/unlocking device based on visual servo of claim 4, wherein: and the central coordinates of the target screw or the screw hole under the coordinate system of the coarse positioning camera are converted into the central coordinates of the target screw or the screw hole under the coordinate system of the base in a rotating and translating mode.
6. The screw positioning and locking and unlocking device based on visual servo of claim 1, wherein: the binocular camera is used for accurately positioning the target screw or screw hole, confirming the attitude information of the target screw or screw hole, searching the target screw or screw hole by adopting a matching method based on region correlation, matching image windows of fixed size shot by a left camera and a right camera of the binocular camera, and measuring the correlation between the two image windows based on a similarity criterion.
7. The screw positioning and locking/unlocking device based on visual servo of claim 6, wherein: the method for confirming the area in the matching method based on the area correlation comprises the steps of amplifying a local area with the target screw or the screw hole as the center of a circle, marking laser mark points on the local area by using the laser dotter, selecting three characteristic points from the laser mark points, and determining a plane by using the three characteristic points.
8. The screw positioning and locking and unlocking device based on visual servo of claim 1, wherein: when the high torque tightening gun is aligned with the target screw hole, a screw placed in the high torque tightening gun is tightened into the target screw hole.
9. The screw positioning and locking and unlocking device based on visual servo of claim 1, wherein: and when the screw sleeve is aligned with the target screw, the target screw to be disassembled is disassembled.
10. The screw positioning and locking and unlocking device based on visual servo of claim 1, wherein: the screw hole positioning and screw locking and unlocking device based on visual servo can be further connected with terminal equipment, manual operation is added in real time, and remote real-time monitoring and regulation are achieved.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721641545.6U CN208391427U (en) | 2017-11-30 | 2017-11-30 | A kind of screw hole positioning of view-based access control model servo and lock unload screw device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721641545.6U CN208391427U (en) | 2017-11-30 | 2017-11-30 | A kind of screw hole positioning of view-based access control model servo and lock unload screw device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN208391427U true CN208391427U (en) | 2019-01-18 |
Family
ID=65066479
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201721641545.6U Active CN208391427U (en) | 2017-11-30 | 2017-11-30 | A kind of screw hole positioning of view-based access control model servo and lock unload screw device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN208391427U (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107825125A (en) * | 2017-11-30 | 2018-03-23 | 中国地质大学（武汉） | A kind of screw positioning of view-based access control model servo and lock unload screw device |
| CN110170827A (en) * | 2019-05-30 | 2019-08-27 | 河南沐桐环保产业有限公司 | Battery pack screw disassembling method |
| CN111037269A (en) * | 2019-11-30 | 2020-04-21 | 富泰华工业（深圳）有限公司 | Machine vision-based lock screw control method, lock attachment device and control device |
-
2017
- 2017-11-30 CN CN201721641545.6U patent/CN208391427U/en active Active
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107825125A (en) * | 2017-11-30 | 2018-03-23 | 中国地质大学（武汉） | A kind of screw positioning of view-based access control model servo and lock unload screw device |
| CN110170827A (en) * | 2019-05-30 | 2019-08-27 | 河南沐桐环保产业有限公司 | Battery pack screw disassembling method |
| CN111037269A (en) * | 2019-11-30 | 2020-04-21 | 富泰华工业（深圳）有限公司 | Machine vision-based lock screw control method, lock attachment device and control device |
| CN111037269B (en) * | 2019-11-30 | 2021-07-13 | 富泰华工业（深圳）有限公司 | Locking device and control device based on machine vision |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107984201B (en) | A kind of screw hole positioning of view-based access control model servo and lock unload screw method | |
| CN107825125B (en) | Screw hole positioning and locking screw unloading device based on visual servo | |
| CN208391427U (en) | A kind of screw hole positioning of view-based access control model servo and lock unload screw device | |
| Hutchinson et al. | A tutorial on visual servo control | |
| Drummond et al. | Real-time visual tracking of complex structures | |
| CN111775146A (en) | Visual alignment method under industrial mechanical arm multi-station operation | |
| Jiang et al. | A measurement method for robot peg-in-hole prealignment based on combined two-level visual sensors | |
| US7333133B2 (en) | Recursive least squares approach to calculate motion parameters for a moving camera | |
| KR20080029080A (en) | System for estimating self-position of the mobile robot using monocular zoom-camara and method therefor | |
| US20220230348A1 (en) | Method and apparatus for determining a three-dimensional position and pose of a fiducial marker | |
| CN113329179B (en) | Shooting alignment method, device, equipment and storage medium | |
| Meng et al. | Self-calibration of camera-equipped robot manipulators | |
| WO2023134237A1 (en) | Coordinate system calibration method, apparatus and system for robot, and medium | |
| Bunschoten et al. | Visual odometry from an omnidirectional vision system | |
| Li et al. | Research on hand-eye calibration technology of visual service robot grasping based on ROS | |
| CN113971835A (en) | Control method and device of household appliance, storage medium and terminal device | |
| CN104296657A (en) | Stone wall blasthole detecting and positioning device based on binocular vision and positioning method | |
| CN115409878A (en) | AI algorithm for workpiece sorting and homing | |
| Bao et al. | Cost-effective and robust visual based localization with consumer-level cameras at construction sites | |
| Zhou et al. | Research on Camera Calibration Method for Visual Inspection of Excavator Working Object | |
| Gedik et al. | Fusing 2D and 3D clues for 3D tracking using visual and range data | |
| Horaud et al. | Euclidean reconstruction and affine camera calibration using controlled robot motions | |
| Kulpate et al. | An eye-to-hand visual servoing structure for 3d positioning of a robotic arm using one camera and a flat mirror | |
| Luqiao et al. | A single-hand and binocular visual system for EOD robot | |
| Grimsrud et al. | Estimation of simulation error due to trace inaccuracies |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |