CN211824261U - Relative pose measurement and assembly system of robot and tool in aircraft assembly - Google Patents

Relative pose measurement and assembly system of robot and tool in aircraft assembly Download PDF

Info

Publication number
CN211824261U
CN211824261U CN202020355825.6U CN202020355825U CN211824261U CN 211824261 U CN211824261 U CN 211824261U CN 202020355825 U CN202020355825 U CN 202020355825U CN 211824261 U CN211824261 U CN 211824261U
Authority
CN
China
Prior art keywords
rotation angle
laser
measuring device
displacement
vision
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202020355825.6U
Other languages
Chinese (zh)
Inventor
朱炫霖
张洁茹
叶玉玲
范家怿
王刚
张百乐
邓辰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Shengong Technology Co ltd
Original Assignee
Beijing Shengong Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Shengong Technology Co ltd filed Critical Beijing Shengong Technology Co ltd
Priority to CN202020355825.6U priority Critical patent/CN211824261U/en
Application granted granted Critical
Publication of CN211824261U publication Critical patent/CN211824261U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The utility model discloses a relative position appearance of robot and frock is measured and assembly system in aircraft assembly, include: displacement and rotation angle measuring device: the displacement measuring device includes: a plurality of first visual acquisition devices having an identification function and acquiring an image of the marker; the first vision acquisition equipment acquires images of the markers matched with the first vision acquisition equipment in a view crossing manner; the rotation angle measuring device includes: the diffuse reflection plate and the laser emission devices are fixed on the assembling tool side, the mirror reflection devices are arranged opposite to the diffuse reflection plate and the laser emission devices, and the second vision acquisition equipment with the identification function is fixed on the observation side; the second vision acquisition equipment acquires laser emitted by the laser emitting device, and a spot image formed by reflecting the laser to the diffuse reflection plate through the mirror reflection device. The rotation angle measuring device has the characteristic that the measurement distance is longer, the measurement precision of the rotation angle is higher, and the rotation angle measuring device is suitable for occasions with high requirements on the measurement precision of the rotation angle.

Description

Relative pose measurement and assembly system of robot and tool in aircraft assembly
Technical Field
The application relates to the technical field of visual relative pose measurement of an assembly robot and an assembly tool, in particular to a relative pose measurement and assembly system of the robot and the tool in aircraft assembly.
Background
On the automatic aviation assembly site, a large number of large-size tools are needed to support and position the processed workpiece. Due to the multiple processing steps involved. The tooling needs to be frequently moved among a plurality of automated processing stations with different functions. After each movement, the tool needs to be accurately positioned to a designated position, or the pose parameter of the tool needs to be accurately measured, so that the automatic manufacturing equipment can adjust the processing parameter and adapt to the change of the pose parameter of the tool.
Therefore, the measurement accuracy of the rotation angle of the tool is very high. The small measurement error of the rotation angle also causes a larger displacement error of a far point of the tool. The automatic aviation assembly needs a high-precision six-degree-of-freedom tool pose parameter measurement system. The existing visual pose measuring device has the following problems:
at present, the measurement of the visual pose is limited by the principle, and the tangent value of the measurement precision of the rotation angle is adopted and approaches to the quotient of the displacement measurement precision and the measurement visual field range. In an aviation assembly scene, the pose measuring equipment and the tool are always required to be relatively far away. The actual tool size is relatively large, the front width is generally more than 2m, and the larger width can reach 4-5 m. Under the premise, the currently used displacement measurement system is difficult to realize both higher displacement measurement precision and larger measurement visual field range. Therefore, it is also difficult to obtain a sufficiently high rotation angle measurement accuracy with respect to the displacement measurement accuracy.
Generally, in order to obtain complete six-degree-of-freedom pose parameters (three mutually orthogonal displacement degrees of freedom and three mutually orthogonal rotation degrees of freedom), observation in three orthogonal directions is required. This results in a layout of the measuring device which often "surrounds" the parking position of the measured device. This is not conducive to the construction of a "flexible production line" required for modern industrial production, to the collaborative operation or replacement of a plurality of assembly robots, and to the provision of a wide space for free movement of the object to be measured.
From the principle of detection, it is of course possible to have a relatively large measurable range under remote observation conditions. Due to the assembly requirement, the vision pose measurement must take into account two functions of displacement measurement and rotation angle measurement, so that the geometric dimension of an observation object must account for a considerable proportion in an image in order to simultaneously ensure the rotation angle measurement accuracy and the displacement measurement accuracy. This results in a compression of the available dynamic range of displacement and therefore does not facilitate a larger measurable range.
Due to the problems, the existing pose measuring device of the assembly tool and the assembly system using the pose measuring device are difficult to meet the requirements of automatic aviation, particularly assembly of large-size aviation accessories, and an assembly tool pose measuring system suitable for the large-size aviation accessories and an assembly system corresponding to the pose measuring system are urgently needed.
SUMMERY OF THE UTILITY MODEL
In view of the above problems, the system for measuring and assembling the relative pose of the robot and the tool in the aircraft assembly is provided. The specific scheme is as follows:
the utility model provides a relative position appearance measurement system of vision of robot and frock in aircraft assembly, includes: displacement measuring device and rotation angle measuring device:
the displacement measuring device includes: a plurality of first visual acquisition devices having an identification function and acquiring an image of the marker; the first vision acquisition equipment acquires images of the markers matched with the first vision acquisition equipment in a view crossing manner;
the rotation angle measuring device includes: the diffuse reflection plate and the laser emission devices are fixed on the assembling tool side, the mirror reflection devices are arranged opposite to the diffuse reflection plate and the laser emission devices, and the second vision acquisition equipment with the identification function is fixed on the observation side; the second vision acquisition equipment acquires laser emitted by the laser emitting device, and a spot image formed by reflecting the laser to the diffuse reflection plate through the mirror reflection device.
Further, the displacement measuring device comprises 2 first vision acquisition devices; optical axes of the first vision acquisition equipment lens are mutually vertical, form an angle of 45 degrees with the front plane of the assembly tool respectively, and are intersected at one point; the number of the markers is 2, and the markers are respectively arranged on two sides of the assembly tool.
Further, in an initial state, when the assembly tool is located at a reference position, the lens optical axis of each first vision acquisition device passes through the geometric center point of each marker.
Furthermore, the laser emitting devices are fixedly connected with the diffuse reflection plate, and the straight lines where the lasers emitted by the laser emitting devices are located are intersected or are in a different plane.
Further, the laser emitting devices are different, different light spots are formed on the diffusion plate, and the light spots can be distinguished and identified by the visual acquisition equipment of the rotation angle measuring device.
Further, the laser emitting device comprises 2 point lasers emitting laser beams with different colors, and laser beams emitted by the point laser emitter are reflected by the mirror reflection device to form light spots with different colors on the diffuse reflection plate.
Furthermore, the mirror reflection device is fixed on the observation side, the reflection surface of the mirror reflection device and the reflection surface of the diffuse reflection plate are perpendicular to the same plane and are rigidly and fixedly connected with the second vision acquisition equipment, and the included angle between the normal line of the reflection surface of the mirror reflection device and the optical axis of the lens of the second vision acquisition equipment is less than 5 degrees.
Furthermore, the optical axes of the lenses of the first visual collection device and the second visual collection device are located in the same plane, and the first visual collection device and/or the second visual collection device are/is an area-array camera.
Furthermore, the pose measuring system also comprises an industrial personal computer which is in communication connection with the displacement measuring device and/or the rotation angle measuring device and used for calculating and processing the image content acquired by the displacement measuring device and/or the rotation angle measuring device.
An assembling system comprising the attitude measurement system according to any one of the above, and further comprising an assembling robot that is located on the observation side and is communicatively connected to the displacement measurement device and the rotation angle measurement device.
Borrow by above-mentioned technical scheme, this application discloses relative position appearance measurement and assembly system of robot and frock in aircraft assembly. The utility model discloses a vision collection system with sign effect carries out the position appearance of assembly fixture and measures, including displacement measurement device and rotation angle measuring device. During displacement measurement, the system simultaneously observes displacement values of the assembly tool in different directions by matching the visual acquisition equipment with the cross vision field with the corresponding markers. In this way, the size of the observable fitting is larger with the same observation side and assembly fixture distance, since the measured angle becomes larger.
Meanwhile, when the rotation angle is measured, the combination of the mirror reflection device and the diffuse reflection device is utilized, so that the visual acquisition device can be arranged on the observation side, the light spot displacement change caused by the rotation of the tool can be visually acquired, the visual acquisition device for pose measurement and the assembly tool can be separately arranged, and any physical connection device is not needed between the visual acquisition device and the assembly tool. After the division is finished, the arrangement of an assembly production line is very facilitated, and the operation and the replacement of an assembly robot are facilitated, so that the flexible production line of a factory is conveniently reconstructed.
And the measurement range of the rotation angle can be flexibly adjusted by adjusting the position relation and the size of the diffuse reflection plate and the specular reflection device, and a larger measurement range can be obtained. According to the working principle, the farther the observation side of the system is from the assembly tool, the larger the light spot displacement is when the rotation angle is the same, so that the system is more favorable for the variable of the displacement captured and identified by the vision acquisition equipment, and the measurement accuracy is higher. Therefore, the pose measuring system and the assembly system are very beneficial to the use in the occasions of automatic production of machining/measuring large-size accessories such as aviation accessories.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a general layout diagram of a system for measuring a relative visual pose of a robot and a tool in aircraft assembly according to an embodiment of the present disclosure;
fig. 2 is a schematic top view of a rotation angle measuring device of a vision relative pose measuring system of a robot and a tool in aircraft assembly according to an embodiment of the present disclosure;
fig. 3 is a schematic side view of a rotation angle measuring device of a vision relative pose measuring system of a robot and a tool in aircraft assembly according to an embodiment of the present disclosure;
fig. 4 is a schematic top view of a laser when a rotation angle measuring device of a vision relative pose measuring system of a robot and a tool in aircraft assembly provided by an embodiment of the present application is at a calibration position;
fig. 5 is a schematic side view of a laser when a rotation angle measuring device of a vision relative pose measuring system of a robot and a tool in aircraft assembly provided by an embodiment of the present application is at a calibration position;
fig. 6 is a schematic top view illustrating a change in rotation angle of an assembly tool of a system for measuring a visual relative pose of a robot and the tool in aircraft assembly according to an embodiment of the present disclosure;
fig. 7 is a schematic side view illustrating changes in rotation angle of an assembly tool of a system for measuring a visual relative pose of a robot and the tool in aircraft assembly according to an embodiment of the present disclosure.
In the figure: 1. assembling a tool; 2. a marker (1); 3. a camera (1); 4. an observation side; 5. a camera (2); 6. a reflective mirror; 7. a camera (3); 8. a marker (2); 9. a red laser; 10. a blue laser; 11. a diffuse reflection plate.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The following describes in detail specific implementations provided in embodiments of the present application.
Example 1
As shown in fig. 1 to 7, the present embodiment discloses a pose measurement system of an assembly fixture, including: displacement measuring device and rotation angle measuring device:
the pose measurement system of the assembly fixture of the embodiment has the overall spatial arrangement as shown in fig. 1, and adopts the visual acquisition equipment with the identification function to measure the displacement of the assembly fixture in each direction. To be able to achieve this, the visual acquisition devices in this implementation are all area-array cameras. The area-array camera is used for acquiring images by taking an area as a unit, can acquire complete target images at one time and can acquire the images in time. Plays a crucial role in imaging in the application of the shape, size, position, etc. of the target object.
As shown in fig. 1, the displacement measuring device includes 2 area-array cameras fixed on the observation side, which are respectively: camera (1)3 and camera (3)7, this device is through area array camera to fixing in the marker near opposite assembly fixture and observe. As shown in the figure, the number of the markers is two, and the markers are respectively a marker (1)2 and a marker (2)8, the markers are fixed on two sides of the assembly tool, the 2 planar array cameras observe the opposite markers in a mutually crossed manner, specifically, as shown in fig. 1, a camera (3)7 observes the opposite marker (1)2, and the camera (1)3 observes the opposite marker (2) 8. Because the marker is rigidly fixed with the assembly tool, the translational displacement value of each direction of the marker is the same as that of the assembly tool, the observation visual fields which are mutually crossed naturally form different observation coordinates of the assembly tool, and after the arrangement, the image measuring equipment can be far away from the assembly tool, and meanwhile, under the condition of the same observation distance, the observation angle is observed from the side surface of the accessory, so that the assembly tool and the accessory fixed by the assembly tool can be allowed to have larger depth dimension, and the pose measurement requirement of the accessory with larger dimension can be met.
Meanwhile, in order to conveniently and directly use a rectangular coordinate system frequently used in engineering, in the two cameras in the embodiment, the optical axes of the lenses of the camera (1)3 and the camera (3)7 are kept perpendicular to each other, and form an angle of 45 degrees with the front plane of the assembly tool respectively, and intersect at one point, so that the marker (2)8 and the marker (1)2 respectively installed on the two sides of the assembly tool are observed. Thus, displacement in two directions perpendicular to each other and parallel to the horizontal plane and displacement perpendicular to the horizontal plane can be conveniently acquired. Meanwhile, in order to obtain the maximum observation range, in an initial state, when the assembly tool is located at a reference position, the optical axes of the lenses of the camera (1)3 and the camera (3)7 pass through the geometric center points of the markers.
As shown in fig. 1, 2, and 3, the rotation angle measuring device of the present embodiment includes: a diffuse reflection plate 11 and a plurality of laser emitting devices, namely a red laser 9 and a blue laser 10, which are fixed on the assembling tool side, a mirror reflection device, namely a reflector 6, which is arranged opposite to the two lasers, and a camera (2)5 with a marking function, which is also an area-array camera as described above, which is fixed on the observation side; as shown in fig. 2 and 3, the camera (2)5 acquires a change in displacement of a spot image formed by the red laser 9 and the blue laser 10 reflected onto the diffuse reflection plate 11 via the mirror 6.
The red laser 9 and the blue laser 10 are rigidly and fixedly connected with the diffuse reflection plate 11, so that when the assembly tool rotates, the laser can be driven to synchronously deflect correspondingly. In order to measure and calculate the subsequent rotation angle, the laser emitted by the two laser emitting devices needs to be adjusted to have a certain emission included angle at the initial calibration position, that is, the straight lines where the laser is located intersect with each other or are not in a same plane, and the straight lines and the laser cannot be parallel to each other.
In this embodiment, the laser emitting devices used are different, that is, as described above, the dot lasers emitting laser of different colors are used to emit laser, which is because the dot images can be conveniently distinguished when the diffuse reflection plate 11 is used to collect the spot images by using the camera (2)5, so as to meet the requirement of the subsequent calculation of the deflection angle. Of course, in other embodiments, the lasers may also use various schemes for facilitating the camera (2)5 to recognize two different lasers, such as the shape of the spot formed by the emitted laser beam, and/or the area, and/or the brightness, etc.
In the present embodiment, as shown in fig. 1 and 3, the reflecting mirror 6 is mounted and fixed on the observation side, and the reflecting surface thereof is perpendicular to the same plane as the reflecting surface of the diffuse reflection plate 11, and is nearly parallel to the same plane. In the initial calibration stage, the angle of the reflector is adjusted to enable light spots to be concentrated in the middle area of the diffuse reflection plate as much as possible, the reflector 6 is rigidly and fixedly connected with the camera (2)5, the normal line of the reflecting surface of the reflector is parallel to the optical axis of the lens of the camera (2)5, the normal line of the reflecting surface of the reflector only has a small included angle, and the suggested included angle is smaller than 5 degrees. This allows a larger rotation angle to be measured with the same dimensions of the mirror and the diffuse reflection plate.
For unifying the coordinate systems of the measurement calculation of the displacement measuring device and the rotation angle measuring device, the lens optical axes of the area array camera used by the displacement measuring device and the rotation angle measuring device are arranged to be positioned in the same plane.
The pose measuring system in the embodiment further comprises an industrial personal computer, wherein the industrial personal computer is in communication connection with the displacement measuring device and/or the rotation angle measuring device and calculates and processes image contents acquired by the displacement measuring device and/or the rotation angle measuring device so as to obtain the relative displacement and rotation angle change values of the assembling tool.
Example 2
This embodiment discloses a fitting system including the attitude measurement system according to the above embodiment, and further including a fitting robot that is located on the observation side and is communicatively connected to the displacement measurement device and the rotation angle measurement device. And the assembly robot carries out related production assembly operation according to the pose parameters of the assembly tool acquired by the pose measurement system.
Example 3
As shown in fig. 1 and 4, fig. 5, fig. 6, and fig. 7, the present embodiment discloses a measurement process of the pose measurement system in the above embodiment.
1. And measuring displacement, namely acquiring the position change of images of the sub-markers on the assembly tool in respective visual fields according to visual acquisition equipment with crossed visual fields to obtain displacement values of the assembly tool in different directions, wherein a plurality of markers are fixed on the assembly tool and belong to different visual acquisition equipment respectively.
The displacement measurement uses 2 visual acquisition devices to carry out measurement, the number of the markers is 2, the markers are respectively fixed on two sides of the assembly tool and are positioned in the visual field of the respective visual acquisition device, the optical axes of the lens of the visual acquisition device respectively form an angle of 45 degrees with the front plane of the tool, the optical axes are mutually perpendicular and intersect at one point, and the plane formed by the two optical axes is a displacement horizontal reference plane.
The displacement measurement comprises the following steps:
s101, moving an assembly tool to a calibration position, defining a midpoint O of a connecting line of geometric center points of two markers as a reference point, calibrating a six-degree-of-freedom pose parameter of a measurement tool by using a laser tracker, and storing the pose parameter as a pose parameter corresponding to a tool reference position;
s102, extracting image geometric characteristic points of the markers in respective visual fields by using each visual acquisition device in displacement measurement respectively to obtain corresponding image coordinate values, and storing the image coordinate values as reference image coordinate values (x01, y01) and (x02, y02) of the respective markers;
s103, moving an assembly tool, shooting respective markers through vision acquisition equipment, finding the geometric feature points on the respective markers again by adopting a conventional known geometric feature recognition algorithm, and further calculating to obtain new image coordinate values of the geometric feature points in the vision acquisition device, wherein the new image coordinate values are (x11, y11) and (x12, y 12);
s104, subtracting the image coordinate values (x11, y11) and (x12, y12) of the geometric feature points in S103 from the reference image coordinate values (x01, y01) and (x02, y02) to obtain H1 and H2: h1-x 11-x 01, H2-x 12-x02, and H1 and H2 are the displacement amounts of the assembly tool in two orthogonal directions on the displacement horizontal reference plane (or the difference is multiplied by the image resolution value obtained in advance through a camera calibration operation (such as checkerboard calibration) to obtain a real displacement value);
v1 and V2: v1-y 11-y01, V2-y 12-y02, and V (V1+ V2)/2, which is the displacement of the mounter perpendicular to the horizontal reference plane of displacement, is further calculated.
2. And measuring a rotation angle, and calculating the rotation angle of the assembly tool according to the obtained deflection displacement of a light spot formed by laser irradiation on the diffuse reflection plate fixed on the assembly tool side and/or the displacement value measured in the displacement measurement, wherein the light spot is formed by irradiating laser emitted from the assembly tool side on the diffuse reflection plate after being reflected by a mirror reflection device outside the assembly tool, and the deflection displacement is obtained by observing through a visual acquisition device.
When the rotation angle is measured, the mirror reflection device and the visual collection device for measuring the rotation angle are fixed, and the normal line of the mirror reflection device is parallel to the optical axis of the visual collection device.
When the rotation angle is measured, 2 laser emitting devices are fixedly installed on the assembling tool side to emit laser to the mirror reflection device, and the reflection surface of the diffuse reflection plate and the reflection surface of the mirror reflection device are adjusted to be perpendicular to the same plane at the same time. The laser color that laser emission device transmitted is different, forms the facula of different colors on the diffuse reflection board, mirror surface reflection device with vision collection equipment all fixes in the observation side, and its plane of reflection normal and the camera lens optical axis contained angle of vision collection equipment are less than 5 degrees.
Measuring the rotation angle, comprising the following steps:
s201, moving the assembly tool to a calibration position, defining a midpoint O of a connecting line of geometric central points of the markers as a reference point, calibrating pose parameters of six degrees of freedom of the measurement tool, and storing the pose parameters as pose parameters corresponding to the tool reference position;
s202, as shown in fig. 4 and 5, using the vision collecting device in rotation angle measurement, extracting coordinates (xro, yro) and (xbo, ybo) of center points of two laser spots on the diffuse reflection plate at this time as spot reference image coordinates, and calibrating coordinates of a light exit of the red laser 9 at this time: r (ao, bo) and coordinates of the light exit of the blue laser 10: b (co, do); initial included angles R alpha and B alpha between the red laser and the blue laser in the direction of the transverse axis of the front end face of the tool and the normal line of the diffuse reflection plate, and initial included angles R beta and B beta between the red laser and the blue laser in the direction of the longitudinal axis of the front end face of the tool and the normal line of the diffuse reflection plate;
s203, rotating the assembly tool to drive the laser emitting device and the diffuse reflection plate to rotate, and then extracting new coordinates (xr, yr) and (xb, yb) of the central points of the two laser spots on the diffuse reflection plate when the rotation stops by using a visual acquisition device in rotation angle measurement and adopting the existing known connected domain identification and gravity center calculation algorithm;
s204, respectively subtracting the coordinates (xr, yr) and (xb, yb) of the central points of the two laser spots from the coordinates (xro, yro) and (xbo, ybo) of the spot reference image to obtain: red laser spot coordinates: r (a, b); blue laser spot coordinates: b (c, d); wherein, a is xr-xro, b is yr-yro, c is xb-xbo, and d is yb-ybo;
s205, solving the following deflection angle tangent equation set:
Figure DEST_PATH_GDA0002615243770000091
as shown in fig. 6 and 7, α is a rotation increment corresponding to a transverse axis of the front end surface of the tool (in a direction parallel to the paper and the text in the top view of fig. 6), β is a rotation increment corresponding to a longitudinal axis of the front end surface of the tool (in a direction perpendicular to the paper and the text in the top view of fig. 6), and h is an average value of distances between the diffuse reflection plate and the mirror surface of the specular reflection device, which are variables to be solved;
and S206, defining gamma as a third rotation increment which is vertical to the transverse and longitudinal directions of the front end surface of the tool, differentiating displacement components V1 and V2 which are vertical to the horizontal plane on the horizontal displacement reference plane in displacement measurement to obtain V ', and calculating the gamma according to tg gamma as V'/L when the distance value of the connecting line of the geometric center points of the two markers is L.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (10)

1. The utility model provides a relative position appearance measurement system of robot and frock in aircraft assembly which characterized in that includes: displacement measuring device and rotation angle measuring device:
the displacement measuring device includes: a plurality of first visual acquisition devices having an identification function and acquiring an image of the marker; the first vision acquisition equipment acquires images of the markers matched with the first vision acquisition equipment in a view crossing manner;
the rotation angle measuring device includes: the diffuse reflection plate and the laser emission devices are fixed on the assembling tool side, the mirror reflection devices are arranged opposite to the diffuse reflection plate and the laser emission devices, and the second vision acquisition equipment with the identification function is fixed on the observation side; the second vision acquisition equipment acquires laser emitted by the laser emitting device, and a spot image formed by reflecting the laser to the diffuse reflection plate through the mirror reflection device.
2. The relative pose measurement system according to claim 1, wherein the displacement measurement apparatus includes 2 first vision acquisition devices; optical axes of the first vision acquisition equipment lens are mutually vertical, form an angle of 45 degrees with the front plane of the assembly tool respectively, and are intersected at one point; the number of the markers is 2, and the markers are respectively arranged on two sides of the assembly tool.
3. The relative pose measurement system according to claim 2, wherein in an initial state, when the assembly tool is located at a reference position, the lens optical axis of each of the first vision collection devices passes through the geometric center point of the respective marker.
4. The relative pose measurement system according to claim 1, wherein the laser emission devices are fixedly connected to a diffuse reflection plate, and straight lines on which the lasers emitted by the laser emission devices are located intersect with each other or are out of plane.
5. The relative pose measurement system according to claim 4, wherein the laser emission devices are different, and different light spots are formed on the diffusion plate, which can be discriminated by the visual acquisition device of the rotation angle measurement device.
6. The relative pose measurement system according to claim 5, wherein the laser emitting device comprises 2 point lasers emitting laser light of different colors, and laser beams emitted by the point laser emitting devices form light spots of different colors on the diffuse reflection plate after being reflected by the specular reflection device.
7. The relative pose measurement system according to claim 1, wherein the specular reflection device is fixed to the observation side, a reflection surface of the specular reflection device and a reflection surface of the diffuse reflection plate are perpendicular to the same plane, and are rigidly and fixedly connected to the second vision acquisition device, and an included angle between a normal line of the reflection surface and an optical axis of a lens of the second vision acquisition device is less than 5 degrees.
8. The relative pose measurement system according to claim 1, wherein lens optical axes of the first and second vision collection devices are located in the same plane, and the first and/or second vision collection devices are area-array cameras.
9. The relative pose measurement system according to claim 1, further comprising an industrial personal computer that is communicatively connected to the displacement measurement device and/or the rotation angle measurement device and that performs calculation processing on image content acquired by the displacement measurement device and/or the rotation angle measurement device.
10. A fitting system comprising the relative posture measuring system according to any one of claims 1 to 9, characterized by further comprising a fitting robot that is located on the observation side and that is communicatively connected to the displacement measuring device and the rotation angle measuring device.
CN202020355825.6U 2020-03-19 2020-03-19 Relative pose measurement and assembly system of robot and tool in aircraft assembly Active CN211824261U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202020355825.6U CN211824261U (en) 2020-03-19 2020-03-19 Relative pose measurement and assembly system of robot and tool in aircraft assembly

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202020355825.6U CN211824261U (en) 2020-03-19 2020-03-19 Relative pose measurement and assembly system of robot and tool in aircraft assembly

Publications (1)

Publication Number Publication Date
CN211824261U true CN211824261U (en) 2020-10-30

Family

ID=73010446

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202020355825.6U Active CN211824261U (en) 2020-03-19 2020-03-19 Relative pose measurement and assembly system of robot and tool in aircraft assembly

Country Status (1)

Country Link
CN (1) CN211824261U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115655115A (en) * 2022-12-12 2023-01-31 锦瑞信息科技(南通)有限公司 Display panel vision alignment system based on CCD camera

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115655115A (en) * 2022-12-12 2023-01-31 锦瑞信息科技(南通)有限公司 Display panel vision alignment system based on CCD camera

Similar Documents

Publication Publication Date Title
CN111322954B (en) Assembly tool pose measuring method and device, storage medium and electronic equipment
US20170054954A1 (en) System and method for visually displaying information on real objects
US20140160115A1 (en) System And Method For Visually Displaying Information On Real Objects
US9151607B2 (en) Dimensional measurement through a combination of photogrammetry and optical scattering
EP0866308B1 (en) Optical profile sensor
CN101876532B (en) Camera on-field calibration method in measuring system
EP2010941B1 (en) Camera based six degree-of-freedom target measuring and target tracking device with rotatable mirror
CN111604598B (en) Tool setting method of mechanical arm feeding type laser etching system
EP2008120B1 (en) Camera based six degree-of-freedom target measuring and target tracking device
CN104197960B (en) A kind of overall calibration method of laser tracker visual guidance video camera
CN105547147A (en) System and method for calibrating a vision system with respect to a touch probe
GB2516528A (en) Automatic measurement of dimensional data with a laser tracker
NO174025B (en) POINT MEASUREMENT OF SPACIAL COORDINATES
US11454498B2 (en) Coordinate measuring system
JP2021527220A (en) Methods and equipment for identifying points on complex surfaces in space
CN111174698A (en) Automobile detection non-common-view-field camera global calibration system and method based on surface light field
CN211824261U (en) Relative pose measurement and assembly system of robot and tool in aircraft assembly
CN110211175B (en) Method for calibrating space pose of collimated laser beam
US6304680B1 (en) High resolution, high accuracy process monitoring system
CN109773589B (en) Method, device and equipment for online measurement and machining guidance of workpiece surface
CN114459345A (en) System and method for detecting position and attitude of airplane body based on visual space positioning
CN112529856A (en) Method for determining the position of an operating object, robot and automation system
CN108458692B (en) Close-range three-dimensional attitude measurement method
CN102095386B (en) Two-dimensional small-angle laser-vision precise measurement device and implementation method thereof
Huissoon Robotic laser welding: seam sensor and laser focal frame registration

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant