CN113998100A - Robot for aerial contact type nondestructive testing operation and control method - Google Patents
Robot for aerial contact type nondestructive testing operation and control method Download PDFInfo
- Publication number
- CN113998100A CN113998100A CN202111594747.0A CN202111594747A CN113998100A CN 113998100 A CN113998100 A CN 113998100A CN 202111594747 A CN202111594747 A CN 202111594747A CN 113998100 A CN113998100 A CN 113998100A
- Authority
- CN
- China
- Prior art keywords
- carbon tube
- robot
- camera
- image
- matrix
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000009659 non-destructive testing Methods 0.000 title claims abstract description 20
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 claims abstract description 78
- 229910052799 carbon Inorganic materials 0.000 claims abstract description 78
- 239000000523 sample Substances 0.000 claims abstract description 33
- 230000007246 mechanism Effects 0.000 claims abstract description 25
- 239000011159 matrix material Substances 0.000 claims description 48
- 239000003381 stabilizer Substances 0.000 claims description 20
- 230000003993 interaction Effects 0.000 claims description 15
- 238000001514 detection method Methods 0.000 claims description 13
- 239000013598 vector Substances 0.000 claims description 13
- 230000008859 change Effects 0.000 claims description 12
- 238000007689 inspection Methods 0.000 claims description 11
- 230000033001 locomotion Effects 0.000 claims description 11
- 238000013016 damping Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims description 8
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 230000001066 destructive effect Effects 0.000 claims description 7
- 238000012360 testing method Methods 0.000 claims description 7
- 229910000831 Steel Inorganic materials 0.000 claims description 6
- 239000010959 steel Substances 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 5
- 230000001133 acceleration Effects 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 claims description 3
- 230000000295 complement effect Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 claims description 3
- 230000005484 gravity Effects 0.000 claims description 3
- 238000013507 mapping Methods 0.000 claims description 3
- 239000000126 substance Substances 0.000 claims description 3
- 238000005259 measurement Methods 0.000 description 12
- 239000002184 metal Substances 0.000 description 6
- 238000012544 monitoring process Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 239000003921 oil Substances 0.000 description 3
- 239000002994 raw material Substances 0.000 description 3
- 230000009194 climbing Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- QGZKDVFQNNGYKY-UHFFFAOYSA-O Ammonium Chemical compound [NH4+] QGZKDVFQNNGYKY-UHFFFAOYSA-O 0.000 description 1
- ZAMOUSCENKQFHK-UHFFFAOYSA-N Chlorine atom Chemical compound [Cl] ZAMOUSCENKQFHK-UHFFFAOYSA-N 0.000 description 1
- 206010033799 Paralysis Diseases 0.000 description 1
- NINIDFKCEFEMDL-UHFFFAOYSA-N Sulfur Chemical compound [S] NINIDFKCEFEMDL-UHFFFAOYSA-N 0.000 description 1
- 239000000460 chlorine Substances 0.000 description 1
- 229910052801 chlorine Inorganic materials 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000009193 crawling Effects 0.000 description 1
- 239000010779 crude oil Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 150000002500 ions Chemical class 0.000 description 1
- 239000007769 metal material Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012958 reprocessing Methods 0.000 description 1
- 239000007921 spray Substances 0.000 description 1
- 229910052717 sulfur Inorganic materials 0.000 description 1
- 239000011593 sulfur Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C27/00—Rotorcraft; Rotors peculiar thereto
- B64C27/04—Helicopters
- B64C27/08—Helicopters with two or more rotors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C39/00—Aircraft not otherwise provided for
- B64C39/02—Aircraft not otherwise provided for characterised by special use
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Manipulator (AREA)
Abstract
The invention discloses a robot for aerial contact type nondestructive testing operation and a control method, wherein the aerial contact type nondestructive testing operation robot comprises a multi-rotor unmanned aerial vehicle, the multi-rotor unmanned aerial vehicle is provided with an airborne computer, a measuring mechanism and a driving mechanism, the measuring mechanism comprises a measuring host, a depth camera, a first carbon tube, a second carbon tube and an ultrasonic measuring probe, and the driving mechanism comprises a first driving motor, a second driving motor and a third driving motor; the invention can improve the working efficiency, liberate the manpower and provide better precision stability.
Description
Technical Field
The invention relates to the technical field of aerial nondestructive testing, in particular to a robot for aerial contact type nondestructive testing operation and a control method.
Background
The large-scale oil and gas pipelines, the large-scale wind driven generators, the fire/nuclear power stations, the large-scale bridges and other heavy infrastructures are the common material foundation for production, operation and life of all enterprises, units and residents, are the guarantee of normal operation of main urban facilities, and are the important conditions of material production and labor reproduction. However, in the case of large oil and gas pipelines, crude oil and other raw materials are circulated in storage tanks and pipelines at high speed throughout the year, and since the raw materials contain a large amount of ions such as chlorine, sulfur and ammonium which have strong corrosiveness on various metal materials, casualties and production line paralysis are caused once equipment leakage occurs in the process of conveying and reprocessing the raw materials, and national economy is seriously affected. The state regulates that these major infrastructures need to be tested at different periods each year according to their respective testing requirements.
Since the damage detection damages the subject, nondestructive thickness measurement is generally used. The metal nondestructive thickness measuring equipment on the market only has a handheld type and a crawling type. Due to the limitation of equipment, the detection of large-scale infrastructure can only depend on manual scaffold erection, climbing and hanging. In order to ensure the safety of detection, extra materials are spent for protection, so that the cost is increased; meanwhile, during detection, personnel with certain construction experience and skill are required to monitor on the ground, so that the manpower is wasted; in the detection process, not only the constructors face the falling danger, but also the objects falling from high altitude threaten the life safety of the guardians below; because manual work wastes time and energy when climbing to the high altitude, mobility is also very poor, simultaneously because of there is a series of problems that air gap etc. leads to the inaccurate testing result in the manual detection to have when contacting for detection efficiency is low, the rate of accuracy is low. Therefore, industrial metal nondestructive testing equipment in China needs to be upgraded urgently to completely replace manpower.
In combination with the background, in order to make up for the vacancy of large-scale infrastructure detection equipment, the invention designs a flexible autonomous operation aerial robot system with accurate positioning and strong anti-interference capability aiming at metal nondestructive detection, and aims to solve the defects of the existing scheme.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a robot and a method for aerial contact type nondestructive testing operation.
The technical scheme provided by the invention is as follows: the utility model provides a robot for aerial contact nondestructive test operation, includes many rotor unmanned aerial vehicle, many rotor unmanned aerial vehicle is provided with the machine and carries the computer, still includes:
the measuring mechanism comprises a measuring host, a depth camera, a first carbon tube, a second carbon tube and an ultrasonic measuring probe, wherein the measuring host is fixedly arranged on the multi-rotor unmanned aerial vehicle, the depth camera is fixedly arranged on the first carbon tube, the first carbon tube is provided with a chute, an elastic part is fixedly arranged in the chute, the second carbon tube is movably sleeved with the first carbon tube, the second carbon tube is elastically connected with the first carbon tube through the elastic part, and the ultrasonic measuring probe is arranged at one end part of the second carbon tube, which is far away from the first carbon tube;
actuating mechanism, including first driving motor, second driving motor and third driving motor, first driving motor is fixed to be set up on many rotor unmanned aerial vehicle, second driving motor passes through the connecting piece and rotates with first driving motor to be connected, first carbon pipe passes through the connecting piece and rotates to be located on the second driving motor, third driving motor is fixed to be located on the first carbon pipe and is connected with the transmission of second carbon pipe.
Furthermore, the measuring mechanism further comprises a third carbon tube, the third carbon tube is fixedly sleeved on the second carbon tube, an annular stabilizer and a spring are sleeved at one end part of the third carbon tube, which is far away from the second carbon tube, the ultrasonic measuring probe is positioned in the middle of the annular stabilizer base, and the annular stabilizer is elastically connected with the third carbon tube through the spring.
Further, many rotor unmanned aerial vehicle still is provided with the gel distributor, the gel distributor is connected to the probe surface through the conveying pipeline.
Furthermore, a steering wheel is fixedly arranged on the third driving motor, a steel wire is arranged on the steering wheel, and the third driving motor is in transmission connection with the second carbon tube through the steel wire.
Furthermore, both ends of the elastic component are provided with pin shafts, and the elastic component is fixedly connected with the first carbon tube and the second carbon tube through the pin shafts respectively.
A method of controlling a robot for aerial contact non-destructive inspection operations, the method comprising the steps of:
s1: establishing an unmanned aerial vehicle dynamic model, a perspective camera model and a mass-spring-damper model;
s2: designing a task function according to the image characteristics and the expected image characteristics, wherein the task function is expressed as:
in order to be a feature of the image,in order to be able to characterize the image as desired,is an interaction matrix, which relates the change of image features in the camera to the camera speed,as an interaction matrixThe generalized inverse matrix of (2);
s3: designing a visual control law of the unmanned aerial vehicle by combining a task function with the change track of the image characteristics and the movement speed of the camera;
s4: converting the speed generated by the contact force applied to the manipulator into the speed in the image space;
s5: the velocity of the robot end mechanism in the camera coordinate system required to ensure constant control of the contact force is calculated.
Further, the step 1 comprises the following steps:
s11: establishing an unmanned aerial vehicle dynamic model, wherein the model description is as follows:
wherein the content of the first and second substances,representing the corresponding position and attitude information of the drone,is composed ofThe first order differential of the first order of the,is composed ofThe second order differential of (a) is,for symmetrically positively determining an inertia matrix, matrixRepresenting the centrifugal force and the effect of the coriolis force,is a vector related to the gravity force,is prepared from (a)) Order vector, representing a generalized coordinate variable to the systemIs the force/moment of the generalized force/moment,representing the force/moment that the system is reacting to the environment;
s12: establishing a perspective camera model, wherein the model is described as follows:
as a camera coordinate systemOne of the image coordinate points in (1),is the abscissa of the coordinate point of the image,is the ordinate of the image coordinate point,is the height of the image coordinate point,is the focal length of the camera and,as image coordinate pointsMapping to an image coordinate system;
s13, establishing a mass-spring-damper model, wherein the model is described as follows:
in order for the inertia to be as desired,in order to achieve the desired damping,in order to be the desired stiffness matrix,is prepared from (a)) The order vector represents the pose of the flexible manipulator;is composed ofThe first order differential, representing the corresponding velocity,is composed ofThe second order differential of (a), representing the corresponding acceleration,for the outside of the robotThe force is the contact force.
Further, the step S3 includes the following steps:
s31: expressing the differential relationship of the change of the image feature to the motion speed of the camera:
is a 6-dimensional vector representing the speed of the camera; involving instantaneous angular velocityAnd instantaneous linear velocity in the camera coordinate system with respect to a given desired point,For the interaction matrix, the change in image characteristics in the camera is linked to the camera speed,representing the motion trail of the image feature S in the camera image;
s, 33: combining formulas (1) and (2) to obtain:
s34: designing a vision control law according to the following equations (1) and (3):
Further, the step S4 includes the following steps:
is composed ofCorresponding to a correlation interaction matrix in the definition of the 3-dimensional pose of the image;
s42: the manipulator is contacted with the contact forceSpeed of generationDegree of rotationConversion to velocity in image spaceThe calculation formula is as follows:
indicating that the manipulator is subjected to contact forceVelocity of generationConversion to a velocity in the image space is made,as an interaction matrixThe inverse of the matrix of (a) is,is a damping matrixThe inverse of the matrix of (a) is,a desired constant contact force.
Further, the step S5 includes the following steps:
s51: expressing the speed of the robot end mechanism in the camera coordinate system:
s52: introducing diagonal selection matrixAnd corresponding complementary matrixTo ensure orthogonality:
s53: an expression for hybrid vision/force control is obtained from equations (5) and (6):
when in useOrTime, outputThereby controlling the robot and the manipulator to move and ensuring the constant control of the contact force.
Compared with the prior art, the robot for aerial contact type nondestructive testing operation and the control method have the following advantages that:
the flexible manipulator with the nondestructive testing function is combined with the unmanned aerial vehicle, and the defects of high overhead nondestructive testing cost and long time consumption are overcome by utilizing the characteristics of hovering and high maneuverability of the unmanned aerial vehicle. The designed control algorithm realizes the combination of visual servo control and force control, namely the air robot realizes front and back movement while maintaining constant force contact in nondestructive testing, can effectively buffer external interference, and solves the problem that the robot is greatly interfered by external environment in the contact testing process; because the surfaces of the bridge pier, the oil tank and the wind driven generator are mostly very smooth, the designed annular stabilizer can add extra stress points for the robot and a measured object, and the horizontal sliding caused by the single-point plane contact of the probe in the contact process is prevented, so that the annular stabilizer is also suitable for the arc-shaped curved surface, and the application scene of the robot is enlarged.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a block diagram of a robot for aerial contact non-destructive inspection operations;
FIG. 2 is a top view of a robot for aerial contact non-destructive inspection operations;
FIG. 3 is a rear view of a robot for aerial contact non-destructive inspection operations;
FIG. 4 is a flowchart of a method of controlling a robot for aerial contact non-destructive inspection operations;
fig. 5 is a system framework diagram of a control method of a robot for aerial contact type nondestructive testing operation.
1. A multi-rotor unmanned aerial vehicle; 3. a third drive motor; 4. a first drive motor; 5. a second drive motor; 6, a measuring host; 7. an ultrasonic measurement probe; 8. an annular stabilizer; 9. an elastic mechanism; 10. a depth camera; 11. an onboard computer; 12. a power source; 13. a rudder wheel; 14. a first pin shaft; 15. a first carbon tube; 16. a second carbon tube; 17. a third carbon tube; 18. a second pin shaft; 19. a gel dispenser; 20. a spring.
Detailed Description
The following detailed description of the present invention is given for the purpose of better understanding technical solutions of the present invention by those skilled in the art, and the present description is only exemplary and explanatory and should not be construed as limiting the scope of the present invention in any way.
An embodiment one, a robot for aerial contact nondestructive test operation, including many rotor unmanned aerial vehicle 1, many rotor unmanned aerial vehicle 1 is provided with airborne computer 11, airborne computer 11 is fixed to be located 1 bottoms of many rotor unmanned aerial vehicle, still includes: the measuring mechanism comprises a measuring host 6, a depth camera 10, a first carbon tube 15, a second carbon tube 16 and an ultrasonic measuring probe 7, the measurement host 6 is fixedly arranged at the top of the multi-rotor unmanned aerial vehicle 1, the depth camera 10 is fixedly arranged at the middle position of the first carbon tube 15, the second carbon tube 16 is movably sleeved with the first carbon tube 15, and the first carbon tube 15 is provided with a chute, an elastic component such as a spring and the like which has the functions of elastic transmission of power or movement and damping is fixedly arranged in the chute, the two ends of the elastic component are respectively provided with a pin shaft, the elastic component is respectively fixedly connected with a first carbon tube 15 and a second carbon tube 16 through the pin shafts, the pin shaft at the front end is a first pin shaft 14, the pin shaft at the rear end is a second pin shaft 18, the ultrasonic measurement probe 7 is arranged at one end part of the second carbon tube 16 far away from the first carbon tube 15;
the driving mechanism comprises a first driving motor 4, a second driving motor 5 and a third driving motor 3, wherein the first driving motor 4 is fixedly arranged at the top of the multi-rotor unmanned aerial vehicle 1, the first driving motor 4 and the measuring host 6 are arranged in parallel in the embodiment, in other embodiments, the position of the measuring host 6 is set to be the position which does not affect the work of the first driving motor 4, the second driving motor 5 is fixedly arranged on the first driving motor 4, the second driving motor 5 is fixedly connected with the output end of the first driving motor 4 through a connecting piece, namely, the rotation of the output end of the first driving motor 4 can drive the second driving motor 5 to rotate left and right, the first carbon tube 15 is rotatably arranged on the second driving motor 5 through the connecting piece, namely, the first carbon tube 15 is fixedly connected with the connecting piece, the connecting piece is fixedly arranged at the output end of the second driving motor 5, the rotation of the output end of the second driving motor 5 can drive the first carbon tube 15 to move up and down, the third driving motor 3 is fixedly arranged at the tail end of the first carbon tube 15, namely, one end far away from the ultrasonic measuring probe 7, a steering wheel 13 is fixedly arranged on the third driving motor 3, a steel wire is arranged on the steering wheel 13, the output end of the third driving motor 3 is fixedly connected with the first pin shaft 14 through the steel wire, and the elasticity of the elastic component and the rotation of the output end of the third driving motor 3 are utilized to enable the second carbon tube 16 to be retracted backwards or extended forwards according to the operation of the third driving motor 3.
When the multi-rotor unmanned aerial vehicle 1 flies to the position near the surface of an object to be detected, the multi-rotor unmanned aerial vehicle 1 acquires image characteristics to the airborne computer 11 through the depth camera 10, and the airborne computer 11 performs algorithm processing to control the multi-rotor unmanned aerial vehicle 1 to move towards the surface of the object to be detected, so that the ultrasonic measuring probe 7 is in contact with the object, and the airborne computer 11 controls the contact force to be constant through the algorithm, thereby keeping dynamic stability; in the contact process, the ultrasonic measurement probe 7 sends ultrasonic waves constantly to detect, detection data are returned to the measurement host 6, the measurement host 6 carries out data processing to obtain monitoring data which can be checked by an operator, and the monitoring data are transmitted to a ground computer software interface in real time to be displayed by using a built-in radio frequency module. The ultrasonic measuring probe 7 detects data such as thickness of metal, thickness of certain metal such as wind turbine blade, and the like.
The measuring mechanism further includes a third carbon tube 17, the third carbon tube 17 is fixedly sleeved on the second carbon tube 16, in this embodiment, the third carbon tube 17 is in interference fit with the second carbon tube 16, an end portion of the third carbon tube 17, which is far away from the second carbon tube 16, is sleeved with an annular stabilizer 8 and a spring 20, the ultrasonic measuring probe 7 is located at a middle position of a base of the annular stabilizer 8, the annular stabilizer 8 is elastically connected with the third carbon tube 17 through the spring 20, that is, the annular stabilizer 8 is movably sleeved on the third carbon tube 17, one end of the spring 20 is fixedly connected with the third carbon tube 17, and the other end of the spring 20 is fixedly connected with the annular stabilizer 8, so that when the annular stabilizer 8 is subjected to pressure and moves towards the direction of the second carbon tube 16, the spring 20 can be compressed, and thus the ultrasonic measuring probe 7, the annular stabilizer 8, the counter-acting force of the spring 20, and the ultrasonic measuring probe 7, the annular stabilizer 8, The first carbon tube 15, the second carbon tube 16, and the third carbon tube 17 constitute a robot.
When the multi-rotor unmanned aerial vehicle 1 flies to the position near the surface of an object to be detected, the multi-rotor unmanned aerial vehicle 1 acquires image characteristics to the airborne computer 11 through the depth camera 10, and the airborne computer 11 performs algorithm processing to control the multi-rotor unmanned aerial vehicle 1 to move towards the surface of the object to be detected, so that the ultrasonic measuring probe 7 is in contact with the object, and the airborne computer 11 controls the contact force to be constant through the algorithm, thereby keeping dynamic stability; in-process of contact, annular stabilizer 8 is earlier than ultrasonic measurement probe 7 contact object surface, many rotor unmanned aerial vehicle 1 continues to move to the object surface, the spring 20 of compression annular stabilizer 8 rear, can assist ultrasonic measurement probe 7 to carry out nondestructive test, improve the stability of contact detection, prevent that many rotor unmanned aerial vehicle 1 from rocking the removal that leads to ultrasonic measurement probe 7 because of self, ultrasonic measurement probe 7 sends the ultrasonic wave constantly and surveys, and return measured data to measuring host 6, measuring host 6 carries out data processing, obtain the monitoring data that can supply the operating personnel to look over, and utilize built-in wireless radio frequency module to convey monitoring data to ground computer software interface in real time and show.
Still be provided with the gel distributor on many rotor unmanned aerial vehicle 1, the gel distributor sets up on measuring the host computer to be connected to probe 7 surfaces through the conveying pipeline.
When many rotor unmanned aerial vehicle 1 flies near waiting to detect the object surface, acquire image characteristic to machine-carried computer 11 through depth camera 10, carry out algorithm by machine-carried computer 11 and handle to control many rotor unmanned aerial vehicle 1 and remove to detecting the object surface, make ultrasonic measurement probe 7 contact the object after, ground operating personnel sends the instruction to gel distributor 19 in the software on the ground computer, gel distributor 19 sprays the gel to the probe surface through the conveying pipeline, forms vacuum environment with the object contact.
In a second embodiment, a method for controlling a robot for aerial contact type nondestructive testing work includes the steps of:
s1: establishing an unmanned aerial vehicle dynamic model, a perspective camera model and a mass-spring-damper model;
s2: designing a task function according to the image characteristics and the expected image characteristics, wherein the task function is expressed as:
in order to be a feature of the image,in order to be able to characterize the image as desired,is an interaction matrix, which relates the change of image features in the camera to the camera speed,the generalized inverse matrix is an interaction matrix;
s3: designing a visual control law of the unmanned aerial vehicle by combining a task function with the change track of the image characteristics and the movement speed of the camera;
s4: converting the speed generated by the contact force applied to the manipulator into the speed in the image space;
s5: the speed of the robot end mechanism (i.e. the ultrasonic measuring probe 7 and the ring stabilizer 8 described above) in the camera coordinate system required to ensure constant control of the contact force is calculated.
By adopting the mixed vision/force control, the contact force between the ultrasonic measuring probe and the detected object is constant in the contact process of the manipulator and the detected metal object, and the interference resistance, the measuring accuracy and the measuring efficiency in the nondestructive testing process are effectively improved by combining with the vision servo control, so that the robot can carry out nondestructive testing on non-smooth curved surfaces such as planes and curved surfaces, and the diversification of the scene application of the aerial nondestructive testing is realized.
Further, the step 1 comprises the following steps:
s11: establishing an unmanned aerial vehicle dynamic model, wherein the model description is as follows:
wherein the content of the first and second substances,representing the corresponding position and attitude information of the drone,is composed ofThe first order differential of the first order of the,is composed ofThe second order differential of (a) is,for symmetrically positively determining an inertia matrix, matrixRepresenting the centrifugal force and the effect of the coriolis force,is a vector related to the gravity force,is prepared from (a)) Order vector, representing a generalized coordinate variable to the systemIs the force/moment of the generalized force/moment,representing the force/moment that the system is reacting to the environment;
s12: establishing a perspective camera model, wherein the model is described as follows:
for one image coordinate point in the camera coordinate system,is the abscissa of the coordinate point of the image,is the ordinate of the image coordinate point,is the height of the image coordinate point,is the focal length of the camera and,as image coordinate pointsMapping to an image coordinate system;
s13, establishing a mass-spring-damper model, wherein the model is described as follows:
in order for the inertia to be as desired,in order to achieve the desired damping,in order to be the desired stiffness matrix,is prepared from (a)) An order vector representing the pose of the flexible manipulator 2;is composed ofThe first order differential, representing the corresponding velocity,is composed ofThe second order differential of (a), representing the corresponding acceleration,is the contact force of the robot.
Further, the step S3 includes the following steps:
s31: expressing the differential relationship of the change of the image feature to the motion speed of the camera:
is a 6-dimensional vector representing the speed of the camera; involving instantaneous angular velocityAnd instantaneous linear velocity in the camera coordinate system with respect to a given desired point,For the interaction matrix, the change in image characteristics in the camera is linked to the camera speed,representing the motion trail of the image feature S in the camera image;
s, 33: combining formulas (1) and (2) to obtain:
is a 6-dimensional square matrix, and when the aerial robot reaches a specified position, the expected image characteristicsThe method comprises the following steps:
s34: the vision control law is therefore designed according to equations (1) and (3):
Further, the step S4 includes the following steps:
is composed ofCorresponding to a correlation interaction matrix in the definition of the 3-dimensional pose of the image;
s42: the manipulator is contacted with the contact forceVelocity of generationConversion to velocity in image spaceThe calculation formula is as follows:
indicating that the manipulator is subjected to contact forceVelocity of generationConversion to a velocity in the image space is made,as an interaction matrixThe inverse of the matrix of (a) is,is a damping matrixThe inverse of the matrix of (a) is,a desired constant contact force.
Further, the step S5 includes the following steps:
s51: expressing the speed of the robot end mechanism in the camera coordinate system:
s52: because the invention adopts mixed vision/force control, the speed of the final aerial manipulator end mechanism in a camera coordinate systemEnsuring vision and force controller outputAndthe invention divides visual control and force control into two independent control loops which run in orthogonal directions, introduces a diagonal selection matrixAnd corresponding complementary matrixTo ensure orthogonality, then:
s53: an expression for hybrid vision/force control is obtained from equations (5) and (6):
when in useOrTime, outputFinally throughImage Jacobian inverse matrix, velocity of end mechanism of manipulator in camera coordinate systemConversion to corresponding velocity vectors in joint coordinate systemThereby controlling the robot and the manipulator to move and ensuring the constant control of the contact force. The joint coordinate system (joint coordinate system) is an automated scientific term published in 1990.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. The utility model provides a robot for aerial contact nondestructive test operation, includes many rotor unmanned aerial vehicle (1), many rotor unmanned aerial vehicle (1) are provided with airborne computer (11), its characterized in that still includes:
the measuring mechanism comprises a measuring host (6), a depth camera (10), a first carbon tube (15), a second carbon tube (16) and an ultrasonic measuring probe (7), wherein the measuring host (6) is fixedly arranged on the multi-rotor unmanned aerial vehicle (1), the depth camera (10) is fixedly arranged on the first carbon tube (15), a sliding groove is formed in the first carbon tube (15), an elastic component (9) is fixedly arranged in the sliding groove, the second carbon tube (16) is movably sleeved with the first carbon tube (15), the second carbon tube (16) is elastically connected with the first carbon tube (15) through the elastic component (9), and the ultrasonic measuring probe (7) is arranged at one end part, far away from the first carbon tube (15), of the second carbon tube (16);
the driving mechanism comprises a first driving motor (4), a second driving motor (5) and a third driving motor (3), wherein the first driving motor (4) is fixedly arranged on the multi-rotor unmanned aerial vehicle (1), the second driving motor (5) is rotatably connected with the first driving motor (4) through a connecting piece, the first carbon tube (15) is rotatably arranged on the second driving motor (5) through the connecting piece, and the third driving motor (3) is fixedly arranged on the first carbon tube (15) and is in transmission connection with the second carbon tube (16);
when the multi-rotor unmanned aerial vehicle (1) flies to the position near the surface of an object to be detected, image characteristics are acquired to the airborne computer (11) through the depth camera (10) and processed by the airborne computer (11) to control the multi-rotor unmanned aerial vehicle (1) to move towards the surface of the object to be detected, so that the ultrasonic measuring probe (7) is in contact with the object, and the airborne computer (11) controls the contact force to be constant, so that the ultrasonic measuring probe (7) is kept to be dynamically stable; in the contact process, the ultrasonic measuring probe (7) sends ultrasonic waves at any time for detection, detection data are returned to the measuring host (6), and the measuring host (6) performs data processing.
2. The robot for aerial contact type nondestructive testing operation according to claim 1, wherein the measuring mechanism further comprises a third carbon tube (17), the third carbon tube (17) is fixedly sleeved on the second carbon tube (16), an annular stabilizer (8) and a spring (20) are sleeved on an end portion of the third carbon tube (17) far away from the second carbon tube (16), the ultrasonic measuring probe (7) is located at a middle position of a base of the annular stabilizer (8), and the annular stabilizer (8) is elastically connected with the third carbon tube (17) through the spring (20).
3. Robot for aerial contact non-destructive inspection operations according to claim 2, characterized in that said multi-rotor drone (1) is further provided with a gel distributor (19), said gel distributor (19) being connected to the probe (7) surface by a feed conveyor.
4. The robot for aerial contact type nondestructive testing operation according to claim 3, wherein a rudder plate (13) is fixedly arranged on the third driving motor (3), a steel wire is arranged on the rudder plate (13), and the third driving motor (3) is in transmission connection with the second carbon tube (16) through the steel wire.
5. The robot for aerial contact type nondestructive testing operation according to claim 4, wherein the elastic member (9) has pins at both ends, and the elastic member (9) is fixedly connected to the first carbon tube (15) and the second carbon tube (16) by the pins.
6. A method of controlling a robot for aerial contact non-destructive inspection operations, the method comprising the steps of:
s1: establishing an unmanned aerial vehicle dynamic model, a perspective camera model and a mass-spring-damper model;
s2: designing a task function according to the image characteristics and the expected image characteristics, wherein the task function is expressed as:
in order to be a feature of the image,in order to be able to characterize the image as desired,is an interaction matrix, which relates the change of image features in the camera to the camera speed,as an interaction matrixThe generalized inverse matrix of (2);
s3: designing a visual control law of the unmanned aerial vehicle by combining a task function with the change track of the image characteristics and the movement speed of the camera;
s4: converting the speed generated by the contact force applied to the manipulator into the speed in the image space;
s5: the velocity of the robot end mechanism in the camera coordinate system required to ensure constant control of the contact force is calculated.
7. The method for controlling a robot for aerial contact type nondestructive inspection work according to claim 6, wherein the step 1 comprises the steps of:
s11: establishing an unmanned aerial vehicle dynamic model, wherein the model description is as follows:
wherein the content of the first and second substances,representing the corresponding position and attitude information of the drone,is composed ofThe first order differential of the first order of the,is composed ofThe second order differential of (a) is,for symmetrically positively determining an inertia matrix, matrixRepresenting the centrifugal force and the effect of the coriolis force,is a vector related to the gravity force,is prepared from (a)) Order vector, representing a generalized coordinate variable to the systemIs the force/moment of the generalized force/moment,representing the force/moment that the system is reacting to the environment;
s12: establishing a perspective camera model, wherein the model is described as follows:
as a camera coordinate systemOne of the image coordinate points in (1),is the abscissa of the coordinate point of the image,is the ordinate of the image coordinate point,is the height of the image coordinate point,is the focal length of the camera and,as image coordinate pointsMapping to an image coordinate system;
s13, establishing a mass-spring-damper model, wherein the model is described as follows:
in order for the inertia to be as desired,in order to achieve the desired damping,in order to be the desired stiffness matrix,is prepared from (a)) The order vector represents the pose of the flexible manipulator;is composed ofThe first order differential, representing the corresponding velocity,is composed ofThe second order differential of (a), representing the corresponding acceleration,is the contact force of the robot.
8. The method for controlling a robot for aerial contact type nondestructive inspection work according to claim 7, wherein said step S3 includes the steps of:
s31: expressing the differential relationship of the change of the image feature to the motion speed of the camera:
is a 6-dimensional vector representing the speed of the camera; involving instantaneous angular velocityAnd instantaneous linear velocity in the camera coordinate system with respect to a given desired point,For the interaction matrix, the change in image characteristics in the camera is linked to the camera speed,representing the motion trail of the image feature S in the camera image;
s, 33: combining formulas (1) and (2) to obtain:
s34: designing a vision control law according to the following equations (1) and (3):
9. The method for controlling a robot for aerial contact type nondestructive inspection work according to claim 8, wherein said step S4 includes the steps of:
is composed ofCorresponding to a correlation interaction matrix in the definition of the 3-dimensional pose of the image;
s42: the manipulator is contacted with the contact forceVelocity of generationConversion to velocity in image spaceThe calculation formula is as follows:
10. The method for controlling a robot for aerial contact type nondestructive inspection work according to claim 9, wherein said step S5 includes the steps of:
s51: expressing the speed of the robot end mechanism in the camera coordinate system:
s52: introducing diagonal selection matrixAnd corresponding complementary matrixTo ensure orthogonality:
s53: an expression for hybrid vision/force control is obtained from equations (5) and (6):
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111594747.0A CN113998100B (en) | 2021-12-24 | 2021-12-24 | Robot for aerial contact type nondestructive testing operation and control method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111594747.0A CN113998100B (en) | 2021-12-24 | 2021-12-24 | Robot for aerial contact type nondestructive testing operation and control method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113998100A true CN113998100A (en) | 2022-02-01 |
CN113998100B CN113998100B (en) | 2022-03-15 |
Family
ID=79931944
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111594747.0A Active CN113998100B (en) | 2021-12-24 | 2021-12-24 | Robot for aerial contact type nondestructive testing operation and control method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113998100B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117566111A (en) * | 2024-01-17 | 2024-02-20 | 湖南大学 | Omnidirectional contact type operation aerial robot oriented to complex environment |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080103639A1 (en) * | 2006-10-25 | 2008-05-01 | The Boeing Company | Systems and Methods for Haptics-Enabled Teleoperation of Vehicles and Other Devices |
WO2017183637A1 (en) * | 2016-04-19 | 2017-10-26 | インダストリーネットワーク株式会社 | Drone aircraft |
US20180120196A1 (en) * | 2016-10-31 | 2018-05-03 | The Boeing Company | Method and system for non-destructive testing using an unmanned aerial vehicle |
KR102083132B1 (en) * | 2019-12-12 | 2020-02-28 | 우현선박기술 주식회사 | Drone system for inspecting and measuring ships with ultrasonic wave thickness measurement technology and sending capabilities |
CN112607022A (en) * | 2020-12-29 | 2021-04-06 | 国网山东省电力公司蒙阴县供电公司 | Power transmission and distribution line inspection device |
-
2021
- 2021-12-24 CN CN202111594747.0A patent/CN113998100B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080103639A1 (en) * | 2006-10-25 | 2008-05-01 | The Boeing Company | Systems and Methods for Haptics-Enabled Teleoperation of Vehicles and Other Devices |
WO2017183637A1 (en) * | 2016-04-19 | 2017-10-26 | インダストリーネットワーク株式会社 | Drone aircraft |
US20180120196A1 (en) * | 2016-10-31 | 2018-05-03 | The Boeing Company | Method and system for non-destructive testing using an unmanned aerial vehicle |
KR102083132B1 (en) * | 2019-12-12 | 2020-02-28 | 우현선박기술 주식회사 | Drone system for inspecting and measuring ships with ultrasonic wave thickness measurement technology and sending capabilities |
CN112607022A (en) * | 2020-12-29 | 2021-04-06 | 国网山东省电力公司蒙阴县供电公司 | Power transmission and distribution line inspection device |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117566111A (en) * | 2024-01-17 | 2024-02-20 | 湖南大学 | Omnidirectional contact type operation aerial robot oriented to complex environment |
Also Published As
Publication number | Publication date |
---|---|
CN113998100B (en) | 2022-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103395064B (en) | A kind of Rack pipe detection robot based on supersonic guide-wave technology | |
CN102901772B (en) | Robot for intelligent tracking ultrasonic detection of welding line, and software analysis system therefor | |
CN108593656B (en) | Structure detection method and device and unmanned aerial vehicle system for structure detection | |
CN109163675B (en) | Method for detecting angular pendulum shaft position accuracy based on laser tracker | |
Bogue | The role of robotics in non‐destructive testing | |
CN113998100B (en) | Robot for aerial contact type nondestructive testing operation and control method | |
CN104502456A (en) | Single-manipulator ultrasonic non-destructive testing device and single-manipulator ultrasonic non-destructive testing method | |
CN100462884C (en) | Crawling intelligent controller in submarine pipeline | |
CN110666794B (en) | Method for compensating load force and moment of end tool of robot | |
CN105387872A (en) | Navigation and positioning performance testing device and method for autonomous mobile robot | |
Watson et al. | Dry coupled ultrasonic non-destructive evaluation using an over-actuated unmanned aerial vehicle | |
US20230134633A1 (en) | Self-propelled towing simulator for deep-sea mining system applicable to natural water bodies and simulation method using the same | |
CN110065094A (en) | A kind of motion detection apparatus and method of flexible joint mechanical arm | |
CN106802322A (en) | A kind of Tunnel Lining Cracks ultrasonic wave detecting system that car is detected based on wall-attaching type | |
CN109625165B (en) | Method for simulating motion of offshore floating structure | |
Montero et al. | Intelligent robotic system for autonomous crack detection and caracterization in concrete tunnels | |
CN206557155U (en) | A kind of Tunnel Lining Cracks ultrasonic wave detecting system that car is detected based on wall-attaching type | |
CN206493337U (en) | A kind of test device of industrial robot repetitive positioning accuracy | |
CN115575503A (en) | Ultrasonic detection method and device for welding defects of large-scale component | |
CN210027842U (en) | Simulation system for motion of offshore floating structure | |
Chen et al. | Design and Verification of Microgravity Simulation System for Space Station Manipulator | |
CN207344597U (en) | A kind of robot system with active compensation of undulation | |
CN112539780A (en) | Building surveying robot | |
CN104891357A (en) | Lifting operation auxiliary system | |
Caccia et al. | Minoas a marine inspection robotic assistant: system requirements and design |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |