CN111812669A - Winding inspection device, positioning method thereof and storage medium - Google Patents

Winding inspection device, positioning method thereof and storage medium Download PDF

Info

Publication number
CN111812669A
CN111812669A CN202010690698.XA CN202010690698A CN111812669A CN 111812669 A CN111812669 A CN 111812669A CN 202010690698 A CN202010690698 A CN 202010690698A CN 111812669 A CN111812669 A CN 111812669A
Authority
CN
China
Prior art keywords
inspection device
coordinate system
airplane
winding
point cloud
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010690698.XA
Other languages
Chinese (zh)
Other versions
CN111812669B (en
Inventor
吕品
季博文
赖际舟
卢坤
陆建
徐扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Lechange Information Communication Tech Co ltd
Nanjing University of Aeronautics and Astronautics
Original Assignee
Shenzhen Lechange Information Communication Tech Co ltd
Nanjing University of Aeronautics and Astronautics
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Lechange Information Communication Tech Co ltd, Nanjing University of Aeronautics and Astronautics filed Critical Shenzhen Lechange Information Communication Tech Co ltd
Priority to CN202010690698.XA priority Critical patent/CN111812669B/en
Publication of CN111812669A publication Critical patent/CN111812669A/en
Application granted granted Critical
Publication of CN111812669B publication Critical patent/CN111812669B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30—Computing systems specially adapted for manufacturing

Abstract

The application discloses a winding machine inspection device, a positioning method thereof and a readable storage medium. Controlling the winding inspection device to run around the airplane, and establishing a laser radar point cloud map of the airplane wheels under an airplane coordinate system according to the obtained laser radar point clouds of the airplane wheels at different moments; in the checking process, carrying out point cloud matching on the laser radar point cloud of the airplane wheel under the coordinate system of the winding checking device and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the airplane coordinate system in the coordinate system of the winding checking device; and determining the pose of the winding inspection device in an airplane coordinate system according to the transformation matrix. The problem of inaccurate in determining the position and orientation information of the winding inspection device through a GPS positioning method in the prior art is solved.

Description

Winding inspection device, positioning method thereof and storage medium
Technical Field
The application relates to the technical field of laser radar positioning, in particular to a winding machine inspection device, a positioning method and a storage medium thereof.
Background
The airplane becomes an indispensable transportation tool for people to go out due to the characteristics of high speed, high safety and the like. In order to ensure the navigation safety of the airplane, safety inspection before flight is an essential link. However, because the safety inspection time before flight is short and the task is heavy, the manual inspection is inevitable and careless, and the efficiency and reliability of the manual inspection are also reduced due to the influence of the environment. For manual inspection, the efficiency and the reliability of inspection can be improved by using a ground unmanned vehicle or an unmanned machine for inspection, and the recorded images are convenient to reappear afterwards when the inspection is performed.
At present, in an outdoor environment, a satellite/inertial sensor fusion method is mainly adopted for positioning a ground unmanned vehicle, but in the process of passenger plane patrol inspection, a satellite refusal environment exists, so that the reliability of positioning by using a GPS is low. In a factory environment, an unmanned vehicle generally adopts a mode of paving a guide rail or a magnetic strip in advance for navigation, but the method is more complicated, the track is difficult to change, and the method is not suitable for an airport environment.
Disclosure of Invention
The embodiment of the application aims to solve the problem that when the conventional method of fusing a satellite/inertial sensor is adopted to position the flight inspection device, the positioning of the flight inspection device is inaccurate due to the existence of a satellite refused environment in the process of inspecting the passenger plane.
In order to achieve the above object, an aspect of the present application provides a positioning method of a winding inspection apparatus, including:
controlling the winding inspection device to operate around the airplane, and establishing a laser radar point cloud map of the airplane wheels under an airplane coordinate system according to the obtained laser radar point clouds of the airplane wheels at different moments;
in the checking process, carrying out point cloud matching on the laser radar point cloud of the airplane wheel under the coordinate system of the winding checking device and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the coordinate system of the airplane in the coordinate system of the winding checking device;
and determining the pose of the winding inspection device in an airplane coordinate system according to the transformation matrix.
Optionally, the step of performing point cloud matching on the acquired laser radar point cloud of the wheel under the winding inspection device coordinate system and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the wheel to the aircraft coordinate system in the winding inspection device coordinate system includes:
when the winding machine inspection device is at an initial inspection time, acquiring laser radar point cloud of the airplane wheel under a winding machine inspection device coordinate system at the initial inspection time;
and performing point cloud matching on the laser radar point cloud of the airplane wheel and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the airplane coordinate system in the winding inspection device coordinate system at the initial inspection moment.
Optionally, the step of performing point cloud matching on the laser radar point cloud of the wheel under the winding inspection device coordinate system and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the wheel to the aircraft coordinate system in the winding inspection device coordinate system further includes:
when the winding machine inspection device is at a non-initial inspection time, acquiring laser radar point cloud of the airplane wheel under a winding machine inspection device coordinate system at the current time;
converting the laser radar point cloud according to the pose of the winding inspection at the last moment in an airplane coordinate system to obtain an original laser radar point cloud;
and performing point cloud matching on the original laser radar point cloud and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the airplane coordinate system in the winding inspection device coordinate system at the current moment.
Optionally, the step of determining the pose of the orbiting inspection device in the aircraft coordinate system according to the transformation matrix includes:
if the winding inspection device is at the initial inspection time, determining a first pose of the winding inspection device under an airplane coordinate system at the initial inspection time according to a transformation matrix of the initial inspection time;
and if the winding inspection device is at the non-initial inspection time, determining a first pose of the winding inspection device at the current time in an airplane coordinate system according to the conversion matrix at the current time.
Optionally, after the step of determining the first pose of the orbiting checking device in the airplane coordinate system according to the transformation matrix, the method includes:
acquiring the pose of the winding inspection device in an SLAM coordinate system;
if the winding inspection device is at an initial inspection time, acquiring a first pose of the initial inspection time, and converting the pose of the winding inspection device at the initial time under an SLAM coordinate system into a pose under an airplane coordinate system;
and if the winding inspection device is at the non-initial inspection time, acquiring the pose of the winding inspection device under the airplane coordinate system at the previous time of the current time, and converting the pose of the winding inspection device under the SLAM coordinate system at the current time into a second pose under the airplane coordinate system.
Optionally, after the step of determining the first pose of the orbiting checking device in the airplane coordinate system according to the transformation matrix, the method further includes:
judging whether a first position and a second position of the winding inspection device at the current moment are accurate or not according to data information of an inertial sensor of the winding inspection device and a vehicle-mounted odometer;
judging whether a first position and a second position of the winding inspection device at the current moment are accurate or not according to data information of an inertial sensor of the winding inspection device and a vehicle-mounted odometer;
if the pose of the winding inspection device is accurate, performing data fusion on the first pose and the second pose at the current moment, inertial sensor data and vehicle-mounted mileage data by using extended Kalman filtering to obtain a more accurate pose of the winding inspection device in an airplane coordinate system;
and if the attitude of the winding inspection device is inaccurate, acquiring the attitude of the winding inspection device obtained by recursion of the inertial sensor and the vehicle-mounted odometer as the attitude of the winding inspection device in the airplane coordinate system at the current moment.
Optionally, the step of determining whether the first position and the second position of the winding inspection device at the current time are accurate includes:
and respectively comparing the first position and the second position of the winding inspection device at the current moment with the predicted position and posture of the current moment, and if the calculated difference is within a preset range, determining that the first position and the second position at the current moment are accurate.
Optionally, the step of acquiring the lidar point cloud of the wheel at different times includes:
controlling the winding inspection device to run around the airplane and collecting laser radar points;
clustering the scanning points, and screening the clustered laser radar points according to the relative distance of the airplane wheels to obtain laser radar point cloud of the airplane wheels;
and acquiring laser radar points at different moments, executing the clustering, screening the clustered laser radar points according to the relative distance of the airplane wheels to obtain the laser radar point cloud of the airplane wheels, and thus obtaining the laser radar point cloud of the airplane wheels at different moments.
In addition, to achieve the above object, another aspect of the present application further provides a winding inspection apparatus, including:
the acquisition module is used for acquiring a global point cloud coordinate of a scanning device of the winding inspection device for scanning the airplane wheel in an airplane coordinate system;
the conversion module is used for converting the global point cloud coordinate and a point cloud coordinate of a scanning airplane wheel based on an apparatus coordinate system in the process of winding inspection;
and the determining module is used for determining the position and the posture of the winding inspection device under an airplane coordinate system according to the conversion result.
In order to achieve the above object, another aspect of the present application provides a computer-readable storage medium, which is characterized by storing thereon a positioning program of a winding inspection apparatus, the positioning program of the winding inspection apparatus implementing the steps of the method according to any one of the above when executed by a processor.
The method comprises the steps of firstly running around an airplane to be inspected when the winding inspection device is inspected around the airplane, acquiring laser radar point clouds of airplane wheels at different moments through laser scanning equipment of the winding inspection device, establishing a laser radar point cloud map of the airplane wheels under an airplane coordinate system, carrying out point cloud matching on the acquired laser radar point clouds of the airplane wheels under the winding inspection device coordinate system and the laser radar point cloud map in the inspection process, obtaining a conversion matrix for converting the laser radar point clouds of the airplane wheels to the airplane coordinate system under the winding inspection device coordinate system, and determining the pose of the winding inspection device under the airplane coordinate system according to the conversion matrix. By the mode, when the position and the pose of the winding inspection device in the winding inspection process are determined, positioning systems such as a GPS (global positioning system) and the like are not needed, so that the problem that when the position and the pose of the winding inspection device are determined by the GPS is avoided, the positioning of the winding inspection device is inaccurate due to the existence of a satellite refusing environment, and the effect of improving the positioning accuracy of the winding inspection device in the process of executing the inspection task is achieved.
Drawings
FIG. 1 is a schematic structural diagram of an apparatus according to an embodiment of the present disclosure;
FIG. 2 is a schematic flow chart illustrating an embodiment of a positioning method for a winding inspection apparatus according to the present application;
FIG. 3 is a detailed flowchart of the positioning method step S20 of the winding inspection device according to the present application;
FIG. 4 is a detailed flowchart of the positioning method step S20 of the winding inspection device according to the present application;
FIG. 5 is a schematic flow chart illustrating another embodiment of the positioning method for the winding inspection apparatus according to the present application;
fig. 6 is a schematic flowchart of another embodiment of the positioning method of the winding inspection device according to the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
The main solution of the embodiment of the application is as follows: controlling the winding inspection device to run around the airplane, and establishing a laser radar point cloud map of the airplane wheels under an airplane coordinate system according to the obtained laser radar point clouds of the airplane wheels at different moments; in the checking process, carrying out point cloud matching on the laser radar point cloud of the airplane wheel under the coordinate system of the winding checking device and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the coordinate system of the airplane in the coordinate system of the winding checking device; and determining the pose of the winding inspection device in an airplane coordinate system according to the transformation matrix.
In the prior art, a satellite/inertial sensor fusion method is mainly adopted for positioning the flight inspection device, but when an environment where a satellite rejects exists in the process of inspecting the passenger plane, the reliability of positioning the flight inspection device is reduced.
The present invention provides the above solution, aiming to improve the positioning accuracy of the winding inspection device.
The embodiment of the application provides a winding machine inspection device, which comprises a laser radar sensor, a supporting part and a control circuit. The laser radar sensor is used for scanning an airplane wheel to form laser radar point cloud of the airplane wheel, the supporting part is used for supporting equipment built in the winding inspection device when the winding inspection device performs inspection tasks around the airplane, and the control circuit is used for controlling the winding inspection device to perform control operations such as winding inspection.
In the embodiment of the present application, as shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment of a device according to an embodiment of the present application.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 does not constitute a limitation of the terminal device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer-readable storage medium, may include therein an operating system, a network communication module, a user interface module, and a positioning program of the by-pass inspection apparatus.
The application also provides a positioning method of the winding machine inspection device.
Referring to fig. 2, an embodiment of a positioning method of the winding inspection device of the present application is provided. In this embodiment, the positioning method of the winding inspection apparatus includes:
step S10, controlling the winding inspection device to operate around the airplane, and establishing a laser radar point cloud map of the airplane wheel under the airplane coordinate system according to the obtained laser radar point clouds of the airplane wheels at different moments;
before the winding inspection, the winding inspection device is controlled to run around the airplane for one circle, wherein the winding inspection device can be embodied as a winding inspection device provided with a laser radar in the application. Before the winding inspection device performs winding inspection, the method for establishing the laser radar point cloud map under the airplane coordinate system by acquiring the laser radar point cloud of the airplane wheel at different moments can be used for constructing the map in a field acquisition mode and can also be used for constructing the map in a simulation environment (a three-dimensional model of the airplane is built in the simulation environment, and the winding inspection device is controlled to wind around the airplane of the three-dimensional model).
The plane coordinate system can be specifically established by taking the center of a front wheel of the plane as an origin, pointing the y axis to the tail along the longitudinal axis of the plane, and vertically and rightwards establishing the x axis.
In the application, a laser radar point cloud map of the wheel is firstly constructed, and the laser radar point cloud map of the wheel is formed by that before the winding inspection, the winding inspection device winds around the airplane to obtain the laser radar point cloud of the wheel at different moments, which can be understood as the preparation work of the winding inspection device in executing the winding inspection task.
The step of obtaining the laser radar point cloud of the airplane wheel at different moments comprises the following steps:
step S11, controlling the winding inspection device to run around the airplane and collecting laser radar points;
step S12, clustering the scanning points, and screening the laser radar points after clustering according to the relative distance of the airplane wheels to obtain laser radar point cloud of the airplane wheels;
and step S13, acquiring laser radar points at different moments, executing the clustering, screening the clustered laser radar points according to the relative distance of the airplane wheels to obtain the laser radar point cloud of the airplane wheels, so as to obtain the laser radar point cloud of the airplane wheels at different moments.
In the process of acquiring the laser radar point of the wheel by the winding inspection device around the airplane (including constructing the laser radar point cloud map of the wheel and acquiring the laser radar point cloud of the wheel in the process of executing the winding inspection task), the laser radar points obtained by the laser scanning device are not all the laser radar points of the wheel (scanned to the wheel)Laser radar point clouds of wings, a fuselage, an empennage, or the like), so that the laser radar point clouds of the airplane wheels need to be screened, wherein the laser radar point clouds are a collection consisting of a plurality of laser radar points. And clustering the laser radar point cloud data by using a nearest neighbor clustering method. Calculating the distance D between adjacent laser points in S (k):
Figure BDA0002587961490000071
where ρ (i) and ρ (i +1) are the ith and i +1 th valid points in the laser radar point cloud, D (ρ (i) and ρ (i +1)) are the distance between two adjacent points, and DthIs a set breakpoint distance threshold;
if D (ρ (i), ρ (i +1)) is greater than DthMarking rho (i) and rho (i +1) as breakpoints, and marking each type of point cloud after finishing clustering as Sd(k)，1≤d≤ND，NDThe quantity of the clustered laser radar point clouds is obtained; then the point cloud Sd(k) The average value of the points in the point cloud is obtained to obtain the central point of each point cloud, then the pose information of the ground winding inspection device at the moment of k-1 is utilized to screen the classes which are segmented by the point cloud, the points which do not meet the requirements are removed, the calculation formula is as follows,
Figure BDA0002587961490000072
wherein d isLW(k-1) is the Euclidean distance, psi, between the position of the ground winding inspection device in the airplane coordinate system at the time k-1 and the coordinates of the airplane wheel in the airplane coordinate systemLWAnd (k-1) obtaining angle information between the pose of the ground winding inspection device in the airplane coordinate system at the moment k-1 and the coordinates of the wheel in the airplane coordinate system. dLC(k) Is the Euclidean distance phi from the central point of each type under the machine system to the original point of the machine system at the moment kLC(k) And (4) the directions of various central points under the machine system at the moment k, and r and gamma are set distance threshold values and angle threshold values. dLW(k)、ψLW(k)、 dLC(k)、ψLC(k) The calculation formula of (a) is as follows:
(1)
Figure BDA0002587961490000073
(2)
Figure BDA0002587961490000074
(3)
Figure BDA0002587961490000075
(4)
Figure BDA0002587961490000076
wherein the content of the first and second substances,
Figure BDA0002587961490000077
is the coordinate of the center point of the class at the moment k under the machine system;
Figure BDA0002587961490000078
is the coordinates of the airplane wheel in the airplane coordinate system; x is the number ofn(k-1)、yn(k-1)、ψn(k-1) is the position of the k-1 time flight-winding inspection device under an airplane coordinate system, a plurality of groups of point clouds corresponding to a certain airplane wheel possibly exist after screening by the method, and the screened laser radar point clouds are recorded as laser radar point clouds
Figure BDA0002587961490000079
Figure BDA00025879614900000710
n0The number of wheels is indicated and,
Figure BDA00025879614900000711
representing the number of different point clouds corresponding to each wheel.
Calculating the relative distance between the central points of the laser radar point clouds corresponding to different airplane wheels, and comparing the relative distance relation between the airplane wheels:
Figure BDA00025879614900000712
wherein
Figure BDA00025879614900000713
Representing the corresponding wheel n1The center point of a certain group of laser radar point clouds in the point cloud belongs to the corresponding n2The euclidean distance between the center points of a certain set of lidar point clouds,
Figure BDA00025879614900000714
indicating the wheel n1And airplane wheel n2The euclidean distance between them, d representing the set threshold.
Screening out a group of laser radar point cloud sets meeting all relative position relations between airplane wheels
Figure BDA00025879614900000715
And combining the points into L (k), wherein the L (k) is the laser radar point cloud of the airplane wheel.
Step S20, in the checking process, carrying out point cloud matching on the laser radar point cloud of the airplane wheel under the coordinate system of the winding checking device and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the airplane coordinate system in the coordinate system of the winding checking device;
in the process of the winding inspection, laser radar point clouds of airplane wheels are obtained after screening laser radar points acquired by a winding inspection device, the acquired laser radar point clouds are acquired for a coordinate system based on the winding inspection device, point cloud matching is carried out on the laser radar point clouds of the airplane wheels and a laser radar point cloud map acquired before the winding inspection, and the purpose that the laser radar point clouds taking the winding inspection device as the coordinate system are converted into the laser radar point clouds under the airplane coordinate system is achieved. The coordinate system of the winding machine inspection device can be constructed by taking the center of mass of the winding machine inspection device as an origin, wherein the y axis is forward along the longitudinal axis of the winding machine inspection device, and the x axis is rightward along the longitudinal axis of the winding machine inspection device.
Referring to fig. 3, the step of performing point cloud matching on the acquired laser radar point cloud of the wheel under the coordinate system of the winding inspection device and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the wheel to the coordinate system of the airplane in the coordinate system of the winding inspection device includes:
step S21, when the winding inspection device is at an initial inspection time, acquiring laser radar point cloud of the wheel under a winding inspection device coordinate system at the initial inspection time;
and step S22, performing point cloud matching on the laser radar point cloud of the airplane wheel and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the airplane coordinate system in the winding inspection device coordinate system at the initial inspection moment.
Wherein the step of determining the attitude of the winding inspection device in the aircraft coordinate system according to the transformation matrix comprises:
and step S23, if the winding inspection device is at the initial inspection time, determining the first pose of the winding inspection device in the airplane coordinate system at the initial inspection time according to the transformation matrix of the initial inspection time.
In the present embodiment, a pose determination method of confirming an initial inspection timing of a winding inspection apparatus is proposed. That is, when the winding inspection apparatus performs an initial inspection task, the lidar point cloud for acquiring the wheel at the initial inspection time is matched with the point cloud map, which may be specifically understood as setting the lidar point cloud for acquiring the wheel at the initial inspection time as a source point cloud, setting the lidar point cloud map for acquiring the wheel as a target point cloud, and making the original point cloud and the target point cloud substantially coincide by rotation and translation, wherein a transformation matrix R, T from the original point cloud to the target point cloud is obtained. Suppose that the transformation matrix R, T is solved as
Figure BDA0002587961490000081
The position of the winding inspection device in the plane coordinate system and the course information of the winding inspection device at the initial inspection moment
Figure BDA0002587961490000091
The first pose of the initial checking time is a passing point of the winding checking device at the initial checking timeThe cloud matching method determines the pose under the airplane coordinate system.
Referring to fig. 4, the step of performing point cloud matching on the laser radar point cloud of the wheel under the winding inspection device coordinate system and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the wheel to the aircraft coordinate system in the winding inspection device coordinate system further includes:
step S24, when the winding machine inspection device is at the non-initial inspection time, acquiring the laser radar point cloud of the wheel under the winding machine inspection device coordinate system at the current time;
step S25, converting the laser radar point cloud according to the pose of the winding inspection in the airplane coordinate system at the last moment to obtain an original laser radar point cloud;
and step S26, performing point cloud matching on the original laser radar point cloud and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the airplane coordinate system in the winding inspection device coordinate system at the current moment.
The step of determining the pose of the winding inspection device in an airplane coordinate system according to the transformation matrix comprises the following steps:
and step S27, if the winding inspection device is at the non-initial inspection time, determining a first pose of the winding inspection device at the current time in an airplane coordinate system according to the conversion matrix at the current time.
When the winding inspection device (winding inspection device) is at a non-initial inspection time, the pose of the winding inspection device at the previous time of the current time is acquired, and the pose (x) of the winding inspection device at the time k-1 is acquiredn(k-1),yn(k-1),ψn(k-1)), performing coordinate conversion on the laser radar point cloud L (k) of the airplane wheel processed in the step 2 to obtain a new laser radar point cloud L '(k), and setting the L' (k) as an original point cloud;
note piThe ith laser spot (i ═ 1, 2, …, N) of l (k)0)，N0P is the number of laser spots in L (k)iThe ith laser spot (i ═ 1, 2, …) 'L' (k)，N0)，N0The number of laser points in L' (k) is obtained by the following conversion relationship:
Figure BDA0002587961490000092
wherein the content of the first and second substances,
Figure BDA0002587961490000097
and
Figure BDA0002587961490000098
is p'iCoordinates under a laser radar rectangular coordinate system,
Figure BDA0002587961490000095
and
Figure BDA0002587961490000096
is piAnd coordinates under a laser radar rectangular coordinate system.
And setting a laser radar point cloud map of the airplane wheel, which is acquired by the winding inspection device when the winding inspection task is executed, as a target point cloud. Setting parameters including maximum number of iterations KsMaximum of sum of mean square errors RMSEmaxThe difference Δ T between two transformation matrices, the maximum distance d between corresponding pointsmax。
Through a point cloud registration method (such as ICP algorithm), a conversion matrix R, T from the original point cloud to the target point cloud is obtained, and the pose of the orbiting inspection device at the moment k in an airplane coordinate system is assumed to be
Figure BDA0002587961490000101
Then:
Figure BDA0002587961490000102
so that the pose of the winding inspection device in the airplane coordinate system at the non-initial inspection time (k time) is obtained according to the R, T solution
Figure BDA0002587961490000103
And step S30, determining the position and posture of the winding inspection device in the airplane coordinate system according to the conversion matrix.
The laser radar point cloud obtained by taking the winding inspection device as a coordinate system is matched with a point cloud map and converted into the point cloud taking the airplane as the coordinate system, so that the pose changes of the winding inspection device at different moments are solved, and the pose of the winding inspection device comprises the position information of an x axis and a y axis of the winding inspection device under the airplane coordinate system and the driving direction of the winding inspection device.
In this embodiment, when the winding inspection device inspects around an airplane, firstly, the winding inspection device runs around the airplane to be inspected for one circle, laser radar point clouds of the airplane wheels at different moments are obtained through a laser scanning device of the winding inspection device, a laser radar point cloud map of the airplane wheels under an airplane coordinate system is established, in the inspection process, the obtained laser radar point clouds of the airplane wheels under the winding inspection device coordinate system are subjected to point cloud matching with the laser radar point cloud map, a conversion matrix of the laser radar point clouds of the airplane wheels converted to the airplane coordinate system under the winding inspection device coordinate system is obtained, and the pose of the winding inspection device under the airplane coordinate system is determined according to the conversion matrix. By the mode, when the position and the pose of the winding inspection device in the winding inspection process are determined, positioning systems such as a GPS (global positioning system) and the like are not needed, so that the problem that when the position and the pose of the winding inspection device are determined by the GPS is avoided, the positioning of the winding inspection device is inaccurate due to the existence of a satellite refused environment is solved, and the effect of improving the positioning accuracy of the winding inspection device in the process of executing the inspection task is achieved.
Referring to fig. 5, fig. 5 is a schematic flowchart of another embodiment of the present application, after the step of determining the first pose of the winding inspection apparatus in the aircraft coordinate system according to the transformation matrix, the method includes:
step S31, acquiring the pose of the winding inspection device in the SLAM coordinate system;
step S32, judging whether the vehicle winding inspection device is at the initial time;
step S33, if the winding inspection device is at the initial inspection time, acquiring a first pose of the initial inspection time, and converting the pose of the winding inspection device at the initial time in the SLAM coordinate system into a pose in an airplane coordinate system;
step S34, if the winding inspection device is at the non-initial inspection time, acquiring the pose of the winding inspection device under the airplane coordinate system at the previous time of the current time, and converting the pose under the SLAM coordinate system at the current time into a second pose under the airplane coordinate system.
Acquiring acquired laser radar original point cloud data (laser radar point cloud not needing to be screened), and resolving to obtain a k-time SLAM (simultaneous localization and mapping) by a method of simultaneously locating and mapping (SLAM) to obtain a position posture of the winding inspection device in an SLAM coordinate system
Figure BDA0002587961490000111
The method for determining the pose of the winding inspection device in the airplane coordinate system by means of the SLAM coordinate system is divided into an initial inspection time and a non-initial inspection time, and comprises the following steps:
if the current k moment is the initial inspection moment, reading a first position of the winding inspection device at the initial inspection moment obtained after the midpoint cloud registration in the first embodiment in the plane coordinate system
Figure BDA0002587961490000112
Obtaining a conversion relation from the SLAM coordinate system to the airplane coordinate system as follows:
Figure BDA0002587961490000113
wherein
Figure BDA0002587961490000114
Representing the pose of the winding inspection device obtained by SLAM resolving at the current initial inspection time k in an airplane coordinate system;
if the current time is not the initial checking time, e.g. the current timeWhen the moment is k, reading the pose information (x) of the winding inspection device at the moment k-1 in the airplane coordinate systemn(k-1),yn(k-1),ψn(k-1)), the position of the winding inspection device in the SLAM coordinate system is obtained by SLAM resolving at the time of k-1
Figure BDA0002587961490000115
And correcting a rotation matrix from the SLAM coordinate system to the airplane coordinate system through the difference value between the poses according to the following equation:
Figure BDA0002587961490000116
solving to obtain;
when k time is obtained, the pose of the winding inspection device obtained by SLAM calculation in the airplane coordinate system
Figure BDA0002587961490000117
Comprises the following steps:
Figure BDA0002587961490000118
the embodiment provides a method for obtaining the pose of the winding inspection device in the airplane coordinate system by establishing the SLAM coordinate system. The laser radar point cloud data acquired in the established SLAM coordinate system is original point cloud data, and the pose of the winding inspection device under the SLAM coordinate system is converted into a second pose at the initial inspection time and a second pose at the non-initial inspection time of the winding inspection device under the airplane coordinate system through respectively converting with a first pose at the initial inspection time and a first pose at the non-initial inspection time of the winding inspection device.
Referring to fig. 6, fig. 6 is a diagram of another embodiment of the present application, after the step of determining the first pose of the orbiting inspection device in the aircraft coordinate system according to the transformation matrix, the method further includes:
step S34, judging whether the first position and the second position of the winding inspection device at the current time are accurate according to the data information of an inertial sensor of the winding inspection device and a vehicle-mounted odometer;
step S35, if the attitude is accurate, performing data fusion on the first attitude and the second attitude at the current moment, inertial sensor data and vehicle-mounted odometry data by using extended Kalman filtering to obtain a more accurate attitude of the winding inspection device in an airplane coordinate system;
and step S36, if the attitude of the winding inspection device is inaccurate, acquiring the attitude of the winding inspection device obtained by recursion of the inertial sensor and the vehicle-mounted odometer as the attitude of the winding inspection device at the current moment in an airplane coordinate system.
And judging whether the first position and the second position of the winding inspection device at the current moment are accurate according to the data information of an inertial sensor and a vehicle-mounted odometer of the winding inspection device, and performing data fusion on the position and the attitude of the accurate position and attitude information according to the judgment result to obtain the position and the attitude information of the winding inspection device in an airplane coordinate system.
One-step prediction of mean square error Pk|k-1The calculation formula of (a) is as follows:
Figure BDA0002587961490000121
Figure BDA0002587961490000122
where Φ is the state transition matrix, Φk,k-1Is the state transition matrix for time k-1 to k,k-1is the noise matrix of the filter at the time k-1, Wk-1Is the noise matrix of the system at time k-1;
in which M is4×4，U4×3，N3×4All intermediate variables were calculated as follows:
Figure BDA0002587961490000123
Figure BDA0002587961490000124
Figure BDA0002587961490000131
wherein the content of the first and second substances,
Figure BDA0002587961490000132
is a coordinate transformation matrix from a k-1 moment machine system to an airplane coordinate system,
Figure BDA0002587961490000133
Figure BDA0002587961490000134
are respectively
Figure BDA0002587961490000135
The first, second, and third rows of (a); Δ t is the discrete time of the system; i is an identity matrix;
the noise matrix of the filter is calculated as follows:
Figure BDA0002587961490000136
noise matrix of a system
Figure BDA0002587961490000137
Wherein the content of the first and second substances,wx，wy，wzare respectively
Figure RE-GDA0002661175030000138
The model noise of (1);ax，ay，azare respectively
Figure RE-GDA0002661175030000139
Figure RE-GDA00026611750300001310
The model noise of (1);
Figure RE-GDA00026611750300001311
are respectively
Figure RE-GDA00026611750300001312
The noise standard deviation of (d);
Figure RE-GDA00026611750300001313
are respectively
Figure RE-GDA00026611750300001314
The noise standard deviation of (d);
updating the state according to the measurement;
the calculation method of the filter gain equation of the system is as follows:
Figure BDA00025879614900001316
wherein, KkIs the filter gain, R, of the system at time kkIs to measure the noise matrix, HkIs a measurement matrix;
according to the difference of the current state of the winding inspection device and the reliability of the measurement information, the measurement noise matrix and the measurement matrix are different, and the method specifically comprises the following steps:
a) judging whether the winding inspection device is in the zero-speed state or not according to the feedback provided by the control mechanism, and if the winding inspection device is in the zero-speed state, using the position information and the course information (x) of the winding inspection device at the moment of k-1n(k-1),yn(k-1),ψn(k-1)) as a measurement, the measurement matrix H (k) and the measurement noise matrix R (k) are respectively:
Figure BDA00025879614900001317
Figure BDA0002587961490000141
wherein diag denotes a matrix diagonalization, wherein
Figure BDA0002587961490000142
Are respectively xn(k-1)、 yn(k-1)、ψn(k-1) noise; x is the number ofn(k-1)、yn(k-1)、ψn(k-1) x, y direction coordinates and yaw angle, psi, of the flight inspection device in the aircraft coordinate system at time k-1n(k-1) is related to the attitude quaternion as follows:
Figure BDA0002587961490000143
the state estimation equation of the system is calculated as follows:
Figure BDA0002587961490000144
wherein the content of the first and second substances,
Figure BDA0002587961490000145
is an estimate of the state quantity at time k,
Figure BDA0002587961490000146
the state variable one-step predicted value from the k-1 moment to the k moment is obtained; zkThe measured value of the checking device to be wound at the moment k is obtained; zk＝[xn(k-1) yn(k-1) ψn(k-1)]；
The estimated mean square error equation of the system is:
Pk|k＝(I-KkHk)Pk|k-1
wherein, Pk|kThe mean square error is estimated for time k, I is the identity matrix.
b) If the winding machine checking device is not in a zero-speed state at present and the information obtained by the first pose and the second pose is reliable, the information obtained by the first pose, the second pose and the odometer is used as measurement, and a measurement matrix and a measurement noise matrix are respectively as follows:
Figure BDA0002587961490000147
Figure BDA0002587961490000148
wherein diag denotes a matrix diagonalization, wherein
Figure BDA0002587961490000149
Are respectively as
Figure BDA00025879614900001410
Figure BDA00025879614900001411
The noise of (2) is detected,
Figure BDA00025879614900001412
respectively obtaining x and y direction coordinates and a course angle of the k-time winding inspection device in an airplane coordinate system from a first position at the non-initial inspection time;
Figure BDA00025879614900001413
are respectively as
Figure BDA00025879614900001414
The noise of (2) is detected,
Figure BDA00025879614900001415
respectively obtaining x and y direction coordinates and a yaw angle of the flight-winding inspection device at the k moment obtained by the SLAM calculation;
Figure BDA0002587961490000151
and
Figure BDA0002587961490000152
are respectively as
Figure BDA0002587961490000153
The noise of (2) is detected,
Figure BDA0002587961490000154
the speed of the odometer at the moment k in the x and y directions of the coordinate system of the airplane respectively. The relationship between yaw angle and attitude quaternion is as follows:
Figure BDA0002587961490000155
the state estimation equation of the system is calculated as follows:
Figure BDA0002587961490000156
wherein the content of the first and second substances,
Figure BDA0002587961490000157
is an estimate of the state quantity at time k,
Figure BDA0002587961490000158
the state variable one-step predicted value from the k-1 moment to the k moment is obtained; zkThe measured value of the inspection device to be wound at the time k is calculated as follows: (ii) a
Figure BDA0002587961490000159
The estimated mean square error equation of the system is:
Pk|k＝(I-KkHk)Pk|k-1
wherein, Pk|kThe mean square error is estimated for time k, I is the identity matrix.
c) If the winding machine checking device is not in a zero-speed state at present, the information obtained by the first position posture is reliable, and the information obtained by the second position posture is unreliable, the information obtained by the first position posture and the odometer is used as measurement, and a measurement matrix and a measurement noise matrix are respectively as follows:
Figure BDA00025879614900001510
Figure BDA00025879614900001511
wherein diag denotes a matrix diagonalization, wherein
Figure BDA00025879614900001512
Are respectively as
Figure BDA00025879614900001513
Figure BDA00025879614900001514
The noise of (2) is detected,
Figure BDA00025879614900001515
coordinates of the flight-winding inspection device in x and y directions of an airplane coordinate system and a yaw angle at the moment k, which are obtained by the first attitude respectively;
Figure BDA00025879614900001516
and
Figure BDA00025879614900001517
are respectively as
Figure BDA00025879614900001518
The noise of (2) is reduced to a low level,
Figure BDA00025879614900001519
the speed of the odometer at the moment k in the x and y directions of the coordinate system of the airplane respectively. The relationship of yaw angle to attitude quaternion is as follows:
Figure BDA00025879614900001520
the state estimation equation of the system is calculated as follows:
Figure BDA00025879614900001521
wherein the content of the first and second substances,
Figure BDA00025879614900001522
is an estimate of the state quantity at time k,
Figure BDA00025879614900001523
is a state variable one from the time k-1 to the time kStep (4) predicting value; zkThe measured value of the checking device to be wound at the moment k is calculated as follows:
Figure BDA0002587961490000161
the estimated mean square error equation of the system is:
Pk|k＝(I-KkHk)Pk|k-1
wherein, Pk|kThe mean square error is estimated for time k, I is the identity matrix.
d) If the winding machine checking device is not in a zero-speed state at present, the information obtained by the first position posture is unreliable, and the information obtained by the second position posture is reliable, the information obtained by the second position posture and the odometer is used as measurement, and a measurement matrix and a measurement noise matrix are respectively as follows:
Figure BDA0002587961490000162
Figure BDA0002587961490000163
wherein diag denotes matrix diagonalization,
Figure BDA0002587961490000164
are respectively as
Figure BDA0002587961490000165
The noise of (2) is detected,
Figure BDA0002587961490000166
respectively obtaining x-direction coordinates, y-direction coordinates and yaw angles of the flight inspection device at the k moment obtained by SLAM in an aircraft coordinate system;
Figure BDA0002587961490000167
and
Figure BDA0002587961490000168
are respectively as
Figure BDA0002587961490000169
The noise of (2) is detected,
Figure BDA00025879614900001610
Figure BDA00025879614900001611
the speed of the odometer at the moment k in the x and y directions of the coordinate system of the airplane respectively. The relationship between yaw angle and attitude quaternion is as follows:
Figure BDA00025879614900001612
the state estimation equation of the system is calculated as follows:
Figure BDA00025879614900001613
wherein the content of the first and second substances,
Figure BDA00025879614900001614
is an estimate of the state quantity at time k,
Figure BDA00025879614900001615
the state variable one-step predicted value from the k-1 moment to the k moment is obtained; zkThe measured value of the checking device to be wound at the moment k is obtained;
Figure BDA00025879614900001616
the estimated mean square error equation of the system is:
Pk|k＝(I-KkHk)Pk|k-1
wherein, Pk|kThe mean square error is estimated for time k, I is the identity matrix.
e) If the winding machine checking device is not in a zero-speed state at present and the information of the first pose and the second pose is unreliable, the information obtained by the odometer is used as measurement, and a measurement matrix and a measurement noise matrix are respectively as follows:
H(k)＝[02×6I2×202×6]
Figure BDA0002587961490000171
wherein the content of the first and second substances,
Figure BDA0002587961490000172
and
Figure BDA0002587961490000173
are respectively as
Figure BDA0002587961490000174
The noise of (2) is detected,
Figure BDA0002587961490000175
the speed of the odometer in the x and y directions of the navigation system, respectively.
The state estimation equation of the system is calculated as follows:
Figure BDA0002587961490000176
wherein the content of the first and second substances,
Figure BDA0002587961490000177
is an estimate of the state quantity at time k,
Figure BDA0002587961490000178
the state variable one-step predicted value from the k-1 moment to the k moment is obtained; zkThe measured value of the checking device to be wound at the moment k is obtained;
Figure BDA0002587961490000179
the estimated mean square error equation of the system is:
Pk|k＝(I-KkHk)Pk|k-1
wherein, Pk|kThe mean square error is estimated for time k, I is the identity matrix.
Judging whether the first position and the second position of the winding inspection device at the current moment are accurate or not, wherein the judging step comprises the following steps of:
in this embodiment, the first position and the second position of the winding inspection device at the current time are respectively compared with the predicted position and the predicted position of the current time, and if the calculated difference is within a preset range, the first position and the second position at the current time are considered to be accurate.
According to the data of the inertial sensor and the vehicle-mounted odometer, whether the first position and the second position obtained by the winding inspection device in the first embodiment and the second embodiment in the plane coordinate system at the initial inspection time and the first position and the second position at the non-initial inspection time are accurate or not is judged, and the method comprises the following steps:
(1) and predicting the attitude, the speed and the position of the device to be tested around the aircraft at the current moment according to the information of the inertial sensor and an extended Kalman filtering algorithm. First, a 14-dimensional state quantity is selected as
Figure BDA00025879614900001710
q0、q1、q2、q3Quaternion, x, representing the attitude of the winding inspection devicen、ynRespectively representing the position of the winding inspection device in the x and y directions of the plane coordinate system,
Figure BDA00025879614900001711
representing the speed of the orbiting inspection device in the x and y directions of the aircraft coordinate system,
Figure BDA00025879614900001712
Figure BDA00025879614900001713
respectively representing the zero offset of the gyroscope in the x, y and z directions,
Figure BDA00025879614900001714
representing the zero offset of the accelerometer in the x, y, z directions, respectively. The following formulas are adopted for predicting the attitude, the speed and the position of the inspection device to be wound at the current moment:
the attitude quaternion prediction formula is as follows:
Figure BDA00025879614900001715
wherein, the time k is the current time, and q (k) is [ q ]0(k),q1(k),q2(k),q3(k)]TThe attitude quaternion of the winding inspection device at the moment k; q (k-1) ═ Q0(k-1),q1(k-1),q2(k-1),q3(k-1)]Tk-1 is a posture quaternion of the moment winding inspection device; superscript T represents the transpose of the matrix; Δ t is the discrete sampling period; Ω (k) is an intermediate variable, and is calculated by the following formula:
Figure BDA0002587961490000181
Figure BDA0002587961490000182
the calculation method of (2) is as follows:
Figure BDA0002587961490000183
wherein
Figure BDA0002587961490000184
Is omegab(k) Component in x, y, z direction, ωb(k) The angular speed of the body system of the winding inspection device relative to the plane coordinate system at the moment k is represented under the system;
(2) the position prediction formula is:
Figure BDA0002587961490000185
wherein x isn(k)、yn(k) The position of the winding inspection device in the plane coordinate system at the moment k; x is the number ofn(k-1)、 ynAnd (k-1) is the position of the orbiting checking device in the airplane coordinate system at the moment k-1.
Figure BDA0002587961490000186
The component of the projection of the linear velocity of the body system of the winding inspection device relative to the airplane coordinate system in the X-axis direction and the Y-axis direction at the moment of k-1;
(3)
Figure BDA0002587961490000187
calculated by the following formula:
Figure BDA0002587961490000188
wherein
Figure BDA0002587961490000189
Is the projection of the acceleration of the body system of the flight-winding inspection device relative to the airplane coordinate system at the moment k in the airplane coordinate system,
Figure BDA00025879614900001810
the projection of the acceleration (except the gravity acceleration) of the body system of the winding inspection device relative to the plane coordinate system at the moment k on the plane system.
Figure BDA00025879614900001811
The attitude matrix is obtained from an airframe to an airplane coordinate system, and the calculation formula is as follows:
Figure BDA00025879614900001812
(4) the prediction formula of the speed is as follows:
Figure BDA00025879614900001813
reading the pose resolved at the non-initial inspection time (k time)
Figure BDA00025879614900001814
And predicting to obtain the pose (x)n(k),yn(k),ψn(k) Compare, calculate the difference between:
Figure BDA0002587961490000191
wherein, Δ x, Δ y, Δ ψ are set threshold values, and if the above conditions are satisfied, the pose obtained in step 4 is considered to be reliable;
then, the pose of the winding inspection device at the current moment in the SLAM coordinate system is obtained
Figure BDA0002587961490000192
And predicting to obtain the pose (x)n(k),yn(k),ψn(k) Compare, calculate the difference between:
Figure BDA0002587961490000193
and if the conditions are met, the pose obtained through SLAM is considered to be reliable.
In this embodiment, the first pose and the second pose at the initial inspection time, and the first pose and the second pose at the non-initial inspection time are determined by obtaining the odometer information of the winding inspection device, so as to obtain a more accurate pose of the winding inspection device in the aircraft coordinate system.
Furthermore, the present application provides a computer-readable storage medium storing a positioning program of a winding inspection apparatus, which when executed by a processor implements the steps of the positioning method of the winding inspection apparatus described above.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
While alternative embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following appended claims be interpreted as including alternative embodiments and all such alterations and modifications as fall within the scope of the application.
Obviously, various modifications and alterations to this application will become apparent to those skilled in the art without departing from the invention
With clear spirit and scope. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include such modifications and variations.

Claims (10)

1. A method of positioning a winding inspection device, the method comprising:
controlling the winding inspection device to run around the airplane, and establishing a laser radar point cloud map of the airplane wheels under an airplane coordinate system according to the obtained laser radar point clouds of the airplane wheels at different moments;
in the checking process, carrying out point cloud matching on the laser radar point cloud of the airplane wheel under the coordinate system of the winding checking device and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the airplane coordinate system in the coordinate system of the winding checking device;
and determining the pose of the winding inspection device in an airplane coordinate system according to the transformation matrix.
2. The method of claim 1, wherein the step of point cloud matching the acquired laser radar point cloud of the wheel under the coordinate system of the inspection device to the laser radar point cloud map to obtain the transformation matrix of the laser radar point cloud of the wheel in the coordinate system of the inspection device to the coordinate system of the airplane comprises:
when the winding machine inspection device is at an initial inspection time, acquiring laser radar point cloud of the airplane wheel under a winding machine inspection device coordinate system at the initial inspection time;
and performing point cloud matching on the laser radar point cloud of the airplane wheel and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel to the airplane coordinate system in the winding inspection device coordinate system at the initial inspection moment.
3. The method of claim 2, wherein the step of point cloud matching the lidar point cloud of the wheel under the onboard inspection apparatus coordinate system to the lidar point cloud map to obtain a transformation matrix for transforming the lidar point cloud of the wheel to the aircraft coordinate system under the onboard inspection apparatus coordinate system further comprises:
when the winding machine inspection device is at a non-initial inspection time, acquiring laser radar point cloud of the airplane wheel under a winding machine inspection device coordinate system at the current time;
converting the laser radar point cloud according to the pose of the winding inspection at the last moment in an airplane coordinate system to obtain an original laser radar point cloud;
and performing point cloud matching on the original laser radar point cloud and the laser radar point cloud map to obtain a conversion matrix for converting the laser radar point cloud of the airplane wheel at the current moment into the airplane coordinate system in the winding inspection device coordinate system.
4. The method of positioning a winding inspection device according to claim 3, wherein the step of determining the pose of the winding inspection device in an aircraft coordinate system from the transformation matrix comprises:
if the winding inspection device is at the initial inspection time, determining a first pose of the winding inspection device under an airplane coordinate system at the initial inspection time according to a transformation matrix of the initial inspection time;
and if the winding inspection device is at the non-initial inspection time, determining a first pose of the winding inspection device at the current time in an airplane coordinate system according to the conversion matrix at the current time.
5. The method of positioning a winding inspection device according to claim 4, wherein the step of determining the first pose of the winding inspection device in the aircraft coordinate system according to the transformation matrix is followed by:
acquiring the pose of the winding inspection device in an SLAM coordinate system;
judging whether the vehicle winding inspection device is at an initial moment or not;
if the winding inspection device is at an initial inspection time, acquiring a first pose of the initial inspection time, and converting the pose of the winding inspection device at the initial time under an SLAM coordinate system into a pose under an airplane coordinate system;
and if the winding inspection device is at the non-initial inspection time, acquiring the pose of the winding inspection device under the airplane coordinate system at the previous time of the current time, and converting the pose of the winding inspection device under the SLAM coordinate system at the current time into a second pose under the airplane coordinate system.
6. The method of positioning a winding inspection device according to claim 5, wherein the step of determining the first pose of the winding inspection device in the aircraft coordinate system according to the transformation matrix further comprises:
judging whether a first position and a second position of the winding inspection device at the current moment are accurate or not according to data information of an inertial sensor of the winding inspection device and a vehicle-mounted odometer;
if the pose of the winding inspection device is accurate, performing data fusion on the first pose and the second pose at the current moment, inertial sensor data and vehicle-mounted mileage data by using extended Kalman filtering to obtain a more accurate pose of the winding inspection device in an airplane coordinate system;
and if the attitude of the winding inspection device is inaccurate, acquiring the attitude of the winding inspection device obtained by recursion of the inertial sensor and the vehicle-mounted odometer as the attitude of the winding inspection device in the airplane coordinate system at the current moment.
7. The positioning method of the winding inspection device according to claim 6, wherein the step of determining whether the first position and the second position of the winding inspection device at the current time are accurate comprises:
and respectively comparing the first position and the second position of the winding inspection device at the current moment with the predicted position and posture of the current moment, and if the calculated difference is within a preset range, determining that the first position and the second position at the current moment are accurate.
8. The method of claim 1, wherein the step of obtaining the lidar point cloud for the wheels at different times comprises:
controlling the winding inspection device to run around the airplane and collecting laser radar points;
clustering the scanning points, and screening the clustered laser radar points according to the relative distance of the airplane wheels to obtain laser radar point cloud of the airplane wheels;
and acquiring laser radar points at different moments, executing the clustering, screening the clustered laser radar points according to the relative distance of the airplane wheels to obtain the laser radar point cloud of the airplane wheels, so as to obtain the laser radar point cloud of the airplane wheels at different moments.
9. A winder inspection apparatus, the apparatus comprising:
the acquisition module is used for acquiring a global point cloud coordinate of a scanning device of the winding inspection device for scanning the airplane wheel in an airplane coordinate system;
the conversion module is used for converting the global point cloud coordinate and a point cloud coordinate of a scanning airplane wheel based on an apparatus coordinate system in the process of winding inspection;
and the determining module is used for determining the pose of the winding inspection device in an airplane coordinate system according to the conversion result.
10. A computer-readable storage medium, on which a positioning program of a winding inspection apparatus is stored, characterized in that the positioning program of the winding inspection apparatus realizes the steps of the method of any one of claims 1 to 8 when executed by a processor.
CN202010690698.XA 2020-07-16 2020-07-16 Winding machine inspection device, positioning method thereof and storage medium Active CN111812669B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010690698.XA CN111812669B (en) 2020-07-16 2020-07-16 Winding machine inspection device, positioning method thereof and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010690698.XA CN111812669B (en) 2020-07-16 2020-07-16 Winding machine inspection device, positioning method thereof and storage medium

Publications (2)

Publication Number Publication Date
CN111812669A true CN111812669A (en) 2020-10-23
CN111812669B CN111812669B (en) 2023-08-04

Family

ID=72865473

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010690698.XA Active CN111812669B (en) 2020-07-16 2020-07-16 Winding machine inspection device, positioning method thereof and storage medium

Country Status (1)

Country Link
CN (1) CN111812669B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112764053A (en) * 2020-12-29 2021-05-07 深圳市普渡科技有限公司 Fusion positioning method, device, equipment and computer readable storage medium
CN112781594A (en) * 2021-01-11 2021-05-11 桂林电子科技大学 Laser radar iteration closest point improvement algorithm based on IMU coupling
CN113720721A (en) * 2021-08-16 2021-11-30 中国飞机强度研究所 Calibration fusion method for inspection of inner cabin structure in airplane fatigue test
CN113720721B (en) * 2021-08-16 2024-05-03 中国飞机强度研究所 Calibration fusion method for inspection of inner cabin structure in aircraft fatigue test

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108320329A (en) * 2018-02-02 2018-07-24 维坤智能科技（上海）有限公司 A kind of 3D map creating methods based on 3D laser
CN108536163A (en) * 2018-03-15 2018-09-14 南京航空航天大学 A kind of kinetic model/laser radar Combinated navigation method under single-sided structure environment
US20180306922A1 (en) * 2017-04-20 2018-10-25 Baidu Online Network Technology (Beijing) Co., Ltd Method and apparatus for positioning vehicle
CN108917759A (en) * 2018-04-19 2018-11-30 电子科技大学 Mobile robot pose correct algorithm based on multi-level map match
CN109959377A (en) * 2017-12-25 2019-07-02 北京东方兴华科技发展有限责任公司 A kind of robot navigation's positioning system and method
CN110297224A (en) * 2019-08-01 2019-10-01 深圳前海达闼云端智能科技有限公司 Laser radar positioning method and device, robot and computing equipment
CN110849374A (en) * 2019-12-03 2020-02-28 中南大学 Underground environment positioning method, device, equipment and storage medium
CN110879400A (en) * 2019-11-27 2020-03-13 炬星科技（深圳）有限公司 Method, equipment and storage medium for fusion positioning of laser radar and IMU
CN110927740A (en) * 2019-12-06 2020-03-27 合肥科大智能机器人技术有限公司 Mobile robot positioning method
CN111045017A (en) * 2019-12-20 2020-04-21 成都理工大学 Method for constructing transformer substation map of inspection robot by fusing laser and vision
CN111161353A (en) * 2019-12-31 2020-05-15 深圳一清创新科技有限公司 Vehicle positioning method and device, readable storage medium and computer equipment
CN111208492A (en) * 2018-11-21 2020-05-29 长沙智能驾驶研究院有限公司 Vehicle-mounted laser radar external parameter calibration method and device, computer equipment and storage medium

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180306922A1 (en) * 2017-04-20 2018-10-25 Baidu Online Network Technology (Beijing) Co., Ltd Method and apparatus for positioning vehicle
CN109959377A (en) * 2017-12-25 2019-07-02 北京东方兴华科技发展有限责任公司 A kind of robot navigation's positioning system and method
CN108320329A (en) * 2018-02-02 2018-07-24 维坤智能科技（上海）有限公司 A kind of 3D map creating methods based on 3D laser
CN108536163A (en) * 2018-03-15 2018-09-14 南京航空航天大学 A kind of kinetic model/laser radar Combinated navigation method under single-sided structure environment
CN108917759A (en) * 2018-04-19 2018-11-30 电子科技大学 Mobile robot pose correct algorithm based on multi-level map match
CN111208492A (en) * 2018-11-21 2020-05-29 长沙智能驾驶研究院有限公司 Vehicle-mounted laser radar external parameter calibration method and device, computer equipment and storage medium
CN110297224A (en) * 2019-08-01 2019-10-01 深圳前海达闼云端智能科技有限公司 Laser radar positioning method and device, robot and computing equipment
CN110879400A (en) * 2019-11-27 2020-03-13 炬星科技（深圳）有限公司 Method, equipment and storage medium for fusion positioning of laser radar and IMU
CN110849374A (en) * 2019-12-03 2020-02-28 中南大学 Underground environment positioning method, device, equipment and storage medium
CN110927740A (en) * 2019-12-06 2020-03-27 合肥科大智能机器人技术有限公司 Mobile robot positioning method
CN111045017A (en) * 2019-12-20 2020-04-21 成都理工大学 Method for constructing transformer substation map of inspection robot by fusing laser and vision
CN111161353A (en) * 2019-12-31 2020-05-15 深圳一清创新科技有限公司 Vehicle positioning method and device, readable storage medium and computer equipment

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112764053A (en) * 2020-12-29 2021-05-07 深圳市普渡科技有限公司 Fusion positioning method, device, equipment and computer readable storage medium
CN112764053B (en) * 2020-12-29 2022-07-15 深圳市普渡科技有限公司 Fusion positioning method, device, equipment and computer readable storage medium
CN112781594A (en) * 2021-01-11 2021-05-11 桂林电子科技大学 Laser radar iteration closest point improvement algorithm based on IMU coupling
CN113720721A (en) * 2021-08-16 2021-11-30 中国飞机强度研究所 Calibration fusion method for inspection of inner cabin structure in airplane fatigue test
CN113720721B (en) * 2021-08-16 2024-05-03 中国飞机强度研究所 Calibration fusion method for inspection of inner cabin structure in aircraft fatigue test

Also Published As

Publication number Publication date
CN111812669B (en) 2023-08-04

Similar Documents

Publication Publication Date Title
CN110160542B (en) Method and device for positioning lane line, storage medium and electronic device
EP3875985B1 (en) Method, apparatus, computing device and computer-readable storage medium for positioning
CN110609290B (en) Laser radar matching positioning method and device
Alonso et al. Accurate global localization using visual odometry and digital maps on urban environments
CN113945206A (en) Positioning method and device based on multi-sensor fusion
CN110146909A (en) A kind of location data processing method
CN113147738A (en) Automatic parking positioning method and device
CN111563450A (en) Data processing method, device, equipment and storage medium
CN111812669A (en) Winding inspection device, positioning method thereof and storage medium
CN112346104A (en) Unmanned aerial vehicle information fusion positioning method
CN113252051A (en) Map construction method and device
CN114639085A (en) Traffic signal lamp identification method and device, computer equipment and storage medium
CN112154303B (en) High-precision map positioning method, system, platform and computer readable storage medium
CN112154429B (en) High-precision map positioning method, system, platform and computer readable storage medium
CN112414415A (en) High-precision point cloud map construction method
CN109916417B (en) Map establishing method, map establishing device, computer equipment and storage medium thereof
CN111257853A (en) Automatic driving system laser radar online calibration method based on IMU pre-integration
CN112154355B (en) High-precision map positioning method, system, platform and computer readable storage medium
CN114485698A (en) Intersection guide line generating method and system
CN113822944A (en) External parameter calibration method and device, electronic equipment and storage medium
CN111812668B (en) Winding inspection device, positioning method thereof and storage medium
CN109710594B (en) Map data validity judging method and device and readable storage medium
Wang et al. Simultaneous localization of rail vehicles and mapping of environment with multiple LiDARs
CN113405555B (en) Automatic driving positioning sensing method, system and device
US20230204364A1 (en) Ascertaining a starting position of a vehicle for a localization

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant