CN114581519A - Laser autonomous positioning mapping method for quadruped robot in cross-country environment - Google Patents

Laser autonomous positioning mapping method for quadruped robot in cross-country environment Download PDF

Info

Publication number
CN114581519A
CN114581519A CN202210172153.9A CN202210172153A CN114581519A CN 114581519 A CN114581519 A CN 114581519A CN 202210172153 A CN202210172153 A CN 202210172153A CN 114581519 A CN114581519 A CN 114581519A
Authority
CN
China
Prior art keywords
point
points
plane
edge
iteration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202210172153.9A
Other languages
Chinese (zh)
Inventor
贺亮
陈建林
袁建平
宋婷
马川
于洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Yunmu Zhizao Technology Co ltd
Original Assignee
Jiangsu Yunmu Zhizao Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Yunmu Zhizao Technology Co ltd filed Critical Jiangsu Yunmu Zhizao Technology Co ltd
Priority to CN202210172153.9A priority Critical patent/CN114581519A/en
Publication of CN114581519A publication Critical patent/CN114581519A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

The invention discloses a quadruped robot laser autonomous positioning mapping method in a cross-country environment, which comprises the steps of obtaining laser radar original point cloud in a field environment, extracting less than 100 three-dimensional feature points on the basis of the original point cloud for registration, focusing alternative three-dimensional feature points into edge points and plane points, and extracting the edge points and the plane points according to the values; after the three-dimensional characteristic points are obtained, registering the two frames of point clouds; establishing a geometric relation between the related point clouds, performing positioning work of the inspection device, and performing motion compensation on distortion generated by laser radar motion; the redundant parameters are effectively processed through an L-M algorithm, and the back end carries out nonlinear optimization state estimation by utilizing the L-M algorithm; when a certain number of point clouds are accumulated, the map can be built, and the point cloud data is integrated into a world map.

Description

Laser autonomous positioning mapping method for quadruped robot in cross-country environment
Technical Field
The invention belongs to the technical field of unmanned systems, and particularly relates to a laser autonomous positioning mapping method for a quadruped robot in a cross-country environment, a storage medium and electronic equipment.
Background
With the maturity of the Simultaneous Localization and Mapping (SLAM) technology of robots, more and more scholars are dedicated to applying the SLAM technology to field unmanned system inspection tasks, for example, n.b. joseph and others test several SLAM algorithms for desert inspectors, and propose a three-dimensional landform model generated by utilizing the SLAM algorithms to design an inspector reachable domain; affan Shaukat et al uses the obstacles detected by the binocular camera of the patrol instrument to form a feature combination, and designs a complete autonomous positioning algorithm under an EKF-SLAM framework, and the method is worth taking reference that the navigation road sign is regarded as a feature point combination representing the obstacle, and compared with the traditional positioning method, the success rate of feature recognition is improved; mark Woods and the like analyze and summarize the working mode and environment of a Mars rover in the past generation, design a Mars desert field autonomous positioning experiment based on an SLAM technology aiming at a future Mars surface patrol task (ExoMars2.0) in the European and aviation administration, and verify the effectiveness of an SLAM algorithm under the working conditions of long-term and insufficient communication of the Mars rover.
The SLAM problem can be simply summarized as how to position the robot in an unknown environment and use the measurement information of the sensor to perform self-positioning and surrounding environment description. Dissanayake et al established an initial framework for mobile robot navigation in the last 80 th century, proposed Kalman Filter based KF-SLAM navigation algorithms, and S.Thrun et al reviewed KF-SLAM algorithms. Montemello et al proposed a famous Fast-SLAM algorithm in 2002, proposed the idea of using Particle filter (Particle filter) to estimate the robot state, extended Kalman filtering to estimate map features, and referred to Rao-Blackwellize estimation structure to attribute EKF map estimates to individual particles. Montemerlo and S.Thrun further perfected the FastSLAM algorithm in 2003, and proposed that the Probability Density of measurement (Probability Density Function) is introduced to re-weight in the state prediction process, and the new FastSLAM 2.0 algorithm can achieve better estimation effect even when 1 particle is used. In recent years, with the improvement of computer computing power, the SLAM method based on graph optimization gradually becomes a research hotspot, and some excellent algorithms such as TreeMap, TORO, HOG _ MAN, G2O and the like are all superior to the SLAM method based on a filter system, but the calculation amount of the methods is significantly increased along with the increase of time, and the methods are still in offline optimization processing at present, and for the problem, Kaess et al propose an incremental smooth graph building method imam (incremental Smoothing and mapping). When calculating the nonlinear optimization problem, the iSAM carries out QR decomposition on the information matrix, and when new measurement information arrives, the algorithm updates the information matrix in an incremental manner by applying the matrix information of the previous step, so that recalculation of all related elements is avoided, and the algorithm efficiency is improved.
The core of the SLAM algorithm is to control accumulated errors through repeated feature re-observation (re-visualization), and a peripheral map can be output while accurate positioning is carried out, so that the SLAM algorithm has potential application value in field exploration navigation tasks. However, the existing autonomous positioning mapping method lacks robustness in a single field environment, so that the state estimation error rate is high, and the detection accuracy needs to be improved.
Disclosure of Invention
The purpose of the invention is as follows: in order to overcome the defects, the invention aims to provide a quadruped robot laser autonomous positioning mapping method in a cross-country environment, which can enable the robot to autonomously perform pose state estimation, positioning and navigation on the surrounding environment, improve the target detection precision and complete the patrol exploration task of the quadruped robot in the field environment.
The technical scheme is as follows: in order to achieve the technical effects, the invention provides a laser autonomous positioning mapping method for a quadruped robot in a cross-country environment, which comprises the following steps: the real-time positioning and mapping are decomposed into two threads, wherein the first thread is a high-frequency thread, the patrol device motion estimation is mainly carried out at 10Hz, IMU mileage information is fused, and the second thread is a low-frequency thread and is mainly responsible for local mapping;
the specific mapping method comprises the following steps:
s1: acquiring laser radar original point cloud under a field environment, extracting less than 100 three-dimensional feature points on the basis of the original point cloud for registration, focusing the alternative three-dimensional feature points into edge points and plane points, and extracting the edge points and the plane points according to the value of c;
s2: after the three-dimensional characteristic points are obtained, registering the two frames of point clouds;
s3: establishing a geometric relation between the related point clouds, positioning the inspection device, and performing motion compensation on a distortion problem generated by the motion of the laser radar;
s4: redundant parameters are effectively processed through a Levenberg-Marquardt algorithm, nonlinear optimization state estimation is carried out at the rear end by utilizing the Levenberg-Marquardt algorithm, and the Levenberg-Marquardt algorithm is not sensitive to an over-parameterization problem and can effectively process the redundant parameter problem, so that the condition that an optimization function falls into a local minimum value is greatly reduced;
s5: when a certain number of point clouds are accumulated, mapping can be carried out, the pose of the laser radar in a world coordinate system is accurately estimated, the point cloud data are integrated into a world map, and the operation frequency of an algorithm adopted for mapping is lower than that of a mileage calculation method.
According to the laser autonomous positioning mapping method for the quadruped robot in the off-road environment, less than 100 three-dimensional feature points are extracted for registration on the basis of the original point cloud in S1, the number of the selected points is small, the processing of large-scale point cloud by similar ICP algorithm can be effectively avoided, the data accuracy is improved, and meanwhile, the workload can be reduced; .
The invention relates to a laser autonomous positioning mapping method for a quadruped robot in a cross-country environment, which specifically comprises the following steps of extracting edge points and plane points according to the value of c in step S1:
Figure BDA0003518683260000041
wherein i is pkA point of (1), pkFor the point cloud obtained by one scan of the laser scanner, i ∈ pkS is a set of continuous points near i in the same line scanning of the laser scanner, the S comprises half of points on two sides of i, and | S | is the number of the points;
Figure BDA0003518683260000042
modulo the normalized vector sum of points in i and S;
the modulus of the edge point vector sum is large, while the modulus of the plane point vector sum is small;
the points in the scan are sorted based on the c-value, and then the largest c-value and the smallest c-value are selected as feature points, wherein the largest c-value is an edge point, and the smallest c-value is a plane point.
In the autonomous laser positioning and mapping method for the quadruped robot in the off-road environment, when the point i is selected as the edge point or the plane point in the process of extracting the edge point and the plane point through the value of c in S1, the following conditions are also required to be met:
in order to uniformly distribute the characteristic points, the data obtained by each scanning needs to be uniformly divided into four regions, each region contains 2 edge points and 4 plane points at most, the number of the selected edge points or plane points cannot exceed the maximum value of the sub-region, the points in 10 points in the neighborhood around the point i cannot be selected again, and the point i cannot be on a plane which is approximately parallel to the laser beam and cannot be on the boundary of the shielded region;
assuming that point a is on a curved surface at an angle to the laser beam and point B is on a curved surface substantially parallel to the laser beam, point B is an unreliable laser echo and is not selected as a feature point, a real line segment is an object observable by the laser, and point a is on the boundary of the occlusion region and may be detected as an edge point, but if viewed from a different angle, the occlusion region may change and become observable, point a is not a significant edge point and may not be selected as a feature point.
The invention relates to a laser autonomous positioning mapping method for a quadruped robot in a cross-country environment, which comprises the following specific steps of registering two frames of point clouds in step S2:
1):tkdenotes the time at which the k-th scan starts, tk+1The point cloud p obtained by the scanning is used as the scanning end timekProjection to time stamp t after distortion correctionk+1The above step (1);
2): recording the point cloud after projection as pk
3): p will be used at the k +1 scankAnd newly acquired point cloud pk+1Performing registration to estimate the movement of the lidar;
4): at the end of the k-th scan, p is addedkReprojection of time stamp tk+1To obtain pkWherein p iskIs the point cloud perceived during the kth scan;
5): during the k +1 th scan, pkAnd a newly perceived point cloud pk+1Together for estimating the movement of the lidar;
6): for pk+1Extracting characteristic points from the laser radar point cloud, and recording epsilonk+1And Hk+1Respectively, the edge points and the plane points of the collection;
7): then find from pkHas an edge line of as ∈k+1Finding a plane as H according to the corresponding relation of the midpointsk+1The corresponding relation of the midpoints;
8): transform using current estimate will be epsilonk+1And Hk+1Re-projecting to coordinate system of scanning starting point, recording
Figure BDA0003518683260000061
And
Figure BDA0003518683260000062
the point set is re-projected, so that the pose transformation information of all points in the point cloud of the (k + 1) th frame can be obtained;
9): for the
Figure BDA0003518683260000063
And
Figure BDA0003518683260000064
will be at each point in
Figure BDA0003518683260000065
The corresponding relation is found out in the step (A),
Figure BDA0003518683260000066
the characteristic points of (2) are stored in a 3D KD-tree, which is commonly used as a range search and a nearest neighbor search.
The invention relates to a quadruped robot laser autonomous positioning mapping method in a cross-country environment, which is characterized in that two frames of point clouds are registered in step S2, and the specific method for registering three-dimensional edge feature points is as follows:
let i be
Figure BDA0003518683260000067
At the point of one of (a) and (b),
Figure BDA0003518683260000068
two points need to be found to represent the edge line, first at
Figure BDA0003518683260000069
Finding the point nearest to i, marking as j, then finding the point nearest to i in two continuous scans of the adjacent line of j, marking as l, then (j, l) forming the corresponding relation of i, wherein the nearest neighbor point is selected and used as the nearest neighbor index of KD-tree, in order to avoid the situation that the three points of i, j and l are collinear to cause no solution, j and l must come from the scans of different lines, and for the point
Figure BDA00035186832600000610
If (j, l) is the corresponding edge line,
Figure BDA00035186832600000611
the distance of the point to the edge line can be calculated as:
Figure BDA00035186832600000612
wherein
Figure BDA00035186832600000613
And
Figure BDA00035186832600000614
the coordinates of the points i, j and L in { L } respectively, and finding an edge line as
Figure BDA00035186832600000615
J is the point closest to the feature point, at
Figure BDA00035186832600000616
Finding a first line representing the same scan as j, a second line representing two consecutive scans, finding another point l on the second line for finding the correspondence of the edge line, and representing the correspondence as (j, l); geometric constraint relation constructed by three points i, j and l, dεIs the distance from the point to the edge line.
The invention relates to a quadruped robot laser autonomous positioning mapping method in a cross-country environment, which is characterized in that two frames of point clouds are registered in step S2, and the specific method for registering three-dimensional plane feature points is as follows: let i be
Figure BDA0003518683260000071
At the point of one of (a) and (b),
Figure BDA0003518683260000072
find three points to represent a plane, first at
Figure BDA0003518683260000073
Finding the point nearest to i, marking as j, then marking the other two points as l and m, which are the points nearest to i, i is in the same line scanning with j, m is the point in two continuous scans of the adjacent line of j, thus ensuring that the three points are non-collinear, and calculating the distance between the plane point and the corresponding plane for the point
Figure BDA0003518683260000074
If (j, l, m) is the corresponding plane,
Figure BDA0003518683260000075
the point-to-plane distance is then:
Figure BDA0003518683260000076
wherein
Figure BDA0003518683260000077
Is the coordinate of the mid-point m of { L }, find a plane as
Figure BDA0003518683260000078
J is the point closest to the feature point and can be in
Figure BDA0003518683260000079
Finding out the points l and m, and respectively finding out other two points l and m on different lines, wherein the corresponding relation is expressed as (j, l, m); the geometric constraint relation constructed by four points of i, j, l and m in the process of matching the characteristics of the plane points, dHIs the point-to-plane distance;
after the corresponding relation of the characteristic points is obtained, the positioning work of the patrol instrument is carried out, the carrier is assumed to have constant angular speed and linear speed in a short time in the scanning process of the laser radar, the linear interpolation posture conversion can be carried out on the points received at different times in the scanning process,
Figure BDA00035186832600000710
wherein, tk+1Is the time at which the (k + 1) th scan starts, tk+2To be the time at which the scanning is finished,
Figure BDA00035186832600000711
is [ t ]k+1,tk+2]The laser radar attitude change between the two modes,
Figure BDA00035186832600000712
including six-degree-of-freedom rigid movement of the laser radar,
Figure BDA0003518683260000081
wherein t isx,tyAnd tzIs a translation along the x-, y-and z-axes of { L }, and θxyAnd thetazIs the angle of rotation, t, following the right hand ruleiIs the time stamp of the point i,
Figure BDA0003518683260000082
is [ t ]k+1,ti]And the attitude of the laser radar is changed.
The invention relates to a quadruped robot laser autonomous positioning mapping method under a cross-country environment, wherein a geometric relationship is established between related point clouds in step S3, so that a specific method for performing motion compensation comprises the following steps:
from the transformation in equation (4), it can be derived,
Figure BDA0003518683260000083
wherein,
Figure BDA0003518683260000084
is epsilonk+1Or Hk+1The coordinates of the middle point i are,
Figure BDA0003518683260000085
is that
Figure BDA0003518683260000086
And
Figure BDA0003518683260000087
the corresponding point of (i) in (1),
Figure BDA0003518683260000088
is that
Figure BDA0003518683260000089
R is a rotation matrix defined by the Rodrigues equation, facilitating derivation:
Figure BDA00035186832600000810
in the above formula, θ is the rotation amplitude
Figure BDA00035186832600000811
ω is a unit vector representing the direction of rotation
Figure BDA00035186832600000812
Omega is
Figure BDA00035186832600000813
Is determined by the skew-symmetric matrix of (a),
by combining equation (2) and equations (4) - (8), ε can be obtainedk+1The edge points in (b) and the corresponding edge lines,
Figure BDA00035186832600000814
similarly, in combination with formula (3) and formulas (4) - (8), can be at Hk+1Another geometrical relationship is established between the plane points in (a) and the corresponding planes,
Figure BDA00035186832600000815
for epsilonk+1Or Hk+1The iteration of equations (8) and (9) for each feature point in (a) can obtain a non-linear function,
Figure BDA00035186832600000816
where each row of f corresponds to a feature point and d contains the corresponding distance. In this case, equation (11) has only one unknown quantity
Figure BDA0003518683260000091
Then, a Levenberg-Marquardt method is used for iterative optimization, and the aim is to find an optimal pose transformation
Figure BDA0003518683260000092
The distance d is minimized in such a way that,
first, calculate the relative
Figure BDA0003518683260000093
The Jacobian matrix of f, denoted J, where
Figure BDA0003518683260000094
Then, d is minimized to zero by iteration through equation (12),
Figure BDA0003518683260000095
where λ is a penalty factor determined by Levenberg-Marquardt.
The invention relates to a quadruped robot laser autonomous positioning mapping method under a cross-country environment, wherein in the step S4, a Levenberg-Marquardt algorithm is used for nonlinear optimization state estimation at the rear end, and the specific steps are as follows:
1): assuming that a nonlinear least square problem is researched, an optimization function is set, and an iteration step size of a Levenberg-Marquardt algorithm is defined:
Figure BDA0003518683260000096
where f (x) is an optimization function, the Levenberg-Marquardt algorithm defines an iteration step size of,
hlm=-(JTJ+μI)-1g,g=JTf and mu is more than or equal to 0 (14)
Where, f ═ f (x), J ═ J (x), is the jacobian matrix of f, μ is a penalty factor, and it has the following effects:
(1) when μ > 0, all coefficient matrices are positive, which ensures that hlmRepresents the descending direction of f (x), i.e. each step hlmWill result in a decrease in the value of f (x);
(2) when the value of μ is large, it is preferable that,
Figure BDA0003518683260000097
hlmdegenerating to an iteration step size of a steepest descent (steepbest) algorithm;
(3) if the value of mu is small or equal to zero,
hlm=-(JTJ)-1g (16)
hlmthe method has the advantages that the method is degraded into the iteration step length of the Gauss-Newton algorithm, is suitable for the final stage of iteration, is very close to the optimal solution, and avoids the oscillation of the steepest descent;
it follows that μ affects both the direction of descent of the function and the size of the iteration step, and in order to minimize the optimization function, μ should be set to a small value at the start of the iteration and the size of μ and the matrix a should be set to0=JT(x0)J(x0) The size of the middle element is related to that:
Figure BDA0003518683260000101
where tau is selected by the user on a case-by-case basis,
Figure BDA0003518683260000102
is a matrix A0The elements of (1);
2): in an iterative process, the confidence domain method is a common method for updating μ, and defines a gain ratio Q to control the update, as follows:
Figure BDA0003518683260000103
here, F (x) -F (x + h)lm) Is F (x) the actual reduction value of iteration at step k, L (h)lm) Is F (x + h)lm) Is a function of the linear approximation of (c),
Figure BDA0003518683260000104
denominator L (0) -L (h)lm) A decreasing value for the linear model prediction, which is constantly zero;
if Q is larger, indicate L (h)lm) Is F (x + h)lm) Better approximation can reduce mu, so that the algorithm is closer to the gauss-newton algorithm in the next iteration, if Q is very small or negative, the approximation effect is poor, mu needs to be increased to reduce the iteration step length, and at the moment, the algorithm is closer to the steepest descent method, specifically:
(1) when Q > 0, this iteration is valid
Figure BDA0003518683260000105
(2) When Q is less than or equal to 0, the iteration is invalid, and a parameter v is introduced to update:
μ=μ×v,v=2×v (21)
and finally, judging whether to finish iteration according to an iteration termination condition, wherein the method has two specific forms:
(1) one is that the gradient g satisfies
||g||≤ε1 (22)
Here epsilon1A defined threshold, positive, meaning that when the rate of iterative descent is almost zero, it is considered to have converged to near the extreme point;
(2) alternatively, when the amount of change in the variable x is too small, the iteration is considered to converge,
||xnew-x||<ε2(||x||+ε2) (23)
here,. epsilon2A positive number greater than zero, defined by the user;
3): defining a maximum number of iterations kmaxWhen the iteration number k is more than or equal to kmaxThe iteration is stopped to avoid the situation of infinite loop.
The invention relates to a quadruped robot laser autonomous positioning mapping method in a cross-country environment, which can map when accumulating a certain number of point clouds in step S5 and blend the point cloud data into a world map, and the specific method is as follows:
at the end of the (k + 1) th frame of point cloud scanning, a frame of undistorted point cloud can be obtained through a laser radar odometer,
Figure BDA0003518683260000111
and a pose change
Figure BDA0003518683260000112
It is contained in [ tk+1,tk+2]The mapping algorithm will be paired under the world coordinate system { W }, due to the movement of the laser radar in between
Figure BDA0003518683260000113
And (6) carrying out registration.
Herein is defined as QkFor the projection of all point clouds accumulated to the k-th frame under W,
Figure BDA0003518683260000114
is the last time t of the kth scanning of the laser radar on the mapk+1The mapping algorithm will follow the output of the laser radar odometer
Figure BDA0003518683260000115
From tk+1Extension to tk+2Thereby obtaining
Figure BDA0003518683260000116
Then pass through
Figure BDA0003518683260000117
Handle
Figure BDA0003518683260000118
Projected into the world coordinate System { W }, denoted
Figure BDA0003518683260000119
Then through registration
Figure BDA00035186832600001110
And QkTo further optimize radar pose
Figure BDA00035186832600001111
The invention relates to a laser autonomous positioning mapping method for a quadruped robot in a cross-country environment, which can optimize the position and pose of a radar
Figure BDA00035186832600001112
The method comprises the following steps:
Figure BDA00035186832600001113
representing the pose of the radar on a map
Figure BDA00035186832600001114
It is generated by the mapping algorithm at the kth frame;
radar motion between k +1 th frames
Figure BDA00035186832600001115
It is calculated by a mileage calculation method;
through
Figure BDA00035186832600001116
And
Figure BDA00035186832600001117
the distorted point cloud issued by the mileage calculation method can be mapped on a map and defined as
Figure BDA00035186832600001118
And matched to an existing map QkThe above step (1);
the definition and use of the mapping node for the feature points are the same as those of a mileage calculation method, but the number of the mapping node is more than ten times that of the mileage calculation method, so that a covariance matrix is introduced to find the corresponding relation of the feature points:
firstly, Q is put inkStored in a cube with a side length of 10m, will be combined with
Figure BDA00035186832600001119
Extracting points in the intersected cube and storing the points in the 3D KD-tree;
then, using a 3D KD-tree to index, and finding a group of point cloud data of the adjacent characteristic points, and recording the point cloud data as S'; according to the characteristic of the covariance matrix, the coordinate distribution of the three-dimensional points of one area and the eigenvalue and the eigenvector of the covariance matrix formed by the coordinate distribution can be known to have a certain relation;
then calculating a covariance matrix of S', recording the covariance matrix as M, and respectively recording the eigenvalue and the eigenvector of M as V and V; for a line approximated by V, which contains a feature value significantly larger than the other two, the corresponding feature vector is the line vector of the midpoint of S';
for S 'on an approximate plane, V contains two larger eigenvalues, the third eigenvalue is significantly smaller, and the eigenvector associated with the smallest eigenvalue in E is the normal vector of the plane on which the midpoint of S' lies. Determining the position of the edge line or plane through the geometric center of S';
thus, an edge line corresponding to a lower edge point of the world coordinate system is found, and a plane corresponding to the plane point is found;
next, selecting two points on the edge line, selecting three points on the plane, calculating the distance by using the formula same as the formula (2) and the formula (3), and then performing iterative optimization, wherein the method used in the method is the same as the method used in the odometer node;
finally, the obtained optimal transformation is utilized
Figure BDA0003518683260000121
Will be provided with
Figure BDA0003518683260000122
Superposing the map again to the map;
to evenly distribute the points, the size of the map cloud will be reduced by a voxel grid filter, the voxel size being a 5cm cube.
The technical scheme shows that the invention has the following beneficial effects:
1. the autonomous laser positioning and mapping method for the quadruped robot in the cross-country environment can autonomously estimate the pose state of the laser radar in the cross-country environment, enables the robot to autonomously estimate, position and navigate the pose state of the surrounding environment, improves the target detection precision, and completes the patrol exploration task of the quadruped robot in the cross-country environment.
2. The laser autonomous positioning and mapping method for the quadruped robot in the off-road environment, provided by the invention, has the advantages that the motion distortion generated by point cloud is assumed in the scanning process of the laser radar, the carrier has constant angular velocity and linear velocity in a short time, the linear interpolation attitude transformation can be carried out on points received at different times in scanning, the motion compensation is carried out, and the problem that the points in the point cloud can generate motion distortion along with the fluctuation motion of the laser radar when a vehicle cannot run stably due to a rugged road condition by adopting real-time mileages is solved.
Drawings
FIG. 1 is a flowchart for autonomous positioning mapping of a quadruped robot based on a laser radar in the invention;
FIG. 2 is a schematic diagram of feature point screening according to the present invention;
FIG. 3 is a schematic diagram of the time history of the point cloud reprojection according to the present invention;
FIG. 4 is a schematic diagram of the edge point feature matching process of the present invention, wherein (a) shows three points being non-collinear, and (b) shows the geometric relationship of the members;
FIG. 5 is a schematic diagram of a planar point feature matching process in the present invention, wherein (a) shows three points being non-collinear, and (b) shows a geometric relationship of the structure;
FIG. 6 is a schematic diagram of a laser radar mapping algorithm process according to the present invention;
FIG. 7 is a diagram illustrating the mapping result of the lidar-based system of the present invention.
Detailed Description
The invention is further elucidated with reference to the drawings and the embodiments.
Examples
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "clockwise", "counterclockwise", and the like, indicate orientations and positional relationships based on those shown in the drawings, and are used only for convenience of description and simplicity of description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, are not to be considered as limiting the present invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, unless otherwise specified, "a plurality" means two or more unless explicitly defined otherwise.
In the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the present invention, unless otherwise expressly stated or limited, "above" or "below" a first feature means that the first and second features are in direct contact, or that the first and second features are not in direct contact but are in contact with each other via another feature therebetween. Also, the first feature being "on," "above" and "over" the second feature includes the first feature being directly on and obliquely above the second feature, or merely indicating that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature includes the first feature being directly under and obliquely below the second feature, or simply meaning that the first feature is at a lesser elevation than the second feature.
A laser autonomous positioning mapping method of a quadruped robot in a cross-country environment is shown in the figure, and comprises the following steps: the real-time positioning and mapping are decomposed into two threads, wherein the first thread is a high-frequency thread, the patrol device motion estimation is mainly carried out at 10Hz, IMU mileage information is fused, and the second thread is a low-frequency thread and is mainly responsible for local mapping;
the specific mapping method comprises the following steps:
s1: acquiring laser radar original point cloud under a field environment, extracting less than 100 three-dimensional feature points on the basis of the original point cloud for registration, focusing the alternative three-dimensional feature points into edge points and plane points, and extracting the edge points and the plane points according to the value of c;
s2: after the three-dimensional characteristic points are obtained, registering the two frames of point clouds;
s3: establishing a geometric relation between the related point clouds, positioning the inspection device, and performing motion compensation on a distortion problem generated by the motion of the laser radar;
s4: redundant parameters are effectively processed through a Levenberg-Marquardt algorithm, and nonlinear optimization state estimation is carried out at the rear end by utilizing the Levenberg-Marquardt algorithm;
s5: when a certain number of point clouds are accumulated, mapping can be carried out, the pose of the laser radar in a world coordinate system is accurately estimated, point cloud data are fused into a world map, and the operation frequency of an algorithm adopted for mapping is lower than that of a mileage calculation method.
In the method for establishing a map by autonomous laser positioning of a quadruped robot in an off-road environment in this embodiment, the specific method for extracting edge points and plane points through the value of c in step S1 is as follows:
Figure BDA0003518683260000151
wherein i is pkA point of (1), pkFor the point cloud obtained by one scan of the laser scanner, i ∈ pkS is a set of continuous points near i in the same line scanning of the laser scanner, the S comprises half of points on two sides of i, and | S | is the number of the points;
Figure BDA0003518683260000152
modulo the normalized vector sum of points in i and S;
the modulus of the edge point vector sum is large, while the modulus of the plane point vector sum is small;
the points in the scan are sorted based on the c-value, and then the largest c-value and the smallest c-value are selected as feature points, wherein the largest c-value is an edge point, and the smallest c-value is a plane point.
In the laser autonomous positioning mapping method for the quadruped robot in the off-road environment described in this embodiment, in the process of extracting the edge point and the plane point by using the value of c in S1, when the point i is selected as the edge point or the plane point, the following conditions need to be satisfied:
in order to uniformly distribute the characteristic points, the data obtained by each scanning needs to be uniformly divided into four regions, each region contains 2 edge points and 4 plane points at most, the number of the selected edge points or plane points cannot exceed the maximum value of the sub-region, the points in 10 points in the neighborhood around the point i cannot be selected again, and the point i cannot be on a plane which is approximately parallel to the laser beam and cannot be on the boundary of the shielded region;
assuming that point a is on a curved surface at an angle to the laser beam and point B is on a curved surface substantially parallel to the laser beam as shown in fig. 2, point B is an unreliable laser echo and is not selected as a feature point, (B) a real line segment is an object observable by the laser, and point a is on the boundary of an occlusion region (a dotted line segment) and may be detected as an edge point, but if viewed from a different angle, the occlusion region may change and become observable, and point a is not a significant edge point and is not selected as a feature point.
After the point cloud features are extracted and stored in the map, the further scanned point clouds of the same name need to be effectively matched, and after the feature points are obtained in step S2, a specific method for registering the two frames of point clouds is as follows:
1):tkdenotes the time at which the k-th scan starts, tk+1The point cloud p obtained by the scanning is used as the scanning end timekProjection to time stamp t after distortion correctionk+1The above step (1);
2): the projected point cloud is recorded as figure 3
Figure BDA0003518683260000161
3): will be used at the k +1 th scan
Figure BDA0003518683260000162
And newly acquired point cloud pk+1Performing registration to estimate the movement of the lidar;
4): as shown in fig. 3, where the first line segment represents the point cloud p perceived during the k-th scankAt the end of the kth scan, p is addedkReprojection of time stamp tk+1To obtain
Figure BDA00035186832600001713
(second line segment) where pkIs the point cloud perceived during the kth scan;
5): during the (k + 1) th scan, pkAnd a newly perceived point cloud pk+1(third line segments) together used to estimate the movement of the lidar;
6): for pk+1Extracting characteristic points from the laser radar point cloud, and recording epsilonk+1And Hk+1Respectively, the edge points and the plane points of the image are collected;
7): then find out from
Figure BDA0003518683260000171
Has an edge line of as ∈k+1Finding a plane as H according to the corresponding relation of the midpointsk+1The corresponding relation of the midpoints;
8): to facilitate processing and correction of lidar motion distortion, epsilon is transformed using the current estimatek+1And Hk+1Projecting the coordinate system of the scanning starting point again to record
Figure BDA0003518683260000172
And
Figure BDA0003518683260000173
the point set is re-projected, so that pose transformation information of all points in the point cloud of the (k + 1) th frame can be obtained;
9): for the
Figure BDA0003518683260000174
And
Figure BDA0003518683260000175
will be at each point in
Figure BDA0003518683260000176
The corresponding relation is found out in the step (A),
Figure BDA0003518683260000177
the characteristic points of (2) are stored in a 3D KD-tree, which is commonly used as a range search and a nearest neighbor search.
In this embodiment, in step S2, two frames of point clouds are registered, and the specific method for registering the three-dimensional edge feature points is as follows:
let i be
Figure BDA0003518683260000178
At the point of one of (a) and (b),
Figure BDA0003518683260000179
two points need to be found to represent the edge line, first at
Figure BDA00035186832600001710
Finding out the point nearest to i, marking as j, then finding out the point nearest to i in two continuous scans of the adjacent line of j, marking as l, then forming the corresponding relation of i (j, l), wherein the nearest neighbor point is selected by using the nearest neighbor index of KD-tree, in order to avoid that the three points of i, j and l are collinear to cause no solution, j and l must come from the scans of different lines, and for the point
Figure BDA00035186832600001711
If (j, l) is the corresponding edge line,
Figure BDA00035186832600001712
the distance of the point to the edge line can be calculated as:
Figure BDA0003518683260000181
wherein
Figure BDA0003518683260000182
And
Figure BDA0003518683260000183
the coordinates of points i, j and L in { L }, respectively, as shown in FIG. 4, where (a) finds an edge line as
Figure BDA0003518683260000184
J is the point closest to the feature point, at
Figure BDA0003518683260000185
Finding a first line representing the same scan as j and a second line representing two consecutive scans, finding another point l on the second line in order to find the correspondence of the edge line in (a), and representing the correspondence as (j, l); geometric constraint relation constructed by three points i, j and l, dεIs the distance from the point to the edge line.
In this embodiment, the two frames of point clouds are registered in step S2, and the specific method for registering the three-dimensional plane feature points is as follows:
as shown in FIG. 5, let i be
Figure BDA0003518683260000186
At the point of one of (a) and (b),
Figure BDA0003518683260000187
find three points to represent a plane, first at
Figure BDA0003518683260000188
Find the point closest to i, denoted as j, then, note the other two points as l and m, which are the points nearest to i, l is in the same line scan as j, m is the point in two consecutive scans of the adjacent line to j, which ensures thatThe three points are non-collinear, and similarly, the distance between a plane point and a corresponding plane is calculated, and for the point
Figure BDA0003518683260000189
If (j, l, m) is the corresponding plane,
Figure BDA00035186832600001810
the point-to-plane distance is then:
Figure BDA00035186832600001811
wherein
Figure BDA00035186832600001812
Is the coordinate of the mid-point m of { L }, as shown in FIG. 5, the process in (a) finds a plane as
Figure BDA00035186832600001813
J is the point closest to the feature point and can be in
Figure BDA00035186832600001814
Then finding out another two points l and m on different lines of the third line and the fourth line respectively, wherein the corresponding relation is expressed as (j, l, m); the geometric constraint relationship constructed by i, j, l, m four points in the plane point feature matching process is shown as (b) in fig. 5, dHIs the point-to-plane distance;
after the corresponding relation of the characteristic points is obtained, the positioning work of the patrol instrument is carried out, the carrier is assumed to have constant angular speed and linear speed in a short time in the scanning process of the laser radar, the linear interpolation posture conversion can be carried out on the points received at different times in the scanning process,
Figure BDA0003518683260000191
wherein, tk+1Is the time at which the (k + 1) th scan starts, tk+2To be the time at which the scanning is finished,
Figure BDA0003518683260000192
is [ t ]k+1,tk+2]The laser radar posture is changed between the two modes,
Figure BDA0003518683260000193
including six-degree-of-freedom rigid movement of the laser radar,
Figure BDA0003518683260000194
wherein t isx,tyAnd tzIs a translation along the x-, y-and z-axes of { L }, and θxyAnd thetazIs the angle of rotation, t, following the right hand ruleiIs the time stamp of the point i,
Figure BDA0003518683260000195
is [ t ]k+1,ti]And the attitude of the laser radar is changed.
In this embodiment, the specific method for establishing a geometric relationship between the related point clouds in step S3 and performing motion compensation is as follows:
from the transformation in equation (4), it can be derived,
Figure BDA0003518683260000196
wherein,
Figure BDA0003518683260000197
is epsilonk+1Or Hk+1The coordinates of the middle point i are,
Figure BDA0003518683260000198
is that
Figure BDA0003518683260000199
And
Figure BDA00035186832600001910
the corresponding point of (i) in (1),
Figure BDA00035186832600001911
is that
Figure BDA00035186832600001912
R is a rotation matrix defined by the Rodrigues equation, facilitating derivation:
Figure BDA00035186832600001913
in the above formula, θ is the rotation amplitude
Figure BDA00035186832600001914
ω is a unit vector representing the direction of rotation
Figure BDA00035186832600001915
Omega is
Figure BDA00035186832600001916
Is determined by the skew-symmetric matrix of (a),
by combining equation (2) and equations (4) - (8), ε can be obtainedk+1The edge points in (b) and the corresponding edge lines,
Figure BDA0003518683260000201
similarly, in combination with formula (3) and formulas (4) - (8), can be at Hk+1Another geometrical relationship is established between the plane points in (a) and the corresponding planes,
Figure BDA0003518683260000202
for epsilonk+1Or Hk+1The iteration of equations (8) and (9) for each feature point in (a) can obtain a non-linear function,
Figure BDA0003518683260000203
where each row of f corresponds to a feature point and d contains the corresponding distance. In this case, equation (11) has only one unknown quantity
Figure BDA0003518683260000204
Then, a Levenberg-Marquardt method is used for iterative optimization, and the aim is to find an optimal pose transformation
Figure BDA0003518683260000205
The distance d is minimized in such a way that,
first, calculate the relative
Figure BDA0003518683260000206
The Jacobian matrix of f, denoted J, where
Figure BDA0003518683260000207
Then, d is minimized to zero by iteration through equation (12),
Figure BDA0003518683260000208
where λ is a penalty factor determined by Levenberg-Marquardt.
In the step S4 in this embodiment, a Levenberg-Marquardt algorithm is used at the back end to perform nonlinear optimization state estimation, and the specific steps are as follows:
1): assuming that a nonlinear least square problem is researched, an optimization function is set, and an iteration step size of a Levenberg-Marquardt algorithm is defined:
Figure BDA0003518683260000209
where f (x) is an optimization function, the Levenberg-Marquardt algorithm defines an iteration step size of,
hlm=-(JTJ+μI)-1g,g=JTf and mu is more than or equal to 0 (14)
Where, f ═ f (x), J ═ J (x), is the jacobian matrix of f, μ is a penalty factor, and it has the following effects:
(1) when μ > 0, all coefficient matrices are positive, which ensures that hlmRepresents the descending direction of f (x), i.e. each step hlmWill result in a decrease in the value of f (x);
(2) when the value of μ is large, it is preferable that,
Figure BDA0003518683260000211
hlmdegenerating to an iteration step size of a steepest descent (steepest gradient) algorithm;
(3) if the value of mu is small or equal to zero,
hlm=-(JTJ)-1g (16)
hlmthe method has the advantages that the method is degraded into the iteration step length of the Gauss-Newton algorithm, is suitable for the final stage of iteration, is very close to the optimal solution, and avoids the oscillation of the steepest descent;
it follows that μ affects both the descending direction of the function and the size of the iteration step, and that μ should be set to a small value at the start of the iteration and the size of μ and the matrix a in order to minimize the optimization function0=JT(x0)J(x0) The size of the middle element is related to that:
Figure BDA0003518683260000212
where tau is selected by the user on a case-by-case basis,
Figure BDA0003518683260000213
is a matrix A0The elements of (1);
2): in an iterative process, the confidence domain method is a common method for updating μ, and defines a gain ratio Q to control the update, as follows:
Figure BDA0003518683260000214
here, F (x) -F (x + h)lm) Is F (x) the actual reduction value of iteration at step k, L (h)lm) Is F (x + h)lm) Is a function of the linear approximation of (c),
Figure BDA0003518683260000215
denominator L (0) -L (h)lm) A decreasing value for the linear model prediction, which is constantly zero;
if Q is larger, indicate L (h)lm) Is F (x + h)lm) Better approximation can reduce mu, so that the algorithm is closer to the gauss-newton algorithm in the next iteration, if Q is very small or negative, the approximation effect is poor, mu needs to be increased to reduce the iteration step length, and at the moment, the algorithm is closer to the steepest descent method, specifically:
(1) when Q > 0, this iteration is valid
Figure BDA0003518683260000216
(2) When Q is less than or equal to 0, the iteration is invalid, and a parameter v is introduced to update:
μ=μ×v,v=2×v (21)
and finally, judging whether to finish iteration according to an iteration termination condition, wherein the method has two specific forms:
(1) one is that the gradient g satisfies
||g||≤ε1 (22)
Where epsilon1A defined threshold, positive, meaning a number of times when the iteration is downWhen zero is reached, the convergence to the vicinity of the extreme point is considered;
(2) alternatively, when the amount of change in the variable x is too small, the iteration is considered to converge,
||xnew-x||<ε2(||x||+ε2) (23)
here,. epsilon2A positive number greater than zero, defined by the user;
3): defining a maximum number of iterations kmaxWhen the iteration number k is more than or equal to kmaxThe iteration is stopped to avoid the situation of infinite loop.
The specific calculation process of the Levenberg-Marquardt algorithm in this embodiment is as follows:
Figure BDA0003518683260000221
Figure BDA0003518683260000231
in this embodiment, when a certain number of point clouds are accumulated in step S5, a map may be built, and the point cloud data is merged into a world map, which includes the following specific steps:
at the end of the (k + 1) th frame of point cloud scanning, a frame of undistorted point cloud can be obtained through a laser radar odometer,
Figure BDA0003518683260000232
and a pose change
Figure BDA0003518683260000233
It is contained in [ tk+1,tk+2]Will be paired under the world coordinate system { W }, the mapping algorithm
Figure BDA0003518683260000234
And (6) carrying out registration.
Herein is defined as QkFor all point clouds accumulated to the k frame under { W }The projection of (a) is performed,
Figure BDA0003518683260000235
is the last time t of the kth scanning of the laser radar on the mapk+1The mapping algorithm will follow the output of the laser radar odometer
Figure BDA0003518683260000236
From tk+1Extension to tk+2Thereby obtaining
Figure BDA0003518683260000237
Then pass through
Figure BDA0003518683260000238
Handle
Figure BDA0003518683260000239
Projected into the world coordinate System { W }, denoted
Figure BDA00035186832600002310
Then through registration
Figure BDA00035186832600002311
And QkTo further optimize radar pose
Figure BDA00035186832600002312
The embodiment has the advantages of optimizing the radar pose
Figure BDA00035186832600002313
The method comprises the following steps:
as shown in figure 6 of the drawings,
Figure BDA00035186832600002314
representing the pose of the radar on a map
Figure BDA00035186832600002315
It is generated by the mapping algorithm at the kth frame;
the first curve segment in FIG. 6 represents the radar motion between the (k + 1) th frame
Figure BDA00035186832600002316
It is calculated by a mileage calculation method;
through
Figure BDA00035186832600002317
And
Figure BDA00035186832600002318
the distorted point cloud issued by the mileage calculation method can be mapped on a map and defined as
Figure BDA00035186832600002319
(second line segment in fig. 6) and matched to the existing map Qk(broken line in FIG. 6);
the definition and use of the characteristic points by the mapping node are the same as those of a mileage calculation method, but the quantity of the mapping node is more than ten times that of the mileage calculation method, so that a covariance matrix is introduced to find the corresponding relation of the characteristic points:
firstly, Q is put inkStored in a cube with a side length of 10m, will be combined with
Figure BDA00035186832600002320
Extracting points in the intersected cube and storing the points in the 3D KD-tree;
then, using a 3D KD-tree to index, and finding a group of point cloud data of the adjacent characteristic points, and recording the point cloud data as S'; according to the characteristic of the covariance matrix, the coordinate distribution of the three-dimensional points of one area and the eigenvalue and the eigenvector of the covariance matrix formed by the coordinate distribution can be known to have a certain relation;
then, calculating a covariance matrix of S', and recording the covariance matrix as M, wherein the eigenvalue and the eigenvector of M are respectively recorded as V and V; for a line approximated by V, which contains a feature value significantly larger than the other two, the corresponding feature vector is the line vector of the midpoint of S';
for S 'on an approximate plane, V contains two larger eigenvalues, the third eigenvalue is significantly smaller, and the eigenvector associated with the smallest eigenvalue in E is the normal vector of the plane on which the midpoint of S' lies. Determining the position of the edge line or plane through the geometric center of S';
thus, an edge line corresponding to a lower edge point of the world coordinate system is found, and a plane corresponding to the plane point is found; next, selecting two points on the edge line, selecting three points on the plane, calculating the distance by using the formula same as the formula (2) and the formula (3), and then performing iterative optimization, wherein the method used in the method is the same as the method used in the odometer node;
finally, the obtained optimal transformation is utilized
Figure BDA0003518683260000241
Will be provided with
Figure BDA0003518683260000242
Superposing the map again to the map;
to evenly distribute the points, the size of the map cloud will be reduced by a voxel grid filter, voxel size being a cube of 5cm, as shown in fig. 7.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that modifications can be made by those skilled in the art without departing from the principle of the present invention, and these modifications should also be construed as the protection scope of the present invention.

Claims (10)

1. A laser autonomous positioning mapping method for a quadruped robot in a cross-country environment is characterized by comprising the following steps: the method comprises the following steps: the real-time positioning and mapping are decomposed into two threads, wherein the first thread is a high-frequency thread, the patrol device motion estimation is mainly carried out at 10Hz, IMU mileage information is fused, and the second thread is a low-frequency thread and is mainly responsible for local mapping;
the specific mapping method comprises the following steps:
s1: acquiring laser radar original point cloud under a field environment, extracting less than 100 three-dimensional feature points for registration on the basis of the original point cloud, focusing the alternative three-dimensional feature points into edge points and plane points, and extracting the edge points and the plane points according to the value c;
s2: after the three-dimensional characteristic points are obtained, registering the two frames of point clouds;
s3: establishing a geometric relation between the related point clouds, positioning the inspection device, and performing motion compensation on a distortion problem generated by the motion of the laser radar;
s4: the redundancy parameters are effectively processed through a Levenberg-Marquardt algorithm, and nonlinear optimization state estimation is carried out at the rear end through the Levenberg-Marquardt algorithm;
s5: when a certain number of point clouds are accumulated, mapping can be carried out, the pose of the laser radar in a world coordinate system is accurately estimated, the point cloud data are integrated into a world map, and the operation frequency of an algorithm adopted for mapping is lower than that of a mileage calculation method.
2. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 1, characterized in that: the specific method for extracting the edge points and the plane points according to the value of c in step S1 is as follows:
Figure FDA0003518683250000011
wherein i is pkA point of (1), pkFor the point cloud obtained by one scan of the laser scanner, i ∈ pkS is a set of continuous points near i in the same line scanning of the laser scanner, the S comprises half of points on two sides of i, and | S | is the number of the points;
Figure FDA0003518683250000021
modulo the normalized vector sum of points in i and S;
the modulus of the edge point vector sum is large, while the modulus of the plane point vector sum is small;
the points in the scan are sorted based on the c-value, and then the largest c-value and the smallest c-value are selected as feature points, wherein the largest c-value is an edge point, and the smallest c-value is a plane point.
3. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 2, characterized in that: in the process of extracting the edge point and the plane point by the value of c in S1, when the point i is selected as the edge point or the plane point, the following condition needs to be satisfied:
in order to uniformly distribute the characteristic points, the data obtained by each scanning needs to be uniformly divided into four regions, each region contains 2 edge points and 4 plane points at most, the number of the selected edge points or plane points cannot exceed the maximum value of the sub-region, the points in 10 points in the neighborhood around the point i cannot be selected again, and the point i cannot be on a plane which is approximately parallel to the laser beam and cannot be on the boundary of the shielded region;
assuming that point a is on a curved surface at an angle to the laser beam and point B is on a curved surface substantially parallel to the laser beam, point B is an unreliable laser echo and is not selected as a feature point, a real line segment is an object observable by the laser, and point a is on the boundary of the occlusion region and may be detected as an edge point, but if viewed from a different angle, the occlusion region may change and become observable, point a is not a significant edge point and may not be selected as a feature point.
4. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 2, characterized in that: the specific method for registering the two frames of point clouds in the step S2 is as follows:
1):tkdenotes the time at which the k-th scan starts, tk+1The point cloud p obtained by the scanning is used as the scanning end timekProjection to time stamp t after distortion correctionk+1The above step (1);
2): recording the point cloud after projection
Figure FDA0003518683250000031
3): at the k-thWill be used for +1 scan
Figure FDA0003518683250000032
And newly acquired point cloud pk+1Performing registration to estimate the movement of the lidar;
4): at the end of the kth scan, p is dividedkReprojection of time stamp tk+1To obtain
Figure FDA0003518683250000033
Wherein p iskIs the point cloud perceived during the kth scan;
5): during the (k + 1) th scan, pkAnd a newly perceived point cloud pk+1Together for estimating the movement of the lidar;
6): for pk+1Extracting characteristic points from the laser radar point cloud, and recording epsilonk+1And Hk+1Respectively, the edge points and the plane points of the collection;
7): then find out from
Figure FDA0003518683250000034
Has an edge line of as ∈k+1Finding a plane as H according to the corresponding relation of the midpointsk+1The corresponding relation of the midpoints;
8): transform using current estimate will be epsilonk+1And Hk+1Projecting the coordinate system of the scanning starting point again to record
Figure FDA0003518683250000035
And
Figure FDA0003518683250000036
the point set is re-projected, so that pose transformation information of all points in the point cloud of the (k + 1) th frame can be obtained;
9): for the
Figure FDA0003518683250000037
And
Figure FDA0003518683250000038
will be at each point in
Figure FDA0003518683250000039
The corresponding relation is found out in the step (A),
Figure FDA00035186832500000310
the characteristic points of (2) are stored in a 3D KD-tree, which is commonly used as a range search and a nearest neighbor search.
5. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 4, characterized in that: in step S2, the two frames of point clouds are registered, and the specific method of the three-dimensional edge feature point registration is as follows:
let i be
Figure FDA0003518683250000041
At the point of one of (a) and (b),
Figure FDA0003518683250000042
two points need to be found to represent the edge line, first at
Figure FDA0003518683250000043
Finding the point nearest to i, marking as j, then finding the point nearest to i in two continuous scans of the adjacent line of j, marking as l, then (j, l) forming the corresponding relation of i, wherein the nearest neighbor point is selected and used as the nearest neighbor index of KD-tree, in order to avoid the situation that the three points of i, j and l are collinear to cause no solution, j and l must come from the scans of different lines, and for the point
Figure FDA0003518683250000044
If (j, l) is the corresponding edge line,
Figure FDA0003518683250000045
the distance of the point to the edge line can be calculated as:
Figure FDA0003518683250000046
wherein
Figure FDA0003518683250000047
And
Figure FDA0003518683250000048
the coordinates of the points i, j and L in { L } respectively, and finding an edge line as
Figure FDA0003518683250000049
J is the point closest to the feature point, at
Figure FDA00035186832500000410
Finding a first line representing the same scan as j, a second line representing two consecutive scans, finding another point l on the second line for finding the correspondence of the edge line, and representing the correspondence as (j, l); geometric constraint relation constructed by three points i, j and l, dεIs the distance from the point to the edge line.
6. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 4, characterized in that: in step S2, registering the two frames of point clouds, where the specific method of registering the three-dimensional plane feature points is as follows:
let i be
Figure FDA00035186832500000411
At the point of one of (a) and (b),
Figure FDA00035186832500000412
find three points to represent a plane, first at
Figure FDA00035186832500000413
Finding the point nearest to i, marking as j, then marking the other two points as l and m, which are the points nearest to i, i is in the same line scanning with j, m is the point in two continuous scans of the adjacent line of j, thus ensuring that the three points are non-collinear, and calculating the distance between the plane point and the corresponding plane for the point
Figure FDA00035186832500000414
If (j, l, m) is the corresponding plane,
Figure FDA00035186832500000415
the point-to-plane distance is then:
Figure FDA0003518683250000051
wherein
Figure FDA0003518683250000052
Is the coordinate of the mid-point m of { L }, find a plane as
Figure FDA0003518683250000053
J is the point closest to the feature point and can be in
Figure FDA0003518683250000054
Finding out the points l and m, and respectively finding out other two points l and m on different lines, wherein the corresponding relation is expressed as (j, l, m); the geometric constraint relation constructed by four points of i, j, l and m in the process of matching the characteristics of the plane points, dHIs the point-to-plane distance;
after the corresponding relation of the characteristic points is obtained, the positioning work of the patrol instrument is carried out, the carrier is assumed to have constant angular speed and linear speed in a short time in the scanning process of the laser radar, the linear interpolation posture conversion can be carried out on the points received at different times in the scanning process,
Figure FDA0003518683250000055
wherein, tk+1Is the time at which the (k + 1) th scan starts, tk+2To be the time at which the scanning is finished,
Figure FDA0003518683250000056
is [ t ]k+1,tk+2]The laser radar posture is changed between the two modes,
Figure FDA0003518683250000057
including six-degree-of-freedom rigid movement of the laser radar,
Figure FDA0003518683250000058
wherein t isx,tyAnd tzIs a translation along the x-, y-and z-axes of { L }, and θxyAnd thetazIs the angle of rotation, t, following the right hand ruleiIs the time stamp of the point i,
Figure FDA0003518683250000059
is [ t ]k+1,ti]And the attitude of the laser radar is changed.
7. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 6, characterized in that: in step S3, a geometric relationship is established between the related point clouds, and a specific method for performing motion compensation is as follows:
from the transformation in equation (4), it can be derived,
Figure FDA00035186832500000510
wherein,
Figure FDA00035186832500000511
is epsilonk+1Or Hk+1The coordinates of the middle point i are,
Figure FDA00035186832500000512
is that
Figure FDA00035186832500000513
And
Figure FDA00035186832500000514
the corresponding point of (i) in (1),
Figure FDA0003518683250000061
is that
Figure FDA0003518683250000062
R is a rotation matrix defined by the Rodrigues equation, facilitating derivation:
Figure FDA0003518683250000063
in the above formula, θ is the rotation amplitude
Figure FDA0003518683250000064
ω is a unit vector representing the direction of rotation
Figure FDA0003518683250000065
Omega is
Figure FDA0003518683250000066
Of the diagonal-symmetrical matrix of (a),
by combining equation (2) and equations (4) - (8), ε can be obtainedk+1The edge points in (b) and the corresponding edge lines,
Figure FDA0003518683250000067
similarly, in combination with formula (3) and formulas (4) - (8), can be at Hk+1Another geometrical relationship is established between the plane points in (a) and the corresponding planes,
Figure FDA0003518683250000068
for epsilonk+1Or Hk+1The iteration of equations (8) and (9) for each feature point in (a) can obtain a non-linear function,
Figure FDA0003518683250000069
where each row of f corresponds to a feature point and d contains the corresponding distance. In this case, equation (11) has only one unknown quantity
Figure FDA00035186832500000610
Then, a Levenberg-Marquardt method is used for iterative optimization, and the aim is to find an optimal pose transformation
Figure FDA00035186832500000611
The distance d is minimized in such a way that,
first, calculate the relative
Figure FDA00035186832500000612
The Jacobian matrix of f, denoted J, where
Figure FDA00035186832500000613
Then, d is minimized to zero by iteration through equation (12),
Figure FDA00035186832500000614
where λ is a penalty factor determined by Levenberg-Marquardt.
8. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 7, characterized in that: in the step S4, the Levenberg-Marquardt algorithm is used at the back end to perform nonlinear optimization state estimation, and the specific steps are as follows:
1): assuming that a nonlinear least square problem is researched, an optimization function is set, and an iteration step size of a Levenberg-Marquardt algorithm is defined:
Figure FDA0003518683250000071
where f (x) is an optimization function, the Levenberg-Marquardt algorithm defines an iteration step size of,
hlm=-(JTJ+μI)-1g,g=JTf and mu is more than or equal to 0 (14)
Where, f ═ f (x), J ═ J (x), is the jacobian matrix of f, μ is a penalty factor, and it has the following effects:
(1) when μ > 0, all coefficient matrices are positive, which ensures that hlmRepresents the descending direction of f (x), i.e. each step hlmWill result in a decrease in the value of f (x);
(2) when the value of μ is large, it is preferable that,
Figure FDA0003518683250000072
hlmdegenerating to an iteration step size of a steepest descent (steepest gradient) algorithm;
(3) if the value of mu is small or equal to zero,
hlm=-(JTJ)-1g (16)
hlmdegradation of stool into gauss newton's calculationThe iteration step length of the method is suitable for the final stage of iteration, is very close to the optimal solution, and avoids the oscillation of the steepest descent;
it follows that μ affects both the descending direction of the function and the size of the iteration step, and that μ should be set to a small value at the start of the iteration and the size of μ and the matrix a in order to minimize the optimization function0=JT(x0)J(x0) The size of the middle element is related to that:
Figure FDA0003518683250000073
where tau is selected by the user on a case-by-case basis,
Figure FDA0003518683250000074
is a matrix A0The element (1) in (1);
2): in an iterative process, the confidence domain method is a common method for updating μ, and defines a gain ratio Q to control the update, as follows:
Figure FDA0003518683250000075
here, F (x) -F (x + h)lm) Is F (x) the actual reduction value of iteration at step k, L (h)lm) Is F (x + h)lm) Is a function of the linear approximation of (c),
Figure FDA0003518683250000081
denominator L (0) -L (h)lm) A decreasing value for the linear model prediction, which is constantly zero;
if Q is larger, indicate L (h)lm) Is F (x + h)lm) Better approximation can reduce mu, so that the algorithm is closer to the Gauss-Newton algorithm in the next iteration, if Q is very small or negative, the approximation effect is poor, and mu needs to be increased to reduce the iteration stepLong, when the algorithm is closer to the steepest descent method, specifically:
(1) when Q > 0, this iteration is valid
Figure FDA0003518683250000082
(2) When Q is less than or equal to 0, the iteration is invalid, and a parameter v is introduced to update:
μ=μ×v,v=2×v (21)
and finally, judging whether to finish iteration according to an iteration termination condition, wherein the method has two specific forms:
(1) one is that the gradient g satisfies
||g||≤ε1 (22)
Where epsilon1A defined threshold, positive, meaning that when the rate of iterative descent is almost zero, it is considered to have converged to near the extreme point;
(2) alternatively, when the amount of change in the variable x is too small, the iteration is considered to converge,
||xnew-x||<ε2(||x||+ε2) (23)
here,. epsilon2A positive number greater than zero, defined by the user;
3): defining a maximum number of iterations kmaxWhen the iteration number k is more than or equal to kmaxThe iteration is stopped to avoid the situation of infinite loop.
9. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 8, characterized in that: in step S5, when a certain number of point clouds are accumulated, a map may be created, and the point cloud data is merged into a world map, which includes the following specific steps: at the end of the (k + 1) th frame of point cloud scanning, a frame of undistorted point cloud can be obtained through a laser radar odometer,
Figure FDA0003518683250000083
and a pose change
Figure FDA0003518683250000084
It is contained in [ tk+1,tk+2]Will be paired under the world coordinate system { W }, the mapping algorithm
Figure FDA0003518683250000091
And (6) carrying out registration.
Herein is defined as QkFor the projection of all point clouds accumulated to the k-th frame under W,
Figure FDA0003518683250000092
is the last time t of the kth scanning of the laser radar on the mapk+1Along with the output of the laser radar odometer, the mapping algorithm will be
Figure FDA0003518683250000093
From tk+1Extension to tk+2Thereby obtaining
Figure FDA0003518683250000094
Then pass through
Figure FDA0003518683250000095
Handle
Figure FDA0003518683250000096
Projected into the world coordinate System { W }, denoted
Figure FDA0003518683250000097
Then through registration
Figure FDA0003518683250000098
And QkTo further optimize radar pose
Figure FDA0003518683250000099
10. The cross-country environment quadruped robot laser autonomous positioning mapping method according to claim 9, characterized in that: with optimized radar pose
Figure FDA00035186832500000910
The method comprises the following steps:
Figure FDA00035186832500000911
representing the pose of the radar on a map
Figure FDA00035186832500000912
It is generated by the mapping algorithm at the kth frame;
radar motion between k +1 th frames
Figure FDA00035186832500000913
It is calculated by a mileage calculation method;
through
Figure FDA00035186832500000914
And
Figure FDA00035186832500000915
the distorted point cloud issued by the mileage calculation method can be mapped on a map and defined as
Figure FDA00035186832500000916
And matched to an existing map QkThe above step (1);
the definition and use of the characteristic points by the mapping node are the same as those of a mileage calculation method, but the quantity of the mapping node is more than ten times that of the mileage calculation method, so that a covariance matrix is introduced to find the corresponding relation of the characteristic points:
firstly, Q is put inkStored in a cube with a side length of 10m, will be combined with
Figure FDA00035186832500000917
Extracting points in the intersected cube and storing the points in the 3D KD-tree;
then, using a 3D KD-tree to index, and finding a group of point cloud data of the adjacent characteristic points, and recording the point cloud data as S'; according to the characteristic of the covariance matrix, the coordinate distribution of the three-dimensional points of one area and the eigenvalue and the eigenvector of the covariance matrix formed by the coordinate distribution can be known to have a certain relation;
then, calculating a covariance matrix of S', and recording the covariance matrix as M, wherein the eigenvalue and the eigenvector of M are respectively recorded as V and V; for a line approximated by V, which contains a feature value significantly larger than the other two, the corresponding feature vector is the line vector of the midpoint of S';
for S ' on an approximate plane, V contains two larger characteristic values, the third characteristic value is obviously smaller, the characteristic vector related to the minimum characteristic value in E is the normal vector of the plane where the midpoint of S ' is located, and the position of the edge line or the plane is determined through the geometric center of S ';
thus, an edge line corresponding to a lower edge point of the world coordinate system is found, and a plane corresponding to the plane point is found; next, selecting two points on the edge line, selecting three points on the plane, calculating the distance by using the formula same as the formula (2) and the formula (3), and then performing iterative optimization, wherein the method used in the method is the same as the method used in the odometer node;
finally, the obtained optimal transformation is utilized
Figure FDA0003518683250000101
Will be provided with
Figure FDA0003518683250000102
Superposing the map again to the map;
to evenly distribute the points, the size of the map cloud will be reduced by a voxel grid filter, the voxel size being a 5cm cube.
CN202210172153.9A 2022-02-24 2022-02-24 Laser autonomous positioning mapping method for quadruped robot in cross-country environment Withdrawn CN114581519A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210172153.9A CN114581519A (en) 2022-02-24 2022-02-24 Laser autonomous positioning mapping method for quadruped robot in cross-country environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210172153.9A CN114581519A (en) 2022-02-24 2022-02-24 Laser autonomous positioning mapping method for quadruped robot in cross-country environment

Publications (1)

Publication Number Publication Date
CN114581519A true CN114581519A (en) 2022-06-03

Family

ID=81770438

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210172153.9A Withdrawn CN114581519A (en) 2022-02-24 2022-02-24 Laser autonomous positioning mapping method for quadruped robot in cross-country environment

Country Status (1)

Country Link
CN (1) CN114581519A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115079128A (en) * 2022-08-23 2022-09-20 深圳市欢创科技有限公司 Method and device for distortion removal of laser radar point cloud data and robot
CN118381927A (en) * 2024-06-24 2024-07-23 杭州宇泛智能科技股份有限公司 Dynamic point cloud compression method, system, storage medium and device based on multi-mode bidirectional circulating scene flow

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115079128A (en) * 2022-08-23 2022-09-20 深圳市欢创科技有限公司 Method and device for distortion removal of laser radar point cloud data and robot
CN118381927A (en) * 2024-06-24 2024-07-23 杭州宇泛智能科技股份有限公司 Dynamic point cloud compression method, system, storage medium and device based on multi-mode bidirectional circulating scene flow

Similar Documents

Publication Publication Date Title
CN111337941B (en) Dynamic obstacle tracking method based on sparse laser radar data
Yuan et al. Efficient and probabilistic adaptive voxel mapping for accurate online lidar odometry
Borrmann et al. Globally consistent 3D mapping with scan matching
CN108759833A (en) A kind of intelligent vehicle localization method based on priori map
CN114581519A (en) Laser autonomous positioning mapping method for quadruped robot in cross-country environment
CN104732518A (en) PTAM improvement method based on ground characteristics of intelligent robot
CN113706710B (en) Virtual point multi-source point cloud fusion method and system based on FPFH characteristic difference
CN112444246B (en) Laser fusion positioning method in high-precision digital twin scene
CN110021039A (en) The multi-angle of view material object surface point cloud data initial registration method of sequence image constraint
CN116908810B (en) Method and system for measuring earthwork of building by carrying laser radar on unmanned aerial vehicle
CN111932614B (en) Laser radar instant positioning and mapping method based on clustering center characteristics
CN114659514A (en) LiDAR-IMU-GNSS fusion positioning method based on voxelized fine registration
CN111123953B (en) Particle-based mobile robot group under artificial intelligence big data and control method thereof
CN114066773B (en) Dynamic object removal based on point cloud characteristics and Monte Carlo expansion method
CN117392268A (en) Laser scanning mapping method and system based on self-adaption combined CPD and ICP algorithm
WO2023226154A1 (en) Autonomous localization method and apparatus, and device and computer-readable storage medium
CN114897967A (en) Material form recognition method for autonomous operation of excavating equipment
CN114648571A (en) Method for filtering obstacles in driving area in high-precision mapping of robot
Youji et al. A SLAM method based on LOAM for ground vehicles in the flat ground
CN113256693A (en) Multi-view registration method based on K-means and normal distribution transformation
CN111462321A (en) Point cloud map processing method, processing device, electronic device and vehicle
Liu et al. Flexible ground constrained LiDAR SLAM with a novel plane detection
CN113920180B (en) Point cloud registration optimization method based on normal distribution transformation hypothesis verification
CN112950683B (en) Point feature-based aerial image and airborne point cloud registration optimization method and system
Yin et al. Multi-relation octomap based Heuristic ICP for air/surface robots cooperation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20220603

WW01 Invention patent application withdrawn after publication