Disclosure of Invention
An object of the present invention is to solve at least the above problems and to provide at least the advantages described later.
It is still another object of the present invention to provide a high-precision map automatic generation method based on high-precision positioning and lane line identification, so as to generate a high-precision map that is accurate to a lane line based on high-precision positioning and can automatically splice the lane lines, reduce the complexity of generating the high-precision map, and avoid the problems of large amount of labor consumption and high error rate required by the conventional high-precision map production.
To achieve these objects and other advantages in accordance with the present invention, there is provided a high-precision map automatic generation method based on high-precision positioning and lane line recognition, comprising:
step 1, synchronizing the high-precision positioning data acquired each time with lane line data through time alignment processing to obtain the position and the posture of the synchronized high-precision positioning data.
And 2, establishing a map frame through the synchronized lane line data and the high-precision positioning data obtained in the step 1, and storing the map frame in a map frame database.
Step 3, matching the newly acquired lane line data with all the map frames established according to the acquired lane line data, and if the matching fails, establishing a new map frame by using the newly acquired lane line data; and if the matching is successful, updating the information of the map frame established in the step 2 until the updating is finished.
And 4, performing interframe smoothing treatment on all the existing frames in the map frames established in the steps 2 and 3, and recalculating by combining the point set of the map frame updated in the step 3 to obtain a cubic curve representing the lane line information corresponding to the frames subjected to interframe smoothing treatment.
And 5, splicing the cubic curves to generate a high-precision map.
Preferably, step 1 further comprises:
taking the timestamp for acquiring the lane line data as a time alignment point, the position p 'and the posture r' of the high-precision positioning data aligned to the timestamp of the lane line data are respectively:
p′=p+v(tm-tl); (1)
r′=rω(tm-tl); (2)
wherein, tmA timestamp representing the acquisition of the lane line data.
tlA time stamp representing the acquisition of the high accuracy positioning data.
p, r, v and ω represent the position, attitude and linear velocity of the high-precision positioning data before alignment, respectively
Degrees and angular velocities.
Preferably, step 2 further comprises:
the map frame mainly comprises the following elements:
PF: a location of the frame spatial information; rF: a pose of the frame space information.
CF: a cubic curve of lane line information; sF: and (5) sampling point sets of lane lines.
LF: and associating the frames before and after the inter-frame topology information.
The elements are all represented by a frame coordinate system, wherein the frame coordinate system takes the transverse direction as an x axis, the longitudinal direction as a y axis, and the directions vertical to the x axis and the y axis as a z axis.
Preferably, step 2 further comprises:
the map frame is established on the premise that the type and/or the color of the lane line are changed and/or the lane line is disconnected and/or an unmanned vehicle changes lanes in driving and/or the y-axis direction length of the map frame exceeds a threshold value.
Preferably, the conditions for successful matching in step 3 are as follows:
the newly acquired lane line data and one or more of all the map frames established according to the acquired lane line data have an overlapping part, and the overlapping part reaches the threshold value; and/or
And the newly acquired lane line data is connected with any one of the map frames which are established in a front-back mode.
Preferably, the information updating of the map frame in step 3 further includes:
and step C, sampling the cubic curve representing the lane line at certain intervals to obtain a sampling point set.
And D, calculating the position and the posture of the sampling point set relative to the non-updated map frame, and projecting the position of the sampling point set into a frame coordinate system of the non-updated map frame to obtain the sampling point set in the frame coordinate system.
And E, if the position of the sampling point set in the frame coordinate system exceeds the length limit of the frame coordinate system, cutting out an excess part to serve as new lane line data, and entering the step C to update the map frame.
And F, merging the sampling point set of the non-updated map frame with the sampling point set in the frame coordinate system in the step D to obtain a sampling point set which is re-sampled at a certain interval after merging, and updating the sampling point set of the non-updated map frame into the re-sampled sampling point set.
And G, carrying out cubic curve fitting on the sampling point set re-sampled in the step F to obtain a fitted sampling point set, and updating the result of cubic curve fitting of the sampling point set of the non-updated map frame into the fitted sampling point set.
And H, finishing the incidence relation between the front frame and the rear frame of the connected frame by calculating the connection relation between the new map frame and the established map frame so as to finish the information updating of the established map frame.
Preferably, the inter-frame smoothing process in step 4 is performed on the premise that no new lane line data is input.
Preferably, the inter-frame smoothing process in step 4 further includes:
and establishing a cubic curve, wherein the point set for fitting the cubic curve is obtained by mixing a second half point set in the point sets of the previous frame and a first half point set in the point sets of the subsequent frame in the previous frame and the subsequent frame which have a correlation.
And projecting the second half point set onto the cubic curve along a direction perpendicular to a y axis of the frame coordinate system to obtain a projected point set.
Smoothing the projection points corresponding to the points under the former frame coordinate system and the latter half point set on the y axis of the frame coordinate system to obtain smoothed points, thereby obtaining smoothed frames; the smoothing treatment of the point set under the frame coordinate system is similar; the formula of the point-to-point smoothing process is as follows:
P″=((1-a)x+ax′,y,(1-a)z+az′) (3)
wherein, the smoothing coefficient a of the previous frame point set is y/L; l represents the length of the frame.
And the smoothing coefficient a of the subsequent frame point set is 1-y/L.
And P ═ x, y, z denotes any point in the latter half set of points in the former frame coordinate system.
P ' ═ x ', y, z ' denotes any point in the first half set of points in the frame-after coordinate system.
The invention at least comprises the following beneficial effects:
according to the method, time intervals exist between high-precision positioning data and lane line data due to the lead or lag of the high-precision positioning data, time is aligned to the acquisition time stamp of the lane line data through time alignment processing, so that the consistency of data time during data processing is ensured, and the data processing is performed on the premise that a high-precision map is generated, and the coordinate system conversion between the high-precision positioning and the lane line data is required; when a new lane line data is acquired and a map frame is established, the position and the posture of spatial information in the frame are the orientation, namely the position and the posture of the high-precision positioning data after time alignment processing, by taking the high-precision positioning data and the lane line data as prior conditions, and when the lane line data changes, the lane line data is firstly matched with the established map frame to be overlapped or front-back associated parts according to requirements, so that the acquired lane line data is updated and replaced, and if the matching is unsuccessful, the acquired new lane line data establishes a new map frame again, so that the lane line splicing is automatically completed through matching updating and reconstruction; and through the interframe smoothing processing, interframe smooth transition is realized, the overlapped parts of the point sets in the frames are smoothly connected to generate a high-precision map which is accurate to the lane line based on high-precision positioning and can automatically splice the lane line, and the high-precision map which can automatically splice the lane line is generated through the prior conditions of the high-precision positioning and the lane line acquisition, so that the complexity of generating the high-precision map is reduced, the problems of large manpower consumption and high error rate required by the traditional high-precision map manufacturing are solved, and the method has important significance for the unmanned driving to reliably and safely drive.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention.
Detailed Description
The present invention is further described in detail below with reference to the attached drawings so that those skilled in the art can implement the invention by referring to the description text.
It will be understood that terms such as "having," "including," and "comprising," as used herein, do not preclude the presence or addition of one or more other elements or groups thereof.
As shown in fig. 1, the present invention provides a high-precision map automatic generation method based on high-precision positioning and lane line identification, including:
step 1, synchronizing the high-precision positioning data acquired each time with lane line data through time alignment processing to obtain the position and the posture of the synchronized high-precision positioning data.
And 2, establishing a map frame through the synchronized lane line data and the high-precision positioning data obtained in the step 1, and storing the map frame in a map frame database.
Step 3, matching the newly acquired lane line data with all the map frames established according to the acquired lane line data, and if the matching fails, establishing a new map frame by using the newly acquired lane line data; and if the matching is successful, updating the information of the map frame established in the step 2 until the updating is finished.
And 4, performing interframe smoothing treatment on all the existing frames in the map frames established in the steps 2 and 3, and recalculating by combining the point set of the map frame updated in the step 3 to obtain a cubic curve representing the lane line information corresponding to the frames subjected to interframe smoothing treatment.
And 5, splicing the cubic curves to generate a high-precision map.
In the scheme, a time interval exists between the high-precision positioning data and the lane line data due to the lead or lag of the high-precision positioning data, and the time is aligned to the acquisition timestamp of the lane line data through time alignment processing so as to ensure the consistency of data time during data processing, which is taken as the premise of high-precision map generation, and the coordinate system conversion between the high-precision positioning and the lane line data is firstly required in the data processing; when a new lane line data is acquired and a map frame is established, the position and the posture of spatial information in the frame are the orientation, namely the position and the posture of the high-precision positioning data after time alignment processing, by taking the high-precision positioning data and the lane line data as prior conditions, and when the lane line data changes, the lane line data is firstly matched with the established map frame to be overlapped or front-back associated parts according to requirements, so that the acquired lane line data is updated and replaced, and if the matching is unsuccessful, the acquired new lane line data establishes a new map frame again, so that the lane line splicing is automatically completed through matching updating and reconstruction; and through the interframe smoothing processing, interframe smooth transition is realized, the overlapped parts of the point sets in the frames are smoothly connected to generate a high-precision map which is accurate to the lane line based on high-precision positioning and can automatically splice the lane line, and the high-precision map which can automatically splice the lane line is generated through the prior conditions of the high-precision positioning and the lane line acquisition, so that the complexity of generating the high-precision map is reduced, the problems of large manpower consumption and high error rate required by the traditional high-precision map manufacturing are solved, and the method has important significance for the unmanned driving to reliably and safely drive.
In a preferred embodiment, step 1 further comprises:
taking the timestamp for acquiring the lane line data as a time alignment point, the position p 'and the posture r' of the high-precision positioning data aligned to the timestamp of the lane line data are respectively:
p′=p+v(tm-tl); (1)
r′=rω(tm-tl); (2)
wherein, tmA timestamp representing the acquisition of the lane line data.
tlA time stamp representing the acquisition of the high accuracy positioning data.
p, r, v and ω represent the position, attitude and linear velocity of the high-precision positioning data before alignment, respectively
Degrees and angular velocities.
In the above scheme, a timestamp is set for the time for acquiring the lane line data, and the timestamp for acquiring the lane line data is used as a reference, so that high-precision positioning data is acquired, and certain advance or delay is generated due to different data sampling moments, so that the lane line data and the high-precision data are synchronized in the generation method, and are converted by formula 1, and the high-precision positioning data after algorithm synchronization is obtained.
In a preferred embodiment, step 2 further comprises:
the map frame mainly comprises the following elements:
PF: a location of the frame spatial information; rF: a pose of the frame space information.
CF: a cubic curve of lane line information; sF: and (5) sampling point sets of lane lines.
LF: and associating the frames before and after the inter-frame topology information.
The elements are all represented by a frame coordinate system, wherein the frame coordinate system takes the transverse direction as an x axis, the longitudinal direction as a y axis, and the directions vertical to the x axis and the y axis as a z axis.
In the above scheme, as shown in fig. 2, the map frame includes elements in the frame coordinate system.
In a preferred embodiment, step 2 further comprises:
the map frame is established on the premise that the type and/or the color of the lane line are changed and/or the lane line is disconnected and/or an unmanned vehicle changes lanes in driving and/or the y-axis direction length of the map frame exceeds a threshold value.
In the scheme, each frame represented by the map frame corresponds to a position and a posture when lane line data are acquired, and different positions and postures are formed, namely different map frames form a high-precision map based on lane line recognition, when the lane line is recognized, the lane line data change, on the premise of unsuccessful matching, a new map frame is established, the lane line data change, and when the map frame is established, if the y-axis direction of the lane line in the map frame exceeds a threshold value, the position P of the map frameFAnd attitude RFAre assigned values of p 'and r' respectively,as shown in fig. 3, the lane line data in the area indicated by W is extracted to the map frame database because the acquired lane line data has a blind area [0, y ] in the y-axis directionb]That is, in the range of G, searching the data corresponding to the area in the existing map frame, if the data can be found, filling the corresponding data into the blind area.
In a preferred embodiment, the conditions for successful matching in step 3 are as follows:
the newly acquired lane line data and one or more of all the map frames established according to the acquired lane line data have an overlapping part, and the overlapping part reaches the threshold value; and/or
And the newly acquired lane line data is connected with any one of the map frames which are established in a front-back mode.
In the above solution, the newly acquired lane line data first needs to be matched with an already established map frame to acquire a map frame which overlaps or is connected with the newly acquired lane line data, so as to determine the position of the newly acquired lane line data, and update the map frame.
In a preferred embodiment, the information updating of the map frame in step 3 further includes:
and step C, sampling the cubic curve representing the lane line at certain intervals to obtain a sampling point set.
And D, calculating the position and the posture of the sampling point set relative to the non-updated map frame, and projecting the position of the sampling point set into a frame coordinate system of the non-updated map frame to obtain the sampling point set in the frame coordinate system.
And E, if the position of the sampling point set in the frame coordinate system exceeds the length limit of the frame coordinate system, cutting out an excess part to serve as new lane line data, and entering the step C to update the map frame.
And F, merging the sampling point set of the non-updated map frame with the sampling point set in the frame coordinate system in the step D to obtain a sampling point set which is re-sampled at a certain interval after merging, and updating the sampling point set of the non-updated map frame into the re-sampled sampling point set.
And G, carrying out cubic curve fitting on the sampling point set re-sampled in the step F to obtain a fitted sampling point set, and updating the result of cubic curve fitting of the sampling point set of the non-updated map frame into the fitted sampling point set.
And H, finishing the incidence relation between the front frame and the rear frame of the connected frame by calculating the connection relation between the new map frame and the established map frame so as to finish the information updating of the established map frame.
In the above solution, as shown in fig. 4 and 5, the basic flow of map frame information update is as follows:
sampling the cubic curve representing the lane line A at certain intervals to obtain a sampling point set SA;
Calculating the position and the attitude of A relative to the current map frame F and sampling the sampling point set S
AIs projected on F, and is recorded as
If it is not
If the length limit of the current map frame F is exceeded, cutting the exceeded part out and updating the map frame again by taking the exceeded part as new lane line data;
sampling point S of current map frame F
FAnd
combining, and resampling at certain intervals to obtain S
F', and will S
FUpdate to S
F′;
To SF' fitting cubic curve to obtain CF', and CFIs updated to CF′;
Calculating the new map frame and the existing mapThe connection relation of the frames is updated according to the connection relation L of the frames before and after the connectionF。
In a preferred embodiment, the inter-frame smoothing in step 4 is performed on the premise that no new lane line data is input.
In the above scheme, the condition that the update of the established map frame information is completed is that no new lane data line is acquired, otherwise, once the new lane data is acquired, the new lane data will enter into matching with the established map frame, or establishing a new map frame or entering into the update of the established map frame, so that the map frame can be guaranteed to be updated to perform inter-frame smoothing only under the condition that no new lane data is input.
In a preferred embodiment, the inter-frame smoothing process in step 4 further includes:
and establishing a cubic curve, wherein the point set for fitting the cubic curve is obtained by mixing a second half point set in the point sets of the previous frame and a first half point set in the point sets of the subsequent frame in the previous frame and the subsequent frame which have a correlation.
And projecting the second half point set onto the cubic curve along a direction perpendicular to a y axis of the frame coordinate system to obtain a projected point set.
Smoothing the projection points corresponding to the points under the former frame coordinate system and the latter half point set on the y axis of the frame coordinate system to obtain smoothed points, thereby obtaining smoothed frames; the smoothing treatment of the point set under the frame coordinate system is similar; the formula of the point-to-point smoothing process is as follows:
P″=((1-a)x+ax′,y,(1-a)z+az′) (3)
wherein, the smoothing coefficient a of the previous frame point set is y/L; l represents the length of the frame.
And the smoothing coefficient a of the subsequent frame point set is 1-y/L.
And P ═ x, y, z denotes any point in the latter half set of points in the former frame coordinate system.
P ' ═ x ', y, z ' denotes any point in the first half set of points in the frame-after coordinate system.
In the above scheme, two frames with a front-back relationship are respectively set as F
1And F
2Taking a previous frame point set
Second half of point set
And set of post-frame points
First half point set of
Mixing and fitting cubic curve C
m(ii) a For point sets
Project it to a cubic curve C along a direction perpendicular to the y-axis
mTo obtain a projection point set
For frame F
1Set of points under a coordinate system
And each point P ═ x, y, z and with it
The corresponding point P ' ═(x ', y, z '), where the smoothing coefficient a is y/L, and L is the frame F, ((1-a) x + ax ', y, (1-a) z + az '), is calculated as follows
1Length of (d).
Frame F
2The point set smoothing of (1) is similar to this except that the smoothing coefficient becomes a ═ 1-x/L; in particular, for a set of points
Project it to a cubic curve C along a direction perpendicular to the y-axis
mTo obtain a projection point set
For frame F
2Set of points under a coordinate system
And each point P ═ x, y, z and with it
The corresponding point P ' ═(x ', y, z '), where the smoothing coefficient a is 1-y/L, and the smoothed point P ═ ((1-a) x + ax ', y, (1-a) z + az ') is calculated as follows, and L frames F are obtained
2Length of (d);
for the frame with the point set smoothed, recalculating the lane line cubic curve C of the frame according to the updated point setF。
While embodiments of the invention have been described above, it is not limited to the applications set forth in the description and the embodiments, which are fully applicable in various fields of endeavor to which the invention pertains, and further modifications may readily be made by those skilled in the art, it being understood that the invention is not limited to the details shown and described herein without departing from the general concept defined by the appended claims and their equivalents.