WO2022063056A1 - Method for constructing high-precision point cloud map - Google Patents

Method for constructing high-precision point cloud map Download PDF

Info

Publication number
WO2022063056A1
WO2022063056A1 PCT/CN2021/119050 CN2021119050W WO2022063056A1 WO 2022063056 A1 WO2022063056 A1 WO 2022063056A1 CN 2021119050 W CN2021119050 W CN 2021119050W WO 2022063056 A1 WO2022063056 A1 WO 2022063056A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
point cloud
cloud map
sensor data
map
Prior art date
Application number
PCT/CN2021/119050
Other languages
French (fr)
Chinese (zh)
Inventor
彭国旗
黄友
张国龙
张放
李晓飞
张德兆
王肖
霍舒豪
Original Assignee
重庆兰德适普信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 重庆兰德适普信息科技有限公司 filed Critical 重庆兰德适普信息科技有限公司
Publication of WO2022063056A1 publication Critical patent/WO2022063056A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/28Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
    • G01C21/30Map- or contour-matching
    • G01C21/32Structuring or formatting of map data
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/165Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/3407Route searching; Route guidance specially adapted for specific applications
    • G01C21/3415Dynamic re-routing, e.g. recalculating the route when the user deviates from calculated route or after detecting real-time traffic data or accidents
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/38Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
    • G01S19/39Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/42Determining position
    • G01S19/45Determining position by combining measurements of signals from the satellite radio beacon positioning system with a supplementary measurement
    • G01S19/47Determining position by combining measurements of signals from the satellite radio beacon positioning system with a supplementary measurement the supplementary measurement being an inertial measurement, e.g. tightly coupled inertial
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • the invention relates to the technical field of automatic driving, in particular to a method for constructing a high-precision point cloud map.
  • point cloud map construction methods in the autonomous driving industry can be roughly divided into two categories: point cloud map construction methods based on offline data and point cloud map construction methods based on online data.
  • the point cloud map construction method based on offline data, if the point cloud map construction is completed offline based on the vehicle, not only the performance of the vehicle processor is very high, the large map is difficult to process, the map quality and error cannot be guaranteed, and it is impossible to complete multiple tasks at the same time.
  • Point cloud map construction if the point cloud map construction is completed offline based on the local desktop computer, it involves tedious processes such as data download, software startup, and result data upload, which requires more human intervention, and the degree of automation is low, resulting in reduced efficiency, and it is impossible to achieve multiple
  • the scene point cloud map is constructed at the same time, which seriously wastes labor resources and local computing resources.
  • the point cloud map construction method based on online data, since the point cloud map construction tasks are all completed in the on-board processor, the performance of the on-board processor is very high, the large map is difficult to process, the map quality cannot be guaranteed, and the point cloud map verification is missing. Later data accumulation is not friendly, and multiple point cloud map construction tasks cannot be realized at the same time due to vehicle and scene limitations.
  • the purpose of the present invention is to provide a high-precision point cloud map construction method in view of the defects existing in the prior art.
  • the method is executed by a cloud server, and can simultaneously realize the construction of multiple point cloud map tasks, which overcomes the difficulty in handling large maps. Difficulties.
  • the quality of the point cloud map is improved.
  • the present invention provides a method for constructing a high-precision point cloud map, and the method for constructing a high-precision point cloud map includes:
  • the first sensor data includes point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data;
  • map task construction request message obtain the current memory occupancy and the current map task construction number
  • the first sensor data When the first sensor data complies with the data eligibility judgment rule, obtain second sensor data according to the point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data;
  • the point cloud map includes a plurality of points, each of which has first positioning data
  • the point cloud map is verified.
  • the flag bit of the dynamic carrier phase difference technology RTK indicates that the signal is normal
  • the first positioning data is compared with the second positioning data obtained by the real-time dynamic carrier phase difference technology RTK.
  • the difference between the first positioning data and the second positioning data is not greater than a preset threshold, it is determined that the point cloud map meets the accuracy condition;
  • a local path with a preset length is generated, and the local path is compared with the local path in the point cloud map of the same preset length.
  • the difference between the curvatures of the points of the local paths in the point cloud map of length is not greater than a preset difference threshold, it is determined that the point cloud map meets the distortion conditions;
  • the first sensor data sent by the receiving terminal specifically includes:
  • each frame of the raw sensor data includes a frame header
  • the first sensor data sent by the receiving terminal includes:
  • the sensor receives a map collection instruction sent by the terminal, and collects data according to the map collection instruction according to a preset route and a preset manner;
  • the terminal instructs the data collection to be completed through the export instruction.
  • the judging whether the first sensor data complies with the data eligibility judging rule specifically includes:
  • a first prompt message for instructing to re-acquire the first sensor data is generated, and the first prompt message is sent to the terminal.
  • the judging whether the first sensor data complies with the data eligibility judging rule specifically includes:
  • a second prompt message for instructing to re-acquire the original sensor data is generated, and the second prompt message is sent to the terminal.
  • the point cloud data is a first data set corresponding to a first sampling frequency, and each data in the first data set has a first timestamp.
  • the first timestamp is inconsistent with the first sampling frequency , it is determined that the quality of the point cloud data does not meet the requirements; and/or,
  • the inertial navigation data is a second data set corresponding to the second sampling frequency, each data in the second data set has a second time stamp, and when the second time stamp is inconsistent with the second sampling frequency, determine the quality of the inertial navigation data is not satisfactory; and/or,
  • the wheel speedometer data is a third data set corresponding to a third sampling frequency, and each data in the third data set has a third time stamp.
  • the third time stamp is inconsistent with the third sampling frequency, determine that the quality of the wheel speedometer data is not satisfactory; and/or,
  • the GPS positioning data is a fourth data set corresponding to the fourth sampling frequency, and each data in the fourth data set has a fourth time stamp.
  • the fourth time stamp is inconsistent with the fourth sampling frequency, determine The quality of the GPS positioning data does not meet the requirements; and/or,
  • the image data is a fifth data set corresponding to the fifth sampling frequency, each data in the fifth data set has a fifth time stamp, and when the fifth time stamp is inconsistent with the fifth sampling frequency, it is determined that the The quality of the image data described above does not meet the requirements.
  • the inertial navigation data includes acceleration information, angular velocity information and attitude angle information of the vehicle;
  • the wheel speed meter data includes angular velocity information, linear velocity information and vehicle yaw rate information of the left and right wheels of the vehicle;
  • point cloud data, inertial navigation data, wheel speed meter data, GPS positioning data and image data to obtain second sensor data, which specifically includes: combining the point cloud data, the acceleration information of the vehicle, the angular velocity information and the attitude angle information, The angular velocity information, linear velocity information and vehicle yaw rate information of the left and right wheels of the vehicle, the GPS positioning data and the first image data are fused to obtain second sensor data.
  • the present invention provides a device including a memory and a processor, where the memory is used for storing a program, and the processor is used for executing the method for constructing a high-precision point cloud map according to any one of the first aspect.
  • the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the high precision described in any one of the first aspect is realized.
  • Point cloud map construction method
  • the present invention provides a computer server, including: a memory, a processor, and a transceiver; the processor is configured to be coupled to the memory, read and execute instructions in the memory, to implement the first aspect The method for constructing a high-precision point cloud map; the transceiver is coupled to the processor, and the processor controls the transceiver to send and receive messages.
  • the present invention provides a mobile tool, including the computer server described in the fourth aspect.
  • the cloud server automatically responds to and triggers the point cloud map construction task, which can simultaneously realize the construction of multiple point cloud map tasks, and overcomes the difficulty that large maps are difficult to handle;
  • the construction of the point cloud map will be carried out, and through the verification of the integrity, accuracy, distortion, smoothness and continuity of the point cloud map, the time and cost of constructing the point cloud map will be reduced.
  • the error satisfies the high-precision requirement of point cloud map construction, thereby improving the quality of point cloud map.
  • FIG. 1 is a schematic flowchart of a method for constructing a high-precision point cloud map according to Embodiment 1 of the present invention.
  • the method for constructing a high-precision point cloud map provided by the first embodiment of the present invention is applied to a cloud server for constructing a high-precision point cloud map.
  • the sensor data required for constructing a high-precision point cloud map is collected by an intelligent vehicle, where an intelligent vehicle can be understood as an unmanned autonomous vehicle.
  • Smart vehicles are installed with a variety of sensors, and the source of point cloud map data is based on sensors, including but not limited to cameras, lidars, global positioning systems (GPS), inertial measurement units (Inertial measurement unit) , IMU) and wheel speedometer.
  • GPS global positioning systems
  • IMU inertial measurement unit
  • wheel speedometer there can be multiple cameras and lidars, which are respectively set around the smart vehicle; GPS is set on the top of the vehicle; the inertial measurement unit can be set in a hidden position such as the chassis of the vehicle; there can be two wheel speedometers, which are respectively set on the top of the vehicle. on the left and right wheels of the vehicle.
  • FIG. 1 is a schematic flowchart of a method for constructing a high-precision point cloud map according to Embodiment 1 of the present invention. As shown in FIG. 1 , the method for constructing a high-precision point cloud map provided by Embodiment 1 of the present invention includes the following steps:
  • Step 101 Receive first sensor data sent by a terminal; the first sensor data includes point cloud data, inertial navigation data, wheel speed meter data, GPS positioning data, and image data;
  • the point cloud data is the data obtained by the laser radar, and the data of the laser radar can be one or more.
  • the point cloud data represents the point cloud obtained by the multiple laser radars. collection of data.
  • Inertial navigation data refers to the current acceleration information, angular velocity information, and attitude angle information of the vehicle obtained through the inertial measurement unit IMU.
  • the wheel speedometer data is the angular velocity information, linear speed information and vehicle yaw rate information of the left and right wheels of the vehicle obtained by the wheel speedometer.
  • GPS positioning data is the position information of the vehicle acquired by GPS. Due to errors in GPS positioning, the location information of the vehicle is not the current precise location information of the vehicle.
  • the GPS is preferably differential GPS, and the intelligent vehicle obtains the position information of the vehicle detected by the differential GPS.
  • the image data is the environment data around the vehicle collected by the cameras.
  • the image data represents a set of environment data collected by the multiple cameras.
  • the intelligent vehicle receives the driving information sent by the cloud server or the terminal, the driving information includes destination and time information, and the intelligent vehicle automatically drives to the corresponding block according to the destination information and time information.
  • the sensor installed on the smart vehicle collects data according to the map collection instruction, according to the preset route and preset method; when the sensor collects the data, the terminal will indicate the completion of the data collection through the export instruction.
  • the map collection instruction may be input by the user through the terminal, or may be sent by the server to the terminal.
  • the first sensor data that the cloud server receives from the terminal specifically includes:
  • each frame of raw sensor data includes a frame header
  • the frame header determine whether the multi-frame raw sensor data has been transmitted
  • the input sensor data types and formats are different, which is not conducive to the universality of the algorithm. Therefore, it is necessary to preprocess the original sensor data, convert the sensor data into a specific data type and format, and implement the algorithm. Consistency of input data. Therefore, the first sensor data is uploaded to the cloud server after the original sensor data is sorted and perfected.
  • Step 102 after receiving the first sensor data, generate a map task construction request message for constructing a map
  • the cloud server will detect in real time whether there is uploading of the first sensor data, and at the same time monitor whether the uploading of the first sensor data is completed.
  • a map construction command will be triggered, and the cloud server will automatically assign a task name with a unique identification to the task corresponding to the map construction command, and automatically generate different map task construction request messages according to different task names. , so as to construct the map, so that the cloud server can automatically respond and trigger the point cloud map construction task.
  • Step 103 according to the map task construction request message, obtain the current memory occupancy and the current map task construction number
  • Step 104 when the current memory occupancy is less than the preset memory occupancy, and the current map task construction number is less than the preset map task construction threshold, determine whether the first sensor data complies with the data eligibility judgment rule;
  • the cloud server will set a number of configuration parameters, including the memory usage and the number of tasks.
  • the preset memory usage can be understood as the memory usage allowed by the server. In a specific example, the preset memory footprint can be set to 80%.
  • the preset map task construction threshold can be understood as the number of tasks that can run simultaneously on the cloud server. In another specific example, the preset map task construction threshold is N, 0 ⁇ N ⁇ 6, and N is a positive integer .
  • the cloud server can judge whether the point cloud map construction task needs to wait for the completion of other tasks by judging the memory usage and the number of tasks running at the same time. In a specific example, when the memory usage is 60% and the number of tasks running simultaneously on the cloud server is 4, the cloud server can execute the point cloud map construction task without waiting. Therefore, the point cloud map construction through the cloud server can avoid the disadvantage of high requirements on the vehicle processor when the map is constructed through the vehicle processor in the existing online map construction technology, and can realize the simultaneous realization of multiple point cloud map tasks. Build, overcoming the intractable difficulties of a large map.
  • Step 105 when the first sensor data complies with the data eligibility judgment rule, obtain second sensor data according to point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data;
  • the data eligibility judgment rule specifically includes whether the format of the first sensor data is a preset format and whether the quality of the first sensor data meets the requirements.
  • the cloud server When the format of the first sensor data does not conform to the preset format, the cloud server will generate a first prompt message, and send the first prompt message to the terminal to instruct the terminal to re-acquire the first sensor data, that is, the original sensor data according to the preset format
  • the format is rearranged and uploaded to the cloud server.
  • each sensor collects data according to a preset sampling frequency, it is determined whether the quality of the first sensor data meets the requirements by checking whether the data measured by a certain sensor is missing in the first sensor data.
  • the point cloud data is the first data set corresponding to the first sampling frequency, and each data in the first data set has a first timestamp.
  • the inertial navigation data is a second data set corresponding to the second sampling frequency, and each data in the second data set has a second time stamp, when the second time stamp is inconsistent with the second sampling frequency , it is determined that the quality of the inertial navigation data does not meet the requirements;
  • the wheel speedometer data is a third data set corresponding to the third sampling frequency, and each data in the third data set has a third time stamp, when the third time stamp When it is inconsistent with the third sampling frequency, it is determined that the data quality of the wheel speedometer does not meet the requirements; and/or, the GPS positioning data is a fourth data set corresponding to the fourth sampling frequency, and each data in the fourth data set has a fourth time Stamp, when the fourth time stamp is inconsistent with the fourth sampling frequency
  • the cloud server When the quality of the first sensor data does not meet the requirements, the cloud server generates a second prompt message, and sends the second prompt message to the terminal to instruct the terminal to re-collect and acquire the original sensor data.
  • the cloud server will perform the point cloud map construction task.
  • the setting of the data eligibility judgment rules greatly improves the quality of the sensor data for constructing the point cloud map, reduces the data error of the point cloud map construction, and improves the quality of the constructed point cloud map.
  • Step 106 constructing a point cloud map according to the second sensor data;
  • the point cloud map includes a plurality of points, and each point has the first positioning data;
  • the point cloud data, the acceleration information of the vehicle, the angular velocity information and the attitude angle information, the angular velocity information of the left and right wheels of the vehicle, the linear velocity information and the yaw rate information of the vehicle, the GPS positioning data and the first image data are fused to process
  • the second sensor data is obtained, that is, the second sensor data is the data after fusion processing of the first sensor data.
  • the first positioning data is the positioning pose information of each point in the point cloud map calculated by a preset algorithm in the point cloud map, where the positioning pose information may include positioning information and an attitude angle.
  • Step 107 verify the point cloud map, when the flag bit of the dynamic carrier phase difference technology RTK indicates that the signal is normal, compare the first positioning data with the second positioning data obtained by the real-time dynamic carrier phase difference technology RTK, when the first positioning data When the difference between the first positioning data and the second positioning data is not greater than the preset threshold, it is determined that the point cloud map meets the accuracy condition;
  • the cloud server performs quality verification on the above-mentioned successfully constructed point cloud map.
  • the constructed point cloud map must meet certain accuracy conditions. Therefore, in this method, in addition to using two differential GPS measurements, the real-time kinematic (RTK) carrier phase difference technology is also used to obtain the second positioning data.
  • RTK real-time kinematic
  • the RTK flag bit of the dynamic carrier phase difference technology indicates that the signal is normal
  • compare the first positioning data with the second positioning data determine whether the difference between the first positioning data and the second positioning data meets the preset threshold, and if the difference is not greater than the preset threshold, the point cloud map can be determined
  • the accuracy meets the accuracy conditions, and provides centimeter-level positioning results to meet the requirements of high-precision point cloud map construction.
  • Step 108 Generate a local path with a preset length according to the inertial navigation data and the wheel speedometer data, and compare the local path with the local path in the point cloud map of the same preset length. When the difference between the curvatures of each point of the local path in the cloud map is not greater than the preset difference threshold, it is determined that the point cloud map meets the distortion condition;
  • the inertial navigation data and the wheel speedometer data are aligned in time, and a certain preset length is selected to generate a local path.
  • the preset length may be 10m. If the difference between the two aligned local paths (curves) is too large, it means that the shapes of the two curves are different. If they are in the same coordinate system, it means that one of them is distorted.
  • Step 109 judging whether there is a jump in the connection between the multiple first positioning data in the point cloud map, and when there is no jump, it is determined that the point cloud map meets the smoothness condition;
  • smoothness means that the connection line of the points corresponding to the first positioning data in the constructed point cloud map should be a smooth curve. If a certain point jumps, there will be a jagged connection. Therefore, by judging whether there is a jump in the connection between the plurality of first positioning data, it can be judged whether the point cloud map meets the smoothness condition.
  • Step 110 Determine whether the distance between any adjacent points corresponding to two first positioning data in the point cloud map is not greater than a preset distance threshold, and when it is not greater than a preset distance threshold When , it is determined that the point cloud map meets the continuity condition;
  • the distance between any two adjacent points corresponding to the first positioning data in the point cloud map has a preset distance threshold. Therefore, the adjacent points in the point cloud map are The distance between the points is compared with the preset distance threshold. When the distance is not greater than the preset distance threshold, it is considered that the continuity of the points is good, and the point cloud map meets the requirements of continuity.
  • the preset distance threshold is 1m, and if the distance between two points is 2m, it can be determined that the continuity of the point cloud map does not meet the conditions.
  • Step 111 judge whether the point is complete, and when the point is complete, determine that the point cloud map meets the complete condition
  • the complete condition refers to judging whether the points in the point cloud map are complete, and the points include but are not limited to function points, traffic light identification data, and boundary information.
  • the function point refers to the preset point on the point cloud map.
  • the selected point in the point cloud map on the user terminal, the selected point.
  • the traffic light identification data refers to the position of the traffic light, such as the coordinates of the traffic light on the point cloud map, and the coordinates may be the position of the center point of the light board frame.
  • the number of trajectory points on the boundary can be calculated according to the sensor frequency and the acquisition time of the sensor, and the boundary trajectory data in the generated point cloud map and the calculated boundary trajectory data on the boundary can be checked. Whether the number of track points is consistent.
  • the boundary trajectory data in the generated point cloud map is consistent with the calculated number of trajectory points on the boundary, it is determined that the boundary information satisfies the complete condition.
  • the function points, traffic light identification data and boundary information all meet the complete conditions, it is determined that the point cloud map meets the complete conditions.
  • Step 112 when the point cloud map meets the accuracy conditions, distortion conditions, smoothness conditions, continuity conditions and integrity conditions, it is determined that the point cloud map passes the verification.
  • the cloud server when the point cloud map verification fails, for example, when the point cloud map does not meet the accuracy conditions, distortion conditions, smoothness conditions and continuity conditions, the cloud server will automatically modify the point cloud map construction needs. Specify parameters, such as positioning deviation, positioning status, etc., and re-execute the point cloud map construction with the new parameters, and then re-verify the point cloud map quality.
  • the cloud server will give specific data missing items, prompting the terminal to re-collect and upload the original data. Then re-execute steps 101-112 until the point cloud map quality meets the complete conditions.
  • the error of the constructed point cloud map is reduced, thereby improving the quality of the point cloud map.
  • the present application may further include: after the verification of the point cloud map is passed, storing the sensor data corresponding to the point cloud map, so that the sensor data corresponding to the stored multiple areas can be spliced to obtain a larger block of sensor data.
  • Point cloud map after the verification of the point cloud map is passed, storing the sensor data corresponding to the point cloud map, so that the sensor data corresponding to the stored multiple areas can be spliced to obtain a larger block of sensor data. Point cloud map.
  • the method for constructing a high-precision point cloud map provided by the first embodiment of the present invention, through the automatic response and triggering of the point cloud map construction by the cloud server, can realize the construction of multiple point cloud map tasks at the same time, and overcome the difficulty that the large map is difficult to handle;
  • the construction of the point cloud map will be carried out, and through the verification of the integrity, accuracy, distortion, smoothness and continuity of the point cloud map, the time required for the constructed point cloud map will be reduced.
  • the error satisfies the high-precision requirements of point cloud map construction, thereby improving the quality of the point cloud map.
  • the second embodiment of the present invention provides a device including a memory and a processor, where the memory is used to store a program, and the processor is used to execute the high-precision point cloud map construction method provided by the first embodiment of the present invention.
  • Embodiment 3 of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method for constructing a high-precision point cloud map provided by Embodiment 1 of the present invention is implemented.
  • Embodiment 4 of the present invention provides a computer server, including: a memory, a processor, and a transceiver; the processor is configured to be coupled with the memory, and read and execute instructions in the memory, so as to implement the first embodiment of the present invention.
  • the fifth embodiment of the present invention provides a mobile tool, including the computer server described in the fourth embodiment.
  • the mobile tool can be any movable tool, such as a vehicle (such as a vacuum cleaner, a sweeper, a floor scrubber, a logistics trolley, a passenger car, a sanitation vehicle, a bus, a coach, a van, a truck, a truck, Trailers, dump trailers, cranes, excavators, scrapers, road trains, sweepers, sprinklers, garbage trucks, engineering vehicles, rescue vehicles, AGVs (Automated Guided Vehicles), motorcycles, bicycles, Tricycles, hand carts, robots, sweepers, balance vehicles, etc., the application does not strictly limit the types of mobile tools, and will not be exhaustive here.
  • a vehicle such as a vacuum cleaner, a sweeper, a floor scrubber, a logistics trolley, a passenger car, a sanitation vehicle, a bus, a coach, a van, a truck, a truck, Trailers, dump trailers, crane
  • RA high-precision point cloud map construction method random access memory
  • RO high-precision point cloud map construction method read-only memory
  • electrically programmable RO high-precision point cloud map construction method electrically erasable
  • a programmable RO high-precision point cloud map construction method a register, a hard disk, a removable disk, a CD-RO high-precision point cloud map construction method, a power system control method, or any other form of storage medium known in the technical field.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

A method for constructing a high-precision point cloud map, comprising: receiving first sensor data sent by a terminal (101) ; determining whether the first sensor data meets a data eligibility determination rule (104); when the first sensor data meets the data eligibility determination rule, obtaining second sensor data according to sensor data (105); constructing a point cloud map according to the second sensor data (106), the point cloud map comprising first positioning data; and when the point cloud map meets accuracy conditions, distortion conditions, smoothness conditions, continuity conditions and complete conditions, determining that the point cloud map passes verification (112). The method for constructing the high-precision point cloud map improves the quality of the point cloud map, and may construct multiple point cloud map tasks at the same time. Also provided are a device, a computer-readable storage medium, a computer server and a mobile tool.

Description

高精度点云地图构建方法High-precision point cloud map construction method
本申请要求于2020年9月22日提交的、申请号为202011003627.4、标题为“高精度点云地图构建方法”的中国专利申请的优先权,该中国专利申请的公开内容以引用的方式并入本文。This application claims the priority of the Chinese patent application with application number 202011003627.4 and titled "Method for constructing high-precision point cloud maps", filed on September 22, 2020, the disclosure of which is incorporated by reference This article.
技术领域technical field
本发明涉及自动驾驶技术领域,尤其涉及一种高精度点云地图构建方法。The invention relates to the technical field of automatic driving, in particular to a method for constructing a high-precision point cloud map.
背景技术Background technique
目前在自动驾驶行业中应用较多的点云地图构建方法大致可分为基于离线数据的点云地图构建方法和基于在线数据的点云地图构建方法两类。At present, the most widely used point cloud map construction methods in the autonomous driving industry can be roughly divided into two categories: point cloud map construction methods based on offline data and point cloud map construction methods based on online data.
基于离线数据的点云地图构建方法,若基于车端离线完成点云地图构建,不仅对车载处理器性能要求很高,大地图难以处理,地图质量和误差均无法保障,而且无法同时完成多个点云地图构建;若基于本地台式机离线完成点云地图构建,涉及数据下载、启动软件以及成果数据上传等繁琐过程,需要人为干预较多,自动化程度低,导致效率降低,且无法实现多个场景点云地图同时构建,严重造成人工资源和本地计算资源浪费。The point cloud map construction method based on offline data, if the point cloud map construction is completed offline based on the vehicle, not only the performance of the vehicle processor is very high, the large map is difficult to process, the map quality and error cannot be guaranteed, and it is impossible to complete multiple tasks at the same time. Point cloud map construction; if the point cloud map construction is completed offline based on the local desktop computer, it involves tedious processes such as data download, software startup, and result data upload, which requires more human intervention, and the degree of automation is low, resulting in reduced efficiency, and it is impossible to achieve multiple The scene point cloud map is constructed at the same time, which seriously wastes labor resources and local computing resources.
基于在线数据的点云地图构建方法,由于点云地图构建任务均在车载处理器内完成,对车载处理器性能要求很高,大地图难以处理,地图质量无法保障,缺失点云地图验证,对后期数据积累不友好,且因车辆和场景限制无法同时实现多个点云地图构建任务。The point cloud map construction method based on online data, since the point cloud map construction tasks are all completed in the on-board processor, the performance of the on-board processor is very high, the large map is difficult to process, the map quality cannot be guaranteed, and the point cloud map verification is missing. Later data accumulation is not friendly, and multiple point cloud map construction tasks cannot be realized at the same time due to vehicle and scene limitations.
发明内容SUMMARY OF THE INVENTION
本发明的目的是针对现有技术所存在的缺陷,提供一种高精度点云地图构建方法,该方法通过云端服务器执行,可以同时实现多个点云地图任务的 构建,克服了大地图难以处理的困难。通过对构建的点云地图进行验证,提高了点云地图的质量。The purpose of the present invention is to provide a high-precision point cloud map construction method in view of the defects existing in the prior art. The method is executed by a cloud server, and can simultaneously realize the construction of multiple point cloud map tasks, which overcomes the difficulty in handling large maps. Difficulties. By verifying the constructed point cloud map, the quality of the point cloud map is improved.
为实现上述目的,第一方面,本发明提供了一种高精度点云地图构建方法,所述高精度点云地图构建方法包括:In order to achieve the above purpose, in the first aspect, the present invention provides a method for constructing a high-precision point cloud map, and the method for constructing a high-precision point cloud map includes:
接收终端发送的第一传感器数据;所述第一传感器数据包括点云数据、惯导数据、轮速计数据、GPS定位数据和图像数据;receiving first sensor data sent by the terminal; the first sensor data includes point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data;
当接收到所述第一传感器数据后,生成用于构建地图的地图任务构建请求消息;After receiving the first sensor data, generating a map task construction request message for constructing a map;
根据所述地图任务构建请求消息,获取当前内存占用量和当前地图任务构建个数;According to the map task construction request message, obtain the current memory occupancy and the current map task construction number;
当所述当前内存占用量小于预设的内存占用量,且所述当前地图任务构建个数小于预设的地图任务构建阈值时,判断所述第一传感器数据是否符合数据合格判断规则;When the current memory occupancy is less than the preset memory occupancy, and the current map task construction number is less than the preset map task construction threshold, determine whether the first sensor data complies with the data eligibility judgment rule;
当所述第一传感器数据符合数据合格判断规则时,根据所述点云数据、惯导数据、轮速计数据、GPS定位数据和图像数据,得到第二传感器数据;When the first sensor data complies with the data eligibility judgment rule, obtain second sensor data according to the point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data;
根据所述第二传感器数据,构建点云地图;所述点云地图包括多个点,每个所述点具有第一定位数据;constructing a point cloud map according to the second sensor data; the point cloud map includes a plurality of points, each of which has first positioning data;
对所述点云地图进行验证,当动态载波相位差分技术RTK的标志位表示信号正常时,将所述第一定位数据与通过实时动态载波相位差分技术RTK获取的第二定位数据进行比较,当所述第一定位数据与第二定位数据的差值不大于预设阈值时,确定所述点云地图符合精度条件;The point cloud map is verified. When the flag bit of the dynamic carrier phase difference technology RTK indicates that the signal is normal, the first positioning data is compared with the second positioning data obtained by the real-time dynamic carrier phase difference technology RTK. When the difference between the first positioning data and the second positioning data is not greater than a preset threshold, it is determined that the point cloud map meets the accuracy condition;
根据所述惯导数据和轮速计数据,生成预设长度的局部路径,将所述局部路径与相同预设长度的点云地图中的局部路径进行比较,当所述局部路径与相同预设长度的点云地图中的局部路径的各所述点的曲率的差值不大于预设的差值阈值时,确定所述点云地图符合畸变条件;According to the inertial navigation data and the wheel speedometer data, a local path with a preset length is generated, and the local path is compared with the local path in the point cloud map of the same preset length. When the difference between the curvatures of the points of the local paths in the point cloud map of length is not greater than a preset difference threshold, it is determined that the point cloud map meets the distortion conditions;
判断所述点云地图中的多个所述第一定位数据之间的连线是否存在跳 变,当不存在跳变时,确定所述点云地图符合平滑性条件;Judging whether there is a jump in the connection between the multiple first positioning data in the point cloud map, when there is no jump, it is determined that the point cloud map meets the smoothness condition;
判断所述点云地图中的多个所述第一定位数据之间的任意相邻的两个所述第一定位数据对应的点的距离是否不大于预设的距离阈值,当不大于预设的距离阈值时,确定所述点云地图符合连续性条件;Determine whether the distance between any adjacent points corresponding to the first positioning data in the point cloud map is not greater than a preset distance threshold, and when it is not greater than a preset distance When the distance threshold is , it is determined that the point cloud map meets the continuity condition;
判断所述点是否完整,当所述点完整时,确定点云地图符合完整条件;Determine whether the point is complete, and when the point is complete, determine that the point cloud map meets the complete condition;
当所述点云地图符合精度条件、畸变条件、平滑性条件、连续性条件和完整条件时,确定所述点云地图通过验证。When the point cloud map meets the accuracy conditions, distortion conditions, smoothness conditions, continuity conditions and integrity conditions, it is determined that the point cloud map passes the verification.
优选的,所述接收终端发送的第一传感器数据具体包括:Preferably, the first sensor data sent by the receiving terminal specifically includes:
接收终端发送的多帧原始传感器数据;每帧所述原始传感器数据包括帧头;receiving multiple frames of raw sensor data sent by the terminal; each frame of the raw sensor data includes a frame header;
根据所述帧头,判断所述多帧原始传感器数据是否传输完毕;According to the frame header, determine whether the transmission of the multi-frame raw sensor data is completed;
当传输完毕时,根据所述帧头,将多帧原始传感器数据进行拼接,得到第一传感器数据。When the transmission is completed, multiple frames of original sensor data are spliced according to the frame header to obtain the first sensor data.
优选的,所述接收终端发送的第一传感器数据之前包括:Preferably, before the first sensor data sent by the receiving terminal includes:
所述传感器接收终端发送的地图采集指令,并根据所述地图采集指令,按照预设路线与预设方式采集数据;The sensor receives a map collection instruction sent by the terminal, and collects data according to the map collection instruction according to a preset route and a preset manner;
当采集数据完成后,所述终端通过导出指令指示数据采集完成。When the data collection is completed, the terminal instructs the data collection to be completed through the export instruction.
优选的,所述判断所述第一传感器数据是否符合数据合格判断规则具体包括:Preferably, the judging whether the first sensor data complies with the data eligibility judging rule specifically includes:
判断所述第一传感器数据的格式是否为预设格式;judging whether the format of the first sensor data is a preset format;
当所述第一传感器数据的格式不符合所述预设格式时,生成用于指示重新获取第一传感器数据的第一提示消息,并将所述第一提示消息发送给终端。When the format of the first sensor data does not conform to the preset format, a first prompt message for instructing to re-acquire the first sensor data is generated, and the first prompt message is sent to the terminal.
优选的,所述判断所述第一传感器数据是否符合数据合格判断规则具体包括:Preferably, the judging whether the first sensor data complies with the data eligibility judging rule specifically includes:
判断所述第一传感器数据质量是否符合要求;judging whether the data quality of the first sensor meets the requirements;
当所述第一传感器数据质量不符合要求时,生成用于指示重新获取原始 传感器数据的第二提示消息,并将所述第二提示消息发送给所述终端。When the quality of the first sensor data does not meet the requirements, a second prompt message for instructing to re-acquire the original sensor data is generated, and the second prompt message is sent to the terminal.
优选的,所述点云数据为第一采样频率对应的第一数据集,所述第一数据集中的每个数据都具有第一时间戳,当第一时间戳与所述第一采样频率不一致时,确定所述点云数据质量不符合要求;和/或,Preferably, the point cloud data is a first data set corresponding to a first sampling frequency, and each data in the first data set has a first timestamp. When the first timestamp is inconsistent with the first sampling frequency , it is determined that the quality of the point cloud data does not meet the requirements; and/or,
所述惯导数据为第二采样频率对应的第二数据集,所述第二数据集中的每个数据都具有第二时间戳,当第二时间戳与所述第二采样频率不一致时,确定所述惯导数据质量不符合要求;和/或,The inertial navigation data is a second data set corresponding to the second sampling frequency, each data in the second data set has a second time stamp, and when the second time stamp is inconsistent with the second sampling frequency, determine the quality of the inertial navigation data is not satisfactory; and/or,
所述轮速计数据为第三采样频率对应的第三数据集,所述第三数据集中的每个数据都具有第三时间戳,当第三时间戳与所述第三采样频率不一致时,确定所述轮速计数据质量不符合要求;和/或,The wheel speedometer data is a third data set corresponding to a third sampling frequency, and each data in the third data set has a third time stamp. When the third time stamp is inconsistent with the third sampling frequency, determine that the quality of the wheel speedometer data is not satisfactory; and/or,
所述GPS定位数据为第四采样频率对应的第四数据集,所述第四数据集中的每个数据都具有第四时间戳,当第四时间戳与所述第四采样频率不一致时,确定所述GPS定位数据质量不符合要求;和/或,The GPS positioning data is a fourth data set corresponding to the fourth sampling frequency, and each data in the fourth data set has a fourth time stamp. When the fourth time stamp is inconsistent with the fourth sampling frequency, determine The quality of the GPS positioning data does not meet the requirements; and/or,
所述图像数据为第五采样频率对应的第五数据集,所述第五数据集中的每个数据都具有第五时间戳,当第五时间戳与所述第五采样频率不一致时,确定所述图像数据质量不符合要求。The image data is a fifth data set corresponding to the fifth sampling frequency, each data in the fifth data set has a fifth time stamp, and when the fifth time stamp is inconsistent with the fifth sampling frequency, it is determined that the The quality of the image data described above does not meet the requirements.
优选的,所述惯导数据包括车辆的加速度信息、角速度信息和姿态角信息;所述轮速计数据包括车辆左右轮的角速度信息、线速度信息和车辆横摆率信息;所述根据所述点云数据、惯导数据、轮速计数据、GPS定位数据和图像数据,得到第二传感器数据,具体包括;将所述点云数据、所述车辆的加速度信息、角速度信息和姿态角信息、所述、所述车辆左右轮的角速度信息、线速度信息和车辆横摆率信息、所述GPS定位数据和所述第一图像数据进行融合处理,得到第二传感器数据。Preferably, the inertial navigation data includes acceleration information, angular velocity information and attitude angle information of the vehicle; the wheel speed meter data includes angular velocity information, linear velocity information and vehicle yaw rate information of the left and right wheels of the vehicle; point cloud data, inertial navigation data, wheel speed meter data, GPS positioning data and image data to obtain second sensor data, which specifically includes: combining the point cloud data, the acceleration information of the vehicle, the angular velocity information and the attitude angle information, The angular velocity information, linear velocity information and vehicle yaw rate information of the left and right wheels of the vehicle, the GPS positioning data and the first image data are fused to obtain second sensor data.
第二方面,本发明提供了一种设备,包括存储器和处理器,所述存储器用于存储程序,所述处理器用于执行第一方面任一所述的高精度点云地图构建方法。In a second aspect, the present invention provides a device including a memory and a processor, where the memory is used for storing a program, and the processor is used for executing the method for constructing a high-precision point cloud map according to any one of the first aspect.
第三方面,本发明提供了一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如第一方面任一所述的高精度点云地图构建方法。In a third aspect, the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the high precision described in any one of the first aspect is realized. Point cloud map construction method.
第四方面,本发明提供了一种计算机服务器,包括:存储器、处理器和收发器;所述处理器用于与所述存储器耦合,读取并执行所述存储器中的指令,以实现第一方面所述的高精度点云地图构建方法;所述收发器与所述处理器耦合,由所述处理器控制所述收发器进行消息收发。In a fourth aspect, the present invention provides a computer server, including: a memory, a processor, and a transceiver; the processor is configured to be coupled to the memory, read and execute instructions in the memory, to implement the first aspect The method for constructing a high-precision point cloud map; the transceiver is coupled to the processor, and the processor controls the transceiver to send and receive messages.
第五方面,本发明提供了一种移动工具,包括第四方面所述的计算机服务器。In a fifth aspect, the present invention provides a mobile tool, including the computer server described in the fourth aspect.
本发明实施例提供的一种高精度点云地图构建方法,通过云端服务器自动响应和触发点云地图构建任务,可以同时实现多个点云地图任务的构建,克服了大地图难以处理的困难;当第一传感器数据符合数据合格判断规则时,才会进行点云地图的构建并且通过对点云地图的完整、精度、畸变、平滑性和连续性的验证,减小了构建点云地图时的误差,满足了点云地图构建高精度的要求,从而提高了点云地图的质量。In the method for constructing a high-precision point cloud map provided by the embodiment of the present invention, the cloud server automatically responds to and triggers the point cloud map construction task, which can simultaneously realize the construction of multiple point cloud map tasks, and overcomes the difficulty that large maps are difficult to handle; When the first sensor data complies with the data eligibility judgment rules, the construction of the point cloud map will be carried out, and through the verification of the integrity, accuracy, distortion, smoothness and continuity of the point cloud map, the time and cost of constructing the point cloud map will be reduced. The error satisfies the high-precision requirement of point cloud map construction, thereby improving the quality of point cloud map.
附图说明Description of drawings
图1为本发明实施例一提供的高精度点云地图构建方法的流程示意图。FIG. 1 is a schematic flowchart of a method for constructing a high-precision point cloud map according to Embodiment 1 of the present invention.
具体实施方式detailed description
下面通过附图和实施例,对本发明的技术方案做进一步的详细描述。The technical solutions of the present invention will be further described in detail below through the accompanying drawings and embodiments.
本发明实施例一提供的高精度点云地图构建方法应用于云端服务器中,用于高精度点云地图的构建。The method for constructing a high-precision point cloud map provided by the first embodiment of the present invention is applied to a cloud server for constructing a high-precision point cloud map.
需要说明的是,构建高精度点云地图所需要的传感器数据是通过智能车辆进行采集的,其中,智能车辆可以理解为无人驾驶的自动驾驶车辆。智能车辆安装有多种传感器,点云地图数据的来源是基于传感器进行的,多种传 感器包括但不限于摄像头、激光雷达、全球定位系统(Global Positioning System,GPS)、惯性测量单元(Inertial measurement unit,IMU)和轮速计。其中,摄像头和激光雷达可以为多个,分别设置在智能车辆的四周;GPS设置于车辆的顶部;惯性测量单元可以设置在车辆的底盘等隐秘位置;轮速计可以为两个,分别设置在车辆的左右轮子上。It should be noted that the sensor data required for constructing a high-precision point cloud map is collected by an intelligent vehicle, where an intelligent vehicle can be understood as an unmanned autonomous vehicle. Smart vehicles are installed with a variety of sensors, and the source of point cloud map data is based on sensors, including but not limited to cameras, lidars, global positioning systems (GPS), inertial measurement units (Inertial measurement unit) , IMU) and wheel speedometer. Among them, there can be multiple cameras and lidars, which are respectively set around the smart vehicle; GPS is set on the top of the vehicle; the inertial measurement unit can be set in a hidden position such as the chassis of the vehicle; there can be two wheel speedometers, which are respectively set on the top of the vehicle. on the left and right wheels of the vehicle.
图1为本发明实施例一提供的高精度点云地图构建方法的流程示意图。如图1所示,本发明实施例一提供的高精度点云地图构建方法包括如下步骤:FIG. 1 is a schematic flowchart of a method for constructing a high-precision point cloud map according to Embodiment 1 of the present invention. As shown in FIG. 1 , the method for constructing a high-precision point cloud map provided by Embodiment 1 of the present invention includes the following steps:
步骤101,接收终端发送的第一传感器数据;第一传感器数据包括点云数据、惯导数据、轮速计数据、GPS定位数据和图像数据;Step 101: Receive first sensor data sent by a terminal; the first sensor data includes point cloud data, inertial navigation data, wheel speed meter data, GPS positioning data, and image data;
具体的,点云数据为通过激光雷达获取的数据,激光雷达的数据可以是一个,也可以是多个,当激光雷达的数量为多个时,点云数据表示多个激光雷达获得的点云数据的集合。Specifically, the point cloud data is the data obtained by the laser radar, and the data of the laser radar can be one or more. When the number of the laser radar is multiple, the point cloud data represents the point cloud obtained by the multiple laser radars. collection of data.
惯导数据是指通过惯性测量单元IMU获取的车辆当前的加速度信息、角速度信息、姿态角信息。Inertial navigation data refers to the current acceleration information, angular velocity information, and attitude angle information of the vehicle obtained through the inertial measurement unit IMU.
轮速计数据是通过轮速计获取的车辆左右轮的角速度信息、线速度信息和车辆横摆率信息。The wheel speedometer data is the angular velocity information, linear speed information and vehicle yaw rate information of the left and right wheels of the vehicle obtained by the wheel speedometer.
GPS定位数据是通过GPS获取的车辆的位置信息。由于GPS定位存在误差,因此车辆的位置信息不是车辆当前的精确位置信息。在优选的实施例中,为减小车辆的位置信息和车辆当前位置的误差,GPS优选差分GPS,智能车辆获取差分GPS检测到的车辆的位置信息。GPS positioning data is the position information of the vehicle acquired by GPS. Due to errors in GPS positioning, the location information of the vehicle is not the current precise location information of the vehicle. In a preferred embodiment, in order to reduce the error between the position information of the vehicle and the current position of the vehicle, the GPS is preferably differential GPS, and the intelligent vehicle obtains the position information of the vehicle detected by the differential GPS.
图像数据是通过摄像头采集的车辆周围的环境数据,当摄像头的数量为多个时,图像数据表示多个摄像头采集的环境数据的集合。The image data is the environment data around the vehicle collected by the cameras. When the number of cameras is multiple, the image data represents a set of environment data collected by the multiple cameras.
在步骤101之前,智能车辆接收云端服务器或者终端发送的行驶信息,该行驶信息中包括目的地和时间信息,智能车辆根据目的地信息和时间信息,自动行驶至相对应的区块。智能车辆上安装的传感器在接收终端发送的地图采集指令之后,并根据地图采集指令,按照预设路线与预设方式采集数据; 当传感器采集数据完成后,终端会通过导出指令指示数据采集完成。其中地图采集指令可以是用户通过终端输入的也可以是服务器对终端发出的。Before step 101, the intelligent vehicle receives the driving information sent by the cloud server or the terminal, the driving information includes destination and time information, and the intelligent vehicle automatically drives to the corresponding block according to the destination information and time information. After receiving the map collection instruction sent by the terminal, the sensor installed on the smart vehicle collects data according to the map collection instruction, according to the preset route and preset method; when the sensor collects the data, the terminal will indicate the completion of the data collection through the export instruction. The map collection instruction may be input by the user through the terminal, or may be sent by the server to the terminal.
其中,云端服务器接收终端发送的第一传感器数据具体包括:The first sensor data that the cloud server receives from the terminal specifically includes:
接收终端发送的多帧原始传感器数据;每帧原始传感器数据包括帧头;Receive multiple frames of raw sensor data sent by the terminal; each frame of raw sensor data includes a frame header;
根据帧头,判断多帧原始传感器数据是否传输完毕;According to the frame header, determine whether the multi-frame raw sensor data has been transmitted;
当传输完毕时,根据帧头,将多帧原始传感器数据进行拼接,得到第一传感器数据。When the transmission is completed, multiple frames of original sensor data are spliced according to the frame header to obtain the first sensor data.
由于各个传感器型号不同,导致输入的传感器数据类型和格式不同,这样不利于算法的普适性,因此,需要将原始传感器数据进行预处理,将传感器数据转换成特定的数据类型和格式,实现算法输入端数据的一致性。因此,第一传感器数据是原始传感器数据经整理完善之后上传到云端服务器的。Due to the different sensor models, the input sensor data types and formats are different, which is not conducive to the universality of the algorithm. Therefore, it is necessary to preprocess the original sensor data, convert the sensor data into a specific data type and format, and implement the algorithm. Consistency of input data. Therefore, the first sensor data is uploaded to the cloud server after the original sensor data is sorted and perfected.
步骤102,当接收到第一传感器数据后,生成用于构建地图的地图任务构建请求消息; Step 102, after receiving the first sensor data, generate a map task construction request message for constructing a map;
具体的,云端服务器会实时检测是否有第一传感器数据上传,同时监控第一传感器数据是否上传结束。当第一传感器数据上传结束后,会触发一个地图构建命令,云端服务器自动为地图构建命令对应的任务分配一个具有唯一标识的任务名,并自动根据不同的任务名生成不同的地图任务构建请求消息,从而进行地图的构建,由此通过云端服务器即可自动响应和触发点云地图构建任务。Specifically, the cloud server will detect in real time whether there is uploading of the first sensor data, and at the same time monitor whether the uploading of the first sensor data is completed. When the upload of the first sensor data is completed, a map construction command will be triggered, and the cloud server will automatically assign a task name with a unique identification to the task corresponding to the map construction command, and automatically generate different map task construction request messages according to different task names. , so as to construct the map, so that the cloud server can automatically respond and trigger the point cloud map construction task.
步骤103,根据地图任务构建请求消息,获取当前内存占用量和当前地图任务构建个数; Step 103, according to the map task construction request message, obtain the current memory occupancy and the current map task construction number;
步骤104,当当前内存占用量小于预设的内存占用量,且当前地图任务构建个数小于预设的地图任务构建阈值时,判断第一传感器数据是否符合数据合格判断规则; Step 104, when the current memory occupancy is less than the preset memory occupancy, and the current map task construction number is less than the preset map task construction threshold, determine whether the first sensor data complies with the data eligibility judgment rule;
具体的,云端服务器会设置多个配置参数,其中,包括内存占用量、任务个数。Specifically, the cloud server will set a number of configuration parameters, including the memory usage and the number of tasks.
预设的内存占用量可以理解为服务器允许的内存占用量。在一个具体的例子中,预设的内存占用量可以设置为80%。预设的地图任务构建阈值可以理解为云端服务器上能同时运行的任务个数,在另一个具体的例子中,预设的地图任务构建阈值为N,0<N<6,且N为正整数。The preset memory usage can be understood as the memory usage allowed by the server. In a specific example, the preset memory footprint can be set to 80%. The preset map task construction threshold can be understood as the number of tasks that can run simultaneously on the cloud server. In another specific example, the preset map task construction threshold is N, 0<N<6, and N is a positive integer .
云端服务器可以通过判断内存占用量和同时运行的任务个数,判断该点云地图构建任务是否需要等待其他任务结束,若需要等待,直至其他任务完成后,执行此点云地图构建任务。在一个具体的例子中,内存占用量为60%时,云端服务器上同时运行的任务个数为4个时,无需等待,云端服务器即可执行点云地图构建任务。由此,通过云端服务器进行点云地图构建,可以避免现有在线地图构建技术中通过车载处理器进行地图构建时,对车载处理器要求高的缺点,并且可以同时实现多个点云地图任务的构建,克服了大地图难以处理的困难。The cloud server can judge whether the point cloud map construction task needs to wait for the completion of other tasks by judging the memory usage and the number of tasks running at the same time. In a specific example, when the memory usage is 60% and the number of tasks running simultaneously on the cloud server is 4, the cloud server can execute the point cloud map construction task without waiting. Therefore, the point cloud map construction through the cloud server can avoid the disadvantage of high requirements on the vehicle processor when the map is constructed through the vehicle processor in the existing online map construction technology, and can realize the simultaneous realization of multiple point cloud map tasks. Build, overcoming the intractable difficulties of a large map.
步骤105,当第一传感器数据符合数据合格判断规则时,根据点云数据、惯导数据、轮速计数据、GPS定位数据和图像数据,得到第二传感器数据; Step 105, when the first sensor data complies with the data eligibility judgment rule, obtain second sensor data according to point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data;
具体的,数据合格判断规则具体包括第一传感器数据的格式是否为预设格式和第一传感器数据的质量是否符合要求。Specifically, the data eligibility judgment rule specifically includes whether the format of the first sensor data is a preset format and whether the quality of the first sensor data meets the requirements.
当第一传感器数据的格式不符合预设格式时,云端服务器会生成第一提示消息,并将第一提示消息发送给终端,以指示终端重新获取第一传感器数据,即将原始传感器数据按照预设格式重新整理上传至云端服务器。When the format of the first sensor data does not conform to the preset format, the cloud server will generate a first prompt message, and send the first prompt message to the terminal to instruct the terminal to re-acquire the first sensor data, that is, the original sensor data according to the preset format The format is rearranged and uploaded to the cloud server.
进一步的,由于各个传感器会按照预设的采样频率采集数据,因此通过检查第一传感器数据中是否缺失某个传感器测量的数据从而判断第一传感器数据的质量是否符合要求。Further, since each sensor collects data according to a preset sampling frequency, it is determined whether the quality of the first sensor data meets the requirements by checking whether the data measured by a certain sensor is missing in the first sensor data.
其中,点云数据为第一采样频率对应的第一数据集,第一数据集中的每个数据都具有第一时间戳,当第一时间戳与第一采样频率不一致时,确定点云数据质量不符合要求;和/或,惯导数据为第二采样频率对应的第二数据集,第二数据集中的每个数据都具有第二时间戳,当第二时间戳与第二采样频率 不一致时,确定惯导数据质量不符合要求;和/或,轮速计数据为第三采样频率对应的第三数据集,第三数据集中的每个数据都具有第三时间戳,当第三时间戳与第三采样频率不一致时,确定轮速计数据质量不符合要求;和/或,GPS定位数据为第四采样频率对应的第四数据集,第四数据集中的每个数据都具有第四时间戳,当第四时间戳与第四采样频率不一致时,确定GPS定位数据质量不符合要求;和/或,图像数据为第五采样频率对应的第五数据集,第五数据集中的每个数据都具有第五时间戳,当第五时间戳与第五采样频率不一致时,确定图像数据质量不符合要求。The point cloud data is the first data set corresponding to the first sampling frequency, and each data in the first data set has a first timestamp. When the first timestamp is inconsistent with the first sampling frequency, the quality of the point cloud data is determined. does not meet the requirements; and/or, the inertial navigation data is a second data set corresponding to the second sampling frequency, and each data in the second data set has a second time stamp, when the second time stamp is inconsistent with the second sampling frequency , it is determined that the quality of the inertial navigation data does not meet the requirements; and/or, the wheel speedometer data is a third data set corresponding to the third sampling frequency, and each data in the third data set has a third time stamp, when the third time stamp When it is inconsistent with the third sampling frequency, it is determined that the data quality of the wheel speedometer does not meet the requirements; and/or, the GPS positioning data is a fourth data set corresponding to the fourth sampling frequency, and each data in the fourth data set has a fourth time Stamp, when the fourth time stamp is inconsistent with the fourth sampling frequency, it is determined that the quality of the GPS positioning data does not meet the requirements; and/or, the image data is the fifth data set corresponding to the fifth sampling frequency, and each data in the fifth data set Both have a fifth time stamp, and when the fifth time stamp is inconsistent with the fifth sampling frequency, it is determined that the quality of the image data does not meet the requirements.
当第一传感器数据质量不符合要求时,云端服务器生成的第二提示消息,并将第二提示消息发送给终端,以指示终端重新采集获取原始传感器数据。When the quality of the first sensor data does not meet the requirements, the cloud server generates a second prompt message, and sends the second prompt message to the terminal to instruct the terminal to re-collect and acquire the original sensor data.
因此,只有当第一传感器数据的格式符合预设格式且第一传感器数据的质量符合要求时,云端服务器才会执行点云地图构建任务。数据合格判断规则的设置,使得构建点云地图的传感器数据质量得到了很大的改进,减小了点云地图构建的数据误差,从而提高了构建的点云地图的质量。Therefore, only when the format of the first sensor data meets the preset format and the quality of the first sensor data meets the requirements, the cloud server will perform the point cloud map construction task. The setting of the data eligibility judgment rules greatly improves the quality of the sensor data for constructing the point cloud map, reduces the data error of the point cloud map construction, and improves the quality of the constructed point cloud map.
步骤106,根据第二传感器数据,构建点云地图;点云地图包括多个点,每个点具有第一定位数据; Step 106, constructing a point cloud map according to the second sensor data; the point cloud map includes a plurality of points, and each point has the first positioning data;
具体的,将点云数据、车辆的加速度信息、角速度信息和姿态角信息、、车辆左右轮的角速度信息、线速度信息和车辆横摆率信息、GPS定位数据和第一图像数据进行融合处理,得到第二传感器数据,即第二传感器数据为第一传感器数据经融合处理后的数据。第一定位数据为点云地图中通过预设的算法计算得出的每个点在点云地图中的定位位姿信息,其中定位位姿信息可以包括定位信息、姿态角。Specifically, the point cloud data, the acceleration information of the vehicle, the angular velocity information and the attitude angle information, the angular velocity information of the left and right wheels of the vehicle, the linear velocity information and the yaw rate information of the vehicle, the GPS positioning data and the first image data are fused to process, The second sensor data is obtained, that is, the second sensor data is the data after fusion processing of the first sensor data. The first positioning data is the positioning pose information of each point in the point cloud map calculated by a preset algorithm in the point cloud map, where the positioning pose information may include positioning information and an attitude angle.
步骤107,对点云地图进行验证,当动态载波相位差分技术RTK的标志位表示信号正常时,将第一定位数据与通过实时动态载波相位差分技术RTK获取的第二定位数据进行比较,当第一定位数据与第二定位数据的差值不大于预设阈值时,确定点云地图符合精度条件; Step 107, verify the point cloud map, when the flag bit of the dynamic carrier phase difference technology RTK indicates that the signal is normal, compare the first positioning data with the second positioning data obtained by the real-time dynamic carrier phase difference technology RTK, when the first positioning data When the difference between the first positioning data and the second positioning data is not greater than the preset threshold, it is determined that the point cloud map meets the accuracy condition;
具体的,云端服务器对上述构建成功的点云地图进行质量验证。为减小地图数据的误差,提高地图数据的质量,构建好的点云地图必须满足一定的精度条件。因此,该方法中,除了采用两个差分GPS测量还要结合实时动态(Real-time kinematic,RTK)载波相位差分技术获取第二定位数据,当动态载波相位差分技术RTK的标志位表示信号正常时,将第一定位数据与第二定位数据进行比较,判断第一定位数据和第二定位数据之间的差值是否符合预设阈值,如果差值不大于预设阈值,则可确定点云地图的精度符合精度条件,同时给出厘米级定位结果,从而满足高精度点云地图构建的要求。Specifically, the cloud server performs quality verification on the above-mentioned successfully constructed point cloud map. In order to reduce the error of map data and improve the quality of map data, the constructed point cloud map must meet certain accuracy conditions. Therefore, in this method, in addition to using two differential GPS measurements, the real-time kinematic (RTK) carrier phase difference technology is also used to obtain the second positioning data. When the RTK flag bit of the dynamic carrier phase difference technology indicates that the signal is normal , compare the first positioning data with the second positioning data, determine whether the difference between the first positioning data and the second positioning data meets the preset threshold, and if the difference is not greater than the preset threshold, the point cloud map can be determined The accuracy meets the accuracy conditions, and provides centimeter-level positioning results to meet the requirements of high-precision point cloud map construction.
步骤108,根据惯导数据和轮速计数据,生成预设长度的局部路径,将局部路径与相同预设长度的点云地图中的局部路径进行比较,当局部路径与相同预设长度的点云地图中的局部路径的各点的曲率的差值不大于预设的差值阈值时,确定点云地图符合畸变条件;Step 108: Generate a local path with a preset length according to the inertial navigation data and the wheel speedometer data, and compare the local path with the local path in the point cloud map of the same preset length. When the difference between the curvatures of each point of the local path in the cloud map is not greater than the preset difference threshold, it is determined that the point cloud map meets the distortion condition;
具体的,根据时间戳,将惯导数据和轮速计数据在时间上进行对齐处理,并选取一定预设长度,生成一个局部路径。在一个具体的例子中,预设长度可以为10m。如两个对齐的局部路径(曲线)差别过大,说明这两条曲线形状是不同的,如果两者是在同一坐标系中,则说明其中有一个是发生了畸变。Specifically, according to the timestamp, the inertial navigation data and the wheel speedometer data are aligned in time, and a certain preset length is selected to generate a local path. In a specific example, the preset length may be 10m. If the difference between the two aligned local paths (curves) is too large, it means that the shapes of the two curves are different. If they are in the same coordinate system, it means that one of them is distorted.
步骤109,判断点云地图中的多个第一定位数据之间的连线是否存在跳变,当不存在跳变时,确定点云地图符合平滑性条件; Step 109, judging whether there is a jump in the connection between the multiple first positioning data in the point cloud map, and when there is no jump, it is determined that the point cloud map meets the smoothness condition;
具体的,平滑性是指构建的点云地图中多个第一定位数据对应的点的连线应该是一条平滑的曲线,如果有某个点出现跳变,则会出现锯齿状的连线,从而通过判断多个第一定位数据之间的连线是否存在跳变,即可判断点云地图是否符合平滑性条件。Specifically, smoothness means that the connection line of the points corresponding to the first positioning data in the constructed point cloud map should be a smooth curve. If a certain point jumps, there will be a jagged connection. Therefore, by judging whether there is a jump in the connection between the plurality of first positioning data, it can be judged whether the point cloud map meets the smoothness condition.
步骤110,判断点云地图中的多个第一定位数据之间的任意相邻的两个第一定位数据对应的点的距离是否不大于预设的距离阈值,当不大于预设的距离阈值时,确定点云地图符合连续性条件;Step 110: Determine whether the distance between any adjacent points corresponding to two first positioning data in the point cloud map is not greater than a preset distance threshold, and when it is not greater than a preset distance threshold When , it is determined that the point cloud map meets the continuity condition;
具体的,点云地图中的多个第一定位数据之间的任意相邻的两个第一定位数据对应的点的距离都有预设的距离阈值,因此,将点云地图中的相邻的点之间的距离与预设的距离阈值相比较,当距离不大于预设的距离阈值时,则认为点的连续性好,点云地图符合连续性的要求。在一个具体的例子中,预设的距离阈值为1m,如果某两个点之间的距离为2m,那么即可判断该点云地图的连续性不符合条件。Specifically, the distance between any two adjacent points corresponding to the first positioning data in the point cloud map has a preset distance threshold. Therefore, the adjacent points in the point cloud map are The distance between the points is compared with the preset distance threshold. When the distance is not greater than the preset distance threshold, it is considered that the continuity of the points is good, and the point cloud map meets the requirements of continuity. In a specific example, the preset distance threshold is 1m, and if the distance between two points is 2m, it can be determined that the continuity of the point cloud map does not meet the conditions.
步骤111,判断点是否完整,当点完整时,确定点云地图符合完整条件; Step 111, judge whether the point is complete, and when the point is complete, determine that the point cloud map meets the complete condition;
具体的,完整条件指的是指判断点云地图中的点是否完整,该些点包括但不限于功能点、红绿灯标识数据以及边界信息。其中,功能点指的是点云地图上预设的点。比如,在用户终端上的点云地图中,所选取的点。红绿灯标识数据是指红绿灯的位置,比如红绿灯在点云地图上的坐标,该坐标可以是灯板框的中心点的位置。Specifically, the complete condition refers to judging whether the points in the point cloud map are complete, and the points include but are not limited to function points, traffic light identification data, and boundary information. Among them, the function point refers to the preset point on the point cloud map. For example, in the point cloud map on the user terminal, the selected point. The traffic light identification data refers to the position of the traffic light, such as the coordinates of the traffic light on the point cloud map, and the coordinates may be the position of the center point of the light board frame.
在一个示例中,在判断边界信息完整时,可以根据传感器频率和该传感器的采集时间,计算边界上的轨迹点个数,查看生成的点云地图中的边界轨迹数据与计算出的边界上的轨迹点个数是否一致。当生成的点云地图中的边界轨迹数据与计算出的边界上的轨迹点个数一致时,确定边界信息满足完整条件。当功能点、红绿灯标识数据以及边界信息均满足完整条件时,确定点云地图符合完整条件。In one example, when judging that the boundary information is complete, the number of trajectory points on the boundary can be calculated according to the sensor frequency and the acquisition time of the sensor, and the boundary trajectory data in the generated point cloud map and the calculated boundary trajectory data on the boundary can be checked. Whether the number of track points is consistent. When the boundary trajectory data in the generated point cloud map is consistent with the calculated number of trajectory points on the boundary, it is determined that the boundary information satisfies the complete condition. When the function points, traffic light identification data and boundary information all meet the complete conditions, it is determined that the point cloud map meets the complete conditions.
步骤112,当点云地图符合精度条件、畸变条件、平滑性条件、连续性条件和完整条件时,确定点云地图通过验证。 Step 112, when the point cloud map meets the accuracy conditions, distortion conditions, smoothness conditions, continuity conditions and integrity conditions, it is determined that the point cloud map passes the verification.
在一个优选的实施例中,当点云地图验证不通过时,比如点云地图不符合精度条件、畸变条件、平滑性条件和连续性条件时,云端服务器会自动修改点云地图构建所需要的指定参数,比如定位偏差、定位状态等,并以新参数重新执行一次点云地图构建,之后再重新进行点云地图质量验证。In a preferred embodiment, when the point cloud map verification fails, for example, when the point cloud map does not meet the accuracy conditions, distortion conditions, smoothness conditions and continuity conditions, the cloud server will automatically modify the point cloud map construction needs. Specify parameters, such as positioning deviation, positioning status, etc., and re-execute the point cloud map construction with the new parameters, and then re-verify the point cloud map quality.
若点云地图不符合完整条件时,云端服务器会给出具体的数据缺失项,提示终端重新进行原始数据的采集和上传。然后重新执行步骤101-112,直至 点云地图质量符合完整条件。If the point cloud map does not meet the complete conditions, the cloud server will give specific data missing items, prompting the terminal to re-collect and upload the original data. Then re-execute steps 101-112 until the point cloud map quality meets the complete conditions.
通过对点云地图的验证,减小了构建的点云地图时的误差,从而提高了点云地图质量。Through the verification of the point cloud map, the error of the constructed point cloud map is reduced, thereby improving the quality of the point cloud map.
进一步的,本申请之后还可以包括:当点云地图的验证通过后,存储点云地图对应的传感器数据,以便后续将存储的多个区域对应的传感器数据进行拼接,得到一个较大区块的点云地图。Further, the present application may further include: after the verification of the point cloud map is passed, storing the sensor data corresponding to the point cloud map, so that the sensor data corresponding to the stored multiple areas can be spliced to obtain a larger block of sensor data. Point cloud map.
本发明实施例一提供的一种高精度点云地图构建方法,通过云端服务器自动响应和触发点云地图构建,可以同时实现多个点云地图任务的构建,克服了大地图难以处理的困难;当第一传感器数据符合数据合格判断规则时,才会进行点云地图的构建且通过对点云地图的完整、精度、畸变、平滑性和连续性的验证,减小了构建的点云地图时的误差,满足了点云地图构建高精度的要求,从而提高了点云地图的质量。The method for constructing a high-precision point cloud map provided by the first embodiment of the present invention, through the automatic response and triggering of the point cloud map construction by the cloud server, can realize the construction of multiple point cloud map tasks at the same time, and overcome the difficulty that the large map is difficult to handle; When the first sensor data complies with the data eligibility judgment rules, the construction of the point cloud map will be carried out, and through the verification of the integrity, accuracy, distortion, smoothness and continuity of the point cloud map, the time required for the constructed point cloud map will be reduced. The error satisfies the high-precision requirements of point cloud map construction, thereby improving the quality of the point cloud map.
本发明实施例二提供了一种设备,包括存储器和处理器,存储器用于存储程序,处理器用于执行本发明实施例一提供的高精度点云地图构建方法。The second embodiment of the present invention provides a device including a memory and a processor, where the memory is used to store a program, and the processor is used to execute the high-precision point cloud map construction method provided by the first embodiment of the present invention.
本发明实施例三提供了一种计算机可读存储介质,计算机可读存储介质上存储有计算机程序,计算机程序被处理器执行时实现本发明实施例一提供的高精度点云地图构建方法。Embodiment 3 of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method for constructing a high-precision point cloud map provided by Embodiment 1 of the present invention is implemented.
本发明实施例四提供了一种计算机服务器,包括:存储器、处理器和收发器;所述处理器用于与所述存储器耦合,读取并执行所述存储器中的指令,以实现实施例一所述的高精度点云地图构建方法;所述收发器与所述处理器耦合,由所述处理器控制所述收发器进行消息收发。Embodiment 4 of the present invention provides a computer server, including: a memory, a processor, and a transceiver; the processor is configured to be coupled with the memory, and read and execute instructions in the memory, so as to implement the first embodiment of the present invention. The above-mentioned method for constructing a high-precision point cloud map; the transceiver is coupled to the processor, and the processor controls the transceiver to send and receive messages.
本发明实施例五提供了一种移动工具,包括实施例四所述的计算机服务器。移动工具可以是任何可以移动的工具,例如车辆(例如吸尘车、清扫车、洗地车、物流小车、乘用车、环卫车、公交车、大巴车、厢式货车、卡车、载重车、挂车、甩挂车、吊车、挖掘机、铲土机、公路列车、扫地车、洒水车、垃圾车、工程车、救援车、AGV(Automated Guided Vehicle,自动导引 运输车)、摩托车、自行车、三轮车、手推车、机器人、扫地机、平衡车等,本申请对于移动工具的类型不做严格限定,在此不再穷举。The fifth embodiment of the present invention provides a mobile tool, including the computer server described in the fourth embodiment. The mobile tool can be any movable tool, such as a vehicle (such as a vacuum cleaner, a sweeper, a floor scrubber, a logistics trolley, a passenger car, a sanitation vehicle, a bus, a coach, a van, a truck, a truck, Trailers, dump trailers, cranes, excavators, scrapers, road trains, sweepers, sprinklers, garbage trucks, engineering vehicles, rescue vehicles, AGVs (Automated Guided Vehicles), motorcycles, bicycles, Tricycles, hand carts, robots, sweepers, balance vehicles, etc., the application does not strictly limit the types of mobile tools, and will not be exhaustive here.
专业人员应该还可以进一步意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、计算机软件或者二者的结合来实现,为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。Professionals should be further aware that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. Interchangeability, the above description has generally described the components and steps of each example in terms of function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.
结合本文中所公开的实施例描述的方法或算法的步骤可以用硬件、处理器执行的软件模块,或者二者的结合来实施。软件模块可以置于随机存储器(RA高精度点云地图构建方法)、内存、只读存储器(RO高精度点云地图构建方法)、电可编程RO高精度点云地图构建方法、电可擦除可编程RO高精度点云地图构建方法、寄存器、硬盘、可移动磁盘、CD-RO高精度点云地图构建方法动力系统控制方法、或技术领域内所公知的任意其它形式的存储介质中。The steps of a method or algorithm described in connection with the embodiments disclosed herein may be implemented in hardware, a software module executed by a processor, or a combination of the two. Software modules can be placed in random access memory (RA high-precision point cloud map construction method), memory, read-only memory (RO high-precision point cloud map construction method), electrically programmable RO high-precision point cloud map construction method, electrically erasable A programmable RO high-precision point cloud map construction method, a register, a hard disk, a removable disk, a CD-RO high-precision point cloud map construction method, a power system control method, or any other form of storage medium known in the technical field.
以上所述的具体实施方式,对本发明的目的、技术方案和有益效果进行了进一步详细说明,所应理解的是,以上所述仅为本发明的具体实施方式而已,并不用于限定本发明的保护范围,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The specific embodiments described above further describe the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above descriptions are only specific embodiments of the present invention and are not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims (11)

  1. 一种高精度点云地图构建方法,其特征在于,所述高精度点云地图构建方法包括:A method for constructing a high-precision point cloud map, characterized in that the method for constructing a high-precision point cloud map comprises:
    接收终端发送的第一传感器数据;所述第一传感器数据包括点云数据、惯导数据、轮速计数据、GPS定位数据和图像数据;receiving first sensor data sent by the terminal; the first sensor data includes point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data;
    当接收到所述第一传感器数据后,生成用于构建地图的地图任务构建请求消息;After receiving the first sensor data, generating a map task construction request message for constructing a map;
    根据所述地图任务构建请求消息,获取当前内存占用量和当前地图任务构建个数;According to the map task construction request message, obtain the current memory occupancy and the current map task construction number;
    当所述当前内存占用量小于预设的内存占用量,且所述当前地图任务构建个数小于预设的地图任务构建阈值时,判断所述第一传感器数据是否符合数据合格判断规则;When the current memory occupancy is less than the preset memory occupancy, and the current map task construction number is less than the preset map task construction threshold, determine whether the first sensor data complies with the data eligibility judgment rule;
    当所述第一传感器数据符合数据合格判断规则时,根据所述点云数据、惯导数据、轮速计数据、GPS定位数据和图像数据,得到第二传感器数据;When the first sensor data complies with the data eligibility judgment rule, obtain second sensor data according to the point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data;
    根据所述第二传感器数据,构建点云地图;所述点云地图包括多个点,每个所述点具有第一定位数据;constructing a point cloud map according to the second sensor data; the point cloud map includes a plurality of points, each of which has first positioning data;
    对所述点云地图进行验证,当动态载波相位差分技术RTK的标志位表示信号正常时,将所述第一定位数据与通过实时动态载波相位差分技术RTK获取的第二定位数据进行比较,当所述第一定位数据与所述第二定位数据的差值不大于预设阈值时,确定所述点云地图符合精度条件;The point cloud map is verified. When the flag bit of the dynamic carrier phase difference technology RTK indicates that the signal is normal, the first positioning data is compared with the second positioning data obtained by the real-time dynamic carrier phase difference technology RTK. When the difference between the first positioning data and the second positioning data is not greater than a preset threshold, it is determined that the point cloud map meets the accuracy condition;
    根据所述惯导数据和所述轮速计数据,生成预设长度的局部路径,将所述局部路径与相同预设长度的点云地图中的局部路径进行比较,当所述局部路径与相同预设长度的点云地图中的局部路径的各所述点的曲率的差值不大于预设的差值阈值时,确定所述点云地图符合畸变条件;According to the inertial navigation data and the wheel speedometer data, a local path with a preset length is generated, and the local path is compared with the local path in the point cloud map of the same preset length. When the difference between the curvatures of the points of the local paths in the point cloud map of preset length is not greater than a preset difference threshold, it is determined that the point cloud map meets the distortion condition;
    判断所述点云地图中的多个所述第一定位数据之间的连线是否存在跳变,当不存在跳变时,确定所述点云地图符合平滑性条件;Judging whether there is a jump in the connection between the plurality of the first positioning data in the point cloud map, and when there is no jump, it is determined that the point cloud map meets the smoothness condition;
    判断所述点云地图中的多个所述第一定位数据之间的任意相邻的两个所述第一定位数据对应的点的距离是否不大于预设的距离阈值,当不大于预设的距离阈值时,确定所述点云地图符合连续性条件;Determine whether the distance between any adjacent points corresponding to the first positioning data in the point cloud map is not greater than a preset distance threshold, and when it is not greater than a preset distance When the distance threshold is , it is determined that the point cloud map meets the continuity condition;
    判断所述点是否完整,当所述点完整时,确定点云地图符合完整条件;Determine whether the point is complete, and when the point is complete, determine that the point cloud map meets the complete condition;
    当所述点云地图符合精度条件、畸变条件、平滑性条件、连续性条件和完整条件时,确定所述点云地图通过验证。When the point cloud map meets the accuracy conditions, distortion conditions, smoothness conditions, continuity conditions and integrity conditions, it is determined that the point cloud map passes the verification.
  2. 根据权利要求1所述的高精度点云地图构建方法,其特征在于,所述接收终端发送的第一传感器数据,具体包括:The method for constructing a high-precision point cloud map according to claim 1, wherein the receiving the first sensor data sent by the terminal specifically includes:
    接收终端发送的多帧原始传感器数据;每帧所述原始传感器数据包括帧头;receiving multiple frames of raw sensor data sent by the terminal; each frame of the raw sensor data includes a frame header;
    根据所述帧头,判断所述多帧原始传感器数据是否传输完毕;According to the frame header, determine whether the transmission of the multi-frame raw sensor data is completed;
    当传输完毕时,根据所述帧头,将多帧原始传感器数据进行拼接,得到第一传感器数据。When the transmission is completed, multiple frames of original sensor data are spliced according to the frame header to obtain the first sensor data.
  3. 根据权利要求1或2所述的高精度点云地图构建方法,其特征在于,所述接收终端发送的第一传感器数据之前,还包括:The method for constructing a high-precision point cloud map according to claim 1 or 2, wherein before the receiving the first sensor data sent by the terminal, the method further comprises:
    所述传感器接收终端发送的地图采集指令,并根据所述地图采集指令,按照预设路线与预设方式采集数据;The sensor receives a map collection instruction sent by the terminal, and collects data according to the map collection instruction according to a preset route and a preset manner;
    当采集数据完成后,所述终端通过导出指令指示数据采集完成。When the data collection is completed, the terminal instructs the data collection to be completed through the export instruction.
  4. 根据权利要求1-3中任意一项所述的高精度点云地图构建方法,其特征在于,所述判断所述第一传感器数据是否符合数据合格判断规则,具体包括:The method for constructing a high-precision point cloud map according to any one of claims 1-3, wherein the judging whether the first sensor data complies with the data eligibility judgment rule specifically includes:
    判断所述第一传感器数据的格式是否为预设格式;judging whether the format of the first sensor data is a preset format;
    当所述第一传感器数据的格式不符合所述预设格式时,生成用于指示重新获取第一传感器数据的第一提示消息,并将所述第一提示消息发送给所述终端。When the format of the first sensor data does not conform to the preset format, a first prompt message for instructing to re-acquire the first sensor data is generated, and the first prompt message is sent to the terminal.
  5. 根据权利要求1-4中任意一项所述的高精度点云地图构建方法,其特 征在于,所述判断所述第一传感器数据是否符合数据合格判断规则,具体包括:The method for constructing a high-precision point cloud map according to any one of claims 1-4, wherein the judging whether the first sensor data complies with a data qualified judgment rule specifically includes:
    判断所述第一传感器数据质量是否符合要求;judging whether the data quality of the first sensor meets the requirements;
    当所述第一传感器数据质量不符合要求时,生成用于指示重新获取原始传感器数据的第二提示消息,并将所述第二提示消息发送给所述终端。When the quality of the first sensor data does not meet the requirements, a second prompt message for instructing to re-acquire the original sensor data is generated, and the second prompt message is sent to the terminal.
  6. 根据权利要求1-5中任意一项所述的方法,其特征在于,所述点云数据为第一采样频率对应的第一数据集,所述第一数据集中的每个数据都具有第一时间戳,当第一时间戳与所述第一采样频率不一致时,确定所述点云数据质量不符合要求;和/或,The method according to any one of claims 1-5, wherein the point cloud data is a first data set corresponding to a first sampling frequency, and each data in the first data set has a first timestamp, when the first timestamp is inconsistent with the first sampling frequency, it is determined that the quality of the point cloud data does not meet the requirements; and/or,
    所述惯导数据为第二采样频率对应的第二数据集,所述第二数据集中的每个数据都具有第二时间戳,当第二时间戳与所述第二采样频率不一致时,确定所述惯导数据质量不符合要求;和/或,The inertial navigation data is a second data set corresponding to the second sampling frequency, each data in the second data set has a second time stamp, and when the second time stamp is inconsistent with the second sampling frequency, determine the quality of the inertial navigation data is not satisfactory; and/or,
    所述轮速计数据为第三采样频率对应的第三数据集,所述第三数据集中的每个数据都具有第三时间戳,当第三时间戳与所述第三采样频率不一致时,确定所述轮速计数据质量不符合要求;和/或,The wheel speedometer data is a third data set corresponding to a third sampling frequency, and each data in the third data set has a third time stamp. When the third time stamp is inconsistent with the third sampling frequency, determine that the quality of the wheel speedometer data is not satisfactory; and/or,
    所述GPS定位数据为第四采样频率对应的第四数据集,所述第四数据集中的每个数据都具有第四时间戳,当第四时间戳与所述第四采样频率不一致时,确定所述GPS定位数据质量不符合要求;和/或,The GPS positioning data is a fourth data set corresponding to the fourth sampling frequency, and each data in the fourth data set has a fourth time stamp. When the fourth time stamp is inconsistent with the fourth sampling frequency, determine The quality of the GPS positioning data does not meet the requirements; and/or,
    所述图像数据为第五采样频率对应的第五数据集,所述第五数据集中的每个数据都具有第五时间戳,当第五时间戳与所述第五采样频率不一致时,确定所述图像数据质量不符合要求。The image data is a fifth data set corresponding to the fifth sampling frequency, each data in the fifth data set has a fifth time stamp, and when the fifth time stamp is inconsistent with the fifth sampling frequency, it is determined that the The quality of the image data described above does not meet the requirements.
  7. 根据权利要求1-6中任意一项所述的高精度点云地图构建方法,其特征在于,所述惯导数据包括车辆的加速度信息、角速度信息和姿态角信息;所述轮速计数据包括车辆左右轮的角速度信息、线速度信息和车辆横摆率信息;The method for constructing a high-precision point cloud map according to any one of claims 1-6, wherein the inertial navigation data includes acceleration information, angular velocity information and attitude angle information of the vehicle; the wheel speed meter data includes Angular velocity information, linear velocity information and vehicle yaw rate information of the left and right wheels of the vehicle;
    所述根据所述点云数据、惯导数据、轮速计数据、GPS定位数据和图像数 据,得到第二传感器数据,具体包括;The obtaining of the second sensor data according to the point cloud data, inertial navigation data, wheel speedometer data, GPS positioning data and image data, specifically includes;
    将所述点云数据、所述车辆的加速度信息、角速度信息和姿态角信息、所述、所述车辆左右轮的角速度信息、线速度信息和车辆横摆率信息、所述GPS定位数据和所述第一图像数据进行融合处理,得到第二传感器数据。The point cloud data, the acceleration information of the vehicle, the angular velocity information and the attitude angle information, the angular velocity information of the left and right wheels of the vehicle, the linear velocity information and the vehicle yaw rate information, the GPS positioning data and all The first image data is fused to obtain second sensor data.
  8. 一种设备,其特征在于,所述设备包括存储器和处理器,所述存储器用于存储程序,所述处理器用于执行如权利要求1-7任一项所述的高精度点云地图构建方法。A device, characterized in that the device comprises a memory and a processor, the memory is used to store a program, and the processor is used to execute the method for constructing a high-precision point cloud map according to any one of claims 1-7 .
  9. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1-7任一项所述的高精度点云地图构建方法。A computer-readable storage medium, characterized in that, a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the high-precision point according to any one of claims 1-7 is realized Cloud map construction method.
  10. 一种计算机服务器,其特征在于,包括:存储器、处理器和收发器;A computer server, comprising: a memory, a processor and a transceiver;
    所述处理器用于与所述存储器耦合,读取并执行所述存储器中的指令,以实现权利要求1-7任一项所述的高精度点云地图构建方法;The processor is configured to be coupled with the memory, and read and execute the instructions in the memory, so as to realize the method for constructing a high-precision point cloud map according to any one of claims 1-7;
    所述收发器与所述处理器耦合,由所述处理器控制所述收发器进行消息收发。The transceiver is coupled to the processor, and the processor controls the transceiver to send and receive messages.
  11. 一种移动工具,其特征在于,包括上述权利要求10所述的计算机服务器。A mobile tool, characterized in that it comprises the computer server of claim 10 .
PCT/CN2021/119050 2020-09-22 2021-09-17 Method for constructing high-precision point cloud map WO2022063056A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011003627.4 2020-09-22
CN202011003627.4A CN112414415B (en) 2020-09-22 2020-09-22 High-precision point cloud map construction method

Publications (1)

Publication Number Publication Date
WO2022063056A1 true WO2022063056A1 (en) 2022-03-31

Family

ID=74853975

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/119050 WO2022063056A1 (en) 2020-09-22 2021-09-17 Method for constructing high-precision point cloud map

Country Status (2)

Country Link
CN (1) CN112414415B (en)
WO (1) WO2022063056A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117128985A (en) * 2023-04-27 2023-11-28 荣耀终端有限公司 Point cloud map updating method and equipment

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112414415B (en) * 2020-09-22 2023-05-23 重庆兰德适普信息科技有限公司 High-precision point cloud map construction method
CN113804192B (en) * 2021-09-29 2024-02-02 北京易航远智科技有限公司 Map construction method, map construction device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100082307A1 (en) * 2008-10-01 2010-04-01 Navteq North America, Llc Bezier Curves for Advanced Driver Assistance System Applications
CN108958266A (en) * 2018-08-09 2018-12-07 北京智行者科技有限公司 A kind of map datum acquisition methods
CN109064506A (en) * 2018-07-04 2018-12-21 百度在线网络技术(北京)有限公司 Accurately drawing generating method, device and storage medium
CN109084785A (en) * 2018-07-25 2018-12-25 吉林大学 More vehicle co-locateds and map constructing method, device, equipment and storage medium
CN112414415A (en) * 2020-09-22 2021-02-26 重庆智行者信息科技有限公司 High-precision point cloud map construction method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106776996B (en) * 2016-12-02 2018-09-07 百度在线网络技术(北京)有限公司 Method and apparatus for the accuracy for testing high-precision map
CN110221603B (en) * 2019-05-13 2020-08-14 浙江大学 Remote obstacle detection method based on laser radar multi-frame point cloud fusion
CN111561923B (en) * 2020-05-19 2022-04-15 北京数字绿土科技股份有限公司 SLAM (simultaneous localization and mapping) mapping method and system based on multi-sensor fusion

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100082307A1 (en) * 2008-10-01 2010-04-01 Navteq North America, Llc Bezier Curves for Advanced Driver Assistance System Applications
CN109064506A (en) * 2018-07-04 2018-12-21 百度在线网络技术(北京)有限公司 Accurately drawing generating method, device and storage medium
CN109084785A (en) * 2018-07-25 2018-12-25 吉林大学 More vehicle co-locateds and map constructing method, device, equipment and storage medium
CN108958266A (en) * 2018-08-09 2018-12-07 北京智行者科技有限公司 A kind of map datum acquisition methods
CN112414415A (en) * 2020-09-22 2021-02-26 重庆智行者信息科技有限公司 High-precision point cloud map construction method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117128985A (en) * 2023-04-27 2023-11-28 荣耀终端有限公司 Point cloud map updating method and equipment
CN117128985B (en) * 2023-04-27 2024-05-31 荣耀终端有限公司 Point cloud map updating method and equipment

Also Published As

Publication number Publication date
CN112414415A (en) 2021-02-26
CN112414415B (en) 2023-05-23

Similar Documents

Publication Publication Date Title
WO2022063056A1 (en) Method for constructing high-precision point cloud map
Menhour et al. An efficient model-free setting for longitudinal and lateral vehicle control: Validation through the interconnected Pro-SiVIC/RTMaps prototyping platform
CN113819914B (en) Map construction method and device
CN110550029A (en) obstacle avoiding method and device
EP3699052A1 (en) Method and device for eliminating steady-state lateral deviation and storage medium
CN112937607B (en) Internet automatic driving system and method for scenic spot sightseeing vehicle
KR101155565B1 (en) Method and system for providing vehicle control using of network
US20180334166A1 (en) Deceleration curb-based direction checking and lane keeping system for autonomous driving vehicles
KR20150038776A (en) Auto parking system using infra sensors
CN113147738A (en) Automatic parking positioning method and device
CN106080595A (en) Controlling device for vehicle running
US20240053475A1 (en) Method, apparatus, and system for vibration measurement for sensor bracket and movable device
CN110568847B (en) Intelligent control system and method for vehicle, vehicle-mounted equipment and storage medium
US20220254204A1 (en) Checkpoint-Based Tracing for Monitoring a Robotic System
US20210389770A1 (en) Methods and systems for performing inter-trajectory re-linearization about an evolving reference path for an autonomous vehicle
CN113954858A (en) Method for planning vehicle driving route and intelligent automobile
CN112519777B (en) Control method of automatic driving fleet, vehicle-mounted device, vehicle and system
EP4327052A1 (en) Systems and methods for simulation supported map quality assurance in an autonomous vehicle context
CN113459852A (en) Path planning method and device and mobile tool
CN112389438A (en) Method and device for determining transmission ratio of vehicle steering system
CN115476881B (en) Vehicle track tracking control method, device, equipment and medium
CN111483822A (en) Parking control method, device and system for transport tool, transport tool and vehicle
WO2022148068A1 (en) Vehicle detection method and vehicle detection apparatus
CN209889855U (en) Parking control and loading and unloading control system of transport tool, transport tool and vehicle
JP2022139009A (en) Drive support device, drive support method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21871426

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21871426

Country of ref document: EP

Kind code of ref document: A1