CN113639745B - Point cloud map construction method, device and storage medium - Google Patents
Point cloud map construction method, device and storage medium Download PDFInfo
- Publication number
- CN113639745B CN113639745B CN202110887413.6A CN202110887413A CN113639745B CN 113639745 B CN113639745 B CN 113639745B CN 202110887413 A CN202110887413 A CN 202110887413A CN 113639745 B CN113639745 B CN 113639745B
- Authority
- CN
- China
- Prior art keywords
- point cloud
- information
- cloud map
- image
- environment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010276 construction Methods 0.000 title claims description 20
- 238000000034 method Methods 0.000 claims abstract description 40
- 238000004590 computer program Methods 0.000 claims description 29
- 239000011159 matrix material Substances 0.000 claims description 26
- 230000007613 environmental effect Effects 0.000 claims description 25
- 238000013507 mapping Methods 0.000 claims description 21
- 230000009466 transformation Effects 0.000 claims description 17
- 238000005259 measurement Methods 0.000 claims description 11
- 238000012217 deletion Methods 0.000 claims description 8
- 230000037430 deletion Effects 0.000 claims description 8
- 238000010586 diagram Methods 0.000 description 13
- 238000006243 chemical reaction Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 7
- 238000000605 extraction Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
- G01C21/1652—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with ranging devices, e.g. LIDAR or RADAR
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Navigation (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
技术领域Technical field
本申请涉及无人车领域,尤其涉及一种点云地图的构建方法、装置和存储介质。The present application relates to the field of unmanned vehicles, and in particular, to a method, device and storage medium for constructing a point cloud map.
背景技术Background technique
目前,建图技术作为无人车领域的重要技术受到越来越多的重视。现有的建图技术中,没有考虑去除点云地图中的动态目标,从而使得建图的结果不够精确。Currently, mapping technology is receiving more and more attention as an important technology in the field of unmanned vehicles. In existing mapping technology, removal of dynamic targets in point cloud maps is not considered, resulting in inaccurate mapping results.
发明内容Contents of the invention
针对上述技术问题,本申请实施例提供了一种点云地图的构建方法、装置及存储介质,用以感知环境中的动态目标,将点云地图中动态目标的点云删除,从而得到更加精确的环境点云图。In response to the above technical problems, embodiments of the present application provide a method, device and storage medium for constructing a point cloud map, which are used to perceive dynamic targets in the environment and delete the point clouds of dynamic targets in the point cloud map, thereby obtaining a more accurate Environmental point cloud image.
第一方面,本申请实施例提供的一种点云地图的构建方法,包括:In the first aspect, an embodiment of the present application provides a method for constructing a point cloud map, including:
采集第一位置的第一信息;Collect the first information from the first position;
完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;After completing the collection of the first information, move to the second position and collect the second information at the second position;
将所述第二信息与第一信息进行局部匹配,获得局部点云地图;Locally match the second information with the first information to obtain a local point cloud map;
将所述局部点云地图中的动态目标点云删除,获得激光点云地图;Delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;
其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;
所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.
进一步的,当点云地图构建开始时,所述第一位置为起始位置;Further, when the point cloud map construction starts, the first position is the starting position;
当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the last collected position.
优选的,开启采集设备,所述采集设备包括以下之一或者组合:Preferably, the collection device is turned on, and the collection device includes one or a combination of the following:
激光雷达;lidar;
双目摄像头;binocular camera;
深度摄像头;depth camera;
惯性测量单元IMU;Inertial Measurement Unit IMU;
轮速里程计。Wheel speed odometer.
优选的,完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。Preferably, after completing the collection of the entire mapping area, the collection is ended, and the laser point cloud maps of all collection points are spliced to obtain an environmental point cloud map of the entire mapping area.
优选的,所述采集第一位置的第一信息包括:Preferably, collecting the first information of the first location includes:
根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;Establish a first environmental point cloud map based on the lidar data collected by the lidar;
根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。A first environment image is established based on the image data collected by the binocular camera and the depth camera.
所述采集第二位置的第二信息包括:The collecting the second information of the second location includes:
根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;Establish a second environmental point cloud map based on the lidar data collected by the lidar;
根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。A second environment image is established based on the image data collected by the binocular camera and the depth camera.
进一步的,还包括:Furthermore, it also includes:
将所述激光雷达采集的激光雷达数据上传到上位机系统;Upload the lidar data collected by the lidar to the host computer system;
将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统。Upload the image data collected by the binocular camera and the depth camera to the host computer system.
优选的,所述将所述局部点云地图中的动态目标点云删除包括:Preferably, deleting the dynamic target point cloud in the local point cloud map includes:
将第一位置或者第二位置的图像和点云进行匹配;Match the image at the first position or the second position with the point cloud;
将图像中识别出的动态目标对应的点云从点云地图中删除。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map.
优选的,所述表征动态目标的点云包括:Preferably, the point cloud characterizing the dynamic target includes:
表征行人或者非机动车辆或者机动车辆的点云。Point clouds representing pedestrians or non-motor vehicles or motor vehicles.
优选的,所述将第一位置或者第二位置的图像和点云进行匹配包括:Preferably, matching the image at the first position or the second position with the point cloud includes:
根据转换矩阵将图像信息与点云信息进行匹配。Match image information with point cloud information according to the transformation matrix.
使用本发明提供的点云地图的构建方法,根据前后两个采集点的环境图像信息和环境点云图信息进行局部匹配,然后识别出动态目标,再从局部点云地图中将动态目标的点云删除,从而提高了建图的精确性。带有动态目标的地图对后续利用地图进行定位与导航时带有严重的干扰,而使用本发明方法建立的地图不含动态目标,精确性更高。Using the point cloud map construction method provided by the present invention, local matching is performed based on the environmental image information and environmental point cloud map information of the two previous and subsequent collection points, and then the dynamic target is identified, and then the point cloud of the dynamic target is extracted from the local point cloud map. Delete, thus improving the accuracy of mapping. Maps with dynamic targets will cause serious interference to subsequent use of maps for positioning and navigation, while maps established using the method of the present invention do not contain dynamic targets and are more accurate.
第二方面,本申请实施例还提供一种点云地图的构建装置,包括:In a second aspect, embodiments of the present application also provide a device for constructing a point cloud map, including:
采集模块,被配置用于采集第一位置的第一信息,完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;The collection module is configured to collect the first information at the first position, and after completing the collection of the first information, moves to the second position to collect the second information at the second position;
局部匹配模块,被配置用于将所述第二信息与第一信息进行局部匹配,获得局部点云地图;a local matching module configured to locally match the second information with the first information to obtain a local point cloud map;
动态目标删除模块,被配置用于将所述局部点云地图中的动态目标点云删除,获得激光点云地图;A dynamic target deletion module configured to delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;
其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;
所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.
第三方面,本申请实施例还提供一种点云地图的构建装置,包括:存储器、处理器和用户接口;In a third aspect, embodiments of the present application also provide a device for constructing a point cloud map, including: a memory, a processor, and a user interface;
所述存储器,用于存储计算机程序;The memory is used to store computer programs;
所述用户接口,用于与用户实现交互;The user interface is used to interact with users;
所述处理器,用于读取所述存储器中的计算机程序,所述处理器执行所述计算机程序时,实现本发明提供的点云地图的构建方法。The processor is configured to read the computer program in the memory. When the processor executes the computer program, it implements the point cloud map construction method provided by the present invention.
第四方面,本申请实施例还提供一种处理器可读存储介质,所述处理器可读存储介质存储有计算机程序,所述处理器执行所述计算机程序时实现本发明提供的点云地图的构建方法。In a fourth aspect, embodiments of the present application also provide a processor-readable storage medium, the processor-readable storage medium stores a computer program, and when the processor executes the computer program, the point cloud map provided by the present invention is implemented. construction method.
附图说明Description of the drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简要介绍,显而易见地,下面描述中的附图仅是本申请的一些实施例,对于本领域的普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, a brief introduction will be given below to the drawings required to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. Those of ordinary skill in the art can also obtain other drawings based on these drawings without exerting creative efforts.
图1为本实施例提供的点云地图构建示意图;Figure 1 is a schematic diagram of the point cloud map construction provided in this embodiment;
图2为本申请实施例提供的环境图像和环境点云图采集示意图;Figure 2 is a schematic diagram of environmental image and environmental point cloud image collection provided by the embodiment of the present application;
图3为本申请实施例提供的第一位置和第二位置信息采集示意图;Figure 3 is a schematic diagram of first location and second location information collection provided by the embodiment of the present application;
图4为本申请实施例提供的动态目标识别示意图;Figure 4 is a schematic diagram of dynamic target recognition provided by an embodiment of the present application;
图5为本申请实施例提供的动态目标点云删除后的示意图;Figure 5 is a schematic diagram after deletion of the dynamic target point cloud provided by the embodiment of the present application;
图6为本申请实施例提供的一种点云地图的构建装置结构示意图;Figure 6 is a schematic structural diagram of a point cloud map construction device provided by an embodiment of the present application;
图7为本申请实施例提供的另一种点云地图的构建装置结构示意图。Figure 7 is a schematic structural diagram of another point cloud map construction device provided by an embodiment of the present application.
具体实施方式Detailed ways
为了使本发明的目的、技术方案和优点更加清楚,下面将结合附图对本发明作进一步地详细描述,显然,所描述的实施例仅仅是本发明一部份实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. . Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.
下面对文中出现的一些词语进行解释:Here are some explanations of some words that appear in the text:
1、本发明实施例中术语“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。1. In the embodiment of the present invention, the term "and/or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, alone There are three situations B. The character "/" generally indicates that the related objects are in an "or" relationship.
2、本申请实施例中术语“多个”是指两个或两个以上,其它量词与之类似。2. In the embodiments of this application, the term "multiple" refers to two or more, and other quantifiers are similar to it.
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,并不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.
需要说明的是,本申请实施例的展示顺序仅代表实施例的先后顺序,并不代表实施例所提供的技术方案的优劣。It should be noted that the display order of the embodiments of this application only represents the order of the embodiments, and does not represent the quality of the technical solutions provided by the embodiments.
实施例一Embodiment 1
参见图1,本申请实施例提供的一种点云地图的构建方法示意图,如图1所示,该方法包括步骤S101到S104:Referring to Figure 1, a schematic diagram of a point cloud map construction method provided by an embodiment of the present application is shown. As shown in Figure 1, the method includes steps S101 to S104:
S101、采集第一位置的第一信息;S101. Collect the first information of the first position;
S102、完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;S102. After completing the collection of the first information, move to the second position and collect the second information at the second position;
S103、将所述第二信息与第一信息进行局部匹配,获得局部点云地图;S103. Locally match the second information with the first information to obtain a local point cloud map;
S104、将所述局部点云地图中的动态目标点云删除,获得激光点云地图;S104. Delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;
其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;
所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.
具体的,所述第一环境点云图和第二环境点云图是通过激光雷达采集的激光雷达数据建立的,所述第一环境图像和第二环境图像是通过双目摄像头和深度摄像头采集的图像数据建立的。Specifically, the first environment point cloud image and the second environment point cloud image are established through lidar data collected by lidar, and the first environment image and the second environment image are images collected through binocular cameras and depth cameras. Data is created.
需要说明的是,本方法应用于构建点云地图的无人车,无人车上携带激光雷达、双目摄像头、深度摄像头、惯性测量单元(IMU)和轮速里程计中的至少一个。激光雷达用于采集激光雷达数据,双目摄像头和深度摄像头用于采集图像数据,IMU用于采集惯性测量数据,轮速里程计用于采集里程数据,如图2所示。It should be noted that this method is applied to unmanned vehicles that construct point cloud maps. The unmanned vehicle carries at least one of a lidar, a binocular camera, a depth camera, an inertial measurement unit (IMU), and a wheel speed odometer. Lidar is used to collect lidar data, binocular cameras and depth cameras are used to collect image data, IMU is used to collect inertial measurement data, and wheel speed odometer is used to collect mileage data, as shown in Figure 2.
当点云地图开始构建时,无人车处于起始位置,该起始位置为第一位置。当第一位置的第一信息采集完成后,移动到第二位置,采集第二位置的第二信息。即当点云地图构建开始时,所述第一位置为起始位置;当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the point cloud map begins to be constructed, the unmanned vehicle is at the starting position, which is the first position. After the collection of the first information at the first position is completed, it moves to the second position and collects the second information at the second position. That is, when the point cloud map construction starts, the first position is the starting position; when the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the starting position. The location is the last collected location.
作为一种优选示例,在开始构建之前,开启无人车上携带的激光雷达、双目摄像头、深度摄像头、惯性测量单元(IMU)和轮速里程计。As a preferred example, before starting the construction, turn on the lidar, binocular camera, depth camera, inertial measurement unit (IMU) and wheel speed odometer carried on the unmanned vehicle.
需要说明的是,本实施例中的第二位置是第一位置采集完后的下一个采集位置,第二位置在整个建图区域内移动,完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。It should be noted that the second position in this embodiment is the next collection position after the first position is collected. The second position moves within the entire mapping area. After completing the collection of the entire mapping area, the collection ends and all The laser point cloud maps of the collection points are stitched together to obtain an environmental point cloud map of the entire mapping area.
作为一种优选示例,第二位置在整个建图区域内移动,可以通过人工方式移动,也可以无人车根据预设的规则自动移动,本实施例不做限定。As a preferred example, the second position moves within the entire mapping area, and can be moved manually, or the unmanned vehicle can move automatically according to preset rules, which is not limited in this embodiment.
作为一种优选示例,本实施例S101中,所述采集第一位置的第一信息包括:As a preferred example, in this embodiment S101, collecting the first information of the first location includes:
根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;Establish a first environmental point cloud map based on the lidar data collected by the lidar;
根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。A first environment image is established based on the image data collected by the binocular camera and the depth camera.
作为一种优选示例,本实施例S102中,所述采集第二位置的第二信息包括:As a preferred example, in S102 of this embodiment, collecting the second information of the second location includes:
根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;Establish a second environmental point cloud map based on the lidar data collected by the lidar;
根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。A second environment image is established based on the image data collected by the binocular camera and the depth camera.
作为一种优选示例,无人车采集完第一信息或者第二信息后,将所述激光雷达采集的激光雷达数据上传到上位机系统;将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统,还可以将其他设备采集的数据也上传到上位机系统。As a preferred example, after the unmanned vehicle collects the first information or the second information, the lidar data collected by the lidar is uploaded to the host computer system; the images collected by the binocular camera and the depth camera are The data is uploaded to the host computer system, and data collected by other devices can also be uploaded to the host computer system.
作为一种优选示例,本实施例S103中、将所述第二信息与第一信息进行局部匹配,获得局部点云地图包括:As a preferred example, in S103 of this embodiment, locally matching the second information with the first information to obtain a local point cloud map includes:
上述局部匹配过程是前后两个位置激光雷达采集的点云进行配准处理,把不同位置的点云通过重叠部分的信息,变换到同一个位置。作为一种优选示例,利用ICP算法(Iterative Closest Point,最近邻迭代算法),将两组点云统一到统一坐标系下,进行点云的配准,配准后得到的点云地图成为环境局部地图。The above-mentioned local matching process is to register the point clouds collected by the lidar at the two positions, and transform the point clouds at different positions to the same position through the information of the overlapping parts. As a preferred example, the ICP algorithm (Iterative Closest Point, nearest neighbor iterative algorithm) is used to unify the two sets of point clouds into a unified coordinate system and perform point cloud registration. The point cloud map obtained after registration becomes the local environment map.
作为一种优选示例,本实施例S104中,将所述局部点云地图中的动态目标点云删除,获得激光点云地图包括:As a preferred example, in S104 of this embodiment, deleting the dynamic target point cloud in the local point cloud map and obtaining the laser point cloud map includes:
将第一位置或者第二位置的图像和点云进行匹配;Match the image at the first position or the second position with the point cloud;
将图像中识别出的动态目标对应的点云从点云地图中删除。如图4所示,识别出两个动态目标,如图5所示,删除图4中识别出的动态目标后的点云地图。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map. As shown in Figure 4, two dynamic targets are identified, as shown in Figure 5, the point cloud map after deleting the dynamic targets identified in Figure 4.
作为一种优选示例,将第一位置或者第二位置的图像和点云进行匹配包括:As a preferred example, matching the image at the first position or the second position with the point cloud includes:
根据转换矩阵将图像信息与点云信息进行匹配。也就是说,根据转换矩阵将第一环境图像与第一环境点云图匹配,或者根据转换矩阵将第二环境图像与第二环境点云图匹配。Match image information with point cloud information according to the transformation matrix. That is to say, the first environment image is matched with the first environment point cloud image according to the transformation matrix, or the second environment image is matched with the second environment point cloud image according to the transformation matrix.
优选的,转换矩阵由以下步骤确定:Preferably, the transformation matrix is determined by the following steps:
A1:标定。A1: Calibration.
在点云地图构建前进行多传感器标定,即将摄像头图像信息和雷达点云信息进行标定,即在一处特征点明确的环境内打开摄像头采集图像信息,打开雷达采集点云信息,然后工作人员选择图像上的特征位置并在点云信息上划出对应的位置。作为一种优选示例,图像上各个特征点的提取可以由SIFT图像特征点提取算法等得到。Multi-sensor calibration is performed before the point cloud map is constructed, that is, the camera image information and radar point cloud information are calibrated, that is, in an environment with clear feature points, the camera is turned on to collect image information, the radar is turned on to collect point cloud information, and then the staff selects Feature locations on the image and draw corresponding locations on the point cloud information. As a preferred example, the extraction of each feature point on the image can be obtained by SIFT image feature point extraction algorithm or the like.
A2:确定转换矩阵。A2: Determine the transformation matrix.
划出的点云位置和选择的图像位置之间的转换关系即为转换矩阵,转换矩阵表示三维点云与视觉图像像素间直接的映射关系,即图像上的位置通过转化矩阵都可以找到点云信息上的点云位置。The conversion relationship between the drawn point cloud position and the selected image position is the conversion matrix. The conversion matrix represents the direct mapping relationship between the three-dimensional point cloud and the visual image pixels. That is, the point cloud can be found at any position on the image through the conversion matrix. Point cloud locations on the information.
优选的,表征动态目标的点云包括:Preferably, the point cloud characterizing the dynamic target includes:
表征行人或者非机动车辆或者机动车辆的点云。即动态目标包括以下之一或者组合:行人,机动车,非机动车。还可以包括其他在建图区域内移动的物体,例如地面爬行动物,空中的飞行物,以及其他移动的物体。如图3所示中,动态目标为车辆。Point clouds representing pedestrians or non-motor vehicles or motor vehicles. That is, dynamic targets include one or a combination of the following: pedestrians, motor vehicles, and non-motor vehicles. You can also include other objects that move within the mapping area, such as crawlers on the ground, flying objects in the sky, and other moving objects. As shown in Figure 3, the dynamic target is a vehicle.
下面给出本实施例的一个具体示例:A specific example of this embodiment is given below:
S1、无人车在起始位置,开启无人车上携带的激光雷达、双目摄像头、深度摄像头、惯性测量单元(IMU)和轮速里程计,开始采集激光雷达数据、图像数据、惯性测量单元(IMU)数据以及轮速里程计数据;S1. The unmanned vehicle is at the starting position, turns on the lidar, binocular camera, depth camera, inertial measurement unit (IMU) and wheel speed odometer carried on the unmanned vehicle, and starts collecting lidar data, image data, and inertial measurement Unit (IMU) data and wheel speed odometer data;
S2、无人车将激光雷达采集的激光雷达数据上传至上位机系统,建立环境点云图,无人车将双目摄像头和深度摄像头采集的图像数据上传至上位机系统,建立环境图像;S2. The unmanned vehicle uploads the lidar data collected by the lidar to the host computer system to establish an environmental point cloud image. The unmanned vehicle uploads the image data collected by the binocular camera and depth camera to the host computer system to establish an environmental image;
S3、无人车在初始位置的环境点云图和环境图像建立完成后,由工作人员通过无人车携带的摄像头观察周围环境远程控制无人车移动到达下一个位置;S3. After the environmental point cloud map and environmental image of the unmanned vehicle at the initial position are established, the staff will observe the surrounding environment through the camera carried by the unmanned vehicle and remotely control the unmanned vehicle to move to the next position;
S4、无人车上携带的激光雷达、双目摄像头、深度摄像头、惯性测量单元(IMU)和轮速里程计继续采集激光雷达数据、图像数据、惯性测量单元(IMU)数据以及轮速里程计数据,并上传至上位机;S4. The lidar, binocular camera, depth camera, inertial measurement unit (IMU) and wheel speed odometer carried on the unmanned vehicle continue to collect lidar data, image data, inertial measurement unit (IMU) data and wheel speed odometer. data and upload it to the host computer;
S5、上位机根据新采集的激光雷达数据建立新位置的环境点云图,根据新采集的图像数据建立新位置的环境图像;S5. The host computer creates an environmental point cloud image of the new location based on the newly collected lidar data, and creates an environmental image of the new location based on the newly collected image data;
S6、由新位置的环境点云图和环境图像和上一位置的环境点云图和环境图像进行局部匹配,形成局部点云地图;S6. Locally match the environment point cloud map and environment image at the new location with the environment point cloud map and environment image at the previous location to form a local point cloud map;
S7、利用图像信息在局部匹配完的局部点云地图上的行人、非机动车辆、机动车辆等动态目标所表征的点云删除掉,利用新位置与上一位置的点云信息对其中动态的点云进行删除;S7. Use the image information to delete the point clouds represented by dynamic targets such as pedestrians, non-motorized vehicles, and motor vehicles on the locally matched local point cloud map, and use the point cloud information of the new position and the previous position to compare the dynamic objects. Point cloud is deleted;
S8、保存删除完动态的点云后的激光点云地图;S8. Save the laser point cloud map after deleting the dynamic point cloud;
通过本实施例的方法,根据前后两个采集点的环境图像信息和环境点云图信息进行局部匹配,然后识别出动态目标,再从局部点云地图中将动态目标的点云删除,从而提高了建图的精确性。带有动态目标的地图对后续利用地图进行定位与导航时带有严重的干扰,而使用本发明方法建立的地图不含动态目标,精确性更高。Through the method of this embodiment, local matching is performed based on the environmental image information and environmental point cloud map information of the two previous collection points, and then the dynamic target is identified, and then the point cloud of the dynamic target is deleted from the local point cloud map, thereby improving Accuracy of mapping. Maps with dynamic targets will cause serious interference to subsequent use of maps for positioning and navigation, while maps established using the method of the present invention do not contain dynamic targets and are more accurate.
实施例二Embodiment 2
基于同一个发明构思,本发明实施例还提供了一种点云地图的构建装置,如图6所示,该装置包括:Based on the same inventive concept, embodiments of the present invention also provide a device for constructing a point cloud map. As shown in Figure 6, the device includes:
采集模块601,被配置用于采集第一位置的第一信息,完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;The collection module 601 is configured to collect the first information at the first position. After completing the first information collection, move to the second position and collect the second information at the second position;
局部匹配模块602,被配置用于将所述第二信息与第一信息进行局部匹配,获得局部点云地图;The local matching module 602 is configured to locally match the second information with the first information to obtain a local point cloud map;
动态目标删除模块603,被配置用于将所述局部点云地图中的动态目标点云删除,获得激光点云地图;The dynamic target deletion module 603 is configured to delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;
其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;
所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.
本实施例中,当点云地图构建开始时,所述第一位置为起始位置;In this embodiment, when the point cloud map construction starts, the first position is the starting position;
当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the last collected position.
作为一种优选示例,采集模块601还用于在点云地图构建开始之前开启采集设备,所述采集设备包括以下之一或者组合:As a preferred example, the collection module 601 is also used to turn on the collection device before starting the point cloud map construction. The collection device includes one or a combination of the following:
激光雷达;lidar;
双目摄像头;binocular camera;
深度摄像头;depth camera;
惯性测量单元IMU;Inertial Measurement Unit IMU;
轮速里程计。Wheel speed odometer.
作为一种优选示例,采集模块601还用于根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。As a preferred example, the acquisition module 601 is also configured to establish a first environment point cloud map based on the lidar data collected by the lidar; and establish the first environment based on the image data collected by the binocular camera and the depth camera. image. A second environment point cloud image is established based on the lidar data collected by the lidar; a second environment image is established based on the image data collected by the binocular camera and the depth camera.
作为一种优选示例,采集模块601还用于将所述激光雷达采集的激光雷达数据上传到上位机系统;将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统。As a preferred example, the acquisition module 601 is also used to upload the lidar data collected by the lidar to the host computer system; and upload the image data collected by the binocular camera and the depth camera to the host computer system.
作为一种优选示例,局部匹配模块602还用于,根据以下方法将所述第二信息与第一信息进行局部匹配:As a preferred example, the local matching module 602 is also configured to locally match the second information with the first information according to the following method:
将前后两个位置(即第一位置和第二位置)的激光雷达采集的点云进行配准处理,把不同位置的点云通过重叠部分的信息,变换到同一个位置。作为一种优选示例,利用ICP算法(Iterative Closest Point,最近邻迭代算法),将两组或点云统一到统一坐标系下,进行点云的配准,配准后得到的点云地图成为环境局部地图。The point clouds collected by the lidar at the two positions before and after (i.e. the first position and the second position) are registered, and the point clouds at different positions are transformed to the same position through the information of the overlapping parts. As a preferred example, the ICP algorithm (Iterative Closest Point, nearest neighbor iterative algorithm) is used to unify two groups or point clouds into a unified coordinate system, and perform point cloud registration. The point cloud map obtained after registration becomes the environment Local map.
作为一种优选示例,动态目标删除模块603还用于:As a preferred example, the dynamic target deletion module 603 is also used to:
将第一位置或者第二位置的图像和点云进行匹配;Match the image at the first position or the second position with the point cloud;
将图像中识别出的动态目标对应的点云从点云地图中删除。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map.
其中,将第一位置或者第二位置的图像和点云进行匹配包括:Among them, matching the image at the first position or the second position with the point cloud includes:
根据转换矩阵将图像信息与点云信息进行匹配。也就是说,根据转换矩阵将第一环境图像与第一环境点云图匹配,或者根据转换矩阵将第二环境图像与第二环境点云图匹配。Match image information with point cloud information according to the transformation matrix. That is to say, the first environment image is matched with the first environment point cloud image according to the transformation matrix, or the second environment image is matched with the second environment point cloud image according to the transformation matrix.
优选的,动态目标删除模块603还用于根据以下步骤确定转换矩阵:Preferably, the dynamic target deletion module 603 is also used to determine the transformation matrix according to the following steps:
A1:标定。A1: Calibration.
在点云地图构建前进行多传感器标定,即将摄像头图像信息和雷达点云信息进行标定,即在一处特征点明确的环境内打开摄像头采集图像信息,打开雷达采集点云信息,然后工作人员选择图像上的特征位置并在点云信息上划出对应的位置。作为一种优选示例,图像上各个特征点的提取可以由SIFT图像特征点提取算法等得到。Multi-sensor calibration is performed before the point cloud map is constructed, that is, the camera image information and radar point cloud information are calibrated, that is, in an environment with clear feature points, the camera is turned on to collect image information, the radar is turned on to collect point cloud information, and then the staff selects Feature locations on the image and draw corresponding locations on the point cloud information. As a preferred example, the extraction of each feature point on the image can be obtained by SIFT image feature point extraction algorithm or the like.
A2:确定转换矩阵。A2: Determine the transformation matrix.
划出的点云位置和选择的图像位置之间的转换关系即为转换矩阵,转换矩阵表示三维点云与视觉图像像素间直接的映射关系,即图像上的位置通过转化矩阵都可以找到点云信息上的点云位置。The conversion relationship between the drawn point cloud position and the selected image position is the conversion matrix. The conversion matrix represents the direct mapping relationship between the three-dimensional point cloud and the visual image pixels. That is, the point cloud can be found at any position on the image through the conversion matrix. Point cloud locations on the information.
其中,表征动态目标的点云包括:表征行人或者非机动车辆或者机动车辆的点云。Among them, point clouds that represent dynamic targets include: point clouds that represent pedestrians, non-motor vehicles, or motor vehicles.
作为一种优选示例,动态目标删除模块603还用于:As a preferred example, the dynamic target deletion module 603 is also used to:
完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。After completing the collection of the entire mapping area, end the collection, and stitch the laser point cloud maps of all collection points to obtain an environmental point cloud map of the entire mapping area.
需要说明的是,本实施例提供的采集模块601,能实现实施例一中步骤S101和S102包含的全部功能,解决相同技术问题,达到相同技术效果,在此不再赘述;It should be noted that the collection module 601 provided in this embodiment can realize all the functions included in steps S101 and S102 in Embodiment 1, solve the same technical problems, and achieve the same technical effects, which will not be described again here;
需要说明的是,本实施例提供的局部匹配模块602,能实现实施例一中步骤S103包含的全部功能,解决相同技术问题,达到相同技术效果,在此不再赘述;It should be noted that the local matching module 602 provided in this embodiment can realize all the functions included in step S103 in Embodiment 1, solve the same technical problems, and achieve the same technical effects, which will not be described again here;
需要说明的是,本实施例提供的动态目标删除模块603,能实现实施例一中步骤S104包含的全部功能,解决相同技术问题,达到相同技术效果,在此不再赘述;It should be noted that the dynamic target deletion module 603 provided in this embodiment can realize all the functions included in step S104 in Embodiment 1, solve the same technical problems, and achieve the same technical effects, which will not be described again here;
需要说明的是,实施例二提供的装置与实施例一提供的方法属于同一个发明构思,解决相同的技术问题,达到相同的技术效果,实施例二提供的装置能实现实施例一的所有方法,相同之处不再赘述。It should be noted that the device provided in Embodiment 2 and the method provided in Embodiment 1 belong to the same inventive concept, solve the same technical problem, and achieve the same technical effect. The device provided in Embodiment 2 can implement all the methods in Embodiment 1. , the similarities will not be repeated.
实施例三Embodiment 3
基于同一个发明构思,本发明实施例还提供了一种点云地图的构建装置,如图7所示,该装置包括:Based on the same inventive concept, embodiments of the present invention also provide a device for constructing a point cloud map. As shown in Figure 7, the device includes:
包括存储器702、处理器701和用户接口703;Includes memory 702, processor 701 and user interface 703;
所述存储器702,用于存储计算机程序;The memory 702 is used to store computer programs;
所述用户接口703,用于与用户实现交互;The user interface 703 is used to interact with users;
所述处理器701,用于读取所述存储器702中的计算机程序,所述处理器701执行所述计算机程序时,实现:The processor 701 is used to read the computer program in the memory 702. When the processor 701 executes the computer program, it implements:
采集第一位置的第一信息;Collect the first information from the first position;
完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;After completing the collection of the first information, move to the second position and collect the second information at the second position;
将所述第二信息与第一信息进行局部匹配,获得局部点云地图;Locally match the second information with the first information to obtain a local point cloud map;
将所述局部点云地图中的动态目标点云删除,获得激光点云地图;Delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;
其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;
所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.
优选的,当点云地图构建开始时,所述第一位置为起始位置;Preferably, when the point cloud map construction starts, the first position is the starting position;
当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the last collected position.
作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:
点云地图构建开始之前开启采集设备,所述采集设备包括以下之一或者组合:Turn on the collection device before starting the construction of the point cloud map. The collection device includes one or a combination of the following:
激光雷达;lidar;
双目摄像头;binocular camera;
深度摄像头;depth camera;
惯性测量单元IMU;Inertial Measurement Unit IMU;
轮速里程计。Wheel speed odometer.
作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:
完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。After completing the collection of the entire mapping area, end the collection, and stitch the laser point cloud maps of all collection points to obtain an environmental point cloud map of the entire mapping area.
作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:
根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。According to the lidar data collected by the lidar, a first environmental point cloud image is established; according to the image data collected by the binocular camera and the depth camera, a first environment image is established. A second environment point cloud image is established based on the lidar data collected by the lidar; a second environment image is established based on the image data collected by the binocular camera and the depth camera.
进一步的,将所述激光雷达采集的激光雷达数据上传到上位机系统;将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统。Further, the lidar data collected by the lidar is uploaded to the host computer system; the image data collected by the binocular camera and the depth camera are uploaded to the host computer system.
作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:
根据所述第二环境图像和所述第一环境图像,识别出所述局部点云地图上的表征动态目标的点云;根据所述第二环境点云图和所述第一环境点云图,删除所述局部点云地图中的表征动态目标的点云。According to the second environment image and the first environment image, a point cloud representing a dynamic target on the local point cloud map is identified; according to the second environment point cloud map and the first environment point cloud map, delete Point clouds representing dynamic targets in the local point cloud map.
其中,表征动态目标的点云包括:表征行人或者非机动车辆或者机动车辆的点云。Among them, point clouds that represent dynamic targets include: point clouds that represent pedestrians, non-motor vehicles, or motor vehicles.
作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:
根据以下方法将所述第二信息与第一信息进行局部匹配:The second information is partially matched with the first information according to the following method:
将前后两个位置(即第一位置和第二位置)的激光雷达采集的点云进行配准处理,把不同位置的点云通过重叠部分的信息,变换到同一个位置。作为一种优选示例,利用ICP算法(Iterative Closest Point,最近邻迭代算法),将两组或点云统一到统一坐标系下,进行点云的配准,配准后得到的点云地图成为环境局部地图。The point clouds collected by the lidar at the two positions before and after (i.e. the first position and the second position) are registered, and the point clouds at different positions are transformed to the same position through the information of the overlapping parts. As a preferred example, the ICP algorithm (Iterative Closest Point, nearest neighbor iterative algorithm) is used to unify two groups or point clouds into a unified coordinate system, and perform point cloud registration. The point cloud map obtained after registration becomes the environment Local map.
作为一种优选示例,所述处理器701执行所述计算机程序时实现:将第一位置或者第二位置的图像和点云进行匹配;As a preferred example, when the processor 701 executes the computer program, it implements: matching the image at the first position or the second position with the point cloud;
将图像中识别出的动态目标对应的点云从点云地图中删除。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map.
其中,将第一位置或者第二位置的图像和点云进行匹配包括:Among them, matching the image at the first position or the second position with the point cloud includes:
根据转换矩阵将图像信息与点云信息进行匹配。也就是说,根据转换矩阵将第一环境图像与第一环境点云图匹配,或者根据转换矩阵将第二环境图像与第二环境点云图匹配。Match image information with point cloud information according to the transformation matrix. That is to say, the first environment image is matched with the first environment point cloud image according to the transformation matrix, or the second environment image is matched with the second environment point cloud image according to the transformation matrix.
所述处理器701执行所述计算机程序时实现:根据以下步骤确定转换矩阵:When the processor 701 executes the computer program, it implements: determining the transformation matrix according to the following steps:
A1:标定。A1: Calibration.
在点云地图构建前进行多传感器标定,即将摄像头图像信息和雷达点云信息进行标定,即在一处特征点明确的环境内打开摄像头采集图像信息,打开雷达采集点云信息,然后工作人员选择图像上的特征位置并在点云信息上划出对应的位置。作为一种优选示例,图像上各个特征点的提取可以由SIFT图像特征点提取算法等得到。Multi-sensor calibration is performed before the point cloud map is constructed, that is, the camera image information and radar point cloud information are calibrated, that is, in an environment with clear feature points, the camera is turned on to collect image information, the radar is turned on to collect point cloud information, and then the staff selects Feature locations on the image and draw corresponding locations on the point cloud information. As a preferred example, the extraction of each feature point on the image can be obtained by SIFT image feature point extraction algorithm or the like.
A2:确定转换矩阵。A2: Determine the transformation matrix.
划出的点云位置和选择的图像位置之间的转换关系即为转换矩阵,转换矩阵表示三维点云与视觉图像像素间直接的映射关系,即图像上的位置通过转化矩阵都可以找到点云信息上的点云位置。The conversion relationship between the drawn point cloud position and the selected image position is the conversion matrix. The conversion matrix represents the direct mapping relationship between the three-dimensional point cloud and the visual image pixels. That is, the point cloud can be found at any position on the image through the conversion matrix. Point cloud locations on the information.
其中,在图7中,总线架构可以包括任意数量的互联的总线和桥,具体由处理器701代表的一个或多个处理器和存储器702代表的存储器的各种电路链接在一起。总线架构还可以将诸如外围设备、稳压器和功率管理电路等之类的各种其他电路链接在一起,这些都是本领域所公知的,因此,本文不再对其进行进一步描述。总线接口提供接口。处理器701负责管理总线架构和通常的处理,存储器702可以存储处理器701在执行操作时所使用的数据。In FIG. 7 , the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 701 and various circuits of the memory represented by memory 702 are linked together. The bus architecture can also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are all well known in the art and therefore will not be described further herein. The bus interface provides the interface. The processor 701 is responsible for managing the bus architecture and general processing, and the memory 702 can store data used by the processor 701 when performing operations.
处理器701可以是CPU、ASIC、FPGA或CPLD,处理器701也可以采用多核架构。The processor 701 can be a CPU, ASIC, FPGA or CPLD, and the processor 701 can also adopt a multi-core architecture.
处理器701执行存储器702存储的计算机程序时,实现实施例一中的任一点云地图的构建方法。When the processor 701 executes the computer program stored in the memory 702, the method for constructing any point cloud map in Embodiment 1 is implemented.
需要说明的是,实施例三提供的装置与实施例一提供的方法属于同一个发明构思,解决相同的技术问题,达到相同的技术效果,实施例三提供的装置能实现实施例一的所有方法,相同之处不再赘述。It should be noted that the device provided in Embodiment 3 and the method provided in Embodiment 1 belong to the same inventive concept, solve the same technical problem, and achieve the same technical effect. The device provided in Embodiment 3 can implement all the methods in Embodiment 1. , the similarities will not be repeated.
本申请还提出一种处理器可读存储介质。其中,该处理器可读存储介质存储有计算机程序,所述处理器执行所述计算机程序时实现实施例一中的任一点云地图的构建方法。This application also proposes a processor-readable storage medium. Wherein, the processor-readable storage medium stores a computer program, and when the processor executes the computer program, the method for constructing any point cloud map in Embodiment 1 is implemented.
需要说明的是,本申请实施例中对单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods. In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, magnetic disk storage and optical storage, etc.) embodying computer-usable program code therein.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for realizing the functions specified in one process or multiple processes of the flowchart and/or one block or multiple blocks of the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.
显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. In this way, if these modifications and variations of the present application fall within the scope of the claims of the present application and equivalent technologies, the present application is also intended to include these modifications and variations.
Claims (12)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110887413.6A CN113639745B (en) | 2021-08-03 | 2021-08-03 | Point cloud map construction method, device and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110887413.6A CN113639745B (en) | 2021-08-03 | 2021-08-03 | Point cloud map construction method, device and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113639745A CN113639745A (en) | 2021-11-12 |
CN113639745B true CN113639745B (en) | 2023-10-20 |
Family
ID=78419450
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110887413.6A Active CN113639745B (en) | 2021-08-03 | 2021-08-03 | Point cloud map construction method, device and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113639745B (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114646936A (en) * | 2022-03-30 | 2022-06-21 | 北京洛必德科技有限公司 | A point cloud map construction method, device and electronic device |
CN115170630B (en) * | 2022-06-30 | 2023-11-21 | 小米汽车科技有限公司 | Map generation method, map generation device, electronic equipment, vehicle and storage medium |
CN116385622B (en) * | 2023-05-26 | 2023-09-12 | 腾讯科技(深圳)有限公司 | Cloud image processing method, cloud image processing device, computer and readable storage medium |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109282822A (en) * | 2018-08-31 | 2019-01-29 | 北京航空航天大学 | Storage medium, method and device for constructing navigation map |
CN111508072A (en) * | 2020-04-23 | 2020-08-07 | 东软睿驰汽车技术(上海)有限公司 | Map construction method and device, electronic equipment and storage medium |
CN111681163A (en) * | 2020-04-23 | 2020-09-18 | 北京三快在线科技有限公司 | Method and device for constructing point cloud map, electronic equipment and storage medium |
CN111915657A (en) * | 2020-07-08 | 2020-11-10 | 浙江大华技术股份有限公司 | Point cloud registration method and device, electronic equipment and storage medium |
CN111929699A (en) * | 2020-07-21 | 2020-11-13 | 北京建筑大学 | Laser radar inertial navigation odometer considering dynamic obstacles and mapping method and system |
CN112652062A (en) * | 2019-10-10 | 2021-04-13 | 北京京东乾石科技有限公司 | Point cloud map construction method, device, equipment and storage medium |
WO2021128297A1 (en) * | 2019-12-27 | 2021-07-01 | 深圳市大疆创新科技有限公司 | Method, system and device for constructing three-dimensional point cloud map |
CN113168717A (en) * | 2021-03-11 | 2021-07-23 | 华为技术有限公司 | A point cloud matching method and device, navigation method and device, positioning method, and lidar |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108732584B (en) * | 2017-04-17 | 2020-06-30 | 百度在线网络技术(北京)有限公司 | Method and device for updating map |
US20210180958A1 (en) * | 2019-12-16 | 2021-06-17 | Automotive Research & Testing Center | Graphic information positioning system for recognizing roadside features and method using the same |
-
2021
- 2021-08-03 CN CN202110887413.6A patent/CN113639745B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109282822A (en) * | 2018-08-31 | 2019-01-29 | 北京航空航天大学 | Storage medium, method and device for constructing navigation map |
CN112652062A (en) * | 2019-10-10 | 2021-04-13 | 北京京东乾石科技有限公司 | Point cloud map construction method, device, equipment and storage medium |
WO2021128297A1 (en) * | 2019-12-27 | 2021-07-01 | 深圳市大疆创新科技有限公司 | Method, system and device for constructing three-dimensional point cloud map |
CN111508072A (en) * | 2020-04-23 | 2020-08-07 | 东软睿驰汽车技术(上海)有限公司 | Map construction method and device, electronic equipment and storage medium |
CN111681163A (en) * | 2020-04-23 | 2020-09-18 | 北京三快在线科技有限公司 | Method and device for constructing point cloud map, electronic equipment and storage medium |
CN111915657A (en) * | 2020-07-08 | 2020-11-10 | 浙江大华技术股份有限公司 | Point cloud registration method and device, electronic equipment and storage medium |
CN111929699A (en) * | 2020-07-21 | 2020-11-13 | 北京建筑大学 | Laser radar inertial navigation odometer considering dynamic obstacles and mapping method and system |
CN113168717A (en) * | 2021-03-11 | 2021-07-23 | 华为技术有限公司 | A point cloud matching method and device, navigation method and device, positioning method, and lidar |
Non-Patent Citations (1)
Title |
---|
基于激光雷达的移动机器人三维建图与定位;殷江;林建德;孔令华;邹诚;游通飞;易定容;;福建工程学院学报(第04期);67-71 * |
Also Published As
Publication number | Publication date |
---|---|
CN113639745A (en) | 2021-11-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113639745B (en) | Point cloud map construction method, device and storage medium | |
JP6862409B2 (en) | Map generation and moving subject positioning methods and devices | |
CN110160502B (en) | Map element extraction method, device and server | |
JP6898534B2 (en) | Systems and methods to reduce data storage in machine learning | |
CN108763287B (en) | Construction method of large-scale passable regional driving map and unmanned application method thereof | |
CN112069856A (en) | Map generation method, driving control method, device, electronic device and system | |
KR102564430B1 (en) | Method and device for controlling vehicle, and vehicle | |
CN111681163B (en) | Method and device for constructing point cloud map, electronic equipment and storage medium | |
CN108413975A (en) | Ground picture capturing method, system, cloud processor and vehicle | |
CN110146910A (en) | A positioning method and device based on GPS and lidar data fusion | |
JP2015148601A (en) | System and method for mapping, localization and pose correction | |
KR102218881B1 (en) | Method and system for determining position of vehicle | |
CN112465970B (en) | Navigation map construction method, device, system, electronic device and storage medium | |
CN111982133B (en) | Method and device for positioning vehicle based on high-precision map and electronic equipment | |
CN107958451A (en) | Vision high accuracy map production method and device | |
CN114187357A (en) | High-precision map production method and device, electronic equipment and storage medium | |
CN117974916A (en) | High-precision map generation method and device based on information fusion | |
CN110827340B (en) | Map updating method, device and storage medium | |
US11619498B2 (en) | Verification method and device for modeling route, unmanned vehicle, and storage medium | |
EP4124828B1 (en) | Map processing method and apparatus | |
CN116309943A (en) | Parking lot semantic map road network construction method and device and electronic equipment | |
CN116142172A (en) | Parking method and device based on voxel coordinate system | |
CN114812537A (en) | Lane line map construction and update method, system, medium, and apparatus | |
CN115393816A (en) | Lane line generation method, lane line generation device, computer device, and storage medium | |
CN111060114A (en) | Method and device for generating feature map of high-precision map |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |