CN113639745B - Point cloud map construction method, device and storage medium - Google Patents

Point cloud map construction method, device and storage medium Download PDF

Info

Publication number
CN113639745B
CN113639745B CN202110887413.6A CN202110887413A CN113639745B CN 113639745 B CN113639745 B CN 113639745B CN 202110887413 A CN202110887413 A CN 202110887413A CN 113639745 B CN113639745 B CN 113639745B
Authority
CN
China
Prior art keywords
point cloud
information
cloud map
image
environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110887413.6A
Other languages
Chinese (zh)
Other versions
CN113639745A (en
Inventor
吴新开
刘云浩
霍向
宋涛
何山
马亚龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Lobby Technology Co ltd
Beihang University
Original Assignee
Beijing Lobby Technology Co ltd
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Lobby Technology Co ltd, Beihang University filed Critical Beijing Lobby Technology Co ltd
Priority to CN202110887413.6A priority Critical patent/CN113639745B/en
Publication of CN113639745A publication Critical patent/CN113639745A/en
Application granted granted Critical
Publication of CN113639745B publication Critical patent/CN113639745B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/165Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
    • G01C21/1652Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with ranging devices, e.g. LIDAR or RADAR
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

The application discloses a method and a device for constructing a point cloud map and a storage medium, which are used for improving the accuracy of constructing the point cloud map. The method for constructing the point cloud map comprises the following steps: collecting first information of a first position; after the first information is acquired, moving to a second position, and acquiring second information of the second position; locally matching the second information with the first information to obtain a local point cloud map; deleting the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map; the first information comprises a first environment point cloud image and a first environment image; the second information includes a second ambient point cloud image and a second ambient image. The application also provides a device for constructing the point cloud map and a storage medium.

Description

一种点云地图的构建方法、装置及存储介质A method, device and storage medium for constructing a point cloud map

技术领域Technical field

本申请涉及无人车领域,尤其涉及一种点云地图的构建方法、装置和存储介质。The present application relates to the field of unmanned vehicles, and in particular, to a method, device and storage medium for constructing a point cloud map.

背景技术Background technique

目前,建图技术作为无人车领域的重要技术受到越来越多的重视。现有的建图技术中,没有考虑去除点云地图中的动态目标,从而使得建图的结果不够精确。Currently, mapping technology is receiving more and more attention as an important technology in the field of unmanned vehicles. In existing mapping technology, removal of dynamic targets in point cloud maps is not considered, resulting in inaccurate mapping results.

发明内容Contents of the invention

针对上述技术问题,本申请实施例提供了一种点云地图的构建方法、装置及存储介质,用以感知环境中的动态目标,将点云地图中动态目标的点云删除,从而得到更加精确的环境点云图。In response to the above technical problems, embodiments of the present application provide a method, device and storage medium for constructing a point cloud map, which are used to perceive dynamic targets in the environment and delete the point clouds of dynamic targets in the point cloud map, thereby obtaining a more accurate Environmental point cloud image.

第一方面,本申请实施例提供的一种点云地图的构建方法,包括:In the first aspect, an embodiment of the present application provides a method for constructing a point cloud map, including:

采集第一位置的第一信息;Collect the first information from the first position;

完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;After completing the collection of the first information, move to the second position and collect the second information at the second position;

将所述第二信息与第一信息进行局部匹配,获得局部点云地图;Locally match the second information with the first information to obtain a local point cloud map;

将所述局部点云地图中的动态目标点云删除,获得激光点云地图;Delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;

其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;

所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.

进一步的,当点云地图构建开始时,所述第一位置为起始位置;Further, when the point cloud map construction starts, the first position is the starting position;

当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the last collected position.

优选的,开启采集设备,所述采集设备包括以下之一或者组合:Preferably, the collection device is turned on, and the collection device includes one or a combination of the following:

激光雷达;lidar;

双目摄像头;binocular camera;

深度摄像头;depth camera;

惯性测量单元IMU;Inertial Measurement Unit IMU;

轮速里程计。Wheel speed odometer.

优选的,完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。Preferably, after completing the collection of the entire mapping area, the collection is ended, and the laser point cloud maps of all collection points are spliced to obtain an environmental point cloud map of the entire mapping area.

优选的,所述采集第一位置的第一信息包括:Preferably, collecting the first information of the first location includes:

根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;Establish a first environmental point cloud map based on the lidar data collected by the lidar;

根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。A first environment image is established based on the image data collected by the binocular camera and the depth camera.

所述采集第二位置的第二信息包括:The collecting the second information of the second location includes:

根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;Establish a second environmental point cloud map based on the lidar data collected by the lidar;

根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。A second environment image is established based on the image data collected by the binocular camera and the depth camera.

进一步的,还包括:Furthermore, it also includes:

将所述激光雷达采集的激光雷达数据上传到上位机系统;Upload the lidar data collected by the lidar to the host computer system;

将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统。Upload the image data collected by the binocular camera and the depth camera to the host computer system.

优选的,所述将所述局部点云地图中的动态目标点云删除包括:Preferably, deleting the dynamic target point cloud in the local point cloud map includes:

将第一位置或者第二位置的图像和点云进行匹配;Match the image at the first position or the second position with the point cloud;

将图像中识别出的动态目标对应的点云从点云地图中删除。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map.

优选的,所述表征动态目标的点云包括:Preferably, the point cloud characterizing the dynamic target includes:

表征行人或者非机动车辆或者机动车辆的点云。Point clouds representing pedestrians or non-motor vehicles or motor vehicles.

优选的,所述将第一位置或者第二位置的图像和点云进行匹配包括:Preferably, matching the image at the first position or the second position with the point cloud includes:

根据转换矩阵将图像信息与点云信息进行匹配。Match image information with point cloud information according to the transformation matrix.

使用本发明提供的点云地图的构建方法,根据前后两个采集点的环境图像信息和环境点云图信息进行局部匹配,然后识别出动态目标,再从局部点云地图中将动态目标的点云删除,从而提高了建图的精确性。带有动态目标的地图对后续利用地图进行定位与导航时带有严重的干扰,而使用本发明方法建立的地图不含动态目标,精确性更高。Using the point cloud map construction method provided by the present invention, local matching is performed based on the environmental image information and environmental point cloud map information of the two previous and subsequent collection points, and then the dynamic target is identified, and then the point cloud of the dynamic target is extracted from the local point cloud map. Delete, thus improving the accuracy of mapping. Maps with dynamic targets will cause serious interference to subsequent use of maps for positioning and navigation, while maps established using the method of the present invention do not contain dynamic targets and are more accurate.

第二方面,本申请实施例还提供一种点云地图的构建装置,包括:In a second aspect, embodiments of the present application also provide a device for constructing a point cloud map, including:

采集模块,被配置用于采集第一位置的第一信息,完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;The collection module is configured to collect the first information at the first position, and after completing the collection of the first information, moves to the second position to collect the second information at the second position;

局部匹配模块,被配置用于将所述第二信息与第一信息进行局部匹配,获得局部点云地图;a local matching module configured to locally match the second information with the first information to obtain a local point cloud map;

动态目标删除模块,被配置用于将所述局部点云地图中的动态目标点云删除,获得激光点云地图;A dynamic target deletion module configured to delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;

其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;

所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.

第三方面,本申请实施例还提供一种点云地图的构建装置,包括:存储器、处理器和用户接口;In a third aspect, embodiments of the present application also provide a device for constructing a point cloud map, including: a memory, a processor, and a user interface;

所述存储器,用于存储计算机程序;The memory is used to store computer programs;

所述用户接口,用于与用户实现交互;The user interface is used to interact with users;

所述处理器,用于读取所述存储器中的计算机程序,所述处理器执行所述计算机程序时,实现本发明提供的点云地图的构建方法。The processor is configured to read the computer program in the memory. When the processor executes the computer program, it implements the point cloud map construction method provided by the present invention.

第四方面,本申请实施例还提供一种处理器可读存储介质,所述处理器可读存储介质存储有计算机程序,所述处理器执行所述计算机程序时实现本发明提供的点云地图的构建方法。In a fourth aspect, embodiments of the present application also provide a processor-readable storage medium, the processor-readable storage medium stores a computer program, and when the processor executes the computer program, the point cloud map provided by the present invention is implemented. construction method.

附图说明Description of the drawings

为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简要介绍,显而易见地,下面描述中的附图仅是本申请的一些实施例,对于本领域的普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, a brief introduction will be given below to the drawings required to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. Those of ordinary skill in the art can also obtain other drawings based on these drawings without exerting creative efforts.

图1为本实施例提供的点云地图构建示意图;Figure 1 is a schematic diagram of the point cloud map construction provided in this embodiment;

图2为本申请实施例提供的环境图像和环境点云图采集示意图;Figure 2 is a schematic diagram of environmental image and environmental point cloud image collection provided by the embodiment of the present application;

图3为本申请实施例提供的第一位置和第二位置信息采集示意图;Figure 3 is a schematic diagram of first location and second location information collection provided by the embodiment of the present application;

图4为本申请实施例提供的动态目标识别示意图;Figure 4 is a schematic diagram of dynamic target recognition provided by an embodiment of the present application;

图5为本申请实施例提供的动态目标点云删除后的示意图;Figure 5 is a schematic diagram after deletion of the dynamic target point cloud provided by the embodiment of the present application;

图6为本申请实施例提供的一种点云地图的构建装置结构示意图;Figure 6 is a schematic structural diagram of a point cloud map construction device provided by an embodiment of the present application;

图7为本申请实施例提供的另一种点云地图的构建装置结构示意图。Figure 7 is a schematic structural diagram of another point cloud map construction device provided by an embodiment of the present application.

具体实施方式Detailed ways

为了使本发明的目的、技术方案和优点更加清楚,下面将结合附图对本发明作进一步地详细描述,显然,所描述的实施例仅仅是本发明一部份实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. . Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

下面对文中出现的一些词语进行解释:Here are some explanations of some words that appear in the text:

1、本发明实施例中术语“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。1. In the embodiment of the present invention, the term "and/or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, alone There are three situations B. The character "/" generally indicates that the related objects are in an "or" relationship.

2、本申请实施例中术语“多个”是指两个或两个以上,其它量词与之类似。2. In the embodiments of this application, the term "multiple" refers to two or more, and other quantifiers are similar to it.

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,并不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

需要说明的是,本申请实施例的展示顺序仅代表实施例的先后顺序,并不代表实施例所提供的技术方案的优劣。It should be noted that the display order of the embodiments of this application only represents the order of the embodiments, and does not represent the quality of the technical solutions provided by the embodiments.

实施例一Embodiment 1

参见图1,本申请实施例提供的一种点云地图的构建方法示意图,如图1所示,该方法包括步骤S101到S104:Referring to Figure 1, a schematic diagram of a point cloud map construction method provided by an embodiment of the present application is shown. As shown in Figure 1, the method includes steps S101 to S104:

S101、采集第一位置的第一信息;S101. Collect the first information of the first position;

S102、完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;S102. After completing the collection of the first information, move to the second position and collect the second information at the second position;

S103、将所述第二信息与第一信息进行局部匹配,获得局部点云地图;S103. Locally match the second information with the first information to obtain a local point cloud map;

S104、将所述局部点云地图中的动态目标点云删除,获得激光点云地图;S104. Delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;

其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;

所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.

具体的,所述第一环境点云图和第二环境点云图是通过激光雷达采集的激光雷达数据建立的,所述第一环境图像和第二环境图像是通过双目摄像头和深度摄像头采集的图像数据建立的。Specifically, the first environment point cloud image and the second environment point cloud image are established through lidar data collected by lidar, and the first environment image and the second environment image are images collected through binocular cameras and depth cameras. Data is created.

需要说明的是,本方法应用于构建点云地图的无人车,无人车上携带激光雷达、双目摄像头、深度摄像头、惯性测量单元(IMU)和轮速里程计中的至少一个。激光雷达用于采集激光雷达数据,双目摄像头和深度摄像头用于采集图像数据,IMU用于采集惯性测量数据,轮速里程计用于采集里程数据,如图2所示。It should be noted that this method is applied to unmanned vehicles that construct point cloud maps. The unmanned vehicle carries at least one of a lidar, a binocular camera, a depth camera, an inertial measurement unit (IMU), and a wheel speed odometer. Lidar is used to collect lidar data, binocular cameras and depth cameras are used to collect image data, IMU is used to collect inertial measurement data, and wheel speed odometer is used to collect mileage data, as shown in Figure 2.

当点云地图开始构建时,无人车处于起始位置,该起始位置为第一位置。当第一位置的第一信息采集完成后,移动到第二位置,采集第二位置的第二信息。即当点云地图构建开始时,所述第一位置为起始位置;当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the point cloud map begins to be constructed, the unmanned vehicle is at the starting position, which is the first position. After the collection of the first information at the first position is completed, it moves to the second position and collects the second information at the second position. That is, when the point cloud map construction starts, the first position is the starting position; when the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the starting position. The location is the last collected location.

作为一种优选示例,在开始构建之前,开启无人车上携带的激光雷达、双目摄像头、深度摄像头、惯性测量单元(IMU)和轮速里程计。As a preferred example, before starting the construction, turn on the lidar, binocular camera, depth camera, inertial measurement unit (IMU) and wheel speed odometer carried on the unmanned vehicle.

需要说明的是,本实施例中的第二位置是第一位置采集完后的下一个采集位置,第二位置在整个建图区域内移动,完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。It should be noted that the second position in this embodiment is the next collection position after the first position is collected. The second position moves within the entire mapping area. After completing the collection of the entire mapping area, the collection ends and all The laser point cloud maps of the collection points are stitched together to obtain an environmental point cloud map of the entire mapping area.

作为一种优选示例,第二位置在整个建图区域内移动,可以通过人工方式移动,也可以无人车根据预设的规则自动移动,本实施例不做限定。As a preferred example, the second position moves within the entire mapping area, and can be moved manually, or the unmanned vehicle can move automatically according to preset rules, which is not limited in this embodiment.

作为一种优选示例,本实施例S101中,所述采集第一位置的第一信息包括:As a preferred example, in this embodiment S101, collecting the first information of the first location includes:

根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;Establish a first environmental point cloud map based on the lidar data collected by the lidar;

根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。A first environment image is established based on the image data collected by the binocular camera and the depth camera.

作为一种优选示例,本实施例S102中,所述采集第二位置的第二信息包括:As a preferred example, in S102 of this embodiment, collecting the second information of the second location includes:

根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;Establish a second environmental point cloud map based on the lidar data collected by the lidar;

根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。A second environment image is established based on the image data collected by the binocular camera and the depth camera.

作为一种优选示例,无人车采集完第一信息或者第二信息后,将所述激光雷达采集的激光雷达数据上传到上位机系统;将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统,还可以将其他设备采集的数据也上传到上位机系统。As a preferred example, after the unmanned vehicle collects the first information or the second information, the lidar data collected by the lidar is uploaded to the host computer system; the images collected by the binocular camera and the depth camera are The data is uploaded to the host computer system, and data collected by other devices can also be uploaded to the host computer system.

作为一种优选示例,本实施例S103中、将所述第二信息与第一信息进行局部匹配,获得局部点云地图包括:As a preferred example, in S103 of this embodiment, locally matching the second information with the first information to obtain a local point cloud map includes:

上述局部匹配过程是前后两个位置激光雷达采集的点云进行配准处理,把不同位置的点云通过重叠部分的信息,变换到同一个位置。作为一种优选示例,利用ICP算法(Iterative Closest Point,最近邻迭代算法),将两组点云统一到统一坐标系下,进行点云的配准,配准后得到的点云地图成为环境局部地图。The above-mentioned local matching process is to register the point clouds collected by the lidar at the two positions, and transform the point clouds at different positions to the same position through the information of the overlapping parts. As a preferred example, the ICP algorithm (Iterative Closest Point, nearest neighbor iterative algorithm) is used to unify the two sets of point clouds into a unified coordinate system and perform point cloud registration. The point cloud map obtained after registration becomes the local environment map.

作为一种优选示例,本实施例S104中,将所述局部点云地图中的动态目标点云删除,获得激光点云地图包括:As a preferred example, in S104 of this embodiment, deleting the dynamic target point cloud in the local point cloud map and obtaining the laser point cloud map includes:

将第一位置或者第二位置的图像和点云进行匹配;Match the image at the first position or the second position with the point cloud;

将图像中识别出的动态目标对应的点云从点云地图中删除。如图4所示,识别出两个动态目标,如图5所示,删除图4中识别出的动态目标后的点云地图。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map. As shown in Figure 4, two dynamic targets are identified, as shown in Figure 5, the point cloud map after deleting the dynamic targets identified in Figure 4.

作为一种优选示例,将第一位置或者第二位置的图像和点云进行匹配包括:As a preferred example, matching the image at the first position or the second position with the point cloud includes:

根据转换矩阵将图像信息与点云信息进行匹配。也就是说,根据转换矩阵将第一环境图像与第一环境点云图匹配,或者根据转换矩阵将第二环境图像与第二环境点云图匹配。Match image information with point cloud information according to the transformation matrix. That is to say, the first environment image is matched with the first environment point cloud image according to the transformation matrix, or the second environment image is matched with the second environment point cloud image according to the transformation matrix.

优选的,转换矩阵由以下步骤确定:Preferably, the transformation matrix is determined by the following steps:

A1:标定。A1: Calibration.

在点云地图构建前进行多传感器标定,即将摄像头图像信息和雷达点云信息进行标定,即在一处特征点明确的环境内打开摄像头采集图像信息,打开雷达采集点云信息,然后工作人员选择图像上的特征位置并在点云信息上划出对应的位置。作为一种优选示例,图像上各个特征点的提取可以由SIFT图像特征点提取算法等得到。Multi-sensor calibration is performed before the point cloud map is constructed, that is, the camera image information and radar point cloud information are calibrated, that is, in an environment with clear feature points, the camera is turned on to collect image information, the radar is turned on to collect point cloud information, and then the staff selects Feature locations on the image and draw corresponding locations on the point cloud information. As a preferred example, the extraction of each feature point on the image can be obtained by SIFT image feature point extraction algorithm or the like.

A2:确定转换矩阵。A2: Determine the transformation matrix.

划出的点云位置和选择的图像位置之间的转换关系即为转换矩阵,转换矩阵表示三维点云与视觉图像像素间直接的映射关系,即图像上的位置通过转化矩阵都可以找到点云信息上的点云位置。The conversion relationship between the drawn point cloud position and the selected image position is the conversion matrix. The conversion matrix represents the direct mapping relationship between the three-dimensional point cloud and the visual image pixels. That is, the point cloud can be found at any position on the image through the conversion matrix. Point cloud locations on the information.

优选的,表征动态目标的点云包括:Preferably, the point cloud characterizing the dynamic target includes:

表征行人或者非机动车辆或者机动车辆的点云。即动态目标包括以下之一或者组合:行人,机动车,非机动车。还可以包括其他在建图区域内移动的物体,例如地面爬行动物,空中的飞行物,以及其他移动的物体。如图3所示中,动态目标为车辆。Point clouds representing pedestrians or non-motor vehicles or motor vehicles. That is, dynamic targets include one or a combination of the following: pedestrians, motor vehicles, and non-motor vehicles. You can also include other objects that move within the mapping area, such as crawlers on the ground, flying objects in the sky, and other moving objects. As shown in Figure 3, the dynamic target is a vehicle.

下面给出本实施例的一个具体示例:A specific example of this embodiment is given below:

S1、无人车在起始位置,开启无人车上携带的激光雷达、双目摄像头、深度摄像头、惯性测量单元(IMU)和轮速里程计,开始采集激光雷达数据、图像数据、惯性测量单元(IMU)数据以及轮速里程计数据;S1. The unmanned vehicle is at the starting position, turns on the lidar, binocular camera, depth camera, inertial measurement unit (IMU) and wheel speed odometer carried on the unmanned vehicle, and starts collecting lidar data, image data, and inertial measurement Unit (IMU) data and wheel speed odometer data;

S2、无人车将激光雷达采集的激光雷达数据上传至上位机系统,建立环境点云图,无人车将双目摄像头和深度摄像头采集的图像数据上传至上位机系统,建立环境图像;S2. The unmanned vehicle uploads the lidar data collected by the lidar to the host computer system to establish an environmental point cloud image. The unmanned vehicle uploads the image data collected by the binocular camera and depth camera to the host computer system to establish an environmental image;

S3、无人车在初始位置的环境点云图和环境图像建立完成后,由工作人员通过无人车携带的摄像头观察周围环境远程控制无人车移动到达下一个位置;S3. After the environmental point cloud map and environmental image of the unmanned vehicle at the initial position are established, the staff will observe the surrounding environment through the camera carried by the unmanned vehicle and remotely control the unmanned vehicle to move to the next position;

S4、无人车上携带的激光雷达、双目摄像头、深度摄像头、惯性测量单元(IMU)和轮速里程计继续采集激光雷达数据、图像数据、惯性测量单元(IMU)数据以及轮速里程计数据,并上传至上位机;S4. The lidar, binocular camera, depth camera, inertial measurement unit (IMU) and wheel speed odometer carried on the unmanned vehicle continue to collect lidar data, image data, inertial measurement unit (IMU) data and wheel speed odometer. data and upload it to the host computer;

S5、上位机根据新采集的激光雷达数据建立新位置的环境点云图,根据新采集的图像数据建立新位置的环境图像;S5. The host computer creates an environmental point cloud image of the new location based on the newly collected lidar data, and creates an environmental image of the new location based on the newly collected image data;

S6、由新位置的环境点云图和环境图像和上一位置的环境点云图和环境图像进行局部匹配,形成局部点云地图;S6. Locally match the environment point cloud map and environment image at the new location with the environment point cloud map and environment image at the previous location to form a local point cloud map;

S7、利用图像信息在局部匹配完的局部点云地图上的行人、非机动车辆、机动车辆等动态目标所表征的点云删除掉,利用新位置与上一位置的点云信息对其中动态的点云进行删除;S7. Use the image information to delete the point clouds represented by dynamic targets such as pedestrians, non-motorized vehicles, and motor vehicles on the locally matched local point cloud map, and use the point cloud information of the new position and the previous position to compare the dynamic objects. Point cloud is deleted;

S8、保存删除完动态的点云后的激光点云地图;S8. Save the laser point cloud map after deleting the dynamic point cloud;

通过本实施例的方法,根据前后两个采集点的环境图像信息和环境点云图信息进行局部匹配,然后识别出动态目标,再从局部点云地图中将动态目标的点云删除,从而提高了建图的精确性。带有动态目标的地图对后续利用地图进行定位与导航时带有严重的干扰,而使用本发明方法建立的地图不含动态目标,精确性更高。Through the method of this embodiment, local matching is performed based on the environmental image information and environmental point cloud map information of the two previous collection points, and then the dynamic target is identified, and then the point cloud of the dynamic target is deleted from the local point cloud map, thereby improving Accuracy of mapping. Maps with dynamic targets will cause serious interference to subsequent use of maps for positioning and navigation, while maps established using the method of the present invention do not contain dynamic targets and are more accurate.

实施例二Embodiment 2

基于同一个发明构思,本发明实施例还提供了一种点云地图的构建装置,如图6所示,该装置包括:Based on the same inventive concept, embodiments of the present invention also provide a device for constructing a point cloud map. As shown in Figure 6, the device includes:

采集模块601,被配置用于采集第一位置的第一信息,完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;The collection module 601 is configured to collect the first information at the first position. After completing the first information collection, move to the second position and collect the second information at the second position;

局部匹配模块602,被配置用于将所述第二信息与第一信息进行局部匹配,获得局部点云地图;The local matching module 602 is configured to locally match the second information with the first information to obtain a local point cloud map;

动态目标删除模块603,被配置用于将所述局部点云地图中的动态目标点云删除,获得激光点云地图;The dynamic target deletion module 603 is configured to delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;

其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;

所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.

本实施例中,当点云地图构建开始时,所述第一位置为起始位置;In this embodiment, when the point cloud map construction starts, the first position is the starting position;

当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the last collected position.

作为一种优选示例,采集模块601还用于在点云地图构建开始之前开启采集设备,所述采集设备包括以下之一或者组合:As a preferred example, the collection module 601 is also used to turn on the collection device before starting the point cloud map construction. The collection device includes one or a combination of the following:

激光雷达;lidar;

双目摄像头;binocular camera;

深度摄像头;depth camera;

惯性测量单元IMU;Inertial Measurement Unit IMU;

轮速里程计。Wheel speed odometer.

作为一种优选示例,采集模块601还用于根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。As a preferred example, the acquisition module 601 is also configured to establish a first environment point cloud map based on the lidar data collected by the lidar; and establish the first environment based on the image data collected by the binocular camera and the depth camera. image. A second environment point cloud image is established based on the lidar data collected by the lidar; a second environment image is established based on the image data collected by the binocular camera and the depth camera.

作为一种优选示例,采集模块601还用于将所述激光雷达采集的激光雷达数据上传到上位机系统;将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统。As a preferred example, the acquisition module 601 is also used to upload the lidar data collected by the lidar to the host computer system; and upload the image data collected by the binocular camera and the depth camera to the host computer system.

作为一种优选示例,局部匹配模块602还用于,根据以下方法将所述第二信息与第一信息进行局部匹配:As a preferred example, the local matching module 602 is also configured to locally match the second information with the first information according to the following method:

将前后两个位置(即第一位置和第二位置)的激光雷达采集的点云进行配准处理,把不同位置的点云通过重叠部分的信息,变换到同一个位置。作为一种优选示例,利用ICP算法(Iterative Closest Point,最近邻迭代算法),将两组或点云统一到统一坐标系下,进行点云的配准,配准后得到的点云地图成为环境局部地图。The point clouds collected by the lidar at the two positions before and after (i.e. the first position and the second position) are registered, and the point clouds at different positions are transformed to the same position through the information of the overlapping parts. As a preferred example, the ICP algorithm (Iterative Closest Point, nearest neighbor iterative algorithm) is used to unify two groups or point clouds into a unified coordinate system, and perform point cloud registration. The point cloud map obtained after registration becomes the environment Local map.

作为一种优选示例,动态目标删除模块603还用于:As a preferred example, the dynamic target deletion module 603 is also used to:

将第一位置或者第二位置的图像和点云进行匹配;Match the image at the first position or the second position with the point cloud;

将图像中识别出的动态目标对应的点云从点云地图中删除。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map.

其中,将第一位置或者第二位置的图像和点云进行匹配包括:Among them, matching the image at the first position or the second position with the point cloud includes:

根据转换矩阵将图像信息与点云信息进行匹配。也就是说,根据转换矩阵将第一环境图像与第一环境点云图匹配,或者根据转换矩阵将第二环境图像与第二环境点云图匹配。Match image information with point cloud information according to the transformation matrix. That is to say, the first environment image is matched with the first environment point cloud image according to the transformation matrix, or the second environment image is matched with the second environment point cloud image according to the transformation matrix.

优选的,动态目标删除模块603还用于根据以下步骤确定转换矩阵:Preferably, the dynamic target deletion module 603 is also used to determine the transformation matrix according to the following steps:

A1:标定。A1: Calibration.

在点云地图构建前进行多传感器标定,即将摄像头图像信息和雷达点云信息进行标定,即在一处特征点明确的环境内打开摄像头采集图像信息,打开雷达采集点云信息,然后工作人员选择图像上的特征位置并在点云信息上划出对应的位置。作为一种优选示例,图像上各个特征点的提取可以由SIFT图像特征点提取算法等得到。Multi-sensor calibration is performed before the point cloud map is constructed, that is, the camera image information and radar point cloud information are calibrated, that is, in an environment with clear feature points, the camera is turned on to collect image information, the radar is turned on to collect point cloud information, and then the staff selects Feature locations on the image and draw corresponding locations on the point cloud information. As a preferred example, the extraction of each feature point on the image can be obtained by SIFT image feature point extraction algorithm or the like.

A2:确定转换矩阵。A2: Determine the transformation matrix.

划出的点云位置和选择的图像位置之间的转换关系即为转换矩阵,转换矩阵表示三维点云与视觉图像像素间直接的映射关系,即图像上的位置通过转化矩阵都可以找到点云信息上的点云位置。The conversion relationship between the drawn point cloud position and the selected image position is the conversion matrix. The conversion matrix represents the direct mapping relationship between the three-dimensional point cloud and the visual image pixels. That is, the point cloud can be found at any position on the image through the conversion matrix. Point cloud locations on the information.

其中,表征动态目标的点云包括:表征行人或者非机动车辆或者机动车辆的点云。Among them, point clouds that represent dynamic targets include: point clouds that represent pedestrians, non-motor vehicles, or motor vehicles.

作为一种优选示例,动态目标删除模块603还用于:As a preferred example, the dynamic target deletion module 603 is also used to:

完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。After completing the collection of the entire mapping area, end the collection, and stitch the laser point cloud maps of all collection points to obtain an environmental point cloud map of the entire mapping area.

需要说明的是,本实施例提供的采集模块601,能实现实施例一中步骤S101和S102包含的全部功能,解决相同技术问题,达到相同技术效果,在此不再赘述;It should be noted that the collection module 601 provided in this embodiment can realize all the functions included in steps S101 and S102 in Embodiment 1, solve the same technical problems, and achieve the same technical effects, which will not be described again here;

需要说明的是,本实施例提供的局部匹配模块602,能实现实施例一中步骤S103包含的全部功能,解决相同技术问题,达到相同技术效果,在此不再赘述;It should be noted that the local matching module 602 provided in this embodiment can realize all the functions included in step S103 in Embodiment 1, solve the same technical problems, and achieve the same technical effects, which will not be described again here;

需要说明的是,本实施例提供的动态目标删除模块603,能实现实施例一中步骤S104包含的全部功能,解决相同技术问题,达到相同技术效果,在此不再赘述;It should be noted that the dynamic target deletion module 603 provided in this embodiment can realize all the functions included in step S104 in Embodiment 1, solve the same technical problems, and achieve the same technical effects, which will not be described again here;

需要说明的是,实施例二提供的装置与实施例一提供的方法属于同一个发明构思,解决相同的技术问题,达到相同的技术效果,实施例二提供的装置能实现实施例一的所有方法,相同之处不再赘述。It should be noted that the device provided in Embodiment 2 and the method provided in Embodiment 1 belong to the same inventive concept, solve the same technical problem, and achieve the same technical effect. The device provided in Embodiment 2 can implement all the methods in Embodiment 1. , the similarities will not be repeated.

实施例三Embodiment 3

基于同一个发明构思,本发明实施例还提供了一种点云地图的构建装置,如图7所示,该装置包括:Based on the same inventive concept, embodiments of the present invention also provide a device for constructing a point cloud map. As shown in Figure 7, the device includes:

包括存储器702、处理器701和用户接口703;Includes memory 702, processor 701 and user interface 703;

所述存储器702,用于存储计算机程序;The memory 702 is used to store computer programs;

所述用户接口703,用于与用户实现交互;The user interface 703 is used to interact with users;

所述处理器701,用于读取所述存储器702中的计算机程序,所述处理器701执行所述计算机程序时,实现:The processor 701 is used to read the computer program in the memory 702. When the processor 701 executes the computer program, it implements:

采集第一位置的第一信息;Collect the first information from the first position;

完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;After completing the collection of the first information, move to the second position and collect the second information at the second position;

将所述第二信息与第一信息进行局部匹配,获得局部点云地图;Locally match the second information with the first information to obtain a local point cloud map;

将所述局部点云地图中的动态目标点云删除,获得激光点云地图;Delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map;

其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image;

所述第二信息包括第二环境点云图和第二环境图像。The second information includes a second environment point cloud map and a second environment image.

优选的,当点云地图构建开始时,所述第一位置为起始位置;Preferably, when the point cloud map construction starts, the first position is the starting position;

当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the last collected position.

作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:

点云地图构建开始之前开启采集设备,所述采集设备包括以下之一或者组合:Turn on the collection device before starting the construction of the point cloud map. The collection device includes one or a combination of the following:

激光雷达;lidar;

双目摄像头;binocular camera;

深度摄像头;depth camera;

惯性测量单元IMU;Inertial Measurement Unit IMU;

轮速里程计。Wheel speed odometer.

作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:

完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。After completing the collection of the entire mapping area, end the collection, and stitch the laser point cloud maps of all collection points to obtain an environmental point cloud map of the entire mapping area.

作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:

根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。According to the lidar data collected by the lidar, a first environmental point cloud image is established; according to the image data collected by the binocular camera and the depth camera, a first environment image is established. A second environment point cloud image is established based on the lidar data collected by the lidar; a second environment image is established based on the image data collected by the binocular camera and the depth camera.

进一步的,将所述激光雷达采集的激光雷达数据上传到上位机系统;将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统。Further, the lidar data collected by the lidar is uploaded to the host computer system; the image data collected by the binocular camera and the depth camera are uploaded to the host computer system.

作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:

根据所述第二环境图像和所述第一环境图像,识别出所述局部点云地图上的表征动态目标的点云;根据所述第二环境点云图和所述第一环境点云图,删除所述局部点云地图中的表征动态目标的点云。According to the second environment image and the first environment image, a point cloud representing a dynamic target on the local point cloud map is identified; according to the second environment point cloud map and the first environment point cloud map, delete Point clouds representing dynamic targets in the local point cloud map.

其中,表征动态目标的点云包括:表征行人或者非机动车辆或者机动车辆的点云。Among them, point clouds that represent dynamic targets include: point clouds that represent pedestrians, non-motor vehicles, or motor vehicles.

作为一种优选示例,所述处理器701执行所述计算机程序时实现:As a preferred example, when the processor 701 executes the computer program, it implements:

根据以下方法将所述第二信息与第一信息进行局部匹配:The second information is partially matched with the first information according to the following method:

将前后两个位置(即第一位置和第二位置)的激光雷达采集的点云进行配准处理,把不同位置的点云通过重叠部分的信息,变换到同一个位置。作为一种优选示例,利用ICP算法(Iterative Closest Point,最近邻迭代算法),将两组或点云统一到统一坐标系下,进行点云的配准,配准后得到的点云地图成为环境局部地图。The point clouds collected by the lidar at the two positions before and after (i.e. the first position and the second position) are registered, and the point clouds at different positions are transformed to the same position through the information of the overlapping parts. As a preferred example, the ICP algorithm (Iterative Closest Point, nearest neighbor iterative algorithm) is used to unify two groups or point clouds into a unified coordinate system, and perform point cloud registration. The point cloud map obtained after registration becomes the environment Local map.

作为一种优选示例,所述处理器701执行所述计算机程序时实现:将第一位置或者第二位置的图像和点云进行匹配;As a preferred example, when the processor 701 executes the computer program, it implements: matching the image at the first position or the second position with the point cloud;

将图像中识别出的动态目标对应的点云从点云地图中删除。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map.

其中,将第一位置或者第二位置的图像和点云进行匹配包括:Among them, matching the image at the first position or the second position with the point cloud includes:

根据转换矩阵将图像信息与点云信息进行匹配。也就是说,根据转换矩阵将第一环境图像与第一环境点云图匹配,或者根据转换矩阵将第二环境图像与第二环境点云图匹配。Match image information with point cloud information according to the transformation matrix. That is to say, the first environment image is matched with the first environment point cloud image according to the transformation matrix, or the second environment image is matched with the second environment point cloud image according to the transformation matrix.

所述处理器701执行所述计算机程序时实现:根据以下步骤确定转换矩阵:When the processor 701 executes the computer program, it implements: determining the transformation matrix according to the following steps:

A1:标定。A1: Calibration.

在点云地图构建前进行多传感器标定,即将摄像头图像信息和雷达点云信息进行标定,即在一处特征点明确的环境内打开摄像头采集图像信息,打开雷达采集点云信息,然后工作人员选择图像上的特征位置并在点云信息上划出对应的位置。作为一种优选示例,图像上各个特征点的提取可以由SIFT图像特征点提取算法等得到。Multi-sensor calibration is performed before the point cloud map is constructed, that is, the camera image information and radar point cloud information are calibrated, that is, in an environment with clear feature points, the camera is turned on to collect image information, the radar is turned on to collect point cloud information, and then the staff selects Feature locations on the image and draw corresponding locations on the point cloud information. As a preferred example, the extraction of each feature point on the image can be obtained by SIFT image feature point extraction algorithm or the like.

A2:确定转换矩阵。A2: Determine the transformation matrix.

划出的点云位置和选择的图像位置之间的转换关系即为转换矩阵,转换矩阵表示三维点云与视觉图像像素间直接的映射关系,即图像上的位置通过转化矩阵都可以找到点云信息上的点云位置。The conversion relationship between the drawn point cloud position and the selected image position is the conversion matrix. The conversion matrix represents the direct mapping relationship between the three-dimensional point cloud and the visual image pixels. That is, the point cloud can be found at any position on the image through the conversion matrix. Point cloud locations on the information.

其中,在图7中,总线架构可以包括任意数量的互联的总线和桥,具体由处理器701代表的一个或多个处理器和存储器702代表的存储器的各种电路链接在一起。总线架构还可以将诸如外围设备、稳压器和功率管理电路等之类的各种其他电路链接在一起,这些都是本领域所公知的,因此,本文不再对其进行进一步描述。总线接口提供接口。处理器701负责管理总线架构和通常的处理,存储器702可以存储处理器701在执行操作时所使用的数据。In FIG. 7 , the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 701 and various circuits of the memory represented by memory 702 are linked together. The bus architecture can also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are all well known in the art and therefore will not be described further herein. The bus interface provides the interface. The processor 701 is responsible for managing the bus architecture and general processing, and the memory 702 can store data used by the processor 701 when performing operations.

处理器701可以是CPU、ASIC、FPGA或CPLD,处理器701也可以采用多核架构。The processor 701 can be a CPU, ASIC, FPGA or CPLD, and the processor 701 can also adopt a multi-core architecture.

处理器701执行存储器702存储的计算机程序时,实现实施例一中的任一点云地图的构建方法。When the processor 701 executes the computer program stored in the memory 702, the method for constructing any point cloud map in Embodiment 1 is implemented.

需要说明的是,实施例三提供的装置与实施例一提供的方法属于同一个发明构思,解决相同的技术问题,达到相同的技术效果,实施例三提供的装置能实现实施例一的所有方法,相同之处不再赘述。It should be noted that the device provided in Embodiment 3 and the method provided in Embodiment 1 belong to the same inventive concept, solve the same technical problem, and achieve the same technical effect. The device provided in Embodiment 3 can implement all the methods in Embodiment 1. , the similarities will not be repeated.

本申请还提出一种处理器可读存储介质。其中,该处理器可读存储介质存储有计算机程序,所述处理器执行所述计算机程序时实现实施例一中的任一点云地图的构建方法。This application also proposes a processor-readable storage medium. Wherein, the processor-readable storage medium stores a computer program, and when the processor executes the computer program, the method for constructing any point cloud map in Embodiment 1 is implemented.

需要说明的是,本申请实施例中对单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods. In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.

本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, magnetic disk storage and optical storage, etc.) embodying computer-usable program code therein.

本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for realizing the functions specified in one process or multiple processes of the flowchart and/or one block or multiple blocks of the block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.

显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. In this way, if these modifications and variations of the present application fall within the scope of the claims of the present application and equivalent technologies, the present application is also intended to include these modifications and variations.

Claims (12)

1.一种点云地图的构建方法,其特征在于,包括:1. A method for constructing a point cloud map, which is characterized by including: 采集第一位置的第一信息;Collect the first information from the first position; 完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;After completing the collection of the first information, move to the second position and collect the second information at the second position; 将所述第二信息与第一信息进行局部匹配,获得局部点云地图;Locally match the second information with the first information to obtain a local point cloud map; 将所述局部点云地图中的动态目标点云删除,获得激光点云地图;Delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map; 其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image; 所述第二信息包括第二环境点云图和第二环境图像;The second information includes a second environment point cloud map and a second environment image; 所述将所述局部点云地图中的动态目标点云删除包括:Deleting the dynamic target point cloud in the local point cloud map includes: 将第一位置或者第二位置的图像和点云进行匹配;Match the image at the first position or the second position with the point cloud; 将图像中识别出的动态目标对应的点云从点云地图中删除。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map. 2.根据权利要求1所述的方法,其特征在于,包括:2. The method according to claim 1, characterized in that, comprising: 当点云地图构建开始时,所述第一位置为起始位置;When the point cloud map construction starts, the first position is the starting position; 当所述第一位置采集完成后开始采集下一个位置时,所述第二位置是当前的采集位置,所述第一位置是上一个采集的位置。When the next position is collected after the first position collection is completed, the second position is the current collection position, and the first position is the last collected position. 3.根据权利要求2所述的方法,其特征在于,当点云地图构建开始之前还包括:3. The method according to claim 2, characterized in that, before starting the point cloud map construction, it also includes: 开启采集设备,所述采集设备包括以下之一或者组合:Turn on the collection device, which includes one or a combination of the following: 激光雷达;lidar; 双目摄像头;binocular camera; 深度摄像头;depth camera; 惯性测量单元IMU;Inertial Measurement Unit IMU; 轮速里程计。Wheel speed odometer. 4.根据权利要求2所述的方法,其特征在于,还包括:4. The method of claim 2, further comprising: 完成整个建图区域采集后,结束采集,将所有采集点的激光点云地图进行地图拼接得到整个建图区域的环境点云地图。After completing the collection of the entire mapping area, end the collection, and stitch the laser point cloud maps of all collection points to obtain an environmental point cloud map of the entire mapping area. 5.根据权利要求3所述的方法,其特征在于,所述采集第一位置的第一信息包括:5. The method of claim 3, wherein collecting the first information of the first location includes: 根据所述激光雷达采集的激光雷达数据,建立第一环境点云图;Establish a first environmental point cloud map based on the lidar data collected by the lidar; 根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第一环境图像。A first environment image is established based on the image data collected by the binocular camera and the depth camera. 6.根据权利要求3所述的方法,其特征在于,所述采集第二位置的第二信息包括:6. The method of claim 3, wherein collecting the second information of the second location includes: 根据所述激光雷达采集的激光雷达数据,建立第二环境点云图;Establish a second environmental point cloud map based on the lidar data collected by the lidar; 根据所述双目摄像头和所述深度摄像头采集的图像数据,建立第二环境图像。A second environment image is established based on the image data collected by the binocular camera and the depth camera. 7.根据权利要求5或者6所述的方法,其特征在于,还包括:7. The method according to claim 5 or 6, characterized in that, further comprising: 将所述激光雷达采集的激光雷达数据上传到上位机系统;Upload the lidar data collected by the lidar to the host computer system; 将所述双目摄像头和所述深度摄像头采集的图像数据上传到上位机系统。Upload the image data collected by the binocular camera and the depth camera to the host computer system. 8.根据权利要求1所述的方法,其特征在于,所述表征动态目标的点云包括:8. The method according to claim 1, characterized in that the point cloud characterizing the dynamic target includes: 表征行人或者非机动车辆或者机动车辆的点云。Point clouds representing pedestrians or non-motor vehicles or motor vehicles. 9.根据权利要求1所述的方法,其特征在于,所述将第一位置或者第二位置的图像和点云进行匹配包括:9. The method of claim 1, wherein matching the image at the first position or the second position with the point cloud includes: 根据转换矩阵将图像信息与点云信息进行匹配。Match image information with point cloud information according to the transformation matrix. 10.一种点云地图的构建装置,其特征在于,包括:10. A point cloud map construction device, characterized by including: 采集模块,被配置用于采集第一位置的第一信息,完成所述第一信息采集后,移动到第二位置,采集第二位置的第二信息;The collection module is configured to collect the first information at the first position, and after completing the collection of the first information, moves to the second position to collect the second information at the second position; 局部匹配模块,被配置用于将所述第二信息与第一信息进行局部匹配,获得局部点云地图;a local matching module configured to locally match the second information with the first information to obtain a local point cloud map; 动态目标删除模块,被配置用于将所述局部点云地图中的动态目标点云删除,获得激光点云地图;A dynamic target deletion module configured to delete the dynamic target point cloud in the local point cloud map to obtain a laser point cloud map; 其中,所述第一信息包括第一环境点云图和第一环境图像;Wherein, the first information includes a first environment point cloud map and a first environment image; 所述第二信息包括第二环境点云图和第二环境图像;The second information includes a second environment point cloud map and a second environment image; 所述将所述局部点云地图中的动态目标点云删除包括:Deleting the dynamic target point cloud in the local point cloud map includes: 将第一位置或者第二位置的图像和点云进行匹配;Match the image at the first position or the second position with the point cloud; 将图像中识别出的动态目标对应的点云从点云地图中删除。Delete the point cloud corresponding to the dynamic target identified in the image from the point cloud map. 11.一种点云地图的构建装置,其特征在于,包括存储器、处理器和用户接口;11. A point cloud map construction device, characterized by including a memory, a processor and a user interface; 所述存储器,用于存储计算机程序;The memory is used to store computer programs; 所述用户接口,用于与用户实现交互;The user interface is used to interact with users; 所述处理器,用于读取所述存储器中的计算机程序,所述处理器执行所述计算机程序时,实现如权利要求1到9之一所述的点云地图的构建方法。The processor is configured to read the computer program in the memory. When the processor executes the computer program, it implements the point cloud map construction method according to one of claims 1 to 9. 12.一种处理器可读存储介质,其特征在于,所述处理器可读存储介质存储有计算机程序,所述处理器执行所述计算机程序时实现如权利要求1至9之一所述的点云地图的构建方法。12. A processor-readable storage medium, characterized in that the processor-readable storage medium stores a computer program, and when the processor executes the computer program, the method of one of claims 1 to 9 is implemented. Method of constructing point cloud map.
CN202110887413.6A 2021-08-03 2021-08-03 Point cloud map construction method, device and storage medium Active CN113639745B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110887413.6A CN113639745B (en) 2021-08-03 2021-08-03 Point cloud map construction method, device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110887413.6A CN113639745B (en) 2021-08-03 2021-08-03 Point cloud map construction method, device and storage medium

Publications (2)

Publication Number Publication Date
CN113639745A CN113639745A (en) 2021-11-12
CN113639745B true CN113639745B (en) 2023-10-20

Family

ID=78419450

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110887413.6A Active CN113639745B (en) 2021-08-03 2021-08-03 Point cloud map construction method, device and storage medium

Country Status (1)

Country Link
CN (1) CN113639745B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114646936A (en) * 2022-03-30 2022-06-21 北京洛必德科技有限公司 A point cloud map construction method, device and electronic device
CN115170630B (en) * 2022-06-30 2023-11-21 小米汽车科技有限公司 Map generation method, map generation device, electronic equipment, vehicle and storage medium
CN116385622B (en) * 2023-05-26 2023-09-12 腾讯科技(深圳)有限公司 Cloud image processing method, cloud image processing device, computer and readable storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109282822A (en) * 2018-08-31 2019-01-29 北京航空航天大学 Storage medium, method and device for constructing navigation map
CN111508072A (en) * 2020-04-23 2020-08-07 东软睿驰汽车技术(上海)有限公司 Map construction method and device, electronic equipment and storage medium
CN111681163A (en) * 2020-04-23 2020-09-18 北京三快在线科技有限公司 Method and device for constructing point cloud map, electronic equipment and storage medium
CN111915657A (en) * 2020-07-08 2020-11-10 浙江大华技术股份有限公司 Point cloud registration method and device, electronic equipment and storage medium
CN111929699A (en) * 2020-07-21 2020-11-13 北京建筑大学 Laser radar inertial navigation odometer considering dynamic obstacles and mapping method and system
CN112652062A (en) * 2019-10-10 2021-04-13 北京京东乾石科技有限公司 Point cloud map construction method, device, equipment and storage medium
WO2021128297A1 (en) * 2019-12-27 2021-07-01 深圳市大疆创新科技有限公司 Method, system and device for constructing three-dimensional point cloud map
CN113168717A (en) * 2021-03-11 2021-07-23 华为技术有限公司 A point cloud matching method and device, navigation method and device, positioning method, and lidar

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108732584B (en) * 2017-04-17 2020-06-30 百度在线网络技术(北京)有限公司 Method and device for updating map
US20210180958A1 (en) * 2019-12-16 2021-06-17 Automotive Research & Testing Center Graphic information positioning system for recognizing roadside features and method using the same

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109282822A (en) * 2018-08-31 2019-01-29 北京航空航天大学 Storage medium, method and device for constructing navigation map
CN112652062A (en) * 2019-10-10 2021-04-13 北京京东乾石科技有限公司 Point cloud map construction method, device, equipment and storage medium
WO2021128297A1 (en) * 2019-12-27 2021-07-01 深圳市大疆创新科技有限公司 Method, system and device for constructing three-dimensional point cloud map
CN111508072A (en) * 2020-04-23 2020-08-07 东软睿驰汽车技术(上海)有限公司 Map construction method and device, electronic equipment and storage medium
CN111681163A (en) * 2020-04-23 2020-09-18 北京三快在线科技有限公司 Method and device for constructing point cloud map, electronic equipment and storage medium
CN111915657A (en) * 2020-07-08 2020-11-10 浙江大华技术股份有限公司 Point cloud registration method and device, electronic equipment and storage medium
CN111929699A (en) * 2020-07-21 2020-11-13 北京建筑大学 Laser radar inertial navigation odometer considering dynamic obstacles and mapping method and system
CN113168717A (en) * 2021-03-11 2021-07-23 华为技术有限公司 A point cloud matching method and device, navigation method and device, positioning method, and lidar

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于激光雷达的移动机器人三维建图与定位;殷江;林建德;孔令华;邹诚;游通飞;易定容;;福建工程学院学报(第04期);67-71 *

Also Published As

Publication number Publication date
CN113639745A (en) 2021-11-12

Similar Documents

Publication Publication Date Title
CN113639745B (en) Point cloud map construction method, device and storage medium
JP6862409B2 (en) Map generation and moving subject positioning methods and devices
CN110160502B (en) Map element extraction method, device and server
JP6898534B2 (en) Systems and methods to reduce data storage in machine learning
CN108763287B (en) Construction method of large-scale passable regional driving map and unmanned application method thereof
CN112069856A (en) Map generation method, driving control method, device, electronic device and system
KR102564430B1 (en) Method and device for controlling vehicle, and vehicle
CN111681163B (en) Method and device for constructing point cloud map, electronic equipment and storage medium
CN108413975A (en) Ground picture capturing method, system, cloud processor and vehicle
CN110146910A (en) A positioning method and device based on GPS and lidar data fusion
JP2015148601A (en) System and method for mapping, localization and pose correction
KR102218881B1 (en) Method and system for determining position of vehicle
CN112465970B (en) Navigation map construction method, device, system, electronic device and storage medium
CN111982133B (en) Method and device for positioning vehicle based on high-precision map and electronic equipment
CN107958451A (en) Vision high accuracy map production method and device
CN114187357A (en) High-precision map production method and device, electronic equipment and storage medium
CN117974916A (en) High-precision map generation method and device based on information fusion
CN110827340B (en) Map updating method, device and storage medium
US11619498B2 (en) Verification method and device for modeling route, unmanned vehicle, and storage medium
EP4124828B1 (en) Map processing method and apparatus
CN116309943A (en) Parking lot semantic map road network construction method and device and electronic equipment
CN116142172A (en) Parking method and device based on voxel coordinate system
CN114812537A (en) Lane line map construction and update method, system, medium, and apparatus
CN115393816A (en) Lane line generation method, lane line generation device, computer device, and storage medium
CN111060114A (en) Method and device for generating feature map of high-precision map

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant