CN106228602A - Determination method, device and the mobile unit of three-dimensional vehicle alternative area - Google Patents
Determination method, device and the mobile unit of three-dimensional vehicle alternative area Download PDFInfo
- Publication number
- CN106228602A CN106228602A CN201610581697.5A CN201610581697A CN106228602A CN 106228602 A CN106228602 A CN 106228602A CN 201610581697 A CN201610581697 A CN 201610581697A CN 106228602 A CN106228602 A CN 106228602A
- Authority
- CN
- China
- Prior art keywords
- dimensional
- vehicle
- area
- point clouds
- ground plane
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000004422 calculation algorithm Methods 0.000 claims description 17
- 238000005259 measurement Methods 0.000 claims description 15
- 238000005070 sampling Methods 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 description 10
- 238000010276 construction Methods 0.000 description 4
- 230000003044 adaptive effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008447 perception Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Traffic Control Systems (AREA)
Abstract
本发明提供了一种三维车辆备选区域的确定方法、装置及车载设备。该方法包括:获取道路场景中的多个点云,利用所述多个点云确定所述道路场景中的地平面;根据预置的车辆尺寸,在所述地平面上生成多个三维区域;将包含所述多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个所述第二几何体;根据所述各个三维区域包含的一个或多个所述第二几何体,确定该三维区域是否为三维车辆备选区域。本发明实施例利用车辆位于地平面附近的先验知识,同时利用已知车辆尺寸的模板,大幅减少了待搜索的三维区域的数目,提高了搜索效率,满足实际应用中实时性的要求。
The invention provides a method, device and vehicle-mounted equipment for determining a three-dimensional vehicle candidate area. The method includes: acquiring multiple point clouds in a road scene, using the multiple point clouds to determine a ground plane in the road scene; generating multiple three-dimensional areas on the ground plane according to a preset vehicle size; Divide the first geometry containing the plurality of point clouds into a set of a specified number of second geometry, determine one or more of the second geometry contained in each three-dimensional area; The second geometric body is used to determine whether the three-dimensional area is a three-dimensional vehicle candidate area. The embodiment of the present invention utilizes the prior knowledge that the vehicle is located near the ground level and the template of the known vehicle size, which greatly reduces the number of three-dimensional areas to be searched, improves the search efficiency, and meets the real-time requirements in practical applications.
Description
技术领域technical field
本发明涉及智能车辆环境感知技术领域,特别是一种三维车辆备选区域的确定方法、装置及车载设备。The invention relates to the technical field of intelligent vehicle environment perception, in particular to a method, device and vehicle-mounted equipment for determining a three-dimensional vehicle candidate area.
背景技术Background technique
点云是目标表面特性的海量点集合,通过车载的激光雷达或者双目相机等传感器,能够获取到道路场景的密集点云信息。点云可以视为一系列三维坐标的集合。通过点云数据生成车辆的三维备选区域,便于后续算法快速、准确地识别和定位场景中的车辆。该技术是前车碰撞预警、自适应巡航等应用的核心模块之一。The point cloud is a collection of massive points on the surface characteristics of the target. The dense point cloud information of the road scene can be obtained through the vehicle-mounted lidar or binocular camera and other sensors. A point cloud can be viewed as a collection of 3D coordinates. The three-dimensional candidate area of the vehicle is generated through the point cloud data, which is convenient for the subsequent algorithm to quickly and accurately identify and locate the vehicle in the scene. This technology is one of the core modules for applications such as front collision warning and adaptive cruise control.
相关技术中,通过点云数据生成车辆的三维备选区域,需要在三维点云数据中遍历所有可能的车辆备选区域,搜索复杂度为指数级,不能满足实际应用中对算法的实时性要求,亟待解决这一技术问题。In related technologies, generating the 3D candidate areas of the vehicle through point cloud data requires traversing all possible vehicle candidate areas in the 3D point cloud data, and the search complexity is exponential, which cannot meet the real-time requirements of the algorithm in practical applications. , this technical problem needs to be solved urgently.
发明内容Contents of the invention
鉴于上述问题,提出了本发明以便提供一种克服上述问题或者至少部分地解决上述问题的三维车辆备选区域的确定方法、装置及相应的车载设备。In view of the above problems, the present invention is proposed to provide a method and device for determining a three-dimensional vehicle candidate area and corresponding on-board equipment that overcome the above problems or at least partially solve the above problems.
依据本发明的一方面,提供了一种三维车辆备选区域的确定方法,包括:According to an aspect of the present invention, a method for determining a three-dimensional vehicle candidate area is provided, including:
获取道路场景中的多个点云,利用所述多个点云确定所述道路场景中的地平面;Obtaining multiple point clouds in the road scene, using the multiple point clouds to determine the ground plane in the road scene;
根据预置的车辆尺寸,在所述地平面上生成多个三维区域;generating a plurality of three-dimensional areas on the ground plane according to the preset vehicle size;
将包含所述多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个所述第二几何体;Divide the first geometry containing the plurality of point clouds into a set of a specified number of second geometry, and determine one or more of the second geometry contained in each three-dimensional area;
根据所述各个三维区域包含的一个或多个所述第二几何体,确定该三维区域是否为三维车辆备选区域。Whether the three-dimensional area is a three-dimensional vehicle candidate area is determined according to the one or more second geometric bodies included in each three-dimensional area.
可选地,所述获取道路场景中的多个点云,包括:Optionally, the acquiring multiple point clouds in the road scene includes:
根据激光测量原理采集道路场景中的多个点云;和/或Acquisition of multiple point clouds in a road scene based on laser measurement principles; and/or
根据摄影测量原理获取道路场景中的多个点云。According to the principle of photogrammetry, multiple point clouds in the road scene are obtained.
可选地,利用所述多个点云确定所述道路场景中的地平面,包括:Optionally, using the multiple point clouds to determine the ground plane in the road scene includes:
通过随机抽样一致性RANSAC算法,确定所述多个点云中属于所述道路场景中的地平面的点云。A point cloud among the plurality of point clouds belonging to the ground plane in the road scene is determined through a random sampling consistent RANSAC algorithm.
可选地,根据预置的车辆尺寸,在所述地平面上生成多个三维区域,包括:Optionally, according to the preset vehicle size, multiple three-dimensional areas are generated on the ground plane, including:
根据预置的车辆尺寸,在所述地平面随机生成多个三维区域,其中,所述三维区域通过指定参数确定。According to the preset vehicle size, a plurality of three-dimensional areas are randomly generated on the ground plane, wherein the three-dimensional areas are determined by specified parameters.
可选地,所述指定参数包括下列至少之一:Optionally, the specified parameters include at least one of the following:
车辆中心的三维坐标、车辆尺寸、车辆在所述地平面上的朝向角度。The three-dimensional coordinates of the center of the vehicle, the size of the vehicle, and the orientation angle of the vehicle on the ground plane.
可选地,将包含所述多个点云的第一几何体划分为指定数量的第二几何体的集合,包括:Optionally, dividing the first geometry containing the plurality of point clouds into a set of a specified number of second geometry includes:
将包含所述多个点云的长方体按照固定间隔离散化,划分为指定数量的立方体的集合。The cuboid containing the plurality of point clouds is discretized according to a fixed interval, and divided into a set of a specified number of cubes.
可选地,根据所述各个三维区域包含的一个或多个所述第二几何体,确定该三维区域是否为三维车辆备选区域,包括:Optionally, determining whether the three-dimensional area is a three-dimensional vehicle candidate area according to one or more second geometric bodies included in each three-dimensional area includes:
根据所述各个三维区域包含的一个或多个所述第二几何体,利用三维积分图计算所述各个三维区域包含的点云数量和/或点云平均高度;According to one or more of the second geometric bodies contained in each three-dimensional area, calculate the number of point clouds contained in each three-dimensional area and/or the average height of point cloud by using a three-dimensional integral map;
根据所述各个三维区域包含的点云数量和/或点云平均高度,确定该三维区域是否为三维车辆备选区域。Determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to the number of point clouds contained in each three-dimensional area and/or the average height of the point cloud.
可选地,根据所述各个三维区域包含的点云数量和/或点云平均高度,确定该三维区域是否为三维车辆备选区域,包括:Optionally, according to the number of point clouds contained in each three-dimensional area and/or the average height of the point cloud, determining whether the three-dimensional area is a three-dimensional vehicle candidate area includes:
按照指定的权重对所述各个三维区域包含的点云数量和点云平均高度求和加权,得到所述各个三维区域的综合评分值;According to the specified weight, the number of point clouds contained in each three-dimensional area and the average height of the point cloud are summed and weighted to obtain the comprehensive score value of each three-dimensional area;
根据所述各个三维区域的综合评分值,确定该三维区域是否为三维车辆备选区域。According to the comprehensive score value of each three-dimensional area, it is determined whether the three-dimensional area is a three-dimensional vehicle candidate area.
可选地,根据所述各个三维区域的综合评分值,确定该三维区域是否为三维车辆备选区域,包括:Optionally, according to the comprehensive scoring value of each three-dimensional area, determining whether the three-dimensional area is a three-dimensional vehicle candidate area includes:
将所述各个三维区域的综合评分值从大到小进行排序;Sorting the comprehensive scoring values of the various three-dimensional regions from large to small;
选取排序靠前的指定数量的三维区域作为三维车辆备选区域。Select the specified number of 3D areas ranked first as the 3D vehicle candidate areas.
可选地,所述方法还包括:Optionally, the method also includes:
在行车的过程中,根据确定出的所述三维车辆备选区域,识别行车相关信息;In the process of driving, according to the determined three-dimensional vehicle candidate area, identify driving-related information;
对识别出的行车相关信息进行分析以生成相应的行车导航提示信息,并提供给用户。The identified driving-related information is analyzed to generate corresponding driving navigation prompt information and provided to the user.
可选地,所述行车相关信息包括下列至少之一:Optionally, the driving-related information includes at least one of the following:
前车和/或后车与本车的距离、行车路况标识信息、道路环境信息。The distance between the vehicle in front and/or the vehicle behind and the vehicle, road condition identification information, and road environment information.
可选地,所述方法应用在车载的智能控制单元中。Optionally, the method is applied in a vehicle-mounted intelligent control unit.
依据本发明的另一方面,还提供了一种三维车辆备选区域的确定装置,包括:According to another aspect of the present invention, a device for determining a three-dimensional vehicle candidate area is also provided, including:
点云获取模块,适于获取道路场景中的多个点云;The point cloud acquisition module is suitable for acquiring multiple point clouds in road scenes;
地平面确定模块,适于利用所述多个点云确定所述道路场景中的地平面;a ground plane determination module adapted to determine the ground plane in the road scene by using the plurality of point clouds;
三维区域生成模块,适于根据预置的车辆尺寸,在所述地平面上生成多个三维区域;A three-dimensional area generation module, adapted to generate multiple three-dimensional areas on the ground plane according to the preset vehicle size;
几何体确定模块,适于将包含所述多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个所述第二几何体;A geometry determination module, adapted to divide the first geometry containing the plurality of point clouds into a set of a specified number of second geometries, and determine one or more of the second geometries contained in each three-dimensional area;
备选区域确定模块,适于根据所述各个三维区域包含的一个或多个所述第二几何体,确定该三维区域是否为三维车辆备选区域。The candidate area determination module is adapted to determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to one or more of the second geometric bodies included in each three-dimensional area.
可选地,所述点云获取模块还适于:Optionally, the point cloud acquisition module is also suitable for:
根据激光测量原理采集道路场景中的多个点云;和/或Acquisition of multiple point clouds in a road scene based on laser measurement principles; and/or
根据摄影测量原理获取道路场景中的多个点云。According to the principle of photogrammetry, multiple point clouds in the road scene are obtained.
可选地,所述地平面确定模块还适于:Optionally, the ground plane determination module is also adapted to:
通过随机抽样一致性RANSAC算法,确定所述多个点云中属于所述道路场景中的地平面的点云。A point cloud among the plurality of point clouds belonging to the ground plane in the road scene is determined through a random sampling consistent RANSAC algorithm.
可选地,所述三维区域生成模块还适于:Optionally, the three-dimensional area generation module is also suitable for:
根据预置的车辆尺寸,在所述地平面随机生成多个三维区域,其中,所述三维区域通过指定参数确定。According to the preset vehicle size, a plurality of three-dimensional areas are randomly generated on the ground plane, wherein the three-dimensional areas are determined by specified parameters.
可选地,所述指定参数包括下列至少之一:Optionally, the specified parameters include at least one of the following:
车辆中心的三维坐标、车辆尺寸、车辆在所述地平面上的朝向角度。The three-dimensional coordinates of the center of the vehicle, the size of the vehicle, and the orientation angle of the vehicle on the ground plane.
可选地,所述几何体确定模块还适于:Optionally, the geometry determination module is also adapted to:
将包含所述多个点云的长方体按照固定间隔离散化,划分为指定数量的立方体的集合。The cuboid containing the plurality of point clouds is discretized according to a fixed interval, and divided into a set of a specified number of cubes.
可选地,所述备选区域确定模块包括:Optionally, the candidate area determination module includes:
计算单元,适于根据所述各个三维区域包含的一个或多个所述第二几何体,利用三维积分图计算所述各个三维区域包含的点云数量和/或点云平均高度;The calculation unit is adapted to calculate the number of point clouds and/or the average height of point clouds contained in each three-dimensional area by using a three-dimensional integral map according to the one or more second geometric bodies contained in each three-dimensional area;
确定单元,适于根据所述各个三维区域包含的点云数量和/或点云平均高度,确定该三维区域是否为三维车辆备选区域。The determination unit is adapted to determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to the number of point clouds contained in each three-dimensional area and/or the average height of the point cloud.
可选地,所述确定单元还适于:Optionally, the determining unit is further adapted to:
按照指定的权重对所述各个三维区域包含的点云数量和点云平均高度求和加权,得到所述各个三维区域的综合评分值;According to the specified weight, the number of point clouds contained in each three-dimensional area and the average height of the point cloud are summed and weighted to obtain the comprehensive score value of each three-dimensional area;
根据所述各个三维区域的综合评分值,确定该三维区域是否为三维车辆备选区域。According to the comprehensive score value of each three-dimensional area, it is determined whether the three-dimensional area is a three-dimensional vehicle candidate area.
可选地,所述确定单元还适于:Optionally, the determining unit is further adapted to:
将所述各个三维区域的综合评分值从大到小进行排序;Sorting the comprehensive scoring values of the various three-dimensional regions from large to small;
选取排序靠前的指定数量的三维区域作为三维车辆备选区域。Select the specified number of 3D areas ranked first as the 3D vehicle candidate areas.
可选地,所述装置还包括:Optionally, the device also includes:
行车导航提示信息生成模块,适于在行车的过程中,根据确定出的所述三维车辆备选区域,识别行车相关信息;对识别出的行车相关信息进行分析以生成相应的行车导航提示信息,并提供给用户。The driving navigation prompt information generation module is adapted to identify driving-related information according to the determined three-dimensional vehicle candidate area during the driving process; analyze the identified driving-related information to generate corresponding driving navigation prompt information, and provided to users.
可选地,所述行车相关信息包括下列至少之一:Optionally, the driving-related information includes at least one of the following:
前车和/或后车与本车的距离、行车路况标识信息、道路环境信息。The distance between the vehicle in front and/or the vehicle behind and the vehicle, road condition identification information, and road environment information.
可选地,所述装置应用在车载的智能控制单元中。Optionally, the device is applied in a vehicle-mounted intelligent control unit.
依据本发明的又一方面,还提供了一种车载设备,包括上述任一个所述的三维车辆备选区域的确定装置。According to yet another aspect of the present invention, there is also provided a vehicle-mounted device, including any one of the devices for determining a three-dimensional vehicle candidate area described above.
本发明实施例提供的技术方案,首先获取道路场景中的多个点云,利用多个点云确定道路场景中的地平面。随后,根据预置的车辆尺寸,在地平面上生成多个三维区域,进而将包含多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个第二几何体。之后,根据各个三维区域包含的一个或多个第二几何体,确定该三维区域是否为三维车辆备选区域。由此可见,本发明实施例利用车辆位于地平面附近的先验知识,同时利用已知车辆尺寸的模板,大幅减少了待搜索的三维区域的数目,提高了搜索效率,满足实际应用中实时性的要求。并且,由于各个第二几何体包含道路场景中的至少一个点云,本发明实施例基于各个三维区域包含的一个或多个第二几何体,确定该三维区域是否为三维车辆备选区域,确保了三维区域的召回率。In the technical solution provided by the embodiments of the present invention, firstly, multiple point clouds in the road scene are obtained, and the ground plane in the road scene is determined by using the multiple point clouds. Subsequently, according to the preset vehicle size, multiple three-dimensional regions are generated on the ground plane, and then the first geometry containing multiple point clouds is divided into a set of a specified number of second geometry, and one or more a second geometry. Afterwards, according to one or more second geometric bodies contained in each three-dimensional area, it is determined whether the three-dimensional area is a three-dimensional vehicle candidate area. It can be seen that the embodiment of the present invention utilizes the prior knowledge that the vehicle is located near the ground level, and at the same time utilizes the template of the known vehicle size, which greatly reduces the number of three-dimensional areas to be searched, improves the search efficiency, and satisfies the real-time requirements in practical applications. requirements. Moreover, since each second geometric body contains at least one point cloud in the road scene, the embodiment of the present invention determines whether the three-dimensional area is a three-dimensional vehicle candidate area based on one or more second geometric bodies contained in each three-dimensional area, ensuring three-dimensional Region recall.
上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.
根据下文结合附图对本发明具体实施例的详细描述,本领域技术人员将会更加明了本发明的上述以及其他目的、优点和特征。Those skilled in the art will be more aware of the above and other objects, advantages and features of the present invention according to the following detailed description of specific embodiments of the present invention in conjunction with the accompanying drawings.
附图说明Description of drawings
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:
图1示出了根据本发明一实施例的三维车辆备选区域的确定方法的流程图;FIG. 1 shows a flowchart of a method for determining a three-dimensional vehicle candidate area according to an embodiment of the present invention;
图2示出了根据本发明另一实施例的三维车辆备选区域的确定方法的流程图;FIG. 2 shows a flowchart of a method for determining a three-dimensional vehicle candidate area according to another embodiment of the present invention;
图3示出了根据本发明一个实施例的三维车辆备选区域的确定装置的结构示意图;以及FIG. 3 shows a schematic structural diagram of a device for determining a three-dimensional vehicle candidate area according to an embodiment of the present invention; and
图4示出了根据本发明另一个实施例的三维车辆备选区域的确定装置的结构示意图。Fig. 4 shows a schematic structural diagram of an apparatus for determining a three-dimensional vehicle candidate area according to another embodiment of the present invention.
具体实施方式detailed description
下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例,然而应当理解,可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本公开,并且能够将本公开的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
为解决上述技术问题,本发明实施例提供了一种三维车辆备选区域的确定方法。图1示出了根据本发明一实施例的三维车辆备选区域的确定方法的流程图。如图1所示,该方法至少可以包括以下步骤S102至步骤S108。In order to solve the above technical problem, an embodiment of the present invention provides a method for determining a three-dimensional vehicle candidate area. Fig. 1 shows a flowchart of a method for determining a three-dimensional vehicle candidate area according to an embodiment of the present invention. As shown in Fig. 1, the method may at least include the following steps S102 to S108.
步骤S102,获取道路场景中的多个点云,利用多个点云确定道路场景中的地平面。Step S102, acquiring multiple point clouds in the road scene, and using the multiple point clouds to determine the ground plane in the road scene.
步骤S104,根据预置的车辆尺寸,在地平面上生成多个三维区域。Step S104, generating multiple three-dimensional regions on the ground plane according to the preset vehicle size.
步骤S106,将包含多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个第二几何体。Step S106, dividing the first geometry including multiple point clouds into a set of a specified number of second geometry, and determining one or more second geometry contained in each three-dimensional area.
步骤S108,根据各个三维区域包含的一个或多个第二几何体,确定该三维区域是否为三维车辆备选区域。Step S108, according to one or more second geometric bodies contained in each three-dimensional area, determine whether the three-dimensional area is a three-dimensional vehicle candidate area.
本发明实施例实现了基于点云确定车辆的三维备选区域的方法,首先获取道路场景中的多个点云,利用多个点云确定道路场景中的地平面。随后,根据预置的车辆尺寸,在地平面上生成多个三维区域,进而将包含多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个第二几何体。之后,根据各个三维区域包含的一个或多个第二几何体,确定该三维区域是否为三维车辆备选区域。由此可见,本发明实施例利用车辆位于地平面附近的先验知识,同时利用已知车辆尺寸的模板,大幅减少了待搜索的三维区域的数目,提高了搜索效率,满足实际应用中实时性的要求。并且,由于各个第二几何体包含道路场景中的至少一个点云,本发明实施例基于各个三维区域包含的一个或多个第二几何体,确定该三维区域是否为三维车辆备选区域,确保了三维区域的召回率。The embodiment of the present invention implements a method for determining a three-dimensional candidate area of a vehicle based on a point cloud. First, multiple point clouds in a road scene are obtained, and the ground plane in the road scene is determined by using the multiple point clouds. Subsequently, according to the preset vehicle size, multiple three-dimensional regions are generated on the ground plane, and then the first geometry containing multiple point clouds is divided into a set of a specified number of second geometry, and one or more a second geometry. Afterwards, according to one or more second geometric bodies contained in each three-dimensional area, it is determined whether the three-dimensional area is a three-dimensional vehicle candidate area. It can be seen that the embodiment of the present invention utilizes the prior knowledge that the vehicle is located near the ground level, and at the same time utilizes the template of the known vehicle size, which greatly reduces the number of three-dimensional areas to be searched, improves the search efficiency, and satisfies the real-time requirements in practical applications. requirements. Moreover, since each second geometric body contains at least one point cloud in the road scene, the embodiment of the present invention determines whether the three-dimensional area is a three-dimensional vehicle candidate area based on one or more second geometric bodies contained in each three-dimensional area, ensuring three-dimensional Region recall.
上文步骤S102中获取道路场景中的多个点云,本发明实施例提供了多种可选的方案,例如,根据激光测量原理采集道路场景中的多个点云,可以采集到点云的三维坐标(XYZ)和激光反射强度(Intensity);或者根据摄影测量原理获取道路场景中的多个点云,可以采集到点云的三维坐标(XYZ)和颜色信息(RGB);或者,还可以结合激光测量和摄影测量原理得到点云,可以获得点云的三维坐标(XYZ)、激光反射强度(Intensity)和颜色信息(RGB)。The multiple point clouds in the road scene are acquired in step S102 above. The embodiment of the present invention provides a variety of optional solutions. For example, according to the principle of laser measurement, multiple point clouds in the road scene can be collected, and the Three-dimensional coordinates (XYZ) and laser reflection intensity (Intensity); or according to the principle of photogrammetry to obtain multiple point clouds in the road scene, the three-dimensional coordinates (XYZ) and color information (RGB) of the point cloud can be collected; or, you can also The point cloud is obtained by combining the principles of laser measurement and photogrammetry, and the three-dimensional coordinates (XYZ), laser reflection intensity (Intensity) and color information (RGB) of the point cloud can be obtained.
首先,以激光测量原理为例,可以采用三维激光雷达采集点云。三维激光雷达是智能车辆获取外部信息的重要传感器之一,具有可靠性和实时性强,精确性高等优点,因此被广泛地应用在智能车环境感知研究中。雷达具有多个激光传感器,每个传感器测量离散数据点可表示为Pi(x,y,z,s),x,y,z分别表示三维物理距离,单位为米,s表示反射强度,为无量纲值。而点云数据则是大规模的离散测量点数据的集合{P1,P2,P3,...,PN},它们为还原型测量对象的基本形状特征和结构细节提供了充足的信息。First, taking the principle of laser measurement as an example, 3D lidar can be used to collect point clouds. Three-dimensional lidar is one of the important sensors for intelligent vehicles to obtain external information. It has the advantages of high reliability, real-time performance and high accuracy, so it is widely used in the research of intelligent vehicle environment perception. The radar has multiple laser sensors, and the discrete data points measured by each sensor can be expressed as Pi(x, y, z, s), where x, y, and z represent three-dimensional physical distances in meters, and s represents the reflection intensity, which is infinite Outline value. The point cloud data is a collection of large-scale discrete measurement point data {P1, P2, P3,..., PN}, which provide sufficient information for restoring the basic shape characteristics and structural details of the measurement object.
其次,以摄影测量原理为例,可以采用双目相机采集点云。将两个相机放置于同一平面对目标物体进行拍摄,得到许多组对应的物体图像对,由于相机与物体是符合三角测量原理的,同时采用对应点的视差来计算物体的立体信息,从而获得物体的三维点云数据。Secondly, taking the principle of photogrammetry as an example, binocular cameras can be used to collect point clouds. Place two cameras on the same plane to shoot the target object, and get many sets of corresponding object image pairs. Since the camera and the object conform to the principle of triangulation, and use the parallax of the corresponding points to calculate the stereoscopic information of the object, so as to obtain the object 3D point cloud data.
在本发明的可选实施例中,上文步骤S102中利用多个点云确定道路场景中的地平面,可以通过RANSAC(RANdom Sample Consensus,随机抽样一致性)算法,确定多个点云中属于道路场景中的地平面的点云。In an optional embodiment of the present invention, in step S102 above, multiple point clouds are used to determine the ground plane in the road scene, and the RANSAC (RANdom Sample Consensus, random sampling consistency) algorithm can be used to determine which of the multiple point clouds belongs to A point cloud of the ground plane in a road scene.
RANSAC可以从一组包含“局外点”的观测数据集中,通过迭代方式估计数学模型的参数。它是一种不确定的算法,它有一定的概率得出一个合理的结果。RANSAC的基本假设是:RANSAC can iteratively estimate the parameters of a mathematical model from a set of observation data sets containing "outlier points". It is an indeterminate algorithm that has a certain probability of producing a reasonable result. The basic assumptions of RANSAC are:
(1)数据由“局内点”组成,例如:数据的分布可以用一些模型参数来解释;(1) The data consists of "inside points", for example: the distribution of data can be explained by some model parameters;
(2)“局外点”是不能适应该模型的数据;(2) "Outlier points" are data that cannot adapt to the model;
(3)除此之外的数据属于噪声。(3) Data other than this is noise.
局外点产生的原因有:噪声的极值,错误的测量方法,对数据的错误假设。RANSAC也做了以下假设:给定一组(通常很小的)局内点,存在一个可以估计模型参数的过程,而该模型能够解释或者适用于局内点。The reasons for outliers are: noise extremes, wrong measurement methods, and wrong assumptions about the data. RANSAC also makes the following assumption: given a set of (usually small) inlier points, there is a process that can estimate the parameters of a model that can explain or be applicable to the inlier points.
RANSAC算法的输入是一组观测数据,一个可以解释或者适应于观测数据的参数化模型,一些可信的参数。RANSAC通过反复选择数据中的一组随机子集来达成目标。被选取的子集被假设为局内点,并用下述方法进行验证:The input of the RANSAC algorithm is a set of observation data, a parametric model that can explain or adapt to the observation data, and some credible parameters. RANSAC achieves its goal by iteratively selecting a set of random subsets in the data. The selected subsets are assumed to be interior points and verified by the following method:
1)有一个模型适应于假设的局内点,即所有的未知参数都能从假设的局内点计算得出;1) There is a model adapted to the hypothetical interior point, that is, all unknown parameters can be calculated from the hypothetical interior point;
2)用1)中得到的模型去测试所有的其它数据,如果某个点适用于估计的模型,认为它也是局内点;2) Use the model obtained in 1) to test all other data, and if a certain point is suitable for the estimated model, consider it to be an internal point;
3)如果有足够多的点被归类为假设的局内点,那么估计的模型就足够合理;3) If enough points are classified as hypothetical inliers, then the estimated model is reasonable enough;
4)然后,用所有假设的局内点去重新估计模型,因为它仅仅被初始的假设局内点估计过;4) Then, re-estimate the model with all hypothetical inlier points, because it is only estimated by the initial hypothetical inlier points;
5)最后,通过估计局内点与模型的错误率来评估模型。5) Finally, the model is evaluated by estimating the error rate of the inlier points and the model.
这个过程被重复执行固定的次数,每次产生的模型要么因为局内点太少而被舍弃,要么因为比现有的模型更好而被选用。This process is repeated a fixed number of times, and each time the resulting model is either discarded due to too few inliers, or selected because it is better than the existing model.
在本发明实施例中,输入的点云数据中有大量的点云属于地平面,通过RANSAC算法可以较为鲁棒地估计出地平面。地平面π=(a,b,c,d)T通过四维向量的参数化表示,其参考坐标系为以传感器为中心的观测坐标系。In the embodiment of the present invention, a large number of point clouds in the input point cloud data belong to the ground plane, and the ground plane can be estimated relatively robustly through the RANSAC algorithm. The ground plane π=(a,b,c,d) T is expressed parametrically by a four-dimensional vector, and its reference coordinate system is the observation coordinate system centered on the sensor.
上文步骤S104中根据预置的车辆尺寸,在地平面上生成多个三维区域,本发明实施例提供了一种可选的方案,在该方案中,可以根据预置的车辆尺寸,在地平面随机生成多个三维区域,其中,三维区域通过指定参数确定。这里的指定参数可以是车辆中心的三维坐标、车辆尺寸、车辆在地平面上的朝向角度,等等,本发明不限于此。In step S104 above, multiple three-dimensional areas are generated on the ground plane according to the preset vehicle size. The embodiment of the present invention provides an optional solution. In this solution, according to the preset vehicle size, The plane randomly generates multiple 3D regions, where the 3D regions are determined by specifying parameters. The specified parameters here may be the three-dimensional coordinates of the center of the vehicle, the size of the vehicle, the orientation angle of the vehicle on the ground plane, etc., and the present invention is not limited thereto.
具体地,在自然车道场景下,假设车辆均位于路面(即,地平面)附近(不考虑悬挂车辆等极端情况),则根据已知的车型输入车辆的尺寸模板(长、宽、高),在路面附近做轻微扰动,同时遍历车辆模板可能的朝向角度,即可以得到M个可能的三维区域,这些三维区域可以通过7个参数(x,y,z,l,w,h,θ)来确定,其中(x,y,z)代表车辆中心的三维坐标;(l,w,h)为车辆的长、宽、高模板;θ代表车辆在水平面上的朝向角度。Specifically, in the natural lane scenario, assuming that the vehicles are all located near the road surface (that is, the ground level) (regardless of extreme cases such as suspended vehicles), the size template (length, width, height) of the vehicle is input according to the known vehicle type, Make a slight disturbance near the road surface and traverse the possible orientation angles of the vehicle template at the same time, that is, M possible three-dimensional areas can be obtained. These three-dimensional areas can be determined by seven parameters (x, y, z, l, w, h, θ) Determine, where (x, y, z) represents the three-dimensional coordinates of the vehicle center; (l, w, h) are the length, width, and height templates of the vehicle; θ represents the orientation angle of the vehicle on the horizontal plane.
在本发明的可选实施例中,上文步骤S106中将包含多个点云的第一几何体划分为指定数量的第二几何体的集合,本发明提供了一种可选的方案,即,将包含多个点云的长方体按照固定间隔离散化,划分为指定数量的立方体的集合。具体地,将包含所有输入三维点云的长方体按照固定间隔离散化,划分为若干个小立方体的集合,则对于上文得到的M个三维区域,每个三维区域将对应为该区域内若干个小立方体的集合。这里,指定数量可以根据实际需求进行设置,例如,若需要划分更小的立方体则设置较大的指定数量。In an optional embodiment of the present invention, in step S106 above, the first geometric body containing multiple point clouds is divided into a set of a specified number of second geometric bodies. The present invention provides an optional solution, that is, the A cuboid containing multiple point clouds is discretized according to a fixed interval, divided into a set of the specified number of cubes. Specifically, divide the cuboid containing all input 3D point clouds into a set of several small cubes according to the fixed interval discretization, then for the M 3D regions obtained above, each 3D region will correspond to several Collection of small cubes. Here, the designated number can be set according to actual needs, for example, if it is necessary to divide smaller cubes, a larger designated number is set.
在步骤S106中确定各个三维区域包含的一个或多个第二几何体后,由于各个第二几何体包含道路场景中的至少一个点云,因而,步骤S108可以根据各个三维区域包含的一个或多个第二几何体来确定各个三维区域的特征,进而可以根据各个三维区域的特征来确定该三维区域是否为三维车辆备选区域。这里的三维区域的特征可以是三维区域内所包含的点云数量、点云平均高度、点云数目上下左右的比例等等,本发明不限于此。在本发明的可选实施例中,可以利用三维积分图来计算每个三维区域的特征,计算复杂度为O(1),节约了计算量,可以快速计算大量三维区域的特征。After determining one or more second geometric bodies contained in each three-dimensional area in step S106, since each second geometric body contains at least one point cloud in the road scene, step S108 may be based on the one or more second geometric bodies contained in each three-dimensional area According to the characteristics of each three-dimensional area, it can be determined whether the three-dimensional area is a three-dimensional vehicle candidate area according to the characteristics of each three-dimensional area. The characteristics of the three-dimensional area here may be the number of point clouds contained in the three-dimensional area, the average height of the point cloud, the ratio of the number of point clouds, up, down, left, and right, etc., and the present invention is not limited thereto. In an optional embodiment of the present invention, the feature of each three-dimensional area can be calculated by using the three-dimensional integral map, and the calculation complexity is O(1), which saves the amount of calculation and can quickly calculate the features of a large number of three-dimensional areas.
进一步地,步骤S108可以根据三维区域内所包含的点云数量来确定该三维区域是否为三维车辆备选区域;或者根据三维区域内所包含的点云平均高度来确定该三维区域是否为三维车辆备选区域;或者结合三维区域内所包含的点云数量和点云平均高度来确定该三维区域是否为三维车辆备选区域。这里,可以按照指定的权重对各个三维区域包含的点云数量和点云平均高度求和加权,得到各个三维区域的综合评分值,随后根据各个三维区域的综合评分值,确定该三维区域是否为三维车辆备选区域。Further, step S108 can determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to the number of point clouds contained in the three-dimensional area; or determine whether the three-dimensional area is a three-dimensional vehicle according to the average height of point clouds contained in the three-dimensional area Candidate area; or determine whether the three-dimensional area is a three-dimensional vehicle candidate area by combining the number of point clouds contained in the three-dimensional area and the average height of the point cloud. Here, the number of point clouds contained in each three-dimensional area and the average height of the point cloud can be summed and weighted according to the specified weight to obtain the comprehensive score value of each three-dimensional area, and then according to the comprehensive score value of each three-dimensional area, determine whether the three-dimensional area is 3D vehicle candidate regions.
在本发明的可选实施例中,可以将各个三维区域的综合评分值从大到小进行排序,选取排序靠前的指定数量的三维区域作为三维车辆备选区域。In an optional embodiment of the present invention, the comprehensive score values of each three-dimensional area may be sorted from large to small, and a specified number of three-dimensional areas ranked higher are selected as three-dimensional vehicle candidate areas.
下面通过一具体实施例来详细介绍本发明的三维车辆备选区域的确定方法的实现过程。在该实施例中,首先通过车载的激光雷达或者双目相机等传感器,能够获取到道路场景的密集点云信息。点云可以视为一系列三维坐标的集合。如图2所示,该方法至少可以包括以下步骤S202至步骤S208。The implementation process of the method for determining a three-dimensional vehicle candidate area of the present invention will be described in detail below through a specific embodiment. In this embodiment, firstly, the dense point cloud information of the road scene can be obtained through sensors such as a vehicle-mounted lidar or a binocular camera. A point cloud can be viewed as a collection of 3D coordinates. As shown in FIG. 2, the method may at least include the following steps S202 to S208.
步骤S202,RANSAC算法寻找地平面。In step S202, the RANSAC algorithm searches for the ground plane.
在该步骤中,输入的点云数据中有大量的点属于地平面,通过RANSAC算法可以较为鲁棒地估计出地平面。地平面π=(a,b,c,d)T通过四维向量的参数化表示,其参考坐标系为以传感器为中心的观测坐标系。In this step, a large number of points in the input point cloud data belong to the ground plane, and the ground plane can be estimated more robustly through the RANSAC algorithm. The ground plane π=(a,b,c,d) T is expressed parametrically by a four-dimensional vector, and its reference coordinate system is the observation coordinate system centered on the sensor.
步骤S204,在地平面附近按照车辆模板随机生成三维区域。Step S204, randomly generating a three-dimensional area near the ground plane according to the vehicle template.
在自然车道场景下,假设车辆均位于路面(即,地平面)附近(不考虑悬挂车辆等极端情况),则根据已知的车型输入车辆的尺寸模板(长、宽、高),在路面附近做轻微扰动,同时遍历车辆模板可能的朝向角度,即可以得到M个可能的三维区域,这些三维区域可以通过7个参数(x,y,z,l,w,h,θ)来确定,其中(x,y,z)代表车辆中心的三维坐标;(l,w,h)为车辆的长、宽、高模板;θ代表车辆在水平面上的朝向角度。In the natural lane scenario, assuming that the vehicles are all located near the road surface (that is, the ground level) (regardless of extreme cases such as suspended vehicles), the size template (length, width, height) of the vehicle is input according to the known vehicle type, and the vehicle near the road surface Doing a slight disturbance and traversing the possible orientation angles of the vehicle template at the same time can obtain M possible three-dimensional areas, which can be determined by seven parameters (x, y, z, l, w, h, θ), where (x, y, z) represent the three-dimensional coordinates of the vehicle center; (l, w, h) are the length, width, and height templates of the vehicle; θ represents the orientation angle of the vehicle on the horizontal plane.
步骤S206,三维空间离散化并求取各个三维区域的特征。In step S206, the three-dimensional space is discretized and the characteristics of each three-dimensional area are obtained.
在该步骤中,将包含所有输入三维点云的长方体按照固定间隔离散化,划分为若干个小立方体的集合,则对于步骤S204得到的M个三维区域,每个三维区域将对应为该区域内若干个小立方体的集合。利用三维积分图,可以快速求得每个三维区域内所包含的点云数目和点云平均高度,点云数目和点云平均高度作为该三维区域的特征。在本发明的其他实施例中,还可以利用三维积分图计算三维区域的其他特征,如点云数目上下左右的比例等等,本发明不限于此。In this step, the cuboid containing all input 3D point clouds is discretized according to a fixed interval and divided into a set of several small cubes, then for the M 3D regions obtained in step S204, each 3D region will correspond to the A collection of several small cubes. Using the three-dimensional integral map, the number of point clouds and the average height of point clouds contained in each three-dimensional area can be quickly obtained, and the number of point clouds and the average height of point cloud can be used as the characteristics of the three-dimensional area. In other embodiments of the present invention, other features of the three-dimensional area can also be calculated using the three-dimensional integral map, such as the ratio of the number of point clouds, up, down, left, and right, etc., and the present invention is not limited thereto.
步骤S208,将特征线性组合得到三维区域评分,排序得到三维车辆备选区域。Step S208, combining the features linearly to obtain the 3D area score, and sorting to obtain the 3D vehicle candidate area.
在该步骤中,按照一定的权重对每个三维区域的点云数目和点云平均高度求加权和,得到的结果作为该三维区域的评分,将M个三维区域按照评分从大到小排序,取前N个作为最后算法输出的三维车辆备选区域。In this step, the number of point clouds and the average height of point clouds in each three-dimensional area are weighted and summed according to a certain weight, and the obtained result is used as the score of the three-dimensional area, and the M three-dimensional areas are sorted according to the scores from large to small, Take the first N three-dimensional vehicle candidate areas as the final algorithm output.
本发明实施例利用车辆位于地平面附近的先验知识,同时利用已知车辆尺寸的模板,大幅减少了待搜索的三维区域的数目,提高了搜索效率,满足实际应用中实时性的要求。并且,由于各个第二几何体包含道路场景中的至少一个点云,本发明实施例基于各个三维区域包含的一个或多个第二几何体,确定该三维区域是否为三维车辆备选区域,确保了三维区域的召回率。此外,本发明实施例在计算每个三维区域的特征时,利用三维积分图,计算复杂度为O(1),节约了计算量,可以快速计算大量三维区域的特征。The embodiment of the present invention utilizes the prior knowledge that the vehicle is located near the ground level and the template of the known vehicle size, which greatly reduces the number of three-dimensional areas to be searched, improves the search efficiency, and meets the real-time requirements in practical applications. Moreover, since each second geometric body contains at least one point cloud in the road scene, the embodiment of the present invention determines whether the three-dimensional area is a three-dimensional vehicle candidate area based on one or more second geometric bodies contained in each three-dimensional area, ensuring three-dimensional Region recall. In addition, in the embodiment of the present invention, when calculating the features of each three-dimensional area, the three-dimensional integral graph is used, and the calculation complexity is O(1), which saves the amount of calculation and can quickly calculate the features of a large number of three-dimensional areas.
在本发明的可选实施例中,在行车的过程中,可以根据确定出的三维车辆备选区域,识别行车相关信息,进而对识别出的行车相关信息进行分析以生成相应的行车导航提示信息,并提供给用户。这里,行车相关信息可以包括前车和/或后车与本车的距离、行车路况标识信息、道路环境信息,等等,本发明不限于此。具体地,行车路况标识信息,例如,行车路况的行车限速标识信息、限高标识信息、指路标识信息、指示标识信息、道路施工安全标识信息、禁令标识信息和警告标识信息等。道路环境信息,例如,道路周边建筑信息和道路周边的施工信息等。In an optional embodiment of the present invention, during the driving process, the driving-related information can be identified according to the determined three-dimensional vehicle candidate area, and then the identified driving-related information can be analyzed to generate corresponding driving navigation prompt information , and provide it to the user. Here, the driving-related information may include the distance between the preceding vehicle and/or the following vehicle and the own vehicle, driving road condition identification information, road environment information, etc., and the present invention is not limited thereto. Specifically, the road condition identification information, for example, speed limit identification information, height limit identification information, road guidance identification information, instruction identification information, road construction safety identification information, prohibition identification information, warning identification information, etc. of the driving road conditions. Road environment information, for example, building information around the road and construction information around the road.
在本发明的可选实施例中,若识别出的前车与本车的距离小于预定的安全行驶距离阈值时,生成相应的行车导航提示信息,如告警信息等,以告知用户。若识别出的后车与本车的距离小于预定的安全行驶距离阈值时,生成相应的行车导航提示信息,如告警信息等,以告知用户。在实际应用中,可以在显示屏幕中将行车相关信息及行车导航提示信息相关联地高亮显示,并通过语音播放的方式输出行车导航提示信息。In an optional embodiment of the present invention, if the recognized distance between the preceding vehicle and the own vehicle is less than a predetermined safe driving distance threshold, corresponding driving navigation prompt information, such as warning information, is generated to inform the user. If the identified distance between the vehicle behind and the own vehicle is less than the predetermined safe driving distance threshold, corresponding driving navigation prompt information, such as warning information, is generated to inform the user. In practical applications, the driving-related information and driving navigation prompt information can be highlighted in association on the display screen, and the driving navigation prompt information can be output through voice playback.
此外,在识别出前车和/或后车与本车的距离后,除了生成行车导航提示信息之外,还可以实时调整本车的车速。例如,若识别出的前车与本车的距离小于预定的安全行驶距离阈值时,则尽快降低车速,以免与前车发生碰撞。In addition, after identifying the distance between the vehicle in front and/or the vehicle behind and the own vehicle, in addition to generating driving navigation prompt information, the speed of the own vehicle can also be adjusted in real time. For example, if the recognized distance between the vehicle in front and the vehicle in front is less than the predetermined safe driving distance threshold, the vehicle speed will be reduced as soon as possible to avoid collision with the vehicle in front.
在本发明的可选实施例中,还可以根据确定出的三维车辆备选区域来统计分析前车或后车的行驶速度等信息,以便本车进行自适应巡航。In an optional embodiment of the present invention, information such as the driving speed of the vehicle in front or behind can also be statistically analyzed according to the determined three-dimensional vehicle candidate area, so that the vehicle can perform adaptive cruise.
在本发明的可选实施例中,上文提及的方法可以应用在车载的智能控制单元中。In an optional embodiment of the present invention, the method mentioned above can be applied in a vehicle-mounted intelligent control unit.
需要说明的是,在实际应用中,上述所有可选实施方式可以采用结合的方式任意组合,形成本发明的可选实施例,在此不再一一赘述。It should be noted that, in practical applications, all the above optional implementation manners may be combined arbitrarily in combination to form optional embodiments of the present invention, which will not be repeated here.
基于上文各个实施例提供的三维车辆备选区域的确定方法,基于同一发明构思,本发明实施例还提供了一种三维车辆备选区域的确定装置。Based on the method for determining a three-dimensional vehicle candidate area provided in the above embodiments, and based on the same inventive concept, an embodiment of the present invention also provides a device for determining a three-dimensional vehicle candidate area.
图3示出了根据本发明一个实施例的三维车辆备选区域的确定装置的结构示意图。如图3所示,该装置至少可以包括点云获取模块310、地平面确定模块320、三维区域生成模块330、几何体确定模块340以及备选区域确定模块350。Fig. 3 shows a schematic structural diagram of an apparatus for determining a three-dimensional vehicle candidate area according to an embodiment of the present invention. As shown in FIG. 3 , the device may at least include a point cloud acquisition module 310 , a ground plane determination module 320 , a three-dimensional area generation module 330 , a geometry determination module 340 and a candidate area determination module 350 .
现介绍本发明实施例的三维车辆备选区域的确定装置的各组成或器件的功能以及各部分间的连接关系:The function of each component or device and the connection relationship between the various parts of the device for determining the three-dimensional vehicle candidate area in the embodiment of the present invention are now introduced:
点云获取模块310,适于获取道路场景中的多个点云;The point cloud acquisition module 310 is adapted to acquire multiple point clouds in the road scene;
地平面确定模块320,与点云获取模块310相耦合,适于利用所述多个点云确定所述道路场景中的地平面;The ground plane determination module 320, coupled with the point cloud acquisition module 310, is adapted to use the multiple point clouds to determine the ground plane in the road scene;
三维区域生成模块330,与地平面确定模块320相耦合,适于根据预置的车辆尺寸,在所述地平面上生成多个三维区域;The three-dimensional area generation module 330, coupled with the ground plane determination module 320, is adapted to generate multiple three-dimensional areas on the ground plane according to the preset vehicle size;
几何体确定模块340,与三维区域生成模块330相耦合,适于将包含所述多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个所述第二几何体;The geometry determination module 340, coupled with the three-dimensional region generation module 330, is adapted to divide the first geometry containing the plurality of point clouds into a set of a specified number of second geometry, and determine one or more of the three-dimensional regions contained in each Describe the second geometry;
备选区域确定模块350,与几何体确定模块340相耦合,适于根据所述各个三维区域包含的一个或多个所述第二几何体,确定该三维区域是否为三维车辆备选区域。The candidate area determination module 350 is coupled with the geometry determination module 340 and is adapted to determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to one or more second geometric bodies included in each three-dimensional area.
在本发明一实施例中,点云获取模块310获取道路场景中的多个点云,本发明实施例提供了多种可选的方案,例如,根据激光测量原理采集道路场景中的多个点云,可以采集到点云的三维坐标(XYZ)和激光反射强度(Intensity);或者根据摄影测量原理获取道路场景中的多个点云,可以采集到点云的三维坐标(XYZ)和颜色信息(RGB);或者,还可以结合激光测量和摄影测量原理得到点云,可以获得点云的三维坐标(XYZ)、激光反射强度(Intensity)和颜色信息(RGB)。In an embodiment of the present invention, the point cloud acquisition module 310 acquires multiple point clouds in the road scene, and this embodiment of the present invention provides a variety of optional solutions, for example, collecting multiple points in the road scene according to the principle of laser measurement Cloud, which can collect the three-dimensional coordinates (XYZ) and laser reflection intensity (Intensity) of the point cloud; or obtain multiple point clouds in the road scene according to the principle of photogrammetry, and can collect the three-dimensional coordinates (XYZ) and color information of the point cloud (RGB); or, the point cloud can also be obtained by combining the principles of laser measurement and photogrammetry, and the three-dimensional coordinates (XYZ), laser reflection intensity (Intensity) and color information (RGB) of the point cloud can be obtained.
首先,以激光测量原理为例,点云获取模块310可以采用三维激光雷达采集点云。三维激光雷达是智能车辆获取外部信息的重要传感器之一,具有可靠性和实时性强,精确性高等优点,因此被广泛地应用在智能车环境感知研究中。雷达具有多个激光传感器,每个传感器测量离散数据点可表示为Pi(x,y,z,s),x,y,z分别表示三维物理距离,单位为米,s表示反射强度,为无量纲值。而点云数据则是大规模的离散测量点数据的集合{P1,P2,P3,...,PN},它们为还原型测量对象的基本形状特征和结构细节提供了充足的信息。First, taking the principle of laser measurement as an example, the point cloud acquisition module 310 may use a three-dimensional laser radar to collect point clouds. Three-dimensional lidar is one of the important sensors for intelligent vehicles to obtain external information. It has the advantages of high reliability, real-time performance and high accuracy, so it is widely used in the research of intelligent vehicle environment perception. The radar has multiple laser sensors, and the discrete data points measured by each sensor can be expressed as Pi(x, y, z, s), where x, y, and z represent three-dimensional physical distances in meters, and s represents the reflection intensity, which is infinite Outline value. The point cloud data is a collection of large-scale discrete measurement point data {P1, P2, P3,..., PN}, which provide sufficient information for restoring the basic shape characteristics and structural details of the measurement object.
其次,以摄影测量原理为例,点云获取模块310可以采用双目相机采集点云。将两个相机放置于同一平面对目标物体进行拍摄,得到许多组对应的物体图像对,由于相机与物体是符合三角测量原理的,同时采用对应点的视差来计算物体的立体信息,从而获得物体的三维点云数据。Secondly, taking the principle of photogrammetry as an example, the point cloud acquisition module 310 may use binocular cameras to collect point clouds. Place two cameras on the same plane to shoot the target object, and get many sets of corresponding object image pairs. Since the camera and the object conform to the principle of triangulation, and use the parallax of the corresponding points to calculate the stereoscopic information of the object, so as to obtain the object 3D point cloud data.
在本发明一实施例中,地平面确定模块320利用多个点云确定道路场景中的地平面时,可以通过RANSAC算法,确定多个点云中属于道路场景中的地平面的点云。关于RANSAC算法的详细介绍可以参见前文,此处不再赘述。In an embodiment of the present invention, when the ground plane determining module 320 uses multiple point clouds to determine the ground plane in the road scene, it may use the RANSAC algorithm to determine the point cloud belonging to the ground plane in the road scene among the multiple point clouds. For a detailed introduction to the RANSAC algorithm, please refer to the previous article, and will not repeat it here.
在本发明实施例中,输入的点云数据中有大量的点云属于地平面,地平面确定模块320通过RANSAC算法可以较为鲁棒地估计出地平面。地平面π=(a,b,c,d)T通过四维向量的参数化表示,其参考坐标系为以传感器为中心的观测坐标系。In the embodiment of the present invention, a large number of point clouds in the input point cloud data belong to the ground plane, and the ground plane determining module 320 can estimate the ground plane relatively robustly through the RANSAC algorithm. The ground plane π=(a,b,c,d) T is expressed parametrically by a four-dimensional vector, and its reference coordinate system is the observation coordinate system centered on the sensor.
在本发明一实施例中,三维区域生成模块330根据预置的车辆尺寸,在地平面上生成多个三维区域,本发明实施例提供了一种可选的方案,在该方案中,可以根据预置的车辆尺寸,在地平面随机生成多个三维区域,其中,三维区域通过指定参数确定。这里的指定参数可以是车辆中心的三维坐标、车辆尺寸、车辆在地平面上的朝向角度,等等,本发明不限于此。In an embodiment of the present invention, the three-dimensional area generating module 330 generates multiple three-dimensional areas on the ground plane according to the preset vehicle size. This embodiment of the present invention provides an optional solution, in which, it can be based on The preset vehicle size randomly generates multiple three-dimensional areas on the ground plane, where the three-dimensional areas are determined by specifying parameters. The specified parameters here may be the three-dimensional coordinates of the center of the vehicle, the size of the vehicle, the orientation angle of the vehicle on the ground plane, etc., and the present invention is not limited thereto.
具体地,在自然车道场景下,假设车辆均位于路面(即,地平面)附近(不考虑悬挂车辆等极端情况),则三维区域生成模块330根据已知的车型输入车辆的尺寸模板(长、宽、高),在路面附近做轻微扰动,同时遍历车辆模板可能的朝向角度,即可以得到M个可能的三维区域,这些三维区域可以通过7个参数(x,y,z,l,w,h,θ)来确定,其中(x,y,z)代表车辆中心的三维坐标;(l,w,h)为车辆的长、宽、高模板;θ代表车辆在水平面上的朝向角度。Specifically, in the natural lane scenario, assuming that the vehicles are all located near the road surface (i.e., the ground level) (without considering extreme cases such as suspended vehicles), the 3D area generation module 330 inputs the size template of the vehicle according to the known vehicle type (length, Width, height), make a slight disturbance near the road surface, and traverse the possible orientation angles of the vehicle template at the same time, that is, M possible three-dimensional areas can be obtained. These three-dimensional areas can be passed through 7 parameters (x, y, z, l, w, h, θ), where (x, y, z) represents the three-dimensional coordinates of the vehicle center; (l, w, h) are the length, width, and height templates of the vehicle; θ represents the orientation angle of the vehicle on the horizontal plane.
在本发明一实施例中,几何体确定模块340将包含多个点云的第一几何体划分为指定数量的第二几何体的集合,本发明提供了一种可选的方案,即,将包含多个点云的长方体按照固定间隔离散化,划分为指定数量的立方体的集合。具体地,将包含所有输入三维点云的长方体按照固定间隔离散化,划分为若干个小立方体的集合,则对于上文得到的M个三维区域,每个三维区域将对应为该区域内若干个小立方体的集合。这里,指定数量可以根据实际需求进行设置,例如,若需要划分更小的立方体则设置较大的指定数量。In an embodiment of the present invention, the geometry determination module 340 divides the first geometry containing multiple point clouds into a set of a specified number of second geometry. The cuboid of the point cloud is discretized according to a fixed interval and divided into a set of specified number of cubes. Specifically, divide the cuboid containing all input 3D point clouds into a set of several small cubes according to the fixed interval discretization, then for the M 3D regions obtained above, each 3D region will correspond to several Collection of small cubes. Here, the designated number can be set according to actual needs, for example, if it is necessary to divide smaller cubes, a larger designated number is set.
在本发明一实施例中,备选区域确定模块350可以根据各个三维区域包含的一个或多个第二几何体来确定各个三维区域的特征,进而可以根据各个三维区域的特征来确定该三维区域是否为三维车辆备选区域。这里的三维区域的特征可以是三维区域内所包含的点云数量、点云平均高度、点云数目上下左右的比例等等,本发明不限于此。在本发明的可选实施例中,可以利用三维积分图来计算每个三维区域的特征,计算复杂度为O(1),节约了计算量,可以快速计算大量三维区域的特征。In an embodiment of the present invention, the candidate area determination module 350 can determine the characteristics of each three-dimensional area according to one or more second geometric bodies contained in each three-dimensional area, and then can determine whether the three-dimensional area is based on the characteristics of each three-dimensional area Alternate regions for 3D vehicles. The characteristics of the three-dimensional area here may be the number of point clouds contained in the three-dimensional area, the average height of the point cloud, the ratio of the number of point clouds, up, down, left, and right, etc., and the present invention is not limited thereto. In an optional embodiment of the present invention, the feature of each three-dimensional area can be calculated by using the three-dimensional integral map, and the calculation complexity is O(1), which saves the amount of calculation and can quickly calculate the features of a large number of three-dimensional areas.
在本发明一实施例中,如图4所示,上述备选区域确定模块350可以包括:In an embodiment of the present invention, as shown in FIG. 4, the above-mentioned candidate area determination module 350 may include:
计算单元410,适于根据所述各个三维区域包含的一个或多个所述第二几何体,利用三维积分图计算所述各个三维区域包含的点云数量和/或点云平均高度;The calculation unit 410 is adapted to calculate the number of point clouds and/or the average height of point clouds contained in each three-dimensional area by using a three-dimensional integral graph according to the one or more second geometric bodies contained in each three-dimensional area;
确定单元420,与计算单元410相耦合,适于根据所述各个三维区域包含的点云数量和/或点云平均高度,确定该三维区域是否为三维车辆备选区域。The determination unit 420, coupled with the calculation unit 410, is adapted to determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to the number of point clouds contained in each three-dimensional area and/or the average height of the point cloud.
在本发明一实施例中,确定单元420还适于:In an embodiment of the present invention, the determining unit 420 is further adapted to:
按照指定的权重对所述各个三维区域包含的点云数量和点云平均高度求和加权,得到所述各个三维区域的综合评分值;According to the specified weight, the number of point clouds contained in each three-dimensional area and the average height of the point cloud are summed and weighted to obtain the comprehensive score value of each three-dimensional area;
根据所述各个三维区域的综合评分值,确定该三维区域是否为三维车辆备选区域。According to the comprehensive score value of each three-dimensional area, it is determined whether the three-dimensional area is a three-dimensional vehicle candidate area.
在本发明一实施例中,确定单元420还适于:In an embodiment of the present invention, the determining unit 420 is further adapted to:
将所述各个三维区域的综合评分值从大到小进行排序;Sorting the comprehensive scoring values of the various three-dimensional regions from large to small;
选取排序靠前的指定数量的三维区域作为三维车辆备选区域。Select the specified number of 3D areas ranked first as the 3D vehicle candidate areas.
在本发明一实施例中,如图4所示,上文图3展示的装置还可以包括:In an embodiment of the present invention, as shown in FIG. 4, the device shown in FIG. 3 above may further include:
行车导航提示信息生成模块360,与备选区域确定模块350相耦合,适于在行车的过程中,根据确定出的所述三维车辆备选区域,识别行车相关信息;对识别出的行车相关信息进行分析以生成相应的行车导航提示信息,并提供给用户。The driving navigation prompt information generation module 360 is coupled with the candidate area determination module 350, and is suitable for identifying driving-related information according to the determined three-dimensional vehicle candidate areas during driving; for the identified driving-related information Perform analysis to generate corresponding driving navigation prompt information and provide it to users.
在本发明一实施例中,行车相关信息可以包括前车和/或后车与本车的距离、行车路况标识信息、道路环境信息,等等,本发明不限于此。具体地,行车路况标识信息,例如,行车路况的行车限速标识信息、限高标识信息、指路标识信息、指示标识信息、道路施工安全标识信息、禁令标识信息和警告标识信息等。道路环境信息,例如,道路周边建筑信息和道路周边的施工信息等。In an embodiment of the present invention, the driving-related information may include the distance between the preceding vehicle and/or the following vehicle and the own vehicle, driving road condition identification information, road environment information, etc., and the present invention is not limited thereto. Specifically, the road condition identification information, for example, speed limit identification information, height limit identification information, road guidance identification information, instruction identification information, road construction safety identification information, prohibition identification information, warning identification information, etc. of the driving road conditions. Road environment information, for example, building information around the road and construction information around the road.
在本发明一实施例中,若识别出的前车与本车的距离小于预定的安全行驶距离阈值时,行车导航提示信息生成模块360生成相应的行车导航提示信息,如告警信息等,以告知用户。若识别出的后车与本车的距离小于预定的安全行驶距离阈值时,生成相应的行车导航提示信息,如告警信息等,以告知用户。在实际应用中,可以在显示屏幕中将行车相关信息及行车导航提示信息相关联地高亮显示,并通过语音播放的方式输出行车导航提示信息。In an embodiment of the present invention, if the identified distance between the vehicle in front and the vehicle is less than the predetermined safe driving distance threshold, the driving navigation prompt information generation module 360 generates corresponding driving navigation prompt information, such as warning information, to inform user. If the identified distance between the vehicle behind and the own vehicle is less than the predetermined safe driving distance threshold, corresponding driving navigation prompt information, such as warning information, is generated to inform the user. In practical applications, the driving-related information and driving navigation prompt information can be highlighted in association on the display screen, and the driving navigation prompt information can be output through voice playback.
在本发明一实施例中,在识别出前车和/或后车与本车的距离后,除了生成行车导航提示信息之外,还可以实时调整本车的车速。例如,若识别出的前车与本车的距离小于预定的安全行驶距离阈值时,则尽快降低车速,以免与前车发生碰撞。In an embodiment of the present invention, after recognizing the distance between the preceding vehicle and/or the following vehicle and the own vehicle, in addition to generating driving navigation prompt information, the vehicle speed of the own vehicle can also be adjusted in real time. For example, if the recognized distance between the vehicle in front and the vehicle in front is less than the predetermined safe driving distance threshold, the vehicle speed will be reduced as soon as possible to avoid collision with the vehicle in front.
在本发明的可选实施例中,还可以根据确定出的三维车辆备选区域来统计分析前车或后车的行驶速度等信息,以便本车进行自适应巡航。In an optional embodiment of the present invention, information such as the driving speed of the vehicle in front or behind can also be statistically analyzed according to the determined three-dimensional vehicle candidate area, so that the vehicle can perform adaptive cruise.
在本发明的可选实施例中,上文提及的装置可以应用在车载的智能控制单元中。In an optional embodiment of the present invention, the above-mentioned device can be applied in a vehicle-mounted intelligent control unit.
基于同一发明构思,本发明实施例还提供了一种车载设备,包括上述任一个所述的三维车辆备选区域的确定装置。Based on the same inventive concept, an embodiment of the present invention also provides a vehicle-mounted device, including any one of the devices for determining a three-dimensional vehicle candidate area described above.
根据上述任意一个优选实施例或多个优选实施例的组合,本发明实施例能够达到如下有益效果:According to any one of the above preferred embodiments or a combination of multiple preferred embodiments, the embodiments of the present invention can achieve the following beneficial effects:
本发明实施例提供的技术方案,首先获取道路场景中的多个点云,利用多个点云确定道路场景中的地平面。随后,根据预置的车辆尺寸,在地平面上生成多个三维区域,进而将包含多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个第二几何体。之后,根据各个三维区域包含的一个或多个第二几何体,确定该三维区域是否为三维车辆备选区域。由此可见,本发明实施例利用车辆位于地平面附近的先验知识,同时利用已知车辆尺寸的模板,大幅减少了待搜索的三维区域的数目,提高了搜索效率,满足实际应用中实时性的要求。并且,由于各个第二几何体包含道路场景中的至少一个点云,本发明实施例基于各个三维区域包含的一个或多个第二几何体,确定该三维区域是否为三维车辆备选区域,确保了三维区域的召回率。In the technical solution provided by the embodiments of the present invention, firstly, multiple point clouds in the road scene are obtained, and the ground plane in the road scene is determined by using the multiple point clouds. Subsequently, according to the preset vehicle size, multiple three-dimensional regions are generated on the ground plane, and then the first geometry containing multiple point clouds is divided into a set of a specified number of second geometry, and one or more a second geometry. Afterwards, according to one or more second geometric bodies contained in each three-dimensional area, it is determined whether the three-dimensional area is a three-dimensional vehicle candidate area. It can be seen that the embodiment of the present invention utilizes the prior knowledge that the vehicle is located near the ground level, and at the same time utilizes the template of the known vehicle size, which greatly reduces the number of three-dimensional areas to be searched, improves the search efficiency, and satisfies the real-time requirements in practical applications. requirements. Moreover, since each second geometric body contains at least one point cloud in the road scene, the embodiment of the present invention determines whether the three-dimensional area is a three-dimensional vehicle candidate area based on one or more second geometric bodies contained in each three-dimensional area, ensuring three-dimensional Region recall.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.
类似地,应当理解,为了精简本公开并帮助理解各个发明方面中的一个或多个,在上面对本发明的示例性实施例的描述中,本发明的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本发明的单独实施例。Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.
本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如,在权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.
本发明的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的三维车辆备选区域的确定装置及车载设备中的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) can be used in practice to implement the device for determining a three-dimensional vehicle candidate area and some or all of the components in the vehicle-mounted equipment according to the embodiment of the present invention. Some or all functions. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.
应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.
至此,本领域技术人员应认识到,虽然本文已详尽示出和描述了本发明的多个示例性实施例,但是,在不脱离本发明精神和范围的情况下,仍可根据本发明公开的内容直接确定或推导出符合本发明原理的许多其他变型或修改。因此,本发明的范围应被理解和认定为覆盖了所有这些其他变型或修改。So far, those skilled in the art should appreciate that, although a number of exemplary embodiments of the present invention have been shown and described in detail herein, without departing from the spirit and scope of the present invention, the disclosed embodiments of the present invention can still be used. Many other variations or modifications consistent with the principles of the invention are directly identified or derived from the content. Accordingly, the scope of the present invention should be understood and deemed to cover all such other variations or modifications.
本发明实施例的一方面,提供了A1、一种三维车辆备选区域的确定方法,包括:An aspect of the embodiments of the present invention provides A1, a method for determining a three-dimensional vehicle candidate area, including:
获取道路场景中的多个点云,利用所述多个点云确定所述道路场景中的地平面;Obtaining multiple point clouds in the road scene, using the multiple point clouds to determine the ground plane in the road scene;
根据预置的车辆尺寸,在所述地平面上生成多个三维区域;generating a plurality of three-dimensional areas on the ground plane according to the preset vehicle size;
将包含所述多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个所述第二几何体;Divide the first geometry containing the plurality of point clouds into a set of a specified number of second geometry, and determine one or more of the second geometry contained in each three-dimensional area;
根据所述各个三维区域包含的一个或多个所述第二几何体,确定该三维区域是否为三维车辆备选区域。Whether the three-dimensional area is a three-dimensional vehicle candidate area is determined according to the one or more second geometric bodies included in each three-dimensional area.
A2、根据A1所述的方法,其中,所述获取道路场景中的多个点云,包括:A2. The method according to A1, wherein said obtaining multiple point clouds in the road scene includes:
根据激光测量原理采集道路场景中的多个点云;和/或Acquisition of multiple point clouds in a road scene based on laser measurement principles; and/or
根据摄影测量原理获取道路场景中的多个点云。According to the principle of photogrammetry, multiple point clouds in the road scene are obtained.
A3、根据A1或A2所述的方法,其中,利用所述多个点云确定所述道路场景中的地平面,包括:A3. The method according to A1 or A2, wherein, using the plurality of point clouds to determine the ground plane in the road scene includes:
通过随机抽样一致性RANSAC算法,确定所述多个点云中属于所述道路场景中的地平面的点云。A point cloud among the plurality of point clouds belonging to the ground plane in the road scene is determined through a random sampling consistent RANSAC algorithm.
A4、根据A1-A3中任一项所述的方法,其中,根据预置的车辆尺寸,在所述地平面上生成多个三维区域,包括:A4. The method according to any one of A1-A3, wherein a plurality of three-dimensional areas are generated on the ground plane according to a preset vehicle size, including:
根据预置的车辆尺寸,在所述地平面随机生成多个三维区域,其中,所述三维区域通过指定参数确定。According to the preset vehicle size, a plurality of three-dimensional areas are randomly generated on the ground plane, wherein the three-dimensional areas are determined by specified parameters.
A5、根据A4所述的方法,其中,所述指定参数包括下列至少之一:A5. The method according to A4, wherein the specified parameters include at least one of the following:
车辆中心的三维坐标、车辆尺寸、车辆在所述地平面上的朝向角度。The three-dimensional coordinates of the center of the vehicle, the size of the vehicle, and the orientation angle of the vehicle on the ground plane.
A6、根据A1-A5中任一项所述的方法,其中,将包含所述多个点云的第一几何体划分为指定数量的第二几何体的集合,包括:A6. The method according to any one of A1-A5, wherein dividing the first geometry containing the plurality of point clouds into a set of a specified number of second geometry includes:
将包含所述多个点云的长方体按照固定间隔离散化,划分为指定数量的立方体的集合。The cuboid containing the plurality of point clouds is discretized according to a fixed interval, and divided into a set of a specified number of cubes.
A7、根据A6所述的方法,其中,根据所述各个三维区域包含的一个或多个所述第二几何体,确定该三维区域是否为三维车辆备选区域,包括:A7. The method according to A6, wherein, according to the one or more second geometric bodies included in each three-dimensional area, determining whether the three-dimensional area is a three-dimensional vehicle candidate area includes:
根据所述各个三维区域包含的一个或多个所述第二几何体,利用三维积分图计算所述各个三维区域包含的点云数量和/或点云平均高度;According to one or more of the second geometric bodies contained in each three-dimensional area, calculate the number of point clouds contained in each three-dimensional area and/or the average height of point cloud by using a three-dimensional integral map;
根据所述各个三维区域包含的点云数量和/或点云平均高度,确定该三维区域是否为三维车辆备选区域。Determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to the number of point clouds contained in each three-dimensional area and/or the average height of the point cloud.
A8、根据A7所述的方法,其中,根据所述各个三维区域包含的点云数量和/或点云平均高度,确定该三维区域是否为三维车辆备选区域,包括:A8. The method according to A7, wherein, according to the number of point clouds contained in each three-dimensional area and/or the average height of the point cloud, determining whether the three-dimensional area is a three-dimensional vehicle candidate area includes:
按照指定的权重对所述各个三维区域包含的点云数量和点云平均高度求和加权,得到所述各个三维区域的综合评分值;According to the specified weight, the number of point clouds contained in each three-dimensional area and the average height of the point cloud are summed and weighted to obtain the comprehensive score value of each three-dimensional area;
根据所述各个三维区域的综合评分值,确定该三维区域是否为三维车辆备选区域。According to the comprehensive score value of each three-dimensional area, it is determined whether the three-dimensional area is a three-dimensional vehicle candidate area.
A9、根据A8所述的方法,其中,根据所述各个三维区域的综合评分值,确定该三维区域是否为三维车辆备选区域,包括:A9. The method according to A8, wherein, according to the comprehensive scoring value of each three-dimensional area, determining whether the three-dimensional area is a three-dimensional vehicle candidate area includes:
将所述各个三维区域的综合评分值从大到小进行排序;Sorting the comprehensive scoring values of the various three-dimensional regions from large to small;
选取排序靠前的指定数量的三维区域作为三维车辆备选区域。Select the specified number of 3D areas ranked first as the 3D vehicle candidate areas.
A10、根据A1-A9中任一项所述的方法,其中,还包括:A10. The method according to any one of A1-A9, further comprising:
在行车的过程中,根据确定出的所述三维车辆备选区域,识别行车相关信息;In the process of driving, according to the determined three-dimensional vehicle candidate area, identify driving-related information;
对识别出的行车相关信息进行分析以生成相应的行车导航提示信息,并提供给用户。The identified driving-related information is analyzed to generate corresponding driving navigation prompt information and provided to the user.
A11、根据A10所述的方法,其中,所述行车相关信息包括下列至少之一:A11. The method according to A10, wherein the driving-related information includes at least one of the following:
前车和/或后车与本车的距离、行车路况标识信息、道路环境信息。The distance between the vehicle in front and/or the vehicle behind and the vehicle, road condition identification information, and road environment information.
A12、根据A1-A11中任一项所述的方法,其中,所述方法应用在车载的智能控制单元中。A12. The method according to any one of A1-A11, wherein the method is applied in a vehicle-mounted intelligent control unit.
本发明实施例的另一方面,还提供了B13、一种三维车辆备选区域的确定装置,包括:Another aspect of the embodiments of the present invention also provides B13, a device for determining a three-dimensional vehicle candidate area, including:
点云获取模块,适于获取道路场景中的多个点云;The point cloud acquisition module is suitable for acquiring multiple point clouds in road scenes;
地平面确定模块,适于利用所述多个点云确定所述道路场景中的地平面;a ground plane determination module adapted to determine the ground plane in the road scene by using the plurality of point clouds;
三维区域生成模块,适于根据预置的车辆尺寸,在所述地平面上生成多个三维区域;A three-dimensional area generation module, adapted to generate multiple three-dimensional areas on the ground plane according to the preset vehicle size;
几何体确定模块,适于将包含所述多个点云的第一几何体划分为指定数量的第二几何体的集合,确定各个三维区域包含的一个或多个所述第二几何体;A geometry determination module, adapted to divide the first geometry containing the plurality of point clouds into a set of a specified number of second geometries, and determine one or more of the second geometries contained in each three-dimensional area;
备选区域确定模块,适于根据所述各个三维区域包含的一个或多个所述第二几何体,确定该三维区域是否为三维车辆备选区域。The candidate area determination module is adapted to determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to one or more of the second geometric bodies included in each three-dimensional area.
B14、根据B13所述的装置,其中,所述点云获取模块还适于:B14. The device according to B13, wherein the point cloud acquisition module is also suitable for:
根据激光测量原理采集道路场景中的多个点云;和/或Acquisition of multiple point clouds in a road scene based on laser measurement principles; and/or
根据摄影测量原理获取道路场景中的多个点云。According to the principle of photogrammetry, multiple point clouds in the road scene are obtained.
B15、根据B13或B14所述的装置,其中,所述地平面确定模块还适于:B15. The device according to B13 or B14, wherein the ground plane determination module is further adapted to:
通过随机抽样一致性RANSAC算法,确定所述多个点云中属于所述道路场景中的地平面的点云。A point cloud among the plurality of point clouds belonging to the ground plane in the road scene is determined through a random sampling consistent RANSAC algorithm.
B16、根据B13-B15中任一项所述的装置,其中,所述三维区域生成模块还适于:B16. The device according to any one of B13-B15, wherein the three-dimensional area generating module is further adapted to:
根据预置的车辆尺寸,在所述地平面随机生成多个三维区域,其中,所述三维区域通过指定参数确定。According to the preset vehicle size, a plurality of three-dimensional areas are randomly generated on the ground plane, wherein the three-dimensional areas are determined by specified parameters.
B17、根据B16所述的装置,其中,所述指定参数包括下列至少之一:B17. The device according to B16, wherein the specified parameters include at least one of the following:
车辆中心的三维坐标、车辆尺寸、车辆在所述地平面上的朝向角度。The three-dimensional coordinates of the center of the vehicle, the size of the vehicle, and the orientation angle of the vehicle on the ground plane.
B18、根据B13-B17中任一项所述的装置,其中,所述几何体确定模块还适于:B18. The device according to any one of B13-B17, wherein the geometry determination module is further adapted to:
将包含所述多个点云的长方体按照固定间隔离散化,划分为指定数量的立方体的集合。The cuboid containing the plurality of point clouds is discretized according to a fixed interval, and divided into a set of a specified number of cubes.
B19、根据B18所述的装置,其中,所述备选区域确定模块包括:B19. The device according to B18, wherein the candidate area determination module includes:
计算单元,适于根据所述各个三维区域包含的一个或多个所述第二几何体,利用三维积分图计算所述各个三维区域包含的点云数量和/或点云平均高度;The calculation unit is adapted to calculate the number of point clouds and/or the average height of point clouds contained in each three-dimensional area by using a three-dimensional integral map according to the one or more second geometric bodies contained in each three-dimensional area;
确定单元,适于根据所述各个三维区域包含的点云数量和/或点云平均高度,确定该三维区域是否为三维车辆备选区域。The determination unit is adapted to determine whether the three-dimensional area is a three-dimensional vehicle candidate area according to the number of point clouds contained in each three-dimensional area and/or the average height of the point cloud.
B20、根据B19所述的装置,其中,所述确定单元还适于:B20. The device according to B19, wherein the determining unit is further adapted to:
按照指定的权重对所述各个三维区域包含的点云数量和点云平均高度求和加权,得到所述各个三维区域的综合评分值;According to the specified weight, the number of point clouds contained in each three-dimensional area and the average height of the point cloud are summed and weighted to obtain the comprehensive score value of each three-dimensional area;
根据所述各个三维区域的综合评分值,确定该三维区域是否为三维车辆备选区域。According to the comprehensive score value of each three-dimensional area, it is determined whether the three-dimensional area is a three-dimensional vehicle candidate area.
B21、根据B20所述的装置,其中,所述确定单元还适于:B21. The device according to B20, wherein the determining unit is further adapted to:
将所述各个三维区域的综合评分值从大到小进行排序;Sorting the comprehensive scoring values of the various three-dimensional regions from large to small;
选取排序靠前的指定数量的三维区域作为三维车辆备选区域。Select the specified number of 3D areas ranked first as the 3D vehicle candidate areas.
B22、根据B13-B21中任一项所述的装置,其中,还包括:B22. The device according to any one of B13-B21, further comprising:
行车导航提示信息生成模块,适于在行车的过程中,根据确定出的所述三维车辆备选区域,识别行车相关信息;对识别出的行车相关信息进行分析以生成相应的行车导航提示信息,并提供给用户。The driving navigation prompt information generation module is adapted to identify driving-related information according to the determined three-dimensional vehicle candidate area during the driving process; analyze the identified driving-related information to generate corresponding driving navigation prompt information, and provided to users.
B23、根据B22所述的装置,其中,所述行车相关信息包括下列至少之一:B23. The device according to B22, wherein the driving-related information includes at least one of the following:
前车和/或后车与本车的距离、行车路况标识信息、道路环境信息。The distance between the vehicle in front and/or the vehicle behind and the vehicle, road condition identification information, and road environment information.
B24、根据B13-B23中任一项所述的装置,其中,所述装置应用在车载的智能控制单元中。B24. The device according to any one of B13-B23, wherein the device is applied in a vehicle-mounted intelligent control unit.
本发明实施例的又一方面,还提供了C25、一种车载设备,包括B13-B24中任一项所述的三维车辆备选区域的确定装置。Still another aspect of the embodiments of the present invention also provides C25, a vehicle-mounted device, including the device for determining a three-dimensional vehicle candidate area described in any one of B13-B24.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610581697.5A CN106228602A (en) | 2016-07-21 | 2016-07-21 | Determination method, device and the mobile unit of three-dimensional vehicle alternative area |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610581697.5A CN106228602A (en) | 2016-07-21 | 2016-07-21 | Determination method, device and the mobile unit of three-dimensional vehicle alternative area |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106228602A true CN106228602A (en) | 2016-12-14 |
Family
ID=57532456
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610581697.5A Pending CN106228602A (en) | 2016-07-21 | 2016-07-21 | Determination method, device and the mobile unit of three-dimensional vehicle alternative area |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106228602A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019015496A1 (en) * | 2017-07-18 | 2019-01-24 | 武汉智象机器人有限公司 | Fixed radar and movable radar-based vehicle recognition system and parking method |
CN110595492A (en) * | 2019-09-25 | 2019-12-20 | 上海交通大学 | Vehicle self-positioning system and method in park environment |
CN111220786A (en) * | 2020-03-09 | 2020-06-02 | 生态环境部华南环境科学研究所 | Method for rapidly monitoring organic pollution of deep water sediments |
CN118586950A (en) * | 2024-08-02 | 2024-09-03 | 志鸿软件科技(深圳)有限公司 | A project site selection auxiliary decision-making method, device and computer equipment |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103226833A (en) * | 2013-05-08 | 2013-07-31 | 清华大学 | Point cloud data partitioning method based on three-dimensional laser radar |
US20150098076A1 (en) * | 2013-10-08 | 2015-04-09 | Hyundai Motor Company | Apparatus and method for recognizing vehicle |
CN105015419A (en) * | 2015-07-17 | 2015-11-04 | 中山大学 | Automatic parking system and method based on stereoscopic vision localization and mapping |
CN105292085A (en) * | 2015-11-02 | 2016-02-03 | 清华大学苏州汽车研究院(吴江) | Vehicle forward collision avoidance system based on infrared laser aid |
CN105574552A (en) * | 2014-10-09 | 2016-05-11 | 东北大学 | Vehicle ranging and collision early warning method based on monocular vision |
-
2016
- 2016-07-21 CN CN201610581697.5A patent/CN106228602A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103226833A (en) * | 2013-05-08 | 2013-07-31 | 清华大学 | Point cloud data partitioning method based on three-dimensional laser radar |
US20150098076A1 (en) * | 2013-10-08 | 2015-04-09 | Hyundai Motor Company | Apparatus and method for recognizing vehicle |
CN105574552A (en) * | 2014-10-09 | 2016-05-11 | 东北大学 | Vehicle ranging and collision early warning method based on monocular vision |
CN105015419A (en) * | 2015-07-17 | 2015-11-04 | 中山大学 | Automatic parking system and method based on stereoscopic vision localization and mapping |
CN105292085A (en) * | 2015-11-02 | 2016-02-03 | 清华大学苏州汽车研究院(吴江) | Vehicle forward collision avoidance system based on infrared laser aid |
Non-Patent Citations (3)
Title |
---|
XIAOZHI CHEN 等: "3D Object Proposals for Accurate Object Class Detection", 《NIPS’15 PROCEEDINGS OF THE 28TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING SYSTEM》 * |
代新雷: "《车身控制系统检修 汽车类》", 31 December 2011, 北京理工大学出版社 * |
肖强: "地面无人车辆越野环境多要素合成可通行区域检测", 《中国优秀硕士学位论文全文数据库 工程科技II辑》 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019015496A1 (en) * | 2017-07-18 | 2019-01-24 | 武汉智象机器人有限公司 | Fixed radar and movable radar-based vehicle recognition system and parking method |
CN110595492A (en) * | 2019-09-25 | 2019-12-20 | 上海交通大学 | Vehicle self-positioning system and method in park environment |
CN111220786A (en) * | 2020-03-09 | 2020-06-02 | 生态环境部华南环境科学研究所 | Method for rapidly monitoring organic pollution of deep water sediments |
CN118586950A (en) * | 2024-08-02 | 2024-09-03 | 志鸿软件科技(深圳)有限公司 | A project site selection auxiliary decision-making method, device and computer equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102145109B1 (en) | Methods and apparatuses for map generation and moving entity localization | |
CN106080397B (en) | Self-adaption cruise system and mobile unit | |
JP2022538927A (en) | 3D target detection and intelligent driving | |
CN108198145A (en) | For the method and apparatus of point cloud data reparation | |
CN108801268A (en) | Target object positioning method and device and robot | |
WO2021017211A1 (en) | Vehicle positioning method and device employing visual sensing, and vehicle-mounted terminal | |
JP7156515B2 (en) | Point cloud annotation device, method and program | |
CN106228602A (en) | Determination method, device and the mobile unit of three-dimensional vehicle alternative area | |
CN107679458B (en) | Method for extracting road marking lines in road color laser point cloud based on K-Means | |
CN106228134A (en) | Drivable region detection method based on pavement image, Apparatus and system | |
CN110795978B (en) | Road surface point cloud data extraction method and device, storage medium and electronic equipment | |
CN115115655B (en) | Target segmentation method, device, electronic device, storage medium and program product | |
CN113537047A (en) | Obstacle detection method, obstacle detection device, vehicle and storage medium | |
CN116740668B (en) | Three-dimensional target detection method, device, computer equipment and storage medium | |
CN114299161A (en) | Data processing method, device, equipment and computer storage medium | |
CN114627186A (en) | Distance measuring method and distance measuring device | |
Rahmat et al. | Android-based automatic detection and measurement system of highway billboard for tax calculation in Indonesia | |
WO2021189420A1 (en) | Data processing method and device | |
CN114556449A (en) | Obstacle detection and re-identification method and device, movable platform and storage medium | |
CN116051489A (en) | Bird's-eye view view angle feature map processing method, device, electronic device, and storage medium | |
CN112906519B (en) | Vehicle type identification method and device | |
CN110298320B (en) | Visual positioning method, device and storage medium | |
CN112132845A (en) | Monolithic method, apparatus, electronic device and readable medium for three-dimensional model | |
CN115578502B (en) | Image generation method and device, electronic equipment and storage medium | |
CN117132737A (en) | Three-dimensional building model construction method, system and equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161214 |
|
RJ01 | Rejection of invention patent application after publication |