CN111290386A - Path planning method and device and carrying tool - Google Patents

Path planning method and device and carrying tool Download PDF

Info

Publication number
CN111290386A
CN111290386A CN202010104985.8A CN202010104985A CN111290386A CN 111290386 A CN111290386 A CN 111290386A CN 202010104985 A CN202010104985 A CN 202010104985A CN 111290386 A CN111290386 A CN 111290386A
Authority
CN
China
Prior art keywords
vehicle
target object
image
type
shape
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010104985.8A
Other languages
Chinese (zh)
Other versions
CN111290386B (en
Inventor
李阳光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing HX Pony AI Technology Co Ltd
Original Assignee
Beijing HX Pony AI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing HX Pony AI Technology Co Ltd filed Critical Beijing HX Pony AI Technology Co Ltd
Priority to CN202010104985.8A priority Critical patent/CN111290386B/en
Publication of CN111290386A publication Critical patent/CN111290386A/en
Application granted granted Critical
Publication of CN111290386B publication Critical patent/CN111290386B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0257Control of position or course in two dimensions specially adapted to land vehicles using a radar

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses a path planning method and device and a delivery vehicle. Wherein, the method comprises the following steps: acquiring a first image of a target object in front of a first vehicle, wherein the first image is a radar image; extracting feature information of a target object from the first image; identifying the type of the target object according to the characteristic information, wherein the type comprises the following steps: obstacles and liquids located on the ground in front; it is determined whether to alter the planned route of the first vehicle depending on the type. The invention solves the technical problem that whether the liquid on the ground is an obstacle or not cannot be distinguished in the related technology, and the path planning is influenced.

Description

路径规划方法及装置、运载工具Path planning method and device, and vehicle

技术领域technical field

本发明涉及无人驾驶领域,具体而言,涉及一种路径规划方法及装置、运载工具。The present invention relates to the field of unmanned driving, and in particular, to a path planning method and device, and a vehicle.

背景技术Background technique

相关技术中,在无人驾驶车辆的行驶过程中,出于安全性的考虑,需要识别车辆前方的物体是障碍物还是非障碍物。在进行障碍物识别时,可以使用无人驾驶车辆上安装的雷达信号进行识别,但是,由于基于雷达信号得到的雷达图像是基于雷达回波信号确定的,其很难识别前方的对象是分布在地面上的水还是障碍物,容易造成判断失误。针对上述的问题,目前尚未提出有效的解决方案。In the related art, during the driving process of the unmanned vehicle, for the sake of safety, it is necessary to identify whether the object in front of the vehicle is an obstacle or a non-obstruction. When identifying obstacles, the radar signal installed on the unmanned vehicle can be used for identification. However, since the radar image obtained based on the radar signal is determined based on the radar echo signal, it is difficult to recognize that the object ahead is distributed in the The water on the ground is also an obstacle, which is easy to cause errors in judgment. For the above problems, no effective solution has been proposed yet.

发明内容SUMMARY OF THE INVENTION

本发明实施例提供了一种路径规划方法及装置、运载工具,以至少解决相关技术中无法区分地面上的液体是否为障碍物,影响路径规划的技术问题。Embodiments of the present invention provide a path planning method, device, and vehicle, so as to at least solve the technical problem in the related art that it is impossible to distinguish whether the liquid on the ground is an obstacle, which affects path planning.

根据本发明实施例的一个方面,提供了一种路径规划方法,包括:采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;从第一图像中提取目标对象的特征信息;依据特征信息识别目标对象的类型,其中,类型包括:障碍物和位于前方地面上的液体;依据类型确定是否更改第一车辆的规划路线。According to an aspect of the embodiments of the present invention, a path planning method is provided, including: collecting a first image of a target object located in front of a first vehicle, where the first image is a radar image; extracting a target object's image from the first image characteristic information; identifying the type of the target object according to the characteristic information, wherein the types include: obstacles and liquids on the ground ahead; determining whether to change the planned route of the first vehicle according to the type.

可选地,采集位于第一车辆前方的目标对象的第一图像,包括:通过第一车辆中安装的雷达设备扫描目标对象,得到第一图像;从第一图像中提取目标对象的特征信息,包括:从第一图像中提取目标对象的形状。Optionally, collecting the first image of the target object located in front of the first vehicle includes: scanning the target object through a radar device installed in the first vehicle to obtain the first image; extracting feature information of the target object from the first image, Including: extracting the shape of the target object from the first image.

可选地,依据特征信息识别目标对象的类型,包括:基于第一图像中目标对象的形状确定目标对象的类型。Optionally, identifying the type of the target object according to the feature information includes: determining the type of the target object based on the shape of the target object in the first image.

可选地,基于第一图像中目标对象的形状确定目标对象的类型,包括:在目标对象的形状为规则形状时,确定目标对象为障碍物;在目标对象的形状为非规则形状时,确定目标对象为液体。Optionally, determining the type of the target object based on the shape of the target object in the first image includes: when the shape of the target object is a regular shape, determining that the target object is an obstacle; when the shape of the target object is an irregular shape, determining The target object is liquid.

可选地,确定目标对象为障碍物包括:判断目标对象是否来自第一车辆前方的第二车辆;在判断结果指示目标对象不是来自第二车辆,且目标对象的形状为规则形状时,确定目标对象为障碍物。Optionally, determining that the target object is an obstacle includes: judging whether the target object is from a second vehicle in front of the first vehicle; when the judgment result indicates that the target object is not from the second vehicle and the shape of the target object is a regular shape, determining the target The object is an obstacle.

可选地,判断目标对象是否来自第一车辆前方的第二车辆,包括:获取第二车辆的第二图像,第二图像为RGB图像;将第二图像输入至机器学习模型进行分析,得到第二车辆的作业状态以及,其中,作业状态包括:正在进行喷洒作业和未进行喷洒作业;机器学习模型是通过多组数据训练得到的,多组数据中的每组数据均包括:第二车辆的图像和用于标记第二车辆的图像为作业状态的标签;在作业状态为正在进行喷洒作业时,确定喷洒作业对应的喷洒对象的类型;在类型和目标对象的类型一致时,则确定目标对象来自第二车辆。Optionally, judging whether the target object is from a second vehicle in front of the first vehicle includes: acquiring a second image of the second vehicle, where the second image is an RGB image; inputting the second image into a machine learning model for analysis to obtain the first image. 2. The operation status of the vehicle and, wherein, the operation status includes: spraying operation and no spraying operation; the machine learning model is obtained by training multiple sets of data, and each set of data in the multiple sets of data includes: the second vehicle The image and the image used to mark the second vehicle are labels of the working state; when the working state is a spraying operation, the type of the spraying object corresponding to the spraying operation is determined; when the type is consistent with the type of the target object, the target object is determined from the second vehicle.

可选地,依据类型确定是否更改第一车辆的规划路线之前,方法还包括:获取第二车辆的姿态信息和第二车辆所在道路的信息;基于姿态信息预测第二车辆的行驶方向;在第二车辆的行驶方向发生改变且改变的行驶方向上存在与第二车辆所在道路相邻的道路时,则控制第一车辆继续按照规划路线行驶。Optionally, before determining whether to change the planned route of the first vehicle according to the type, the method further includes: acquiring attitude information of the second vehicle and information of the road where the second vehicle is located; predicting the driving direction of the second vehicle based on the attitude information; When the driving direction of the second vehicle changes and there is a road adjacent to the road where the second vehicle is located in the changed driving direction, the first vehicle is controlled to continue to travel according to the planned route.

可选地,在第二车辆的行驶方向未发生改变时,则控制第一车辆更改规划路线,以避开障碍物。Optionally, when the driving direction of the second vehicle does not change, the first vehicle is controlled to change the planned route to avoid obstacles.

可选的,控制第一车辆更改规划路线之前,方法还包括:获取第一车辆和第二车辆的相对速度;在相对速度大于0时,控制第一车辆更改规划路线;在相对速度小于0或者等于0时,则控制第一车辆继续按照规划路线行驶。Optionally, before controlling the first vehicle to change the planned route, the method further includes: acquiring the relative speed of the first vehicle and the second vehicle; when the relative speed is greater than 0, controlling the first vehicle to change the planned route; when the relative speed is less than 0 or When it is equal to 0, the first vehicle is controlled to continue to travel according to the planned route.

可选的,姿态信息包括:第二车辆的车头朝向。Optionally, the attitude information includes: the head direction of the second vehicle.

可选的,方法还包括:在第二车辆的车头朝向发生改变且在车头朝向改变后按照改变后的车头朝向行驶预设时长后,确定第二车辆的行驶方向发生改变。Optionally, the method further includes: determining that the driving direction of the second vehicle is changed after the head direction of the second vehicle is changed and after the head direction is changed and travels for a preset period of time according to the changed head direction.

可选地,依据类型确定是否更改第一车辆的行驶路线,包括:在类型为障碍物时,则修改第一车辆的规划路线,其中,修改后的规划路线中避开目标对象;在类型为液体时,则控制车辆按照当前的规划路线继续行驶。Optionally, determining whether to change the driving route of the first vehicle according to the type includes: when the type is an obstacle, then modifying the planned route of the first vehicle, wherein the target object is avoided in the revised planned route; When the liquid is present, the vehicle is controlled to continue driving according to the current planned route.

根据本申请实施例的另一方面,提供了一种路径规划装置,包括:采集模块,用于采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;提取模块,用于从第一图像中提取目标对象的特征信息;识别模块,用于依据特征信息识别目标对象的类型,其中,类型包括:障碍物和位于前方地面上的液体;确定模块,用于依据类型确定是否更改第一车辆的规划路线。According to another aspect of the embodiments of the present application, a path planning device is provided, comprising: a collection module for collecting a first image of a target object located in front of a first vehicle, where the first image is a radar image; an extraction module, The feature information of the target object is extracted from the first image; the identification module is used to identify the type of the target object according to the feature information, wherein the types include: obstacles and liquids on the ground ahead; Determines whether to change the planned route of the first vehicle.

可选地,采集模块,用于通过第一车辆中安装的雷达设备扫描目标对象,得到第一图像;提取模块,用于从第一图像中提取目标对象的形状。Optionally, the acquisition module is used for scanning the target object through the radar device installed in the first vehicle to obtain the first image; the extraction module is used for extracting the shape of the target object from the first image.

可选地,识别模块,用于基于第一图像中目标对象的形状确定目标对象的类型。Optionally, an identification module, configured to determine the type of the target object based on the shape of the target object in the first image.

可选地,识别模块,用于在目标对象的形状为规则形状时,确定目标对象为障碍物;在目标对象的形状为非规则形状时,确定目标对象为液体。Optionally, the identification module is configured to determine that the target object is an obstacle when the shape of the target object is a regular shape; and determine that the target object is a liquid when the shape of the target object is an irregular shape.

根据本申请实施例的另一方面,提供了一种非易失性存储介质,存储介质包括存储的程序,其中,在程序运行时控制存储介质所在设备执行以上的路径规划方法。According to another aspect of the embodiments of the present application, a non-volatile storage medium is provided, the storage medium includes a stored program, wherein when the program runs, the device where the storage medium is located is controlled to execute the above path planning method.

根据本申请实施例的另一方面,提供了一种运载工具,包括:电子设备,该电子设备包括:存储器,用于存储程序指令;处理器,用于调取存储在存储器中的程序指令,执行以下功能:采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;从第一图像中提取目标对象的特征信息;依据特征信息识别目标对象的类型,其中,类型包括:障碍物和位于前方地面上的液体;依据类型确定是否更改第一车辆的规划路线。According to another aspect of the embodiments of the present application, a vehicle is provided, comprising: an electronic device, the electronic device comprising: a memory for storing program instructions; a processor for retrieving the program instructions stored in the memory, Perform the following functions: collect a first image of the target object located in front of the first vehicle, the first image is a radar image; extract feature information of the target object from the first image; identify the type of the target object according to the feature information, wherein the type Including: obstacles and liquids on the ground ahead; depending on the type, whether to change the planned route of the first vehicle.

在本发明实施例中,采用基于雷达图像识别前方目标对象的类型的方式,从而可以依据最终的识别结果实现对障碍物或液体的识别,避免误判,进而解决了相关技术中无法区分地面上的液体是否为障碍物,影响路径规划的技术问题。In the embodiment of the present invention, the method of identifying the type of the target object in front based on the radar image is adopted, so that the identification of obstacles or liquids can be realized according to the final identification result, so as to avoid misjudgment, and further solve the problem of inability to distinguish between the ground and the ground in the related art. Whether the liquid is an obstacle affects the technical problem of path planning.

附图说明Description of drawings

此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

图1是根据本申请实施例的一种路径规划方法的流程示意图;1 is a schematic flowchart of a path planning method according to an embodiment of the present application;

图2是根据本申请实施例的一种路径规划装置的结构示意图;2 is a schematic structural diagram of a path planning apparatus according to an embodiment of the present application;

图3是根据本申请实施例的一种运载工具的结构示意图。FIG. 3 is a schematic structural diagram of a vehicle according to an embodiment of the present application.

具体实施方式Detailed ways

为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。In order to make those skilled in the art better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only Embodiments are part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed Rather, those steps or units may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.

根据本发明实施例,提供了一种路径规划方法的方法实施例,需要说明的是,在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行,并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。According to an embodiment of the present invention, a method embodiment of a path planning method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings may be executed in a computer system such as a set of computer-executable instructions, and, Although a logical order is shown in the flowcharts, in some cases steps shown or described may be performed in an order different from that herein.

图1是根据本发明实施例的路径规划方法,如图1所示,该方法包括如下步骤:FIG. 1 is a path planning method according to an embodiment of the present invention. As shown in FIG. 1 , the method includes the following steps:

步骤S102,采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;Step S102, collecting a first image of the target object located in front of the first vehicle, where the first image is a radar image;

本申请的一些实施例中,采集位于第一车辆前方的目标对象的第一图像,包括:通过第一车辆中安装的雷达设备扫描目标对象,得到目标对象的第一图像,为了确保检测结果的准确性,采集图像的雷达设备可以为多个安装车辆不同位置的设备,例如在车辆顶部位置的左右两端分别放置一个雷达设备,也可以将多种类型的雷达设备结合使用,例如,将毫米波雷达和超声波雷达结合使用;需要说明的是目标对象可以是车辆、道路两旁的树枝、行人以及其他物体等;从上述第一图像中提取目标对象的特征信息,特征信息可以是目标对象的形状、运动状态、体积大小等。In some embodiments of the present application, collecting the first image of the target object located in front of the first vehicle includes: scanning the target object through a radar device installed in the first vehicle to obtain the first image of the target object, in order to ensure the accuracy of the detection results Accuracy, the radar equipment that collects images can be multiple equipment installed in different positions of the vehicle, for example, a radar equipment is placed on the left and right ends of the top position of the vehicle, or multiple types of radar equipment can be used in combination, for example, the millimeter Wave radar and ultrasonic radar are used in combination; it should be noted that the target object can be vehicles, branches on both sides of the road, pedestrians and other objects; the feature information of the target object is extracted from the first image above, and the feature information can be the shape of the target object , state of motion, size, etc.

步骤S104,从第一图像中提取目标对象的特征信息;Step S104, extracting feature information of the target object from the first image;

需要说明的是,特征信息包括但不限于目标对象的形状、运动状态、体积大小等。It should be noted that the feature information includes, but is not limited to, the shape, motion state, and volume of the target object.

步骤S106,依据特征信息识别目标对象的类型,基于第一图像中目标对象的形状确定目标对象的类型时,分为两种情况,当目标对象的形状为规则形状时,确定目标对象为障碍物;当目标对象的形状为非规则形状时,确定目标对象为液体。需要说明的是,规则形状是边界平滑的形状,非规则形状则是边界不平滑的形状,当目标对象为非规则形状时,雷达反射的点是不规则的,当目标对象的形状为规则形状时,确定目标对象为障碍物;当目标对象的形状为非规则形状时,确定目标对象为液体。Step S106, identifying the type of the target object according to the feature information, and determining the type of the target object based on the shape of the target object in the first image, there are two cases, when the shape of the target object is a regular shape, it is determined that the target object is an obstacle. ; When the shape of the target object is irregular, it is determined that the target object is liquid. It should be noted that a regular shape is a shape with a smooth boundary, and an irregular shape is a shape with an uneven boundary. When the target object is an irregular shape, the points reflected by the radar are irregular, and when the target object is a regular shape When , the target object is determined to be an obstacle; when the shape of the target object is an irregular shape, it is determined that the target object is a liquid.

在另一种可选的实施例中,依据特征信息识别目标对象的类型,包括:基于第一图像中目标对象的形状确定目标对象的类型,例如,当目标对象为一辆停放在路边的轿车上,雷达设备扫描到此轿车时,可以基于深度学习视觉算法确定这是一辆轿车;同样的,当目标对象为一辆停放在路边的自行车时,可以基于深度学习视觉算法确定这是一辆自行车。In another optional embodiment, identifying the type of the target object according to the feature information includes: determining the type of the target object based on the shape of the target object in the first image, for example, when the target object is a car parked on the side of the road On a car, when the radar device scans the car, it can be determined based on the deep learning visual algorithm that it is a car; similarly, when the target object is a bicycle parked on the side of the road, it can be determined based on the deep learning visual algorithm. a bicycle.

在本申请的一种实施例中,当雷达反射的点不是规则排列的,认为其是洒落的地上的液体为水,其次,也可以结合第一车辆前方的行驶环境,确定此液体为其他化合物,例如,当激光雷达结合其他信号采集装置,识别出第一车辆前方的车辆为油罐车,则认定其液体的种类是汽油或者柴油等。In an embodiment of the present application, when the points reflected by the radar are not arranged regularly, it is considered that the liquid on the ground is water. Secondly, the liquid can be determined to be other compounds in combination with the driving environment in front of the first vehicle. For example, when the lidar is combined with other signal acquisition devices to identify that the vehicle in front of the first vehicle is a tanker, it is determined that the type of liquid is gasoline or diesel.

步骤S108,依据类型确定是否更改第一车辆的规划路线。Step S108, determining whether to change the planned route of the first vehicle according to the type.

本申请一种可选的实施例中,在确定目标对象是否为障碍物时:可以先判断目标对象是否来自第一车辆前方的第二车辆;在判断结果指示目标对象不是来自第二车辆,且目标对象的形状为规则形状时,确定目标对象为障碍物,即就是将所有不属于第二车辆且识别为规则形状的对象,均认为是障碍物。In an optional embodiment of the present application, when determining whether the target object is an obstacle: it may be first determined whether the target object is from a second vehicle in front of the first vehicle; when the determination result indicates that the target object is not from the second vehicle, and When the shape of the target object is a regular shape, it is determined that the target object is an obstacle, that is, all objects that do not belong to the second vehicle and are identified as regular shapes are regarded as obstacles.

本申请一种可选的实施例中,为了判断目标对象是否是来自于第二车辆结果的准确性,在判断目标对象是否来自第一车辆前方的第二车辆,可以先获取第二车辆的第二图像,第二图像为RGB图像;然后将将第二图像输入至机器学习模型进行分析,得到第二车辆的作业状态以及基于机器学习模型判断第二车辆的作业状态进一步确定目标对象是否来自于第二车辆,其中,作业状态包括但不限于以下情况:第一种作业状态正在进行喷洒作业;第二种作业状态未进行喷洒作业;机器学习模型是通过多组数据训练得到的,其中多组数据中的每组数据均包括但不限于:第二车辆的图像和用于标记第二车辆的图像为作业状态的标签;在作业状态为正在进行喷洒作业时,确定喷洒作业对应的喷洒对象的类型;在类型和目标对象的类型一致时,则确定目标对象来自第二车辆。In an optional embodiment of the present application, in order to determine whether the target object is from the second vehicle and the accuracy of the result, when judging whether the target object is from the second vehicle in front of the first vehicle, the first Two images, the second image is an RGB image; then the second image is input into the machine learning model for analysis to obtain the working state of the second vehicle and based on the machine learning model to determine the working state of the second vehicle to further determine whether the target object comes from The second vehicle, wherein, the operation status includes but is not limited to the following situations: the first operation status is in the spraying operation; the second operation status is not performing the spraying operation; the machine learning model is obtained through multiple sets of data training, wherein multiple sets of Each set of data in the data includes, but is not limited to: an image of the second vehicle and a label used to mark the image of the second vehicle as a working state; when the working state is a spraying operation, determine the size of the spraying object corresponding to the spraying operation. Type; when the type is consistent with the type of the target object, it is determined that the target object is from the second vehicle.

本申请的一种可选的实施例中,依据类型确定是否更改第一车辆的规划路线之前,方法还包括:获取第二车辆的姿态信息和第二车辆所在道路的信息;基于姿态信息预测第二车辆的行驶方向;在第二车辆的行驶方向发生改变且改变的行驶方向上存在与第二车辆所在道路相邻的道路时,则控制第一车辆继续按照规划路线行驶。In an optional embodiment of the present application, before determining whether to change the planned route of the first vehicle according to the type, the method further includes: acquiring attitude information of the second vehicle and information of the road where the second vehicle is located; predicting the first vehicle based on the attitude information 2. The driving direction of the vehicle; when the driving direction of the second vehicle changes and there is a road adjacent to the road where the second vehicle is located in the changed driving direction, the first vehicle is controlled to continue to travel according to the planned route.

本申请的一种可选的实施例中,在第二车辆的行驶方向未发生改变时,则控制第一车辆更改规划路线,以避开障碍物。In an optional embodiment of the present application, when the driving direction of the second vehicle does not change, the first vehicle is controlled to change the planned route to avoid obstacles.

本申请一种可选的实施例中,控制第一车辆更改规划路线之前,方法还包括:获取第一车辆和第二车辆的相对速度;在相对速度大于0时,控制第一车辆更改规划路线;在相对速度小于0或者等于0时,则控制第一车辆继续按照规划路线行驶。其中,相对速度为第一车辆和第二车辆的速度之差;在第一车辆的速度大于第二车辆的速度时,此时两辆车有可能会发生碰撞,因此,必须更改之前的规划路线;在第一车辆的速度小于第二车辆的速度时,此时第二车辆由于和第一车辆的相对距离越来越大,因此,不会发生碰撞,可以按照之前的规划路线继续行驶。In an optional embodiment of the present application, before controlling the first vehicle to change the planned route, the method further includes: acquiring the relative speed of the first vehicle and the second vehicle; when the relative speed is greater than 0, controlling the first vehicle to change the planned route ; when the relative speed is less than 0 or equal to 0, the first vehicle is controlled to continue to travel according to the planned route. Among them, the relative speed is the difference between the speed of the first vehicle and the second vehicle; when the speed of the first vehicle is greater than the speed of the second vehicle, the two vehicles may collide at this time, so the previous planned route must be changed. ; When the speed of the first vehicle is lower than the speed of the second vehicle, at this time, because the relative distance between the second vehicle and the first vehicle is increasing, no collision will occur, and the vehicle can continue to travel according to the previously planned route.

需要说明的是,姿态信息包括但不限于:第二车辆的车头朝向。It should be noted that the attitude information includes but is not limited to: the head direction of the second vehicle.

本申请一种可选的实施例中,方法还包括:在第二车辆的车头朝向发生改变且在车头朝向改变后按照改变后的车头朝向行驶预设时长后,确定第二车辆的行驶方向发生改变。In an optional embodiment of the present application, the method further includes: after the head direction of the second vehicle is changed and the head direction of the second vehicle is changed and the vehicle head is driven for a preset period of time according to the changed head direction, determining that the travel direction of the second vehicle occurs. Change.

本申请另一种可选的实施例中,依据目标对象类型确定是否更改第一车辆的行驶路线,类型包括障碍物和液体,在确定目标对象的类型为障碍物时,则修改第一车辆的规划路线,其中,修改后的规划路线用于避开目标对象;在确定目标对象的类型为液体时,则控制车辆按照当前的规划路线继续行驶,即就是认为液体不属于障碍物,例如,当洒水车喷洒出来的水喷射到第一车辆上时,不认为其对第一车辆的安全行驶构成影响,第一车辆按照需要预先规划后的路线行驶即可,无需改变行驶路线。In another optional embodiment of the present application, whether to change the driving route of the first vehicle is determined according to the type of the target object, and the types include obstacles and liquids. When it is determined that the type of the target object is an obstacle, the Planning a route, in which the revised planning route is used to avoid the target object; when the type of the target object is determined to be liquid, the vehicle is controlled to continue driving according to the current planned route, that is, the liquid is not considered to be an obstacle. When the water sprayed by the sprinkler is sprayed onto the first vehicle, it is not considered to have an impact on the safe driving of the first vehicle, and the first vehicle can drive according to the pre-planned route as required, and there is no need to change the driving route.

在本申请实施例中,采用基于雷达图像识别前方目标对象的类型的方式,从而可以依据最终的识别结果实现对障碍物或液体的识别,避免误判,进而解决了相关技术中无法区分地面上的液体是否为障碍物,影响路径规划的技术问题。In the embodiment of the present application, the method of identifying the type of the target object in front based on the radar image is adopted, so that the identification of obstacles or liquids can be realized according to the final identification result, so as to avoid misjudgment, thereby solving the problem of inability to distinguish between the objects on the ground in the related art Whether the liquid is an obstacle affects the technical problem of path planning.

本申请实施例还提供了一种路径规划装置,如图2所示,该装置包括:采集模块20,用于采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;提取模块22,用于从第一图像中提取目标对象的特征信息;识别模块24,用于依据特征信息识别目标对象的类型,其中,类型包括:障碍物和位于前方地面上的液体;确定模块26,用于依据类型确定是否更改第一车辆的规划路线;在本发明实施例中,采用基于雷达图像识别前方目标对象的类型的方式,从而可以依据最终的识别结果实现对障碍物或液体的识别,避免误判,进而解决了相关技术中无法区分地面上的液体是否为障碍物,影响路径规划的技术问题The embodiment of the present application further provides a path planning device. As shown in FIG. 2 , the device includes: a collection module 20 for collecting a first image of a target object located in front of a first vehicle, where the first image is a radar image The extraction module 22 is used to extract the feature information of the target object from the first image; the identification module 24 is used to identify the type of the target object according to the feature information, wherein the type includes: obstacles and the liquid on the ground ahead; The module 26 is used to determine whether to change the planned route of the first vehicle according to the type; in the embodiment of the present invention, the method of identifying the type of the target object ahead based on the radar image is adopted, so that the obstacle or liquid can be detected according to the final identification result. identification, avoid misjudgment, and then solve the technical problem of inability to distinguish whether the liquid on the ground is an obstacle and affect the path planning in the related technology

本申请的一些实施例中,采集模块20,用于通过第一车辆中安装的雷达设备扫描目标对象,得到第一图像;提取模块22,用于从第一图像中提取目标对象的形状。In some embodiments of the present application, the acquisition module 20 is used for scanning the target object through the radar device installed in the first vehicle to obtain the first image; the extraction module 22 is used for extracting the shape of the target object from the first image.

具体地,为确保了检测结果的准确性,本申请的一种可选的实施例中,采集图像的雷达设备可以为多个安装在车辆不同位置的设备,例如在车辆顶部左右两端分别放置一个雷达设备,而在本申请另一种可选的实施例中,可以将多种类型的雷达设备结合使用,例如,将毫米波雷达和超声波雷达结合使用。Specifically, in order to ensure the accuracy of the detection results, in an optional embodiment of the present application, the radar devices that collect images may be multiple devices installed in different positions of the vehicle, for example, placed at the left and right ends of the vehicle top respectively. One radar device, and in another optional embodiment of the present application, multiple types of radar devices can be used in combination, for example, a millimeter-wave radar and an ultrasonic radar can be used in combination.

本申请一种可选的实施例中,识别模块24,用于基于第一图像中目标对象的形状确定目标对象的类型。可选地,识别模块,用于在目标对象的形状为规则形状时,确定目标对象为障碍物;在目标对象的形状为非规则形状时,确定目标对象为液体。In an optional embodiment of the present application, the identification module 24 is configured to determine the type of the target object based on the shape of the target object in the first image. Optionally, the identification module is configured to determine that the target object is an obstacle when the shape of the target object is a regular shape; and determine that the target object is a liquid when the shape of the target object is an irregular shape.

具体地,基于第一图像中目标对象的形状确定目标对象的类型时,分为两种情况,当目标对象的形状为规则形状时,确定目标对象为障碍物;当目标对象的形状为非规则形状时,确定目标对象为液体。需要说明的是,规则形状是边界平滑的形状,非规则形状则是边界不平滑的形状,当目标对象为非规则形状时,雷达反射的点是不规则的,当目标对象的形状为规则形状时,确定目标对象为障碍物;当目标对象的形状为非规则形状时,确定目标对象为液体。需要说明的是,规则形状是边界平滑的形状,非规则形状则是边界不平滑的形状,当目标对象为非规则形状时,雷达反射的点是不规则的,在本申请的一种实施例中,当雷达反射的点不是规则排列的,认为其是洒落的地上的液体为水,其次,也可以结合第一车辆前方的行驶环境,确定此液体为其他化合物,例如,当激光雷达结合其他信号采集装置,识别出第一车辆前方的车辆为油罐车,则认定其液体的种类是汽油或者柴油。Specifically, when the type of the target object is determined based on the shape of the target object in the first image, there are two cases. When the shape of the target object is a regular shape, the target object is determined to be an obstacle; when the shape of the target object is irregular When forming a shape, determine that the target object is a liquid. It should be noted that a regular shape is a shape with a smooth boundary, and an irregular shape is a shape with an uneven boundary. When the target object is an irregular shape, the points reflected by the radar are irregular, and when the target object is a regular shape When , the target object is determined to be an obstacle; when the shape of the target object is an irregular shape, it is determined that the target object is a liquid. It should be noted that a regular shape is a shape with a smooth boundary, and an irregular shape is a shape with an uneven boundary. When the target object has an irregular shape, the points reflected by the radar are irregular. In an embodiment of the present application Among them, when the points reflected by the radar are not arranged regularly, it is considered that the liquid on the ground is water. Secondly, it can also be combined with the driving environment in front of the first vehicle to determine that the liquid is other compounds. For example, when the lidar is combined with other compounds The signal acquisition device recognizes that the vehicle in front of the first vehicle is an oil tanker, and determines that the type of the liquid is gasoline or diesel.

本申请的一些实施例中,确定模块26,用于依据类型确定是否更改第一车辆的规划路线。In some embodiments of the present application, the determination module 26 is configured to determine whether to change the planned route of the first vehicle according to the type.

具体地,本申请一种可选的实施例中,在确定目标对象是否为为障碍物时:可以先判断目标对象是否来自第一车辆前方的第二车辆;在判断结果指示目标对象不是来自第二车辆,且目标对象的形状为规则形状时,确定目标对象为障碍物,即就是将所有不属于第二车辆且识别为规则形状的目标对象,均认定是障碍物。Specifically, in an optional embodiment of the present application, when determining whether the target object is an obstacle: it can be first judged whether the target object is from a second vehicle in front of the first vehicle; when the judgment result indicates that the target object is not from the first vehicle When the second vehicle and the shape of the target object is a regular shape, the target object is determined to be an obstacle, that is, all target objects that do not belong to the second vehicle and are identified as a regular shape are identified as obstacles.

本申请一种可选的实施例中,为了判断目标对象是否是来自于第二车辆结果的准确性,在判断目标对象是否来自第一车辆前方的第二车辆,可以先获取第二车辆的第二图像,其中第二图像包括但不限于RGB图像;然后将将第二图像输入至机器学习模型进行分析,得到第二车辆的作业状态以及基于机器学习模型判断第二车辆的作业状态进一步确定目标对象是否来自于第二车辆,其中,需要说明的是,作业状态包括但不限于以下情况:第一种作业状态正在进行喷洒作业;第二种作业状态未进行喷洒作业。机器学习模型是通过多组数据训练得到的,其中多组数据中的每组数据均包括但不限于:第二车辆的图像和用于标记第二车辆的图像为作业状态的标签;在作业状态为正在进行喷洒作业时,确定喷洒作业对应的喷洒对象的类型是否来自于第二车辆;在类型和目标对象的类型一致时,则确定目标对象来自第二车辆。In an optional embodiment of the present application, in order to determine whether the target object is from the second vehicle and the accuracy of the result, when judging whether the target object is from the second vehicle in front of the first vehicle, the first Two images, wherein the second image includes but is not limited to RGB images; then the second image is input into the machine learning model for analysis, to obtain the working state of the second vehicle and judging the working state of the second vehicle based on the machine learning model to further determine the target Whether the object is from the second vehicle, it should be noted that the operation state includes but is not limited to the following situations: the first operation state is performing spraying operation; the second operation state is not performing spraying operation. The machine learning model is obtained by training multiple sets of data, wherein each set of data in the multiple sets of data includes but is not limited to: an image of the second vehicle and a label used to mark the image of the second vehicle as a working state; When the spraying operation is being performed, it is determined whether the type of the spraying object corresponding to the spraying operation is from the second vehicle; when the type is the same as the type of the target object, it is determined that the target object is from the second vehicle.

本申请的一种可选的实施例中,依据类型确定是否更改第一车辆的规划路线之前,方法还包括:获取第二车辆的姿态信息和第二车辆所在道路的信息;基于姿态信息预测第二车辆的行驶方向;在第二车辆的行驶方向发生改变时,则控制第一车辆继续按照规划路线行驶。该姿态信息包括但不限于:车头朝向,即就是在第二车辆与第一车辆不属于同一路线时,认为第二车辆不属于障碍物,第一车辆按照规划路线行驶即可。In an optional embodiment of the present application, before determining whether to change the planned route of the first vehicle according to the type, the method further includes: acquiring attitude information of the second vehicle and information of the road where the second vehicle is located; predicting the first vehicle based on the attitude information The driving direction of the second vehicle; when the driving direction of the second vehicle changes, the first vehicle is controlled to continue to travel according to the planned route. The attitude information includes, but is not limited to, the head orientation, that is, when the second vehicle and the first vehicle do not belong to the same route, it is considered that the second vehicle does not belong to an obstacle, and the first vehicle may travel according to the planned route.

本申请的一种可选的实施例中,在第二车辆的行驶方向未发生改变时,则控制第一车辆更改规划路线,以避开障碍物,即就是在第二车辆与本申请的第一车辆路线发生重叠,则认为第二车辆属于障碍物,此时,需要重新规划第一车辆的行驶路线。In an optional embodiment of the present application, when the driving direction of the second vehicle does not change, the first vehicle is controlled to change the planned route to avoid obstacles, that is, when the second vehicle and the When the routes of one vehicle overlap, it is considered that the second vehicle is an obstacle, and at this time, the driving route of the first vehicle needs to be re-planned.

本申请另一种可选的实施例中,依据目标对象类型确定是否更改第一车辆的行驶路线,类型包括障碍物和液体,在确定目标对象的类型为障碍物时,则修改第一车辆的规划路线,其中,修改后的规划路线用于避开目标对象;在确定目标对象的类型为液体时,则控制车辆按照当前的规划路线继续行驶,即就是认为液体不属于障碍物,例如,当洒水车喷洒出来的水喷射到第一车辆上时,不认为其对第一车辆的安全行驶构成影响,第一车辆按照需要预先规划后的路线行驶即可,无需改变行驶路线。In another optional embodiment of the present application, whether to change the driving route of the first vehicle is determined according to the type of the target object, and the types include obstacles and liquids. When it is determined that the type of the target object is an obstacle, the Planning a route, in which the revised planning route is used to avoid the target object; when the type of the target object is determined to be liquid, the vehicle is controlled to continue driving according to the current planned route, that is, the liquid is not considered to be an obstacle. When the water sprayed by the sprinkler is sprayed onto the first vehicle, it is not considered to have an impact on the safe driving of the first vehicle, and the first vehicle can drive according to the pre-planned route as required, and there is no need to change the driving route.

在本申请实施例中,采用基于雷达图像识别前方目标对象的类型的方式,从而可以依据最终的识别结果实现对障碍物或液体的识别,避免误判,进而解决了相关技术中无法区分地面上的液体是否为障碍物,影响路径规划的技术问题In the embodiment of the present application, the method of identifying the type of the target object in front based on the radar image is adopted, so that the identification of obstacles or liquids can be realized according to the final identification result, so as to avoid misjudgment, thereby solving the problem of inability to distinguish between the objects on the ground in the related art Whether the liquid is an obstacle, which affects the technical problem of path planning

根据本申请实施例的另一方面,提供了一种非易失性存储介质,存储介质包括存储的程序,其中,在程序运行时控制存储介质所在设备执行以上的路径规划方法例如,可以执行以下程序指令:采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;从第一图像中提取目标对象的特征信息;依据特征信息识别目标对象的类型,其中,类型包括:障碍物和位于前方地面上的液体;依据类型确定是否更改第一车辆的规划路线。According to another aspect of the embodiments of the present application, a non-volatile storage medium is provided, the storage medium includes a stored program, wherein, when the program runs, the device where the storage medium is located is controlled to execute the above path planning method. For example, the following may be performed Program instructions: collect a first image of a target object located in front of the first vehicle, where the first image is a radar image; extract feature information of the target object from the first image; identify the type of the target object according to the feature information, wherein the type includes : Obstacles and liquids on the ground ahead; determine whether to change the planned route of the first vehicle depending on the type.

根据本申请实施例的另一方面,提供了一种运载工具,如图3所示,该运载工具包括:电子设备3,该电子设备包括:存储器30,用于存储程序指令;处理器32,用于调取存储在存储器中的程序指令,执行以下功能:采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;从第一图像中提取目标对象的特征信息;依据特征信息识别目标对象的类型,其中,类型包括:障碍物和位于前方地面上的液体;依据类型确定是否更改第一车辆的规划路线。According to another aspect of the embodiments of the present application, a vehicle is provided. As shown in FIG. 3 , the vehicle includes: an electronic device 3 , and the electronic device includes: a memory 30 for storing program instructions; a processor 32 , It is used for retrieving the program instructions stored in the memory to perform the following functions: collecting a first image of the target object located in front of the first vehicle, where the first image is a radar image; extracting feature information of the target object from the first image; The type of the target object is identified according to the characteristic information, wherein the type includes: obstacles and liquids on the ground ahead; whether to change the planned route of the first vehicle is determined according to the type.

可选地,存储器还用于存储执行以下功能的程序:通过第一车辆中安装的雷达设备扫描目标对象,得到第一图像;从第一图像中提取目标对象的形状。Optionally, the memory is further used to store a program for performing the following functions: scanning the target object by the radar device installed in the first vehicle to obtain a first image; and extracting the shape of the target object from the first image.

可选地,存储器还用于存储执行以下功能的程序:基于第一图像中目标对象的形状确定目标对象的类型。在目标对象的形状为规则形状时,确定目标对象为障碍物;在目标对象的形状为非规则形状时,确定目标对象为液体。Optionally, the memory is further configured to store a program for performing the following function: determining the type of the target object based on the shape of the target object in the first image. When the shape of the target object is a regular shape, the target object is determined to be an obstacle; when the shape of the target object is an irregular shape, it is determined that the target object is a liquid.

在本发明实施例中,采用基于雷达图像识别前方目标对象的类型的方式,从而可以依据最终的识别结果实现对障碍物或液体的识别,避免误判,进而解决了相关技术中无法区分地面上的液体是否为障碍物,影响路径规划技术问题。In the embodiment of the present invention, the method of identifying the type of the target object in front based on the radar image is adopted, so that the identification of obstacles or liquids can be realized according to the final identification result, so as to avoid misjudgment, and further solve the problem of inability to distinguish between the ground and the ground in the related art. Whether the liquid is an obstacle affects the technical problem of path planning.

上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.

在本发明的上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the above-mentioned embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

在本申请所提供的几个实施例中,应该理解到,所揭露的技术内容,可通过其它的方式实现。其中,以上所描述的装置实施例仅仅是示意性的,例如所述单元的划分,可以为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,单元或模块的间接耦合或通信连接,可以是电性或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are only illustrative, for example, the division of the units may be a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components may be combined or Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of units or modules, and may be in electrical or other forms.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes .

以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。The above are only the preferred embodiments of the present invention. It should be pointed out that for those skilled in the art, without departing from the principles of the present invention, several improvements and modifications can be made. It should be regarded as the protection scope of the present invention.

Claims (18)

1.一种路径规划方法,其特征在于,包括:1. a path planning method, is characterized in that, comprises: 采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;collecting a first image of the target object located in front of the first vehicle, where the first image is a radar image; 从所述第一图像中提取所述目标对象的特征信息;extracting feature information of the target object from the first image; 依据所述特征信息识别所述目标对象的类型,其中,所述类型包括:障碍物和位于前方地面上的液体;Identifying the type of the target object according to the feature information, wherein the type includes: obstacles and liquids on the ground ahead; 依据所述类型确定是否更改所述第一车辆的规划路线。Whether to change the planned route of the first vehicle is determined according to the type. 2.根据权利要求1所述的方法,其特征在于,2. The method according to claim 1, wherein 采集位于第一车辆前方的目标对象的第一图像,包括:通过所述第一车辆中安装的雷达设备扫描所述目标对象,得到所述第一图像;Collecting a first image of a target object located in front of a first vehicle includes: scanning the target object through a radar device installed in the first vehicle to obtain the first image; 从所述第一图像中提取所述目标对象的特征信息,包括:从所述第一图像中提取所述目标对象的形状。Extracting the feature information of the target object from the first image includes: extracting the shape of the target object from the first image. 3.根据权利要求2所述的方法,其特征在于,依据所述特征信息识别所述目标对象的类型,包括:3. The method according to claim 2, wherein identifying the type of the target object according to the feature information comprises: 基于所述第一图像中所述目标对象的形状确定所述目标对象的类型。The type of the target object is determined based on the shape of the target object in the first image. 4.根据权利要求3所述的方法,其特征在于,基于所述第一图像中所述目标对象的形状确定所述目标对象的类型,包括:4. The method according to claim 3, wherein determining the type of the target object based on the shape of the target object in the first image comprises: 在所述目标对象的形状为规则形状时,确定所述目标对象为障碍物;When the shape of the target object is a regular shape, determine that the target object is an obstacle; 在所述目标对象的形状为非规则形状时,确定所述目标对象为液体。When the shape of the target object is an irregular shape, it is determined that the target object is liquid. 5.根据权利要求4所述的方法,其特征在于,确定所述目标对象为障碍物包括:5. The method according to claim 4, wherein determining the target object as an obstacle comprises: 判断所述目标对象是否来自所述第一车辆前方的第二车辆;determining whether the target object is from a second vehicle in front of the first vehicle; 在判断结果指示所述目标对象不是来自第二车辆,且所述目标对象的形状为规则形状时,确定所述目标对象为障碍物。When the judgment result indicates that the target object is not from the second vehicle and the shape of the target object is a regular shape, it is determined that the target object is an obstacle. 6.根据权利要求5所述的方法,其特征在于,判断所述目标对象是否来自所述第一车辆前方的第二车辆,包括:6. The method according to claim 5, wherein determining whether the target object is from a second vehicle in front of the first vehicle comprises: 获取所述第二车辆的第二图像,第二图像为RGB图像;acquiring a second image of the second vehicle, where the second image is an RGB image; 将所述第二图像输入至机器学习模型进行分析,得到所述第二车辆的作业状态以及,其中,所述作业状态包括:正在进行喷洒作业和未进行喷洒作业;所述机器学习模型是通过多组数据训练得到的,所述多组数据中的每组数据均包括:第二车辆的图像和用于标记所述第二车辆的图像为作业状态的标签;The second image is input into the machine learning model for analysis, and the operation status of the second vehicle is obtained, wherein the operation status includes: spraying operation is being performed and spraying operation is not being performed; the machine learning model is obtained by Obtained by training on multiple sets of data, each of the multiple sets of data includes: an image of the second vehicle and a label for marking the image of the second vehicle as a working state; 在所述作业状态为所述正在进行喷洒作业时,确定所述喷洒作业对应的喷洒对象的类型;在所述类型和所述目标对象的类型一致时,则确定所述目标对象来自所述第二车辆。When the operation status is the ongoing spraying operation, the type of the spraying object corresponding to the spraying operation is determined; when the type is the same as the type of the target object, it is determined that the target object is from the first Two vehicles. 7.根据权利要求5所述的方法,其特征在于,依据所述类型确定是否更改所述第一车辆的规划路线之前,所述方法还包括:7. The method according to claim 5, wherein before determining whether to change the planned route of the first vehicle according to the type, the method further comprises: 获取所述第二车辆的姿态信息和所述第二车辆所在道路;acquiring the attitude information of the second vehicle and the road where the second vehicle is located; 基于所述姿态信息预测所述第二车辆的行驶方向;predicting the driving direction of the second vehicle based on the attitude information; 在所述第二车辆的行驶方向发生改变且改变的行驶方向上存在与所述第二车辆所在道路相邻的道路时,则控制所述第一车辆继续按照所述规划路线行驶。When the driving direction of the second vehicle changes and there is a road adjacent to the road where the second vehicle is located in the changed driving direction, the first vehicle is controlled to continue to travel according to the planned route. 8.根据权利要求7所述的方法,其特征在于,在所述第二车辆的行驶方向未发生改变时,则控制所述第一车辆更改所述规划路线,以避开障碍物。8 . The method according to claim 7 , wherein when the driving direction of the second vehicle does not change, the first vehicle is controlled to change the planned route to avoid obstacles. 9 . 9.根据权利要求8所述的方法,其特征在于,控制所述第一车辆更改所述规划路线之前,所述方法还包括:9. The method according to claim 8, wherein before controlling the first vehicle to change the planned route, the method further comprises: 获取所述第一车辆和第二车辆的相对速度;obtaining the relative speed of the first vehicle and the second vehicle; 在所述相对速度大于0时,控制所述第一车辆更改所述规划路线;在所述相对速度小于0或者等于0时,则控制所述第一车辆继续按照所述规划路线行驶。When the relative speed is greater than 0, the first vehicle is controlled to change the planned route; when the relative speed is less than 0 or equal to 0, the first vehicle is controlled to continue to travel according to the planned route. 10.根据权利要求9所述的方法,其特征在于,所述姿态信息包括:所述第二车辆的车头朝向。10 . The method according to claim 9 , wherein the attitude information comprises: the head direction of the second vehicle. 11 . 11.根据权利要求10所述的方法,其特征在于,所述方法还包括:11. The method of claim 10, wherein the method further comprises: 在所述第二车辆的车头朝向发生改变且在所述车头朝向改变后按照改变后的车头朝向行驶预设时长后,确定所述第二车辆的行驶方向发生改变。It is determined that the driving direction of the second vehicle is changed after the head direction of the second vehicle is changed and the head direction of the second vehicle is changed and the vehicle travels in accordance with the changed head direction for a preset period of time. 12.根据权利要求1所述的方法,其特征在于,依据所述类型确定是否更改所述第一车辆的行驶路线,包括:12. The method according to claim 1, wherein determining whether to change the driving route of the first vehicle according to the type comprises: 在所述类型为障碍物时,则修改所述第一车辆的规划路线,其中,修改后的规划路线中避开所述目标对象;When the type is an obstacle, modifying the planned route of the first vehicle, wherein the target object is avoided in the revised planned route; 在所述类型为液体时,则控制所述车辆按照当前的规划路线继续行驶。When the type is liquid, the vehicle is controlled to continue driving according to the current planned route. 13.一种路径规划装置,其特征在于,包括:13. A path planning device, comprising: 采集模块,用于采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;a collection module, configured to collect a first image of the target object located in front of the first vehicle, where the first image is a radar image; 提取模块,用于从所述第一图像中提取所述目标对象的特征信息;an extraction module for extracting feature information of the target object from the first image; 识别模块,用于依据所述特征信息识别所述目标对象的类型,其中,所述类型包括:障碍物和位于前方地面上的液体;an identification module, configured to identify the type of the target object according to the feature information, wherein the type includes: obstacles and liquids on the ground ahead; 确定模块,用于依据所述类型确定是否更改所述第一车辆的规划路线。A determination module, configured to determine whether to change the planned route of the first vehicle according to the type. 14.根据权利要求13所述的装置,其特征在于,14. The apparatus of claim 13, wherein 所述采集模块,用于通过所述第一车辆中安装的雷达设备扫描所述目标对象,得到所述第一图像;The acquisition module is configured to scan the target object through the radar device installed in the first vehicle to obtain the first image; 所述提取模块,用于从所述第一图像中提取所述目标对象的形状。The extraction module is used for extracting the shape of the target object from the first image. 15.根据权利要求14所述的装置,其特征在于,所述识别模块,用于基于所述第一图像中所述目标对象的形状确定所述目标对象的类型。15. The apparatus according to claim 14, wherein the identification module is configured to determine the type of the target object based on the shape of the target object in the first image. 16.根据权利要求15所述的装置,其特征在于,所述识别模块,用于在所述目标对象的形状为规则形状时,确定所述目标对象为障碍物;在所述目标对象的形状为非规则形状时,确定所述目标对象为液体。16. The device according to claim 15, wherein the identification module is configured to determine that the target object is an obstacle when the shape of the target object is a regular shape; When the shape is irregular, it is determined that the target object is liquid. 17.一种非易失性存储介质,其特征在于,所述存储介质包括存储的程序,其中,在所述程序运行时控制所述存储介质所在设备执行权利要求1至12中任意一项所述的路径规划方法。17. A non-volatile storage medium, characterized in that the storage medium comprises a stored program, wherein when the program is run, a device where the storage medium is located is controlled to execute any one of claims 1 to 12. The path planning method described above. 18.一种运载工具,其特征在于,包括:电子设备,该电子设备包括:18. A vehicle, comprising: electronic equipment, the electronic equipment comprising: 存储器,用于存储程序指令;memory for storing program instructions; 处理器,用于调取存储在所述存储器中的程序指令,并在运行所述程序指令时实现以下功能:A processor, configured to call program instructions stored in the memory, and implement the following functions when running the program instructions: 采集位于第一车辆前方的目标对象的第一图像,该第一图像为雷达图像;collecting a first image of the target object located in front of the first vehicle, where the first image is a radar image; 从所述第一图像中提取所述目标对象的特征信息;extracting feature information of the target object from the first image; 依据所述特征信息识别所述目标对象的类型,其中,所述类型包括:障碍物和位于前方地面上的液体;Identifying the type of the target object according to the feature information, wherein the type includes: obstacles and liquids on the ground ahead; 依据所述类型确定是否更改所述第一车辆的规划路线。Whether to change the planned route of the first vehicle is determined according to the type.
CN202010104985.8A 2020-02-20 2020-02-20 Path planning method and device, delivery vehicle Active CN111290386B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010104985.8A CN111290386B (en) 2020-02-20 2020-02-20 Path planning method and device, delivery vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010104985.8A CN111290386B (en) 2020-02-20 2020-02-20 Path planning method and device, delivery vehicle

Publications (2)

Publication Number Publication Date
CN111290386A true CN111290386A (en) 2020-06-16
CN111290386B CN111290386B (en) 2023-08-04

Family

ID=71023351

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010104985.8A Active CN111290386B (en) 2020-02-20 2020-02-20 Path planning method and device, delivery vehicle

Country Status (1)

Country Link
CN (1) CN111290386B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024051661A1 (en) * 2022-09-07 2024-03-14 中国第一汽车股份有限公司 Pavement unevenness classification and identification method and apparatus, vehicle, and storage medium

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080245945A1 (en) * 2007-04-05 2008-10-09 David Law Modified tripod and "multi-pod" for cameras and other equipment
CN103063548A (en) * 2012-12-24 2013-04-24 江苏大学 Measurement method for liquid interfacial tension based on liquid droplet contour curve four measurement points
US20150070682A1 (en) * 2013-09-10 2015-03-12 Hyundai Motor Company Apparatus and method for recognizing obstacle using laser scanner
CN106647743A (en) * 2016-10-26 2017-05-10 纳恩博(北京)科技有限公司 Control method of electronic device and electronic device
CN106707293A (en) * 2016-12-01 2017-05-24 百度在线网络技术(北京)有限公司 Obstacle recognition method and device for vehicles
CN108931780A (en) * 2017-05-25 2018-12-04 福特全球技术公司 It paddles for vehicle safe method and apparatus
CN109269478A (en) * 2018-10-24 2019-01-25 南京大学 A kind of container terminal based on binocular vision bridge obstacle detection method
CN109664301A (en) * 2019-01-17 2019-04-23 中国石油大学(北京) Method for inspecting, device, equipment and computer readable storage medium
CN109885060A (en) * 2019-01-18 2019-06-14 丰疆智能科技研究院(常州)有限公司 Path management system and its management method
CN110059566A (en) * 2019-03-20 2019-07-26 东软睿驰汽车技术(沈阳)有限公司 A kind of image-recognizing method and device
KR102005559B1 (en) * 2018-09-04 2019-08-07 씨드로닉스(주) Situation awareness method using image segmentation
CN110155060A (en) * 2018-02-12 2019-08-23 联想(新加坡)私人有限公司 The system and method for recognizing the first route of destination
CN110296708A (en) * 2019-07-01 2019-10-01 百度在线网络技术(北京)有限公司 Lines of operation planing method, device and storage medium
CN110461677A (en) * 2017-03-30 2019-11-15 本田技研工业株式会社 Vehicle control system, vehicle control method, and vehicle control program
CN110775063A (en) * 2019-09-25 2020-02-11 华为技术有限公司 Information display method and device of vehicle-mounted equipment and vehicle

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080245945A1 (en) * 2007-04-05 2008-10-09 David Law Modified tripod and "multi-pod" for cameras and other equipment
CN103063548A (en) * 2012-12-24 2013-04-24 江苏大学 Measurement method for liquid interfacial tension based on liquid droplet contour curve four measurement points
US20150070682A1 (en) * 2013-09-10 2015-03-12 Hyundai Motor Company Apparatus and method for recognizing obstacle using laser scanner
CN106647743A (en) * 2016-10-26 2017-05-10 纳恩博(北京)科技有限公司 Control method of electronic device and electronic device
CN106707293A (en) * 2016-12-01 2017-05-24 百度在线网络技术(北京)有限公司 Obstacle recognition method and device for vehicles
CN110461677A (en) * 2017-03-30 2019-11-15 本田技研工业株式会社 Vehicle control system, vehicle control method, and vehicle control program
CN108931780A (en) * 2017-05-25 2018-12-04 福特全球技术公司 It paddles for vehicle safe method and apparatus
CN110155060A (en) * 2018-02-12 2019-08-23 联想(新加坡)私人有限公司 The system and method for recognizing the first route of destination
KR102005559B1 (en) * 2018-09-04 2019-08-07 씨드로닉스(주) Situation awareness method using image segmentation
CN109269478A (en) * 2018-10-24 2019-01-25 南京大学 A kind of container terminal based on binocular vision bridge obstacle detection method
CN109664301A (en) * 2019-01-17 2019-04-23 中国石油大学(北京) Method for inspecting, device, equipment and computer readable storage medium
CN109885060A (en) * 2019-01-18 2019-06-14 丰疆智能科技研究院(常州)有限公司 Path management system and its management method
CN110059566A (en) * 2019-03-20 2019-07-26 东软睿驰汽车技术(沈阳)有限公司 A kind of image-recognizing method and device
CN110296708A (en) * 2019-07-01 2019-10-01 百度在线网络技术(北京)有限公司 Lines of operation planing method, device and storage medium
CN110775063A (en) * 2019-09-25 2020-02-11 华为技术有限公司 Information display method and device of vehicle-mounted equipment and vehicle

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
SMITA A. NAGTODE; N. K. CHOUDHARI: "Electronic sensor based system for detecting impurity level in liquids using additive wavelet transform", 《FIFTH INTERNATIONAL CONFERENCE ON ADVANCES IN RECENT TECHNOLOGIES IN COMMUNICATION AND COMPUTING (ARTCOM 2013)》 *
康乐,等: "液体泡沫中单气泡的图像识别算法", 《渤海大学学报(自然科学版)》 *
李大杰等: "一种基于彩色图像边缘检测的道路检测方法", 《计算机工程与应用》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024051661A1 (en) * 2022-09-07 2024-03-14 中国第一汽车股份有限公司 Pavement unevenness classification and identification method and apparatus, vehicle, and storage medium

Also Published As

Publication number Publication date
CN111290386B (en) 2023-08-04

Similar Documents

Publication Publication Date Title
CN109800658B (en) System and method for on-line identification and positioning of parking space types based on neural network
JP5938569B2 (en) Advanced driver support system considering azimuth information and operation method thereof
CN113370977A (en) Intelligent vehicle forward collision early warning method and system based on vision
Guo et al. A multimodal ADAS system for unmarked urban scenarios based on road context understanding
CN113212456A (en) Vehicle control method, device, vehicle, nonvolatile storage medium and processor
CN110196429A (en) Vehicle target recognition methods, storage medium, processor and system
KR102031503B1 (en) Method and system for detecting multi-object
CN114454875A (en) A method and system for automatic parking on urban roads based on reinforcement learning
CN110949257A (en) Auxiliary parking device and method for motor vehicle
Chavez-Garcia Multiple sensor fusion for detection, classification and tracking of moving objects in driving environments
CN113740874A (en) Road edge detection method, electronic equipment and vehicle
CN113432615B (en) Detection method and system based on multi-sensor fusion drivable area and vehicle
CN109840454A (en) Object localization method, device, storage medium and equipment
CN110949255A (en) Auxiliary parking device and method for motor vehicle
CN115083199A (en) Parking space information determination method and related equipment thereof
CN111290386B (en) Path planning method and device, delivery vehicle
JP2006140636A (en) Obstacle detection apparatus and method
CN115716476A (en) Lane changing method, device, electronic device and storage medium for automatic driving
KR20210074488A (en) Method for generating guide lane for autonomous driving under atypical environment and system thereof
KR102355426B1 (en) Method and apparatus for detecting and avoiding obstacles on driving path
CN113232678A (en) Vehicle control method and device and automatic driving vehicle
Guo et al. CADAS: A multimodal advanced driver assistance system for normal urban streets based on road context understanding
JP2007188349A (en) Rear vehicle analysis device and collision prediction device
CN113176778A (en) Control method and control device for unmanned vehicle and unmanned vehicle
CN116863432B (en) Weak supervision laser travelable region prediction method and system based on deep learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant