WO2023103142A1 - Obstacle trajectory prediction method and system, and computer-readable storage medium - Google Patents

Obstacle trajectory prediction method and system, and computer-readable storage medium Download PDF

Info

Publication number
WO2023103142A1
WO2023103142A1 PCT/CN2022/071090 CN2022071090W WO2023103142A1 WO 2023103142 A1 WO2023103142 A1 WO 2023103142A1 CN 2022071090 W CN2022071090 W CN 2022071090W WO 2023103142 A1 WO2023103142 A1 WO 2023103142A1
Authority
WO
WIPO (PCT)
Prior art keywords
obstacle
candidate
information
trajectory
end point
Prior art date
Application number
PCT/CN2022/071090
Other languages
French (fr)
Chinese (zh)
Inventor
黄超
黎罗河
Original Assignee
上海仙途智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海仙途智能科技有限公司 filed Critical 上海仙途智能科技有限公司
Publication of WO2023103142A1 publication Critical patent/WO2023103142A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/095Predicting travel path or likelihood of collision
    • B60W30/0956Predicting travel path or likelihood of collision the prediction being responsive to traffic or environmental parameters
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/0097Predicting future conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/0098Details of control systems ensuring comfort, safety or stability not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W2050/0001Details of the control system
    • B60W2050/0043Signal treatments, identification of variables or parameters, parameter estimation or state estimation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00Input parameters relating to infrastructure
    • B60W2552/50Barriers
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Definitions

  • the present application relates to the technical field of automatic driving, and in particular to a method, system and computer-readable storage medium for obstacle trajectory prediction.
  • self-driving vehicles With the maturity of self-driving technology, self-driving vehicles can be widely used. In order to enable self-driving vehicles to drive in complex scenes such as urban roads, closed parks, and expressways, self-driving vehicles need to predict the trajectory of surrounding vehicles, pedestrians, bicycles and other obstacles in order to predict risks and avoid accidents.
  • the map information related to the obstacle and the historical track information of the obstacle are preprocessed, and then input into the neural network, so as to determine the target track of the obstacle.
  • the method of the related art is a black-box model, and its internal working mechanism is difficult to be understood by developers, which is not conducive to the later optimization of the method, and it is not convenient to grasp the determination process of the estimated motion trajectory in time.
  • the present application provides a method, system and computer-readable storage medium for obstacle trajectory prediction, so as to facilitate the understanding of developers.
  • the present application provides a method for predicting the trajectory of an obstacle, including: obtaining information about the obstacle and map information of the estimated movement of the obstacle; determining multiple candidate end points of the obstacle according to the map information;
  • the candidate terminal extracts a plurality of features of the candidate terminal, extracts the map feature according to the map information, and extracts the obstacle feature according to the information of the obstacle; according to the feature of the candidate terminal, the map feature and the obstacle characteristics, determining a plurality of predetermined end points from among the plurality of candidate end points, and the plurality of predetermined end points become the target end points of the estimated motion trajectory compared with the remaining candidate end points among the plurality of candidate end points
  • the possibility is higher; according to a plurality of the predetermined end points, determine the target end point of the obstacle, wherein the target end point includes the historical trajectory end point and the future reach end point; and, according to the target end point, determine the obstacle The estimated movement trajectory of the object from the end point of the historical trajectory to the end point in the future.
  • the obstacle information includes historical position information of the obstacle;
  • the map information includes lane line information, and the lane line information includes lane line adjacency relationship and lane line connection relationship; , determining a plurality of candidate end points of the obstacle, including: determining a basic lane matching the actual moving direction of the obstacle according to the historical position information; The lane line connection relationship of the lanes, expanding a plurality of candidate lanes around the basic lane; and determining a plurality of candidate end points according to the plurality of candidate lanes.
  • the extracting the features of the multiple candidate endpoints according to the multiple candidate endpoints includes: using a multi-layer perceptron to determine the features of the multiple candidate endpoints according to the multiple candidate endpoints.
  • the determining a plurality of candidate end points according to the plurality of candidate lanes includes: uniformly selecting a plurality of points on each of the candidate lanes at predetermined intervals as the plurality of candidate end points.
  • the selecting a plurality of points uniformly on each of the candidate lanes at predetermined intervals as the plurality of candidate end points includes: along the direction of the lane line of the candidate lane, uniformly at predetermined intervals on Select a plurality of points on the lane centerline of each of the candidate lanes as a plurality of candidate end points; and/or, select a plurality of points uniformly on each of the candidate lanes at predetermined intervals as a plurality of points
  • the candidate end points include: along the direction of the lane line of the candidate lane and the direction perpendicular to the direction of the lane line, uniformly select a plurality of points on each of the candidate lanes at predetermined intervals, as a plurality of points candidate endpoints.
  • the information of the obstacle includes historical track information of the obstacle; the extracting the feature of the obstacle according to the information of the obstacle includes: using a convolutional neural network according to the historical track information to extract The obstacle feature, the time feature and spatial feature of the obstacle movement; and/or, the map information includes lane line information, drivable area information and semantic information; the map feature is extracted according to the map information,
  • the method includes: extracting the map feature by using a graph neural network according to the lane line information, the drivable area information and the semantic information.
  • the determining a plurality of predetermined endpoints from the plurality of candidate endpoints includes: judging one by one whether a plurality of the candidate endpoints will become the target endpoint; determining a plurality of candidate endpoints that may become the target endpoint and/or, said determining a plurality of predetermined endpoints from a plurality of said candidate endpoints includes: determining the probability that all candidate endpoints become the target endpoint, and selecting the most likely predetermined endpoint as the selected endpoint the target end point; and/or, determining the target end point of the obstacle according to a plurality of the predetermined end points includes: using a deep neural network to extract the characteristics of the predetermined end point; The map feature and the obstacle feature are used to optimize the predetermined end point and determine the target end point.
  • the determining the estimated movement trajectory of the obstacle from the historical trajectory end point to the future reaching end point according to the target end point includes: using an optimization algorithm to determine the predicted motion trajectory according to the target end point. Estimating the motion trajectory, so that the estimated motion trajectory is smooth and conforms to the kinematics characteristics of the obstacle; and/or, according to the target end point, determining the distance from the end point of the historical trajectory to the future achievement of the obstacle
  • the estimated trajectory of the destination includes: extracting the features of the target destination according to the destination destination; inputting the features of the destination destination, the map features and the obstacle features into a deep neural network to output the The estimated trajectory of the obstacle.
  • the present application provides an obstacle trajectory prediction system, including one or more processors, configured to implement any of the methods described above.
  • the present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the method described in any one of the above items is implemented.
  • the obtained obstacle information and the map information of the estimated movement of the obstacle are clear; the extracted features, map features and obstacle features of multiple candidate endpoints , is clear, and, according to the characteristics of candidate endpoints, map features, and obstacle characteristics, multiple predetermined endpoints are determined from multiple candidate endpoints, and the predetermined endpoints are also clear.
  • the history of obstacles can be determined The estimated trajectory from the end of the trajectory to the end in the future. This method can first determine the target end point for estimation, and then determine the estimated motion trajectory based on the historical trajectory end point and the future reached end point.
  • the estimated motion trajectory is complete, so that the estimation process of the target end point is easier for developers to understand and easy to use
  • the target end point explains the final estimated motion trajectory, avoiding completely black-box prediction results, which is conducive to later optimization, and facilitates timely grasp of the determination process of the estimated motion trajectory.
  • Fig. 1 is a schematic flow chart of an embodiment of the obstacle trajectory prediction method provided by the present application
  • FIG. 2 is a schematic flow chart of an embodiment of step 120 in the obstacle trajectory prediction method shown in FIG. 1;
  • FIG. 3 is a module block diagram of an embodiment of the obstacle trajectory prediction system provided by the present application.
  • the steps of the corresponding methods may not necessarily be performed in the order shown and described in this specification.
  • the method may include more or less steps than those described in this specification.
  • a single step described in this specification may be decomposed into multiple steps for description in other embodiments; multiple steps described in this specification may also be combined into a single step in other embodiments describe.
  • the method of the related technology is a black-box model, and its internal working mechanism is difficult for developers to understand. This is not conducive to the later optimization of the method, and it is not convenient to grasp the determination process of the estimated motion trajectory in time.
  • the obtained obstacle information and the map information of the estimated movement of the obstacle are clear; the extracted features of multiple candidate endpoints, map features and obstacle features are Clear, and, according to the characteristics of the candidate endpoints, map features and obstacle characteristics, determine multiple predetermined endpoints from multiple candidate endpoints, the predetermined endpoints are also clear, and finally according to the target endpoint, the historical trajectory endpoint of the obstacle can be determined Estimated movement trajectory to reach the end point in the future.
  • This method can first determine the target end point for estimation, and then determine the estimated motion trajectory based on the historical trajectory end point and the future reached end point.
  • the estimated motion trajectory is complete, so that the estimation process of the target end point is easier for developers to understand and easy to use
  • the target end point explains the final estimated motion trajectory, avoiding completely black-box prediction results, and is also convenient for other developers to understand, which is conducive to later optimization, and facilitates timely grasp of the determination process of the estimated motion trajectory.
  • the following firstly introduces the obstacle trajectory prediction method provided by the embodiment of the present application.
  • the obstacles in the obstacle trajectory prediction method provided in the embodiment of the present application may include moving objects.
  • the mobile objects include, for example, people carrying mobile devices, one or more of non-motor vehicles and motor vehicles.
  • Mobile devices may include cell phones and/or phone watches with information gathering capabilities. It is not limited here.
  • the terminal device may include a vehicle, and the vehicle may include at least one self-driving vehicle.
  • the at least one autonomous vehicle may include one or more of the current vehicle and other vehicles other than the current vehicle. If at least one self-driving vehicle can include at least one other vehicle, based on the current vehicle, the current vehicle uses the obstacle trajectory prediction method, and may encounter an obstacle containing at least one other vehicle during the movement of the current vehicle , can predict the trajectory of obstacles, and the current vehicle can better avoid or plan driving routes.
  • the information of the current vehicle can be used to reflect the current vehicle's own situation, which includes the position information of the current vehicle and the motion state information of the current vehicle. In this way, the current position state of the vehicle can be better reflected.
  • FIG. 1 is a schematic flowchart of an embodiment of an obstacle trajectory prediction method provided by the present application.
  • the obstacle trajectory prediction method provided by the embodiment of the present application may include the following steps 110 to 160 : Step 110 , obtaining information about obstacles and map information of estimated movement of obstacles.
  • the information of the obstacle in this step 110 is used to reflect the situation of the obstacle itself, which includes historical position information of the obstacle and historical motion state information of the obstacle.
  • the historical location information of the obstacle may include one or more of the historical GPS (Global Positioning System, GPS) coordinates of the obstacle, and the historical location of the obstacle relative to the current vehicle.
  • the historical movement state information of the obstacle may include one or more of historical speed, historical acceleration, historical attitude angle, historical angular velocity, and historical angular acceleration.
  • the historical position information of obstacles and the historical motion state information of obstacles are different from the information of the current vehicle in terms of time length.
  • the historical position information of obstacles and the historical motion state information of obstacles are recorded before the current time.
  • the current vehicle’s Information is obtained in real time.
  • Step 120 according to the map information, determine multiple candidate end points of the obstacle.
  • the map information is used to reflect the map information that obstacles may pass through, and includes one or more of lane line information, drivable area information, and semantic information.
  • the lane marking information may include one or more of lane marking position and shape, lane marking adjacency relationship, lane marking connection relationship, and lane marking type.
  • the lane-line adjacency relationship may refer to the left-right adjacent relationship
  • the lane-line connection relationship may refer to the relationship between lanes extending forward and backward of the same lane.
  • the lane marking type may refer to one or more of going straight and/or turning. Wherein, the lane may be composed of a lane center line, a lane left line, and a lane right line.
  • the drivable area may include one or more of a motor vehicle lane area, a non-motor vehicle lane area, and a road boundary.
  • the semantic information may include one or more of intersection area, crosswalk area, and traffic restriction information. Traffic restriction information is used to indicate that obstacles comply with traffic rules, so that obstacles can be used to comply with traffic rules, and the trajectory of obstacles can be accurately predicted.
  • the traffic restriction information may include one or more of traffic light information, speed limit information, and traffic restriction information.
  • FIG. 2 is a schematic flowchart of an embodiment of step 120 in the obstacle trajectory prediction method shown in FIG. 1 .
  • step 120 includes the following steps 121 to 123 : step 121 , according to the historical position information, determine the basic lane matching the actual moving direction of the obstacle.
  • Step 122 expand a plurality of candidate lanes around the basic lane according to the lane-line adjacency relationship of the basic lane and the lane-line connection relationship of the basic lane.
  • multiple longer and more complete candidate lanes can be expanded to cover one or more motion requirements such as lane change, turning, and straight ahead of the obstacle.
  • the obstacle can either go straight or turn right, and two candidate lanes will be expanded.
  • One candidate lane can be the lane that continues straight along the basic lane, and the other candidate lane can be The right turn lane continues along the base lane.
  • Step 123 determine a plurality of candidate end points according to the plurality of candidate lanes.
  • An embodiment of this step 123 may include selecting a plurality of points evenly on each candidate lane at a predetermined interval, as a plurality of candidate end points, the predetermined interval may be determined according to the accuracy of the estimated motion trajectory required by the user, and the estimated motion trajectory The greater the accuracy of the estimated motion trajectory, the smaller the predetermined interval, and the smaller the accuracy of the estimated motion trajectory, the larger the predetermined interval, which is not limited here. In this way, multiple points are uniformly selected on each candidate lane, and the determined candidate lane more accurately reflects the situation of the entire candidate lane, improving the accuracy of multiple candidate end points.
  • the candidate lane can be segmented to obtain a segmented lane; Select multiple points as multiple candidate endpoints. In this way, the amount of calculation for a segmented lane is less than the amount of calculation for the entire segment of candidate lanes, thereby improving processing efficiency.
  • each candidate lane there are multiple embodiments of selecting multiple points uniformly in each candidate lane at predetermined intervals as multiple candidate end points.
  • uniformly select points at predetermined intervals at each Select multiple points on the lane centerline of each candidate lane as multiple candidate end points, so that the candidate end point is selected based on the centerline, and a better prediction effect of the estimated motion trajectory can be obtained while controlling the amount of calculation.
  • a plurality of points are uniformly selected on each candidate lane at predetermined intervals as the plurality of candidate end points.
  • Such a dense selection of points in the candidate lane will increase the amount of calculation to a certain extent, but can obtain more complete and accurate prediction results.
  • the distribution of multiple points selected in the direction of the lane line of the candidate lane and the direction perpendicular to the direction of the lane line can be in an array or a grid. In this way, the selected points are not only dense, but also relatively regular, so that the selected candidate end point It is more reasonable, and the estimated motion trajectory obtained is more reasonable.
  • Step 130 extract features of multiple candidate destinations according to multiple candidate destinations, extract map features according to map information, and extract obstacle features according to obstacle information.
  • extracting features of multiple candidate endpoints according to multiple candidate endpoints in step 130 may include determining features of multiple candidate endpoints based on multiple candidate endpoints using a multi-layer perceptron.
  • the multi-layer perceptron can be used independently to determine the features of multiple candidate endpoints, so that the features of multiple candidate endpoints can be better mined, so as to better extract the features of the target endpoint.
  • Extracting map features based on map information in step 130 may include extracting map features using a graph neural network based on lane line information, drivable area information, and semantic information, wherein the map features may include topological features between multiple candidate lanes, location and semantic features.
  • the graph neural network can be used independently to visually determine the map features, which is convenient for understanding the map features, so that the map features can be better mined.
  • the extraction of obstacle features based on obstacle information in step 130 includes: extracting temporal and spatial features of obstacle movement by using a convolutional neural network based on historical trajectory information.
  • the convolutional neural network can be used independently to extract the temporal and spatial features of the obstacle movement, so that the temporal and spatial characteristics of the obstacle movement can be better mined to facilitate the determination of the target end point.
  • this step 130 may also include a preprocessing operation on the multiple candidate destinations, map information, and obstacle information, wherein the preprocessing operation includes coordinate conversion and information encoding. In this way, it is convenient to remove some noise related to features, improve the accuracy of feature extraction, and then perform extraction of features, map features and obstacle features of multiple candidate endpoints.
  • Step 140 according to the characteristics of the candidate destinations, the map characteristics and the obstacle characteristics, determine a plurality of predetermined destinations from the plurality of candidate destinations.
  • the probability of the target endpoint is higher.
  • the predetermined end point may refer to the initially determined end point, and step 150 needs to be performed to determine whether the predetermined end point can become the final target end point.
  • This step 140 can be implemented in various embodiments. In some embodiments, it is judged one by one whether multiple candidate endpoints will become target endpoints; multiple candidate endpoints that may become target endpoints are determined as multiple predetermined endpoints. Setting multiple predetermined endpoints in this way can predict multiple estimated motion trajectories, covering a more complete trajectory space, and can also reduce the mutation of the estimated motion trajectory and ensure stability. At the same time, determining candidate endpoints one by one can improve the determination of candidate endpoints. accuracy. Specifically, a multi-layer perceptron and/or an attention algorithm may be used to determine whether multiple candidate endpoints will become target endpoints.
  • the probability of all candidate endpoints becoming the target endpoint is determined, and the predetermined endpoint with the highest possibility is selected as the target endpoint. In this way, the passing probability can quickly determine the target end point, and the speed is faster.
  • a multilayer perceptron and/or an attention algorithm may be used to determine the probability that all candidate endpoints become target endpoints.
  • Step 150 determine the target end point of the obstacle according to multiple predetermined end points, wherein the target end point includes the end point of the historical trajectory and the end point reached in the future.
  • the predetermined end point is optimized, and the position of the predetermined end point is adjusted, so that the coordinate point of the predetermined end point is more accurate as the end point of the estimated motion track.
  • An embodiment of this step 150 may include: using a deep neural network to extract features of the predetermined destination; optimizing the predetermined destination and determining the target destination according to the characteristic map features and obstacle characteristics of the predetermined destination.
  • the generation of the predicted trajectory can be controlled to ensure the validity of the end point and the reliability of the estimated motion trajectory.
  • the target end point can then be checked to ensure that the estimated trajectory conforms to vehicle kinematics, follows traffic regulations, has no collisions, etc.
  • Step 160 determine the estimated movement track of the obstacle from the end point of the historical track to the end point in the future.
  • this step 160 there are many implementations of this step 160.
  • an optimization algorithm is used to determine the estimated motion trajectory, so that the estimated motion trajectory is smooth and conforms to the kinematic characteristics of the obstacle.
  • Using the optimization algorithm in this way can detect the estimated motion trajectory and obtain a smooth estimated motion trajectory that conforms to the kinematic characteristics of obstacles, which can ensure the rationality of the estimated motion trajectory, thereby ensuring the safety of the current vehicle and reducing the occurrence of accidents possibility.
  • the features of the target end point are extracted according to the target end point; the feature of the target end point, the map feature and the obstacle feature are input into the deep neural network to output the estimated movement trajectory of the obstacle. In this way, the strong function fitting ability of the deep neural network is used, and at the same time, the artificial design of complex optimization algorithm constraints is avoided.
  • FIG. 3 is a module block diagram of an embodiment of an obstacle trajectory prediction system 300 provided by the present application.
  • the obstacle trajectory prediction system 300 includes one or more processors 301 for implementing the obstacle trajectory prediction method described above.
  • the obstacle trajectory prediction system 300 may include a computer-readable storage medium 309, which may store a program that can be invoked by the processor 301, and may include a non-volatile storage medium.
  • obstacle trajectory prediction system 300 may include memory 308 and interface 307 .
  • the obstacle trajectory prediction system 300 may also include other hardware according to actual applications.
  • the computer-readable storage medium 309 of the embodiment of the present application stores a program thereon, and when the program is executed by the processor 301, it is used to implement the obstacle trajectory prediction method described above.
  • This application may take the form of a computer program product embodied on one or more computer readable storage media 309 (including but not limited to disk storage, CD-ROM, optical storage, etc.) having program code embodied therein.
  • Computer-readable storage media 309 includes both permanent and non-permanent, removable and non-removable media, and information storage may be implemented by any method or technology.
  • Information may be computer readable instructions, data structures, modules of a program, or other data.
  • Examples of computer readable storage media 309 include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), Read memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cartridge, tape magnetic disk storage or other magnetic storage device or any other non-transmission medium that may be used to store information that can be accessed by a computing device.
  • PRAM phase change memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • RAM random access memory
  • ROM Read memory
  • EEPROM electrically erasable programmable read-only memory
  • flash memory or other memory technologies
  • compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage magnetic cartridge, tape magnetic disk storage or other magnetic storage device or any other non-transmission medium that may be used to store information that can be

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Provided in the present application are an obstacle trajectory prediction method and system, and a computer-readable storage medium. The obstacle trajectory prediction method comprises: acquiring information of an obstacle and map information of a predicted motion of the obstacle; determining a plurality of candidate destinations of the obstacle according to the map information; extracting features of the plurality of candidate destinations according to the plurality of candidate destinations, extracting map features according to the map information, and extracting obstacle features according to the information of the obstacle; determining a plurality of predetermined destinations from the plurality of candidate destinations according to these features, wherein compared with the remaining candidate destinations from among the plurality of candidate destinations, the plurality of predetermined destinations have a higher possibility of becoming a target destination of a predicted motion trajectory; determining target destinations of the obstacle according to the plurality of predetermined destinations, wherein the target destinations comprise the destination of a historical trajectory and a future arrival destination; and according to the target destinations, determining a predicted motion trajectory of the obstacle from the destination of the historical trajectory to the future arrival destination.

Description

障碍物轨迹预测的方法、系统和计算机可读存储介质Method, system and computer-readable storage medium for obstacle trajectory prediction 技术领域technical field
本申请涉及自动驾驶技术领域,尤其涉及障碍物轨迹预测的方法、系统和计算机可读存储介质。The present application relates to the technical field of automatic driving, and in particular to a method, system and computer-readable storage medium for obstacle trajectory prediction.
背景技术Background technique
随着自动驾驶技术的日渐成熟,自动驾驶车辆得以广泛应用。为了可以使得自动驾驶车辆在城市道路、封闭园区、高速公路等复杂场景中行驶,自动驾驶车辆需要对周围车辆、行人、自行车等障碍物进行轨迹预测,以便预知风险,避免发生事故。With the maturity of self-driving technology, self-driving vehicles can be widely used. In order to enable self-driving vehicles to drive in complex scenes such as urban roads, closed parks, and expressways, self-driving vehicles need to predict the trajectory of surrounding vehicles, pedestrians, bicycles and other obstacles in order to predict risks and avoid accidents.
相关技术的方法中将障碍物相关的地图信息与障碍物历史轨迹信息经过预处理后,输入神经网络,从而确定障碍物的目标轨迹。但是,相关技术的方法为黑盒模型,其内部工作机制,很难被开发人员理解,这样不利于方法的后期优化,也不方便及时掌握预估运动轨迹的确定过程。In the method of the related art, the map information related to the obstacle and the historical track information of the obstacle are preprocessed, and then input into the neural network, so as to determine the target track of the obstacle. However, the method of the related art is a black-box model, and its internal working mechanism is difficult to be understood by developers, which is not conducive to the later optimization of the method, and it is not convenient to grasp the determination process of the estimated motion trajectory in time.
发明内容Contents of the invention
本申请提供一种障碍物轨迹预测的方法、系统和计算机可读存储介质,以方便开发人员理解。The present application provides a method, system and computer-readable storage medium for obstacle trajectory prediction, so as to facilitate the understanding of developers.
本申请提供一种障碍物轨迹预测方法,包括:获取障碍物的信息及所述障碍物预估运动的地图信息;根据所述地图信息,确定所述障碍物的多个候选终点;根据多个所述候选终点提取多个所述候选终点的特征,根据所述地图信息提取地图特征,并根据所述障碍物的信息提取所述障碍物特征;根据所述候选终点的特征、所述地图特征及所述障碍物特征,从多个所述候选终点中确定多个预定终点,多个所述预定终点相较于多个所述候选终点中的其余候选终点,成为预估运动轨迹的目标终点的可能性更高;根据多个所述预定终点,确定所述障碍物的目标终点,其中,所述目标终点包括历史轨迹终点及未来达到终点;及,根据所述目标终点,确定所述障碍物的从所述历史轨迹终点到所述未来达到终点的预估运动轨迹。The present application provides a method for predicting the trajectory of an obstacle, including: obtaining information about the obstacle and map information of the estimated movement of the obstacle; determining multiple candidate end points of the obstacle according to the map information; The candidate terminal extracts a plurality of features of the candidate terminal, extracts the map feature according to the map information, and extracts the obstacle feature according to the information of the obstacle; according to the feature of the candidate terminal, the map feature and the obstacle characteristics, determining a plurality of predetermined end points from among the plurality of candidate end points, and the plurality of predetermined end points become the target end points of the estimated motion trajectory compared with the remaining candidate end points among the plurality of candidate end points The possibility is higher; according to a plurality of the predetermined end points, determine the target end point of the obstacle, wherein the target end point includes the historical trajectory end point and the future reach end point; and, according to the target end point, determine the obstacle The estimated movement trajectory of the object from the end point of the historical trajectory to the end point in the future.
可选的,所述障碍物的信息包括障碍物的历史位置信息;所述地图信息包括车道线信息,所述车道线信息包括车道线邻接关系及车道线连接关系;所述根据所述地图信息,确定所述障碍物的多个候选终点,包括:根据所述历史位置信息,确定与所述障碍物实 际运动方向相匹配的基础车道;根据所述基础车道的车道线邻接关系及所述基础车道的车道线连接关系,在所述基础车道周围拓展多条候选车道;根据多条所述候选车道,确定多个所述候选终点。Optionally, the obstacle information includes historical position information of the obstacle; the map information includes lane line information, and the lane line information includes lane line adjacency relationship and lane line connection relationship; , determining a plurality of candidate end points of the obstacle, including: determining a basic lane matching the actual moving direction of the obstacle according to the historical position information; The lane line connection relationship of the lanes, expanding a plurality of candidate lanes around the basic lane; and determining a plurality of candidate end points according to the plurality of candidate lanes.
可选的,所述根据多个所述候选终点提取多个所述候选终点的特征,包括:根据多个所述候选终点,采用多层感知机,确定多个所述候选终点的特征。Optionally, the extracting the features of the multiple candidate endpoints according to the multiple candidate endpoints includes: using a multi-layer perceptron to determine the features of the multiple candidate endpoints according to the multiple candidate endpoints.
可选的,所述根据多条所述候选车道,确定多个所述候选终点,包括:以预定间隔均匀地在每条所述候选车道上选择多个点,作为多个所述候选终点。Optionally, the determining a plurality of candidate end points according to the plurality of candidate lanes includes: uniformly selecting a plurality of points on each of the candidate lanes at predetermined intervals as the plurality of candidate end points.
可选的,所述以预定间隔均匀地在每条所述候选车道上选择多个点,作为多个所述候选终点,包括:沿所述候选车道的车道线方向,以预定间隔均匀地在每条所述候选车道的车道中心线上选择多个点,作为多个所述候选终点;和/或,所述以预定间隔均匀地在每条所述候选车道上选择多个点,作为多个所述候选终点,包括:沿所述候选车道的车道线方向以及垂直于所述车道线方向的方向,以预定间隔均匀地在每条所述候选车道上选择多个点,作为多个所述候选终点。Optionally, the selecting a plurality of points uniformly on each of the candidate lanes at predetermined intervals as the plurality of candidate end points includes: along the direction of the lane line of the candidate lane, uniformly at predetermined intervals on Select a plurality of points on the lane centerline of each of the candidate lanes as a plurality of candidate end points; and/or, select a plurality of points uniformly on each of the candidate lanes at predetermined intervals as a plurality of points The candidate end points include: along the direction of the lane line of the candidate lane and the direction perpendicular to the direction of the lane line, uniformly select a plurality of points on each of the candidate lanes at predetermined intervals, as a plurality of points candidate endpoints.
可选的,所述障碍物的信息包括障碍物的历史轨迹信息;所述根据所述障碍物的信息提取所述障碍物特征,包括:根据所述历史轨迹信息,采用卷积神经网络,提取所述障碍物特征,所述障碍物运动的时间特征和空间特征;和/或,所述地图信息包括车道线信息、可行驶区域信息及语义信息;所述根据所述地图信息提取地图特征,包括:根据所述车道线信息、所述可行驶区域信息及所述语义信息,采用图神经网络,提取所述地图特征。Optionally, the information of the obstacle includes historical track information of the obstacle; the extracting the feature of the obstacle according to the information of the obstacle includes: using a convolutional neural network according to the historical track information to extract The obstacle feature, the time feature and spatial feature of the obstacle movement; and/or, the map information includes lane line information, drivable area information and semantic information; the map feature is extracted according to the map information, The method includes: extracting the map feature by using a graph neural network according to the lane line information, the drivable area information and the semantic information.
可选的,所述从多个所述候选终点中确定多个预定终点,包括:逐个判断多个所述候选终点是否会成为所述目标终点;将可能成为目标终点的多个候选终点,确定为多个预定终点;和/或,所述从多个所述候选终点中确定多个预定终点,包括:确定所有候选终点成为所述目标终点的概率,选择可能性最大的预定终点,作为所述目标终点;和/或,所述根据多个所述预定终点,确定所述障碍物的目标终点,包括:使用深度神经网络,提取所述预定终点的特征;根据所述预定终点的特征所述地图特征及所述障碍物特征,优化所述预定终点,确定所述目标终点。Optionally, the determining a plurality of predetermined endpoints from the plurality of candidate endpoints includes: judging one by one whether a plurality of the candidate endpoints will become the target endpoint; determining a plurality of candidate endpoints that may become the target endpoint and/or, said determining a plurality of predetermined endpoints from a plurality of said candidate endpoints includes: determining the probability that all candidate endpoints become the target endpoint, and selecting the most likely predetermined endpoint as the selected endpoint the target end point; and/or, determining the target end point of the obstacle according to a plurality of the predetermined end points includes: using a deep neural network to extract the characteristics of the predetermined end point; The map feature and the obstacle feature are used to optimize the predetermined end point and determine the target end point.
可选的,所述根据所述目标终点,确定所述障碍物的从所述历史轨迹终点到所述未来达到终点的预估运动轨迹,包括:根据所述目标终点,使用优化算法,确定预估运动轨迹,以使所述预估运动轨迹平滑且符合障碍物运动学特性;和/或,所述根据所述目标 终点,确定所述障碍物的从所述历史轨迹终点到所述未来达到终点的预估运动轨迹,包括:根据所述目标终点,提取所述目标终点的特征;将所述目标终点的特征,所述地图特征及所述障碍物特征输入至深度神经网络,以输出所述障碍物的预估运动轨迹。Optionally, the determining the estimated movement trajectory of the obstacle from the historical trajectory end point to the future reaching end point according to the target end point includes: using an optimization algorithm to determine the predicted motion trajectory according to the target end point. Estimating the motion trajectory, so that the estimated motion trajectory is smooth and conforms to the kinematics characteristics of the obstacle; and/or, according to the target end point, determining the distance from the end point of the historical trajectory to the future achievement of the obstacle The estimated trajectory of the destination includes: extracting the features of the target destination according to the destination destination; inputting the features of the destination destination, the map features and the obstacle features into a deep neural network to output the The estimated trajectory of the obstacle.
本申请的提供一种障碍物轨迹预测系统,包括一个或多个处理器,用于实现如上任一项所述的方法。The present application provides an obstacle trajectory prediction system, including one or more processors, configured to implement any of the methods described above.
本申请的提供一种计算机可读存储介质,其上存储有程序,该程序被处理器执行时,实现如上任一项所述的方法。The present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the method described in any one of the above items is implemented.
在一些实施例中,本申请的障碍物轨迹预测方法,获取的障碍物的信息及障碍物预估运动的地图信息,是明确的;提取的多个候选终点的特征、地图特征及障碍物特征,是明确的,并且,根据候选终点的特征、地图特征及障碍物特征,从多个候选终点中确定多个预定终点,预定终点也是明确的,最后根据目标终点,可以确定障碍物的从历史轨迹终点到未来达到终点的预估运动轨迹。如此方法可以先确定目标终点进行估计,再根据历史轨迹终点及未来达到终点确定预估运动轨迹,此预估运动轨迹是完整的,这样目标终点的估计过程是开发人员更容易理解的,易于根据目标终点对最终的预估运动轨迹做出解释,避免完全黑箱式的预测结果,有利于后期优化,方便及时掌握预估运动轨迹的确定过程。In some embodiments, in the obstacle trajectory prediction method of the present application, the obtained obstacle information and the map information of the estimated movement of the obstacle are clear; the extracted features, map features and obstacle features of multiple candidate endpoints , is clear, and, according to the characteristics of candidate endpoints, map features, and obstacle characteristics, multiple predetermined endpoints are determined from multiple candidate endpoints, and the predetermined endpoints are also clear. Finally, according to the target endpoint, the history of obstacles can be determined The estimated trajectory from the end of the trajectory to the end in the future. This method can first determine the target end point for estimation, and then determine the estimated motion trajectory based on the historical trajectory end point and the future reached end point. The estimated motion trajectory is complete, so that the estimation process of the target end point is easier for developers to understand and easy to use The target end point explains the final estimated motion trajectory, avoiding completely black-box prediction results, which is conducive to later optimization, and facilitates timely grasp of the determination process of the estimated motion trajectory.
附图说明Description of drawings
图1所示为本申请提供的障碍物轨迹预测方法的一实施例的流程示意图;Fig. 1 is a schematic flow chart of an embodiment of the obstacle trajectory prediction method provided by the present application;
图2所示为图1所示的障碍物轨迹预测方法中的步骤120的一实施例的流程示意图;FIG. 2 is a schematic flow chart of an embodiment of step 120 in the obstacle trajectory prediction method shown in FIG. 1;
图3所示为本申请提供的障碍物轨迹预测系统的一实施例的模块框图。FIG. 3 is a module block diagram of an embodiment of the obstacle trajectory prediction system provided by the present application.
具体实施方式Detailed ways
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施例并不代表与本说明书一个或多个实施例相一致的所有实施例。相反,它们仅是与如所附权利要求书中所详述的、本说明书一个或多个实施例的一些方面相一致的装置和方法的例子。Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with one or more embodiments of this specification. Rather, they are merely examples of apparatuses and methods consistent with aspects of one or more embodiments of the present specification as recited in the appended claims.
需要说明的是:在其他实施例中并不一定按照本说明书示出和描述的顺序来执行相 应方法的步骤。在一些其他实施例中,其方法所包括的步骤可以比本说明书所描述的更多或更少。此外,本说明书中所描述的单个步骤,在其他实施例中可能被分解为多个步骤进行描述;而本说明书中所描述的多个步骤,在其他实施例中也可能被合并为单个步骤进行描述。It should be noted that in other embodiments, the steps of the corresponding methods may not necessarily be performed in the order shown and described in this specification. In some other embodiments, the method may include more or less steps than those described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; multiple steps described in this specification may also be combined into a single step in other embodiments describe.
相关技术的方法为黑盒模型,其内部工作机制,很难被开发人员理解,这样不利于方法的后期优化,也不方便及时掌握预估运动轨迹的确定过程,为了解决这一技术问题,本申请实施例提供的一种障碍物轨迹预测方法,获取的障碍物的信息及障碍物预估运动的地图信息,是明确的;提取的多个候选终点的特征、地图特征及障碍物特征,是明确的,并且,根据候选终点的特征、地图特征及障碍物特征,从多个候选终点中确定多个预定终点,预定终点也是明确的,最后根据目标终点,可以确定障碍物的从历史轨迹终点到未来达到终点的预估运动轨迹。如此方法可以先确定目标终点进行估计,再根据历史轨迹终点及未来达到终点确定预估运动轨迹,此预估运动轨迹是完整的,这样目标终点的估计过程是开发人员更容易理解的,易于根据目标终点对最终的预估运动轨迹做出解释,避免完全黑箱式的预测结果,也方便其他开发人员理解,有利于后期优化,方便及时掌握预估运动轨迹的确定过程。The method of the related technology is a black-box model, and its internal working mechanism is difficult for developers to understand. This is not conducive to the later optimization of the method, and it is not convenient to grasp the determination process of the estimated motion trajectory in time. In order to solve this technical problem, this In the obstacle trajectory prediction method provided in the embodiment of the application, the obtained obstacle information and the map information of the estimated movement of the obstacle are clear; the extracted features of multiple candidate endpoints, map features and obstacle features are Clear, and, according to the characteristics of the candidate endpoints, map features and obstacle characteristics, determine multiple predetermined endpoints from multiple candidate endpoints, the predetermined endpoints are also clear, and finally according to the target endpoint, the historical trajectory endpoint of the obstacle can be determined Estimated movement trajectory to reach the end point in the future. This method can first determine the target end point for estimation, and then determine the estimated motion trajectory based on the historical trajectory end point and the future reached end point. The estimated motion trajectory is complete, so that the estimation process of the target end point is easier for developers to understand and easy to use The target end point explains the final estimated motion trajectory, avoiding completely black-box prediction results, and is also convenient for other developers to understand, which is conducive to later optimization, and facilitates timely grasp of the determination process of the estimated motion trajectory.
下面首先对本申请实施例提供的障碍物轨迹预测方法进行介绍。The following firstly introduces the obstacle trajectory prediction method provided by the embodiment of the present application.
本申请实施例提供的一种障碍物轨迹预测方法中的障碍物可以包括移动物。其中移动物比如包括携带有移动设备的人,非机动车辆、机动车辆中的一种或多种。移动设备可以包括具有信息收集功能的手机和/或电话手表。在此并不做限定。The obstacles in the obstacle trajectory prediction method provided in the embodiment of the present application may include moving objects. The mobile objects include, for example, people carrying mobile devices, one or more of non-motor vehicles and motor vehicles. Mobile devices may include cell phones and/or phone watches with information gathering capabilities. It is not limited here.
此障碍物轨迹预测方法可以应用于终端设备。此终端设备可以包括车辆,车辆可以包括至少一辆自动驾驶车辆。至少一辆自动驾驶车辆可以包括当前车辆以及除当前车辆以外的其他车辆中的一辆或多辆。如果至少一辆自动驾驶车辆可以包括至少一辆其他车辆,以当前车辆为基准,当前车辆使用该障碍物轨迹预测方法,在当前车辆移动过程中可能会遇到包含至少一辆其他车辆的障碍物,可以预测障碍物的轨迹,当前车辆可以更好的避让或者规划行驶路线。当前车辆可以通过当前车辆的信息用来反映当前车辆的自身情况,其包括当前车辆的位置信息及当前车辆的运动状态信息。如此可以更好的反映当前车辆的位置状态。This obstacle trajectory prediction method can be applied to terminal equipment. The terminal device may include a vehicle, and the vehicle may include at least one self-driving vehicle. The at least one autonomous vehicle may include one or more of the current vehicle and other vehicles other than the current vehicle. If at least one self-driving vehicle can include at least one other vehicle, based on the current vehicle, the current vehicle uses the obstacle trajectory prediction method, and may encounter an obstacle containing at least one other vehicle during the movement of the current vehicle , can predict the trajectory of obstacles, and the current vehicle can better avoid or plan driving routes. The information of the current vehicle can be used to reflect the current vehicle's own situation, which includes the position information of the current vehicle and the motion state information of the current vehicle. In this way, the current position state of the vehicle can be better reflected.
图1所示为本申请提供的障碍物轨迹预测方法的一实施例的流程示意图。FIG. 1 is a schematic flowchart of an embodiment of an obstacle trajectory prediction method provided by the present application.
如图1所示,本申请实施例所提供的障碍物轨迹预测方法,可以包括如下步骤110~ 步骤160:步骤110,获取障碍物的信息及障碍物预估运动的地图信息。As shown in FIG. 1 , the obstacle trajectory prediction method provided by the embodiment of the present application may include the following steps 110 to 160 : Step 110 , obtaining information about obstacles and map information of estimated movement of obstacles.
本步骤110中的障碍物的信息用来反映障碍物的自身情况,其包括障碍物的历史位置信息及障碍物的历史运动状态信息。障碍物的历史位置信息可以包括障碍物的历史全球定位系统(Global Positioning System,简称GPS)坐标、障碍物相对当前车辆的历史位置中的一种或多种。障碍物的历史运动状态信息可以包括历史速度、历史加速度、历史姿态角、历史角速度、历史角加速度中的一种或多种。障碍物的历史位置信息及障碍物的历史运动状态信息分别与当前车辆的信息在于时间长不同,障碍物的历史位置信息及障碍物的历史运动状态信息是当前时间之前已记录的,当前车辆的信息是实时获取的。The information of the obstacle in this step 110 is used to reflect the situation of the obstacle itself, which includes historical position information of the obstacle and historical motion state information of the obstacle. The historical location information of the obstacle may include one or more of the historical GPS (Global Positioning System, GPS) coordinates of the obstacle, and the historical location of the obstacle relative to the current vehicle. The historical movement state information of the obstacle may include one or more of historical speed, historical acceleration, historical attitude angle, historical angular velocity, and historical angular acceleration. The historical position information of obstacles and the historical motion state information of obstacles are different from the information of the current vehicle in terms of time length. The historical position information of obstacles and the historical motion state information of obstacles are recorded before the current time. The current vehicle’s Information is obtained in real time.
步骤120,根据地图信息,确定障碍物的多个候选终点。 Step 120, according to the map information, determine multiple candidate end points of the obstacle.
地图信息用于反映障碍物可以所经的地图信息,其包括车道线信息、可行驶区域信息及语义信息中的一种或多种。车道线信息可以包括车道线位置与形状、车道线邻接关系、车道线连接关系、车道线类型中的一种或多种。车道线邻接关系可以是指左右相邻的关系,车道线连接关系可以是指同一车道前后延伸的车道的关系。车道线类型可以是指直行和/或转弯中的一种或多种。其中,车道可以是由车道中心线、车道左边线、车道右边线构成的。在理想条件下,当车辆直线行驶时,车辆中心的轨迹与车道中心线较为接近。当车辆在车道左边线和车道右边线的中间构成的区域内行驶时,可以称车辆属于此车道。可行驶区域可以包括机动车道区域、非机动车道区域、道路边界中的一种或多种。语义信息可以包括十字路口区域、人行横道区域、交通限制信息中的一种或多种。交通限制信息用于表示障碍物遵守交通规则,如此可以通过障碍物遵守交通规则,准确地预测障碍物的轨迹。交通限制信息可以包括交通灯信息、限速信息及限行信息中的一种或多种。The map information is used to reflect the map information that obstacles may pass through, and includes one or more of lane line information, drivable area information, and semantic information. The lane marking information may include one or more of lane marking position and shape, lane marking adjacency relationship, lane marking connection relationship, and lane marking type. The lane-line adjacency relationship may refer to the left-right adjacent relationship, and the lane-line connection relationship may refer to the relationship between lanes extending forward and backward of the same lane. The lane marking type may refer to one or more of going straight and/or turning. Wherein, the lane may be composed of a lane center line, a lane left line, and a lane right line. Under ideal conditions, when the vehicle is driving straight, the trajectory of the vehicle center is relatively close to the centerline of the lane. When a vehicle is driving in the area formed by the middle of the left line of the lane and the right line of the lane, the vehicle can be said to belong to this lane. The drivable area may include one or more of a motor vehicle lane area, a non-motor vehicle lane area, and a road boundary. The semantic information may include one or more of intersection area, crosswalk area, and traffic restriction information. Traffic restriction information is used to indicate that obstacles comply with traffic rules, so that obstacles can be used to comply with traffic rules, and the trajectory of obstacles can be accurately predicted. The traffic restriction information may include one or more of traffic light information, speed limit information, and traffic restriction information.
图2所示为图1所示的障碍物轨迹预测方法中的步骤120的一实施例的流程示意图。如图2所示,步骤120包括如下步骤121~步骤123:步骤121,根据历史位置信息,确定与障碍物实际运动方向相匹配的基础车道。FIG. 2 is a schematic flowchart of an embodiment of step 120 in the obstacle trajectory prediction method shown in FIG. 1 . As shown in FIG. 2 , step 120 includes the following steps 121 to 123 : step 121 , according to the historical position information, determine the basic lane matching the actual moving direction of the obstacle.
在十字路口区域等车道数量多且互相交错时,如此可以障碍物可能会经过多个车道,根据历史位置信息,确定与障碍物实际运动方向相匹配的车道,作为基础车道,这样可以确定障碍物所属的车道。When there are many lanes in the intersection area and intersect with each other, obstacles may pass through multiple lanes. According to the historical position information, determine the lane that matches the actual movement direction of the obstacle as the basic lane, so that obstacles can be determined. The lane to which it belongs.
步骤122,根据基础车道的车道线邻接关系及基础车道的车道线连接关系,在基础车道周围拓展多条候选车道。从障碍物的基础车道开始,可以拓展出多条更长、更完整 的候选车道,以覆盖障碍物的变道、转向、直行等一种或多种运动需求。例如障碍物处于在十字路口区域前的基础车道,障碍物既可以直行也可以右转,将拓展出两条候选车道,一条候选车道可以为沿基础车道继续直行的车道,另一条候选车道可以为沿基础车道继续右转的车道。 Step 122 , expand a plurality of candidate lanes around the basic lane according to the lane-line adjacency relationship of the basic lane and the lane-line connection relationship of the basic lane. Starting from the basic lane of the obstacle, multiple longer and more complete candidate lanes can be expanded to cover one or more motion requirements such as lane change, turning, and straight ahead of the obstacle. For example, if the obstacle is in the basic lane before the intersection area, the obstacle can either go straight or turn right, and two candidate lanes will be expanded. One candidate lane can be the lane that continues straight along the basic lane, and the other candidate lane can be The right turn lane continues along the base lane.
步骤123,根据多条候选车道,确定多个候选终点。 Step 123, determine a plurality of candidate end points according to the plurality of candidate lanes.
本步骤123的一实施例可以包括以预定间隔均匀地在每条候选车道上选择多个点,作为多个候选终点,预定间隔可以根据用户需求的预估运动轨迹的精度确定,预估运动轨迹的精度越大,则预定间隔越小,预估运动轨迹的精度越小,则预定间隔越大,在此并不做限定。如此,均匀地在每条候选车道上选择多个点,确定出的候选车道更准确地反映整个候选车道的情况,提高多个候选终点的准确性。进一步的,本步骤123中,针对多个候选车道中的每个候选车道,可以将该条候选车道分段,得到分段车道;依次对一个分段车道以预定间隔均匀地在每条候选车道上选择多个点,作为多个候选终点。这样对一个分段车道的计算量小于整段候选车道的计算量,提高处理效率。An embodiment of this step 123 may include selecting a plurality of points evenly on each candidate lane at a predetermined interval, as a plurality of candidate end points, the predetermined interval may be determined according to the accuracy of the estimated motion trajectory required by the user, and the estimated motion trajectory The greater the accuracy of the estimated motion trajectory, the smaller the predetermined interval, and the smaller the accuracy of the estimated motion trajectory, the larger the predetermined interval, which is not limited here. In this way, multiple points are uniformly selected on each candidate lane, and the determined candidate lane more accurately reflects the situation of the entire candidate lane, improving the accuracy of multiple candidate end points. Further, in this step 123, for each candidate lane in a plurality of candidate lanes, the candidate lane can be segmented to obtain a segmented lane; Select multiple points as multiple candidate endpoints. In this way, the amount of calculation for a segmented lane is less than the amount of calculation for the entire segment of candidate lanes, thereby improving processing efficiency.
上述以预定间隔均匀地在每条候选车道选择多个点,作为多个候选终点的实施例有多种,在一种实施例中,沿候选车道的车道线方向,以预定间隔均匀地在每条候选车道的车道中心线上选择多个点,作为多个候选终点,如此以中心线为基准选择候选终点,可以在控制计算量大小的情况下,获取较好的预估运动轨迹的预测效果。在另一种实施例中,沿候选车道的车道线方向以及垂直于车道线方向的方向,以预定间隔均匀地在每条候选车道上选择多个点,作为多个候选终点。如此在候选车道内密集选点,会一定程度上增加计算量,但可以获得更为完善、准确的预测结果。其中,候选车道的车道线方向以及垂直于车道线方向的方向选择的多个点的分布,可以是阵列方式或者网格方式,如此不仅选点不仅密集,而且比较有规则,使得选取的候选终点更合理,进而得到的预估运动轨迹更合理。There are multiple embodiments of selecting multiple points uniformly in each candidate lane at predetermined intervals as multiple candidate end points. In one embodiment, along the direction of the lane line of the candidate lane, uniformly select points at predetermined intervals at each Select multiple points on the lane centerline of each candidate lane as multiple candidate end points, so that the candidate end point is selected based on the centerline, and a better prediction effect of the estimated motion trajectory can be obtained while controlling the amount of calculation. . In another embodiment, along the direction of the lane line of the candidate lane and the direction perpendicular to the direction of the lane line, a plurality of points are uniformly selected on each candidate lane at predetermined intervals as the plurality of candidate end points. Such a dense selection of points in the candidate lane will increase the amount of calculation to a certain extent, but can obtain more complete and accurate prediction results. Among them, the distribution of multiple points selected in the direction of the lane line of the candidate lane and the direction perpendicular to the direction of the lane line can be in an array or a grid. In this way, the selected points are not only dense, but also relatively regular, so that the selected candidate end point It is more reasonable, and the estimated motion trajectory obtained is more reasonable.
步骤130,根据多个候选终点提取多个候选终点的特征,根据地图信息提取地图特征,并根据障碍物的信息提取障碍物特征。 Step 130, extract features of multiple candidate destinations according to multiple candidate destinations, extract map features according to map information, and extract obstacle features according to obstacle information.
其中,本步骤130中的根据多个候选终点提取多个候选终点的特征,可以包括根据多个候选终点,采用多层感知机,确定多个候选终点的特征。如此可以独立使用多层感知机,确定多个候选终点的特征,这样可以更好的挖掘出多个候选终点的特征,以便更好地提取目标终点的特征。Wherein, extracting features of multiple candidate endpoints according to multiple candidate endpoints in step 130 may include determining features of multiple candidate endpoints based on multiple candidate endpoints using a multi-layer perceptron. In this way, the multi-layer perceptron can be used independently to determine the features of multiple candidate endpoints, so that the features of multiple candidate endpoints can be better mined, so as to better extract the features of the target endpoint.
本步骤130中的根据地图信息提取地图特征可以包括根据车道线信息、可行驶区域信息及语义信息,采用图神经网络,提取地图特征,其中地图特征可以包括多条候选车道之间的拓扑特征、位置特征及语义特征。如此可以独立使用图神经网络,可视化地确定地图特征,方便理解地图特征,这样可以更好的挖掘出地图特征。Extracting map features based on map information in step 130 may include extracting map features using a graph neural network based on lane line information, drivable area information, and semantic information, wherein the map features may include topological features between multiple candidate lanes, location and semantic features. In this way, the graph neural network can be used independently to visually determine the map features, which is convenient for understanding the map features, so that the map features can be better mined.
本步骤130中的根据障碍物的信息提取障碍物特征,包括:根据历史轨迹信息,采用卷积神经网络,提取障碍物运动的时间特征和空间特征。如此可以独立的采用卷积神经网络,提取障碍物运动的时间特征和空间特征,这样可以更好的挖掘障碍物运动的时间特征和空间特征,以有利于目标终点的确定。进一步的,在本步骤130还可以包括对多个所述候选终点、地图信息及障碍物的信息的预处理操作,其中,预处理操作包括坐标转换及信息编码。这样方便去除一些与特征相关的噪声,提高特征提取的准确性,之后再执行提取多个候选终点的特征、地图特征及障碍物特征。The extraction of obstacle features based on obstacle information in step 130 includes: extracting temporal and spatial features of obstacle movement by using a convolutional neural network based on historical trajectory information. In this way, the convolutional neural network can be used independently to extract the temporal and spatial features of the obstacle movement, so that the temporal and spatial characteristics of the obstacle movement can be better mined to facilitate the determination of the target end point. Further, this step 130 may also include a preprocessing operation on the multiple candidate destinations, map information, and obstacle information, wherein the preprocessing operation includes coordinate conversion and information encoding. In this way, it is convenient to remove some noise related to features, improve the accuracy of feature extraction, and then perform extraction of features, map features and obstacle features of multiple candidate endpoints.
步骤140,根据候选终点的特征、地图特征及障碍物特征,从多个候选终点中确定多个预定终点,多个预定终点相较于多个候选终点中的其余候选终点,成为预估运动轨迹的目标终点的可能性更高。预定终点可以是指初次确定的终点,还需要通过执行步骤150再次确定预定终点是否可以成为最终的目标终点。 Step 140, according to the characteristics of the candidate destinations, the map characteristics and the obstacle characteristics, determine a plurality of predetermined destinations from the plurality of candidate destinations. The probability of the target endpoint is higher. The predetermined end point may refer to the initially determined end point, and step 150 needs to be performed to determine whether the predetermined end point can become the final target end point.
本步骤140可以采用多种实施例实现,在一些实施例中,逐个判断多个候选终点是否会成为目标终点;将可能成为目标终点的多个候选终点,确定为多个预定终点。如此设置多个预定终点,可以预测出多条预估运动轨迹,覆盖更完善的轨迹空间,也能减少预估运动轨迹的突变,保证稳定性,同时,逐个确定候选终点,可以提高候选终点确定的准确性。具体的,使用可以多层感知机和/或注意力算法逐个多个候选终点是否会成为目标终点。This step 140 can be implemented in various embodiments. In some embodiments, it is judged one by one whether multiple candidate endpoints will become target endpoints; multiple candidate endpoints that may become target endpoints are determined as multiple predetermined endpoints. Setting multiple predetermined endpoints in this way can predict multiple estimated motion trajectories, covering a more complete trajectory space, and can also reduce the mutation of the estimated motion trajectory and ensure stability. At the same time, determining candidate endpoints one by one can improve the determination of candidate endpoints. accuracy. Specifically, a multi-layer perceptron and/or an attention algorithm may be used to determine whether multiple candidate endpoints will become target endpoints.
在另一些实施例中,确定所有候选终点成为目标终点的概率,选择可能性最大的预定终点,作为目标终点。如此通过概率可以快速确定目标终点,速度更快。具体的,使用可以多层感知机和/或注意力算法,确定所有候选终点成为目标终点的概率。In other embodiments, the probability of all candidate endpoints becoming the target endpoint is determined, and the predetermined endpoint with the highest possibility is selected as the target endpoint. In this way, the passing probability can quickly determine the target end point, and the speed is faster. Specifically, a multilayer perceptron and/or an attention algorithm may be used to determine the probability that all candidate endpoints become target endpoints.
步骤150,根据多个预定终点,确定障碍物的目标终点,其中,目标终点包括历史轨迹终点及未来达到终点。如此对预定终点进行优化,调整预定终点的位置,使得预定终点的坐标点作为预估运动轨迹的终点更准确。 Step 150, determine the target end point of the obstacle according to multiple predetermined end points, wherein the target end point includes the end point of the historical trajectory and the end point reached in the future. In this way, the predetermined end point is optimized, and the position of the predetermined end point is adjusted, so that the coordinate point of the predetermined end point is more accurate as the end point of the estimated motion track.
在本步骤150的一实施例可以包括:可以使用深度神经网络,提取预定终点的特征;根据预定终点的特征地图特征及障碍物特征,优化预定终点,确定目标终点。通过调整 终点的设置方式即可控制预测轨迹的生成,保证终点的有效性,可以保证预估运动轨迹的可靠性。随后可以对目标终点进行检查,确保预估运动轨迹符合车辆运动学规律、符合交通规则、没有碰撞等。An embodiment of this step 150 may include: using a deep neural network to extract features of the predetermined destination; optimizing the predetermined destination and determining the target destination according to the characteristic map features and obstacle characteristics of the predetermined destination. By adjusting the setting method of the end point, the generation of the predicted trajectory can be controlled to ensure the validity of the end point and the reliability of the estimated motion trajectory. The target end point can then be checked to ensure that the estimated trajectory conforms to vehicle kinematics, follows traffic regulations, has no collisions, etc.
步骤160,根据目标终点,确定障碍物的从历史轨迹终点到未来达到终点的预估运动轨迹。 Step 160, according to the target end point, determine the estimated movement track of the obstacle from the end point of the historical track to the end point in the future.
本步骤160有多种实现的实施例,在一种实施例中,根据目标终点,使用优化算法,确定预估运动轨迹,以使预估运动轨迹平滑且符合障碍物运动学特性。如此使用优化算法,可以检测预估运动轨迹,得到平滑且符合障碍物运动学特性的预估运动轨迹,可以保证预估运动轨迹的合理性,进而确保当前车辆的安全性,减小意外事故发生的可能性。在另一种实施例中,根据目标终点,提取目标终点的特征;将目标终点的特征,地图特征及障碍物特征输入至深度神经网络,以输出障碍物的预估运动轨迹。如此利用深度神经网络较强的函数拟合能力,同时避免人为设计复杂的优化算法约束条件。There are many implementations of this step 160. In one embodiment, according to the target end point, an optimization algorithm is used to determine the estimated motion trajectory, so that the estimated motion trajectory is smooth and conforms to the kinematic characteristics of the obstacle. Using the optimization algorithm in this way can detect the estimated motion trajectory and obtain a smooth estimated motion trajectory that conforms to the kinematic characteristics of obstacles, which can ensure the rationality of the estimated motion trajectory, thereby ensuring the safety of the current vehicle and reducing the occurrence of accidents possibility. In another embodiment, the features of the target end point are extracted according to the target end point; the feature of the target end point, the map feature and the obstacle feature are input into the deep neural network to output the estimated movement trajectory of the obstacle. In this way, the strong function fitting ability of the deep neural network is used, and at the same time, the artificial design of complex optimization algorithm constraints is avoided.
图3所示为本申请提供的障碍物轨迹预测系统300的一实施例的模块框图。障碍物轨迹预测系统300包括一个或多个处理器301,用于实现如上所述的障碍物轨迹预测方法。FIG. 3 is a module block diagram of an embodiment of an obstacle trajectory prediction system 300 provided by the present application. The obstacle trajectory prediction system 300 includes one or more processors 301 for implementing the obstacle trajectory prediction method described above.
在一些实施例中,障碍物轨迹预测系统300可以包括计算机可读存储介质309,计算机可读存储介质309可以存储有可被处理器301调用的程序,可以包括非易失性存储介质。在一些实施例中,障碍物轨迹预测系统300可以包括内存308和接口307。在一些实施例中,障碍物轨迹预测系统300还可以根据实际应用包括其他硬件。In some embodiments, the obstacle trajectory prediction system 300 may include a computer-readable storage medium 309, which may store a program that can be invoked by the processor 301, and may include a non-volatile storage medium. In some embodiments, obstacle trajectory prediction system 300 may include memory 308 and interface 307 . In some embodiments, the obstacle trajectory prediction system 300 may also include other hardware according to actual applications.
本申请实施例的计算机可读存储介质309,其上存储有程序,该程序被处理器301执行时,用于实现如上描述的障碍物轨迹预测方法。The computer-readable storage medium 309 of the embodiment of the present application stores a program thereon, and when the program is executed by the processor 301, it is used to implement the obstacle trajectory prediction method described above.
本申请可采用在一个或多个其中包含有程序代码的计算机可读存储介质309(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。计算机可读存储介质309包括永久性和非永久性、可移动和非可移动媒体,可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机可读存储介质309的例子包括但不限于:相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式 磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。This application may take the form of a computer program product embodied on one or more computer readable storage media 309 (including but not limited to disk storage, CD-ROM, optical storage, etc.) having program code embodied therein. Computer-readable storage media 309 includes both permanent and non-permanent, removable and non-removable media, and information storage may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer readable storage media 309 include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), Read memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cartridge, tape magnetic disk storage or other magnetic storage device or any other non-transmission medium that may be used to store information that can be accessed by a computing device.
以上所述仅为本说明书的较佳实施例而已,并不用以限制本说明书,凡在本说明书的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本说明书保护的范围之内。The above descriptions are only preferred embodiments of this specification, and are not intended to limit this specification. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this specification shall be included in this specification. within the scope of protection.
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes Other elements not expressly listed, or elements inherent in the process, method, commodity, or apparatus are also included. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Claims (11)

  1. 一种障碍物轨迹预测方法,包括:A method for predicting obstacle trajectory, comprising:
    获取障碍物的信息及所述障碍物预估运动的地图信息;Obtaining information about the obstacle and map information of the estimated movement of the obstacle;
    根据所述地图信息,确定所述障碍物的多个候选终点;determining a plurality of candidate end points of the obstacle according to the map information;
    根据多个所述候选终点提取多个所述候选终点的特征,根据所述地图信息提取地图特征,并根据所述障碍物的信息提取所述障碍物特征;extracting features of a plurality of candidate endpoints according to the plurality of candidate endpoints, extracting map features according to the map information, and extracting the obstacle features according to the information of the obstacles;
    根据所述候选终点的特征、所述地图特征及所述障碍物特征,从多个所述候选终点中确定多个预定终点,多个所述预定终点相较于多个所述候选终点中的其余候选终点,成为预估运动轨迹的目标终点的可能性更高;According to the characteristics of the candidate destinations, the map characteristics and the obstacle characteristics, determine a plurality of predetermined destinations from the plurality of candidate destinations, and compare the plurality of predetermined destinations with those of the plurality of candidate destinations The rest of the candidate endpoints are more likely to become the target endpoints of the estimated trajectory;
    根据多个所述预定终点,确定所述障碍物的目标终点,其中,所述目标终点包括历史轨迹终点及未来达到终点;及,determining a target end point of the obstacle according to a plurality of predetermined end points, wherein the target end point includes an end point of a historical trajectory and an end point reached in the future; and,
    根据所述目标终点,确定所述障碍物的从所述历史轨迹终点到所述未来达到终点的预估运动轨迹。According to the target end point, an estimated movement track of the obstacle from the end point of the historical track to the end point reached in the future is determined.
  2. 如权利要求1所述的方法,其特征在于,The method of claim 1, wherein
    所述障碍物的信息包括障碍物的历史位置信息;The information of the obstacle includes historical position information of the obstacle;
    所述地图信息包括车道线信息,所述车道线信息包括车道线邻接关系及车道线连接关系;The map information includes lane line information, and the lane line information includes lane line adjacency relationship and lane line connection relationship;
    所述根据所述地图信息,确定所述障碍物的多个候选终点,包括:The determining multiple candidate end points of the obstacle according to the map information includes:
    根据所述历史位置信息,确定与所述障碍物实际运动方向相匹配的基础车道;Determining a basic lane matching the actual movement direction of the obstacle according to the historical position information;
    根据所述基础车道的车道线邻接关系及所述基础车道的车道线连接关系,在所述基础车道周围拓展多条候选车道;expanding a plurality of candidate lanes around the basic lane according to the lane line adjacency relationship of the basic lane and the lane connection relationship of the basic lane;
    根据多条所述候选车道,确定多个所述候选终点。A plurality of candidate end points are determined according to the plurality of candidate lanes.
  3. 如权利要求2所述的轨迹预测方法,其特征在于,所述根据多个所述候选终点提取多个所述候选终点的特征,包括:The trajectory prediction method according to claim 2, wherein said extracting features of a plurality of said candidate endpoints according to said plurality of said candidate endpoints comprises:
    根据多个所述候选终点,采用多层感知机,确定多个所述候选终点的特征。According to the plurality of candidate endpoints, a multi-layer perceptron is used to determine the characteristics of the plurality of candidate endpoints.
  4. 如权利要求2所述的轨迹预测方法,其特征在于,所述根据多条所述候选车道,确定多个所述候选终点,包括:The trajectory prediction method according to claim 2, wherein said determining a plurality of said candidate end points according to said plurality of said candidate lanes comprises:
    以预定间隔均匀地在每条所述候选车道上选择多个点,作为多个所述候选终点。A plurality of points are evenly selected on each of the candidate lanes at predetermined intervals as the plurality of candidate end points.
  5. 如权利要求4所述的轨迹预测方法,其特征在于,所述以预定间隔均匀地在每条所述候选车道上选择多个点,作为多个所述候选终点,包括以下任意一项或多项:The trajectory prediction method according to claim 4, wherein said uniformly selecting a plurality of points on each of said candidate lanes at predetermined intervals as a plurality of said candidate end points includes any one or more of the following item:
    沿所述候选车道的车道线方向,以预定间隔均匀地在每条所述候选车道的车道中心线上选择多个点,作为多个所述候选终点;along the direction of the lane line of the candidate lane, uniformly select a plurality of points on the lane centerline of each of the candidate lanes at predetermined intervals as a plurality of candidate end points;
    沿所述候选车道的车道线方向以及垂直于所述车道线方向的方向,以预定间隔均匀地在每条所述候选车道上选择多个点,作为多个所述候选终点。Along the direction of the lane line of the candidate lane and a direction perpendicular to the direction of the lane line, a plurality of points are uniformly selected on each of the candidate lanes at predetermined intervals as the plurality of candidate end points.
  6. 如权利要求1所述的轨迹预测方法,其特征在于,trajectory prediction method as claimed in claim 1, is characterized in that,
    所述障碍物的信息包括障碍物的历史轨迹信息;The information of the obstacle includes historical track information of the obstacle;
    所述根据所述障碍物的信息提取所述障碍物特征,包括:根据所述历史轨迹信息,采用卷积神经网络,提取所述障碍物特征,所述障碍物运动的时间特征和空间特征。The extracting the obstacle feature according to the information of the obstacle includes: extracting the obstacle feature, the time feature and the space feature of the obstacle movement according to the historical track information by using a convolutional neural network.
  7. 如权利要求1或6所述的轨迹预测方法,其特征在于,The trajectory prediction method according to claim 1 or 6, wherein,
    所述地图信息包括车道线信息、可行驶区域信息及语义信息;The map information includes lane line information, drivable area information and semantic information;
    所述根据所述地图信息提取地图特征,包括:根据所述车道线信息、所述可行驶区域信息及所述语义信息,采用图神经网络,提取所述地图特征。The extracting map features according to the map information includes: extracting the map features by using a graph neural network according to the lane line information, the drivable area information and the semantic information.
  8. 如权利要求1所述的轨迹预测方法,其特征在于,所述从多个所述候选终点中确定多个预定终点,包括以下至少一项:The trajectory prediction method according to claim 1, wherein said determining a plurality of predetermined endpoints from a plurality of said candidate endpoints comprises at least one of the following:
    逐个判断多个所述候选终点是否会成为所述目标终点;将可能成为目标终点的多个候选终点,确定为多个预定终点;judging whether multiple candidate endpoints will become the target endpoint one by one; determining multiple candidate endpoints that may become target endpoints as multiple predetermined endpoints;
    确定所有候选终点成为所述目标终点的概率,选择可能性最大的预定终点,作为所述目标终点;determining the probability that all candidate endpoints become the target endpoint, and selecting the predetermined endpoint with the greatest possibility as the target endpoint;
    使用深度神经网络,提取所述预定终点的特征;根据所述预定终点的特征所述地图特征及所述障碍物特征,优化所述预定终点,确定所述目标终点。Using a deep neural network to extract the features of the predetermined destination; optimizing the predetermined destination and determining the target destination according to the characteristics of the predetermined destination, the map features and the characteristics of the obstacles.
  9. 如权利要求1所述的轨迹预测方法,其特征在于,所述根据所述目标终点,确定所述障碍物的从所述历史轨迹终点到所述未来达到终点的预估运动轨迹,包括以下至少一项:The trajectory prediction method according to claim 1, wherein said determining the estimated movement trajectory of said obstacle from said historical trajectory end point to said future reaching end point according to said target end point comprises at least the following one item:
    根据所述目标终点,使用优化算法,确定预估运动轨迹,以使所述预估运动轨迹平 滑且符合障碍物运动学特性;According to the target end point, use an optimization algorithm to determine the estimated motion trajectory, so that the estimated motion trajectory is smooth and conforms to the kinematic characteristics of the obstacle;
    根据所述目标终点,提取所述目标终点的特征;将所述目标终点的特征,所述地图特征及所述障碍物特征输入至深度神经网络,以输出所述障碍物的预估运动轨迹。Extracting the features of the target end point according to the target end point; inputting the feature of the target end point, the map feature and the obstacle feature into a deep neural network to output the estimated movement trajectory of the obstacle.
  10. 一种轨迹预测系统,其特征在于,包括一个或多个处理器,用于实现如权利要求1至9中任一项所述的轨迹预测方法。A trajectory prediction system, characterized by comprising one or more processors for implementing the trajectory prediction method according to any one of claims 1-9.
  11. 一种计算机可读存储介质,其上存储有程序,该程序被处理器执行时,实现如权利要求1至9中任一项所述的轨迹预测方法。A computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the trajectory prediction method according to any one of claims 1 to 9 is realized.
PCT/CN2022/071090 2021-12-07 2022-01-10 Obstacle trajectory prediction method and system, and computer-readable storage medium WO2023103142A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111486385.3A CN115230688B (en) 2021-12-07 2021-12-07 Obstacle trajectory prediction method, system, and computer-readable storage medium
CN202111486385.3 2021-12-07

Publications (1)

Publication Number Publication Date
WO2023103142A1 true WO2023103142A1 (en) 2023-06-15

Family

ID=83666014

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/071090 WO2023103142A1 (en) 2021-12-07 2022-01-10 Obstacle trajectory prediction method and system, and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN115230688B (en)
WO (1) WO2023103142A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115790606B (en) * 2023-01-09 2023-06-27 深圳鹏行智能研究有限公司 Track prediction method, device, robot and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180292834A1 (en) * 2017-04-06 2018-10-11 Toyota Jidosha Kabushiki Kaisha Trajectory setting device and trajectory setting method
CN109855641A (en) * 2019-02-20 2019-06-07 百度在线网络技术(北京)有限公司 Method, apparatus, storage medium and the terminal device of predicted motion track
CN111523643A (en) * 2020-04-10 2020-08-11 商汤集团有限公司 Trajectory prediction method, apparatus, device and storage medium
CN113568416A (en) * 2021-09-26 2021-10-29 智道网联科技(北京)有限公司 Unmanned vehicle trajectory planning method, device and computer readable storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10996679B2 (en) * 2018-04-17 2021-05-04 Baidu Usa Llc Method to evaluate trajectory candidates for autonomous driving vehicles (ADVs)
US11378961B2 (en) * 2018-04-17 2022-07-05 Baidu Usa Llc Method for generating prediction trajectories of obstacles for autonomous driving vehicles
US11663913B2 (en) * 2019-07-01 2023-05-30 Baidu Usa Llc Neural network with lane aggregation for lane selection prediction of moving objects during autonomous driving
US10928820B1 (en) * 2019-11-12 2021-02-23 Baidu Usa Llc Confidence levels along the same predicted trajectory of an obstacle
CN112839855B (en) * 2020-12-31 2022-07-12 华为技术有限公司 Trajectory prediction method and device
CN113335276A (en) * 2021-07-20 2021-09-03 中国第一汽车股份有限公司 Obstacle trajectory prediction method, obstacle trajectory prediction device, electronic device, and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180292834A1 (en) * 2017-04-06 2018-10-11 Toyota Jidosha Kabushiki Kaisha Trajectory setting device and trajectory setting method
CN109855641A (en) * 2019-02-20 2019-06-07 百度在线网络技术(北京)有限公司 Method, apparatus, storage medium and the terminal device of predicted motion track
CN111523643A (en) * 2020-04-10 2020-08-11 商汤集团有限公司 Trajectory prediction method, apparatus, device and storage medium
CN113568416A (en) * 2021-09-26 2021-10-29 智道网联科技(北京)有限公司 Unmanned vehicle trajectory planning method, device and computer readable storage medium

Also Published As

Publication number Publication date
CN115230688A (en) 2022-10-25
CN115230688B (en) 2023-08-25

Similar Documents

Publication Publication Date Title
US11427225B2 (en) All mover priors
US11554785B2 (en) Driving scenario machine learning network and driving environment simulation
CN111857160B (en) Unmanned vehicle path planning method and device
CN108983781B (en) Environment detection method in unmanned vehicle target search system
CN114234998B (en) Unmanned multi-target point track parallel planning method based on semantic road map
RU2756872C1 (en) Structure of probabilistic object tracking and forecasting
CN111771141B (en) LIDAR positioning for solution inference using 3D CNN network in autonomous vehicles
US10814871B2 (en) Computing system for assigning maneuver labels to autonomous vehicle sensor data
US20190138024A1 (en) Map Automation - Lane Classification
CN112212874B (en) Vehicle track prediction method and device, electronic equipment and computer readable medium
US20190278284A1 (en) Determining speeds along a path for autonomous driving vehicles
JP2019528499A (en) System and method for trajectory determination
JP2022546283A (en) Occupancy prediction neural network
KR20200096411A (en) LIDAR position estimation performing temporal smoothing using RNN and LSTM in autonomous vehicles
JP2022160538A (en) Collision detection method, device, electronic apparatus, storage medium, automatic driving vehicle, and computer program
WO2022005576A1 (en) Systems and methods for optimizing trajectory planner based on human driving behaviors
US11875680B2 (en) Systems and methods for augmenting perception data with supplemental information
WO2023103142A1 (en) Obstacle trajectory prediction method and system, and computer-readable storage medium
KR20210118995A (en) Method and apparatus for generating u-turn path of autonomous vehicle based on deep learning
CN113654556A (en) Local path planning method, medium and equipment based on improved EM algorithm
Damerow et al. Intersection warning system for occlusion risks using relational local dynamic maps
CN113753040A (en) Predicting road disorderly crossing behavior of weak road users
CN116653963A (en) Vehicle lane change control method, system and intelligent driving domain controller
CN115246416B (en) Track prediction method, track prediction device, track prediction equipment and computer readable storage medium
CN108896065A (en) A kind of automobile paths planning method, system, equipment and computer storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22902587

Country of ref document: EP

Kind code of ref document: A1