WO2021170140A1 - Lane structure detection method and apparatus - Google Patents

Lane structure detection method and apparatus Download PDF

Info

Publication number
WO2021170140A1
WO2021170140A1 PCT/CN2021/078504 CN2021078504W WO2021170140A1 WO 2021170140 A1 WO2021170140 A1 WO 2021170140A1 CN 2021078504 W CN2021078504 W CN 2021078504W WO 2021170140 A1 WO2021170140 A1 WO 2021170140A1
Authority
WO
WIPO (PCT)
Prior art keywords
distance
lane
time point
vehicle
change
Prior art date
Application number
PCT/CN2021/078504
Other languages
French (fr)
Chinese (zh)
Inventor
周伟
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021170140A1 publication Critical patent/WO2021170140A1/en

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/167Driving aids for lane monitoring, lane changing, e.g. blind spot detection
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096708Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems

Definitions

  • This application relates to the field of automatic driving, and in particular to a method and device for detecting a lane structure.
  • road merging or separation has a very important impact on driving decision-making and needs to be detected in advance.
  • the high-precision map has a certain degree of coverage.
  • the road structure cannot be obtained, and the information of the lane line merge point and separation point cannot be known.
  • high-precision maps still have the problem of failure. Due to urban renewal or construction, the map after a certain period of time may become invalid, so that the vehicle cannot obtain accurate lane structure information.
  • the present application provides a lane structure detection method and device, which are used to improve the accuracy of acquiring lane structure information.
  • an embodiment of the present application provides a lane structure detection method.
  • the method includes: acquiring lane boundary information, where the lane boundary information includes position information of the left lane boundary and the right lane boundary; acquiring the vehicle at least two points in time Respectively corresponding location information; for each time point, determine the distance between the vehicle and the left lane boundary and the right lane boundary according to the vehicle's corresponding location information at the time point; determine the distance between the vehicle and the left lane boundary at at least two time points The first distance change and the second distance change between the vehicle and the right lane boundary at at least two points in time; the lane change is determined based on the first distance change and the second distance change.
  • the change of the lane structure is judged according to the change of the distance between the vehicle and the lane boundary.
  • the embodiment of the present application can realize the detection of the road structure, so as to inform the front
  • the lane structure of the road environment helps intelligent vehicles to carry out risk analysis and path planning in advance under the combined or separated road structure environment, and improve driving safety.
  • the first distance change satisfies: the difference between the first distance and the second distance is less than the first threshold, and the second distance
  • the change satisfies: the third distance is less than the fourth distance, and the difference between the third distance and the fourth distance is greater than the second threshold, it is determined that the right side of the first lane has changed, and the first lane is the lane where the vehicle is located;
  • At least two time points include a first time point and a second time point.
  • the first time point is before the second time point
  • the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance is the vehicle
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  • the change in the right side of the lane can be more accurately determined when the distance between the vehicle and the left lane boundary changes less and the distance from the right lane boundary changes greatly.
  • the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold
  • the second distance change also satisfies: the sixth distance is greater than the fourth distance
  • the sixth distance is greater than the fourth distance. If the difference between the distance and the fourth distance is greater than the second threshold, it is determined that a new lane is added to the right of the first lane; wherein, the multiple time points also include the third time point, and the third time point is after the second time point ,
  • the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the left lane boundary will be small, while the distance between the vehicle and the right lane boundary will gradually increase and increase to the lane width threshold or encounter The new lane line, so when the first distance changes: the distance between the vehicle and the left lane boundary changes less, the second distance change is: the distance between the vehicle and the right lane boundary gradually increases, and increases to the lane width threshold or When a new lane line is encountered, it can be more accurately judged that the right lane is divided.
  • the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold
  • the second distance change also satisfies: the sixth distance is less than the fourth distance
  • the sixth distance is less than the fourth distance.
  • the difference between the distance and the fourth distance is greater than the second threshold, it is determined that the lane on the right side of the first lane is merged into the first lane; wherein, the multiple time points also include the third time point, and the third time point is in the second After the time point, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the left lane boundary changes little, and the distance between the vehicle and the right lane boundary suddenly increases, and then gradually decreases to the lane width, so when the first lane
  • the first distance change is: the distance between the vehicle and the left lane boundary changes less
  • the second distance change is that the distance between the vehicle and the right lane boundary suddenly increases, and then gradually decreases to the lane width, then the right lane can be judged more accurately. Hedao.
  • the first distance change satisfies: the first distance is less than the second distance, and the difference between the first distance and the second distance If the value is greater than the second threshold, the second distance change satisfies: the difference between the third distance and the fourth distance is less than the first threshold, then it is determined that the left side of the first lane has changed, and the first lane is the lane where the vehicle is located;
  • the multiple time points include a first time point and a second time point. The first time point is before the second time point.
  • the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance is the vehicle at the The distance between the second time point and the left lane boundary
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  • the first distance change also satisfies: the fifth distance is greater than the second distance, and the difference between the fifth distance and the second distance is greater than the second threshold
  • the second distance change also satisfies: The difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that a new lane is added to the left of the first lane; wherein, the multiple time points also include the third time point, and the third time point is at the second time point
  • the fifth distance is the distance between the vehicle and the left lane boundary at the third time point
  • the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the right lane boundary changes little, while the distance between the vehicle and the left lane boundary will gradually increase and increase to the lane width threshold or encounter The new lane line, so when the second distance changes: the distance between the vehicle and the right lane boundary changes less, the first distance change is that the distance between the vehicle and the left lane boundary gradually increases, and increases to the lane width threshold or When encountering a new lane line, it can be more accurately judged that the left lane is divided.
  • the second distance change also satisfies: If the difference between the sixth distance and the fourth distance is less than the first threshold, it is determined that the lane on the left side of the first lane will be merged into the first lane; wherein, the multiple time points also include the third time point, and the third time point is at After the second time point, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the right lane boundary changes little, and the distance between the vehicle and the left lane boundary suddenly increases, and then gradually decreases to the lane width.
  • the second distance change is: the distance between the vehicle and the right lane boundary changes slightly
  • the first distance change is: the distance between the vehicle and the left lane boundary suddenly increases, and then gradually decreases to the lane width, then the occurrence lane can be judged more accurately Left Hedao.
  • the first distance change satisfies: the first distance is greater than the second distance, and the difference between the first distance and the second distance is greater than The third threshold
  • the second distance change satisfies: the fourth distance is greater than the third distance
  • the difference between the fourth distance and the third distance is greater than the fourth threshold
  • the distance is the distance between the vehicle and the left lane boundary at the first time point
  • the second distance is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  • the distance between the vehicle and the right lane boundary gradually changes, while the distance between the vehicle and the left lane boundary gradually decreases, so the change in the distance between the vehicle and the left and right lane boundary can be Judge the direction of the lane structure change more accurately.
  • the second distance change still satisfies: the sixth distance If the difference between the fourth distance and the fourth distance is less than the first threshold, it is determined that the first lane is merged into the second lane; wherein the multiple time points also include the third time point, the third time point is after the second time point, and the fifth distance Is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the left lane boundary gradually decreases, and the distance between the vehicle and the right lane boundary increases and the change becomes smaller. Therefore, if the first distance The change is that the distance between the vehicle and the left lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the right lane boundary increases and the change is small, and it can be more accurately judged that the left lane will merge to the right.
  • the first distance change still satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the third threshold
  • the second distance change still satisfies: the sixth distance Is less than the fourth distance
  • the difference between the sixth distance and the fourth distance is greater than the fifth threshold
  • the distance between the vehicle and the left lane boundary gradually decreases, and the distance between the vehicle and the right lane boundary suddenly increases and then gradually decreases.
  • the first distance change is: the distance between the vehicle and the left lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the right lane boundary suddenly increases and then gradually decreases. It can be more accurately judged that the vehicle merges into one through the left lane On the driveway.
  • the second distance change when judging the lane change based on the first distance change and the second distance change, if the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than The fourth threshold, the second distance change satisfies: the fourth distance is less than the third distance, and the difference between the fourth distance and the third distance is greater than the third threshold, then it is determined that the first lane is merged with the fourth lane to the left.
  • the lane is the lane where the vehicle is located, and the fourth lane is the lane to the left of the first lane; among them, at least two time points include the first time point and the second time point, the first time point is before the second time point, and the first time point is before the second time point.
  • the distance is the distance between the vehicle and the left lane boundary at the first time point
  • the second distance is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point.
  • Distance, the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  • the change in the distance between the vehicle and the left and right lane boundary can be Judge the direction of the lane structure change more accurately.
  • the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold
  • the second distance change still satisfies: the sixth distance is less than the fourth distance
  • the sixth distance If the difference between the fourth distance and the fourth distance is greater than the third threshold, it is determined that the first lane is merged into the fourth lane; wherein, the multiple time points also include the third time point, the third time point is after the second time point, and the fifth distance Is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the right lane boundary gradually decreases, and the distance between the vehicle and the left lane boundary increases and the change is small. Therefore, the first distance changes Because the distance between the vehicle and the right lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the left lane boundary increases and the change is small, it can be accurately judged that the left lane will merge to the left.
  • the second distance change also satisfies: If the sixth distance is less than the fourth distance, and the difference between the sixth distance and the fourth distance is greater than the third threshold, it is determined that the first lane and the fourth lane are merged into the fifth lane, and the fifth lane is on the left side of the first lane and in The right side of the fourth lane; where the multiple time points also include the third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the first The six distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the right lane boundary gradually decreases, and the distance between the vehicle and the left lane boundary increases and then gradually decreases.
  • the distance change is that the distance between the vehicle and the right lane boundary gradually decreases
  • the second distance change is that the distance between the vehicle and the left lane boundary increases and then gradually decreases. It can be more accurately judged that the vehicle merges into a lane through the right lane.
  • the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance
  • the second distance change satisfies: the fourth distance is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the seventh threshold
  • the first lane has a road separation, the first lane Is the lane where the vehicle is located; wherein, at least two time points include the first time point and the second time point, the first time point is before the second time point, and the first distance is the boundary between the vehicle at the first time point and the left lane
  • the second distance is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the left lane boundary at the second time point.
  • the distance between the vehicle and the left lane boundary and the distance between the vehicle and the right lane boundary gradually increase to the width of the lane or there is a new lane line, so if the first distance Changes to the distance between the vehicle and the left lane boundary and the distance between the vehicle and the right lane boundary gradually increase to the width of the lane or there is a new lane line, which can indicate that the lane is separated from the road.
  • the vehicle trajectory is greatly affected by the vehicle attitude information.
  • the vehicle may already be at a changing position of the road structure or changing lanes by itself.
  • the judgment of the subsequent lane structure can improve the accuracy of the lane structure judgment.
  • the data collected by the sensor can be acquired; based on the data collected by the sensor, the lane boundary information in the driving environment is acquired.
  • the lane boundary information can be accurately obtained.
  • the present application provides a lane structure detection device, which has the function of realizing any one of the possible designs of the first aspect and the first aspect.
  • the function can be realized by hardware, or by hardware executing corresponding software.
  • the hardware or software includes one or more modules corresponding to the above-mentioned functions.
  • the present application provides an electronic device, including: a processor and a memory.
  • the memory is used to store computer-executable instructions.
  • the processor executes the computer-executable instructions stored in the memory, so that the device executes the method according to the first aspect or any one of the first aspects.
  • a computer storage medium is provided, and a computer program is stored, and the computer program includes instructions for executing the methods of the foregoing aspects.
  • a computer program product containing instructions which when run on a computer, causes the computer to execute the methods described in the above aspects.
  • the present application provides a chip, which is coupled with a memory, and is used to read and execute the program instructions stored in the memory, so as to realize the above-mentioned first aspect or any one of the possibilities of the first aspect.
  • the method described in the design is not limited to:
  • FIG. 1 is a schematic flowchart of a method for detecting a lane structure according to an embodiment of the application
  • FIG. 2 is a schematic diagram of a lane structure detection process provided by an embodiment of the application.
  • FIG. 3 is a schematic diagram of another lane structure detection process provided by an embodiment of the application.
  • FIG. 4 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 5 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 6 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 7 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 8 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 9 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 10 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 11 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 12 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 13 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • FIG. 14 is a schematic diagram of a lane structure provided by an embodiment of the application.
  • 15 is a schematic structural diagram of a lane structure detection device provided by an embodiment of the application.
  • FIG. 16 is a schematic structural diagram of a lane structure detection device provided by an embodiment of the application.
  • Intelligent driving includes assisted driving and automatic driving.
  • the key technologies for its realization include: perception and positioning, planning and decision-making (such as path planning, motion planning, etc.), executive control, and so on.
  • autonomous driving and assisted driving smart vehicles need to perceive the surrounding environment.
  • the typical sensors used include millimeter wave radar, cameras, and lidar.
  • the vehicle can detect and classify the environment around the vehicle through these sensors, and transmit this information to the planning and control module to form a pair
  • the decision of the vehicle's future travel path is finally executed by the actuator, completing the entire process of assisted driving or automatic driving.
  • the separation and merging of roads often indicate changes in the road structure. At the same time, it is also accompanied by the occurrence of vehicle lane changes, which poses a certain safety risk. Therefore, in the driving process, the merger or separation of roads has a very important impact on driving decision-making, and it needs to be detected in advance.
  • the high-precision map has a certain degree of coverage.
  • the road structure cannot be obtained, and the information of the lane line merge point and separation point cannot be known.
  • high-precision maps still have the problem of failure. Due to urban renewal or construction, the map data after a certain period of time may be invalid, resulting in vehicles unable to obtain accurate lane structure information.
  • the embodiments of the present application provide a lane structure detection method and device, which can obtain more accurate lane structure information, thereby improving the safety of automatic driving or assisted driving.
  • the method and the device are based on the same concept. Since the principles of the method and the device to solve the problem are similar, the implementation of the device and the method can be referred to each other, and the repetition will not be repeated.
  • the lane structure detection method provided by the embodiment of the present application is applied to an electronic device, and the electronic device can be applied to a vehicle, especially a smart car.
  • Vehicles can include, but are not limited to, millimeter wave radar, lidar, ultrasonic radar, cameras, positioning systems such as global positioning system (GPS), inertial measurement unit (IMU), speed sensor, acceleration sensor, humidity sensor , Light intensity sensors, microphones and other sensors, can also include display screens, external power amplifiers, speakers and other playback devices. It can also include other devices, which will not be listed here.
  • the electronic device may be a vehicle-mounted controller.
  • the lane structure detection method provided by the embodiments of the present application can be applied to automatic driving scenarios, and can also be extended to manual driving scenarios.
  • At least one refers to one or more, and “multiple” refers to two or more than two.
  • “And/or” describes the association relationship of the associated object, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone, where A, B can be singular or plural.
  • the character “/” generally indicates that the associated objects before and after are in an “or” relationship.
  • the following at least one (item) or similar expressions refers to any combination of these items, including any combination of a single item (a) or a plurality of items (a).
  • At least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c It can be single or multiple.
  • the method is executed by an electronic device or a chip or chipset in the electronic device.
  • the electronic device may be a vehicle-mounted controller.
  • the vehicle controller may include a functional module for acquiring the lane structure, or the electronic device may also be a device independent of the on-board controller for acquiring the lane structure.
  • the method may specifically include the following:
  • S101 Acquire lane boundary information, where the lane boundary information includes position information of the left lane boundary and the right lane boundary.
  • the lane boundary may include, but is not limited to: lane lines, road shoulders, curbs, flower beds on both sides of the road, flower beds in the middle of the road, or other objects that divide the lane.
  • acquiring lane boundary information can be achieved through the following process: acquiring data collected by sensors; acquiring lane boundary information in a driving environment based on the data collected by sensors.
  • the data collected by the camera sensor can be obtained, and the lane boundary information in the driving environment can be obtained.
  • An alternative method is to obtain lane boundary information in the image through gradient threshold or color threshold, including lane line information and road boundary information; another alternative method is to use machine learning methods through pre-training
  • the lane boundary neural network model or other data model detects the lane information in the image to obtain lane boundary information, including lane line information and road boundary information. More specifically, after obtaining the characteristic points of the lane information, the lane boundary equation can be obtained by methods such as fitting and tracking.
  • C0 is the lateral offset of the lane boundary
  • C1 is the heading angle of the lane boundary
  • C2 is the average curvature of the lane boundary twice
  • C3 is the average curvature change rate of the lane boundary 6 times.
  • sensor data such as millimeter wave radar and lidar can also be obtained to obtain lane boundary information.
  • An optional method is to obtain the reflection information of the road boundary, such as guardrail, and process it to obtain the road boundary information, which can also be used as part of the lane information.
  • the final lane boundary information can also be output by fusing the results of multiple sensors, for example, fusing data collected by camera sensors, millimeter wave radar and other sensor data to output the final lane boundary information.
  • S102 Acquire location information corresponding to the vehicle at at least two points in time, respectively.
  • the driving trajectory of the vehicle may be acquired, and the position information corresponding to at least two time points may be determined according to the driving trajectory.
  • the at least two points in time may be points in the future, and can also be understood as determining the location information corresponding to at least two points in the future according to the trajectory of the vehicle.
  • the driving trajectory of the vehicle can be determined in the following manner: by acquiring the data collected by the vehicle sensor and the data collected by the camera, the driving trajectory of the vehicle is determined according to the data collected by the sensor and the amount data collected by the camera.
  • the time interval between any two adjacent time points in the at least two time points may be the same. For example, set a time point every 0.5s.
  • the time interval between two adjacent time points can be set according to the driving speed of the vehicle. For example, the greater the speed of the vehicle, the smaller the time interval between two adjacent points in time.
  • a time point can be set every 0.2s, that is, the interval between two adjacent time points is 0.2s.
  • the driving speed of the vehicle is [50KM/h, 100KM/h)
  • a time point can be set every 0.4s, that is, the interval between two adjacent time points is 0.4s.
  • the greater the traveling speed of the vehicle the greater the time interval between two adjacent time points.
  • the driving distance between any two adjacent time points in the at least two time points may be the same.
  • the driving distance between two adjacent time points can be set according to the driving speed of the vehicle. For example, the greater the traveling speed of the vehicle, the greater the traveling distance between two adjacent points in time. Exemplarily, when the driving speed of the vehicle is greater than 100KM/h, the driving distance between two adjacent time points may be 100m. When the driving speed of the vehicle is [50KM/h, 100KM/h), the driving distance between two adjacent time points can be 50m.
  • the distance between the vehicle and the left lane boundary and the right lane boundary may be determined according to the position information of the vehicle at the time point.
  • the distance can be calculated in different coordinate systems, such as using pixel values to describe, or using actual distance length to describe.
  • S104 Determine the first distance change between the vehicle and the left lane boundary at at least two time points and the second distance change between the vehicle and the right lane boundary at at least two time points.
  • the first distance change may be the distance difference between the vehicle and the left lane boundary at two adjacent time points.
  • the second distance change may be the distance difference between the vehicle and the right lane boundary at two adjacent time points.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L)
  • the distance between the vehicle and the right lane boundary at time t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at time t2 is L (2, R)
  • the first distance change can be the distance difference between the vehicle and the left lane boundary at t1 and t2, that is, L (2, L) -L (1, L)
  • the second distance change can be the distance difference between the vehicle and the right lane boundary at t1 and t2, that is, L (2, R) -L (1, R) .
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 Is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • S105 Determine the lane change based on the first distance change and the second distance change.
  • the lane structure can be judged according to the different measured distance changes. For example, a lane structure keeps one side unchanged while the other side changes from small to large; for example, one The lane structure remains unchanged on one side, suddenly becomes larger on the other side, and then gradually becomes smaller; for another example, there are other ways to change the distance to correspond to different lane structures. Further, the information of adjacent lanes can be combined to output different lane structures, such as road merging or separation, left-division road, right-division road, etc., for subsequent regulation and control. Exemplarily, the lane structure detection process may be as shown in FIG. 2 or FIG. 3.
  • the change of the lane structure is judged according to the change of the distance between the vehicle and the lane boundary.
  • the embodiment of the present application can realize the complete detection of the road structure, so as to inform The lane structure of the road environment ahead helps intelligent vehicles to conduct risk analysis and path planning in advance in a combined or separated road structure environment, and improve driving safety.
  • step S104 may be implemented in any one of the following seven implementation manners:
  • the first distance change satisfies: the difference between the first distance and the second distance is less than the first threshold
  • the second distance change satisfies: the third distance is less than the fourth distance
  • the third distance is less than the If the difference between the fourth distance is greater than the second threshold, it can be determined that the right side of the first lane has changed, and the first lane is the lane where the vehicle is located.
  • At least two time points include a first time point and a second time point
  • the first time point is before the second time point
  • the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance Is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point
  • the first threshold may be smaller than the second threshold.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L)
  • the distance between the vehicle and the right lane boundary at time t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at time t2 is L (2, R) .
  • the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • the first distance change is: the distance between the vehicle and the left lane boundary changes slightly
  • the second distance change is: the distance between the vehicle and the right lane boundary gradually increases, and increases to the lane width threshold or meets When the new lane line is reached, it can be judged that the lane divides to the right.
  • the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, and the second The distance change also satisfies: the sixth distance is less than four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, it can be judged that the lane on the right side of the first lane merges into the first lane;
  • the time point also includes the third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the distance between the vehicle and the right lane at the third time point. The distance of the side lane boundary.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • the first distance change is: the distance between the vehicle and the left lane boundary changes less
  • the second distance change is that the distance between the vehicle and the right lane boundary suddenly increases, and then gradually decreases to the lane width, it can be judged The right lane of the incident occurred.
  • the second distance change satisfies: If the difference between the fourth distance is less than the first threshold, it is determined that the left side of the first lane has changed, and the first lane is the lane where the vehicle is located; wherein the multiple time points include the first time point and the second time point, and the first A time point is before the second time point, the first distance is the distance between the vehicle and the left lane boundary at the first time point, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is The distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L)
  • the distance between the vehicle and the right lane boundary at time t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at time t2 is L (2, R) .
  • the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • the second distance change is: the distance between the vehicle and the right lane boundary changes slightly, and the first distance change is that the distance between the vehicle and the left lane boundary gradually increases and increases to the lane width threshold or encounters With the new lane line, it can be judged that the left lane is divided.
  • the second distance change also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, it can be judged that the lane on the left side of the first lane will be merged into the first lane; where, multiple times The point also includes the third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point to the right The distance of the lane boundary.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • the second distance change is: the distance between the vehicle and the right lane boundary changes slightly
  • the first distance change is: the distance between the vehicle and the left lane boundary suddenly increases, and then gradually decreases to the lane width, then Judge the left side of the lane.
  • the second distance change satisfies: the fourth distance is greater than the third Distance, and the difference between the fourth distance and the third distance is greater than the fourth threshold, it is determined that the first lane to the right is merged with the second lane, the first lane is the lane where the vehicle is located, and the second lane is the right side of the first lane
  • at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the vehicle and the right lane boundary at the second time point. The distance of the border.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L)
  • the distance between the vehicle and the right lane boundary at time t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at time t2 is L (2, R) .
  • L (1,R) ⁇ L (2,R) and L (2, R) -L (1, R) > ⁇ L4 it can be judged that the first lane is merged with the second lane to the right, the first lane is the lane where the vehicle is located, and the second lane is the lane on the right side of the first lane.
  • the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point.
  • the distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the fourth threshold may be greater than or equal to the width of the lane, or the fourth threshold may be less than or equal to the width of the lane.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • L (3,L) ⁇ L (2,L) ⁇ L (1,L) , L (1,L) -L (2,L) > ⁇ L3, L (2,L) -L (3, L) > ⁇ L3,L (1,R) ⁇ L (2,R) and L (2,R) -L (1,R) > ⁇ L4,L (3,R) ⁇ L (2,R) yes It is determined that the first lane is merged into the second lane, as shown in FIG. 8.
  • the first distance change is that the distance between the vehicle and the left lane boundary gradually decreases
  • the second distance change is that the distance between the vehicle and the right lane boundary increases and the change is small.
  • the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the third threshold
  • the second distance change also satisfies: the sixth distance is less than the fourth distance, and the difference between the sixth distance and the fourth distance is greater than the fifth threshold
  • the multiple time points further include a third time point, The third time point is after the second time point, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the vehicle The distance from the boundary of the right lane at the third time point.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • the first distance change is: the distance between the vehicle and the left lane boundary gradually decreases
  • the second distance change is that the distance between the vehicle and the right lane boundary suddenly increases and then gradually decreases. It can be determined that the vehicle passes through the left lane. Merge into one lane.
  • the second distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than the fourth threshold
  • the second distance change satisfies: the fourth distance is less than the third Distance
  • the difference between the fourth distance and the third distance is greater than the third threshold
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L)
  • the distance between the vehicle and the right lane boundary at time t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at time t2 is L (2, R) .
  • the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point.
  • the distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • the first distance change means that the distance between the vehicle and the right lane boundary gradually decreases
  • the second distance change means that the distance between the vehicle and the left lane boundary becomes larger and the change is smaller, which indicates that it will occur from the left lane. Hop left.
  • the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than a fifth threshold
  • the second distance change also satisfies: the sixth distance is less than the fourth distance, and the difference between the sixth distance and the fourth distance is greater than the third threshold
  • the multiple time points further include a third time point , The third time point is after the second time point, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the The distance between the vehicle and the right lane boundary at the third time point.
  • the distance between the vehicle and the left lane boundary at time t1 is L (1, L)
  • the distance between the vehicle and the left lane boundary at time t2 is L (2, L)
  • the distance between the vehicle and the left lane boundary at time t3 is L (3, L)
  • the distance between the vehicle and the right lane boundary at t1 is L (1, R)
  • the distance between the vehicle and the right lane boundary at t2 is L (2, R)
  • the vehicle is at the right lane boundary at t3
  • the distance is L (3, R) .
  • the distance between the vehicle and the right lane boundary gradually decreases, and the distance between the vehicle and the left lane boundary increases and then gradually decreases. It can be determined that the vehicle merges into one lane through the right lane.
  • the second distance change satisfies: the fourth distance is greater than The third distance, and the difference between the fourth distance and the third distance is greater than the seventh threshold, then it is determined that road separation occurs in the first lane, and the first lane is the lane where the vehicle is located; wherein, at least two time points include the first Time point and second time point, the first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance is the distance between the vehicle and the left side at the second time point The distance of the lane boundary, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  • the second distance change satisfies: the difference between the fourth distance and the third distance is less than the sixth threshold, the difference between the fourth distance and the sixth distance is less than the first threshold, and the first The distance change satisfies: the second distance is less than the first distance, and the difference between the first distance and the second distance is greater than the seventh threshold, the fifth distance is less than the second distance, and the difference between the second distance and the fifth distance If the value is greater than the seventh threshold, it can be determined that a new lane is added to the left of the first lane.
  • At least two time points include a first time point, a second time point, and a third time point
  • the first time point is before the second time point
  • the second time point is before the third time point
  • the first distance is the vehicle
  • the second distance is the distance between the vehicle and the left lane boundary at the second time point
  • the fifth distance is the distance between the vehicle and the left lane boundary at the second time point.
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point
  • the sixth distance is the vehicle and the right lane boundary at the third time point. the distance.
  • the second distance change is that the distance between the vehicle and the right lane boundary changes less
  • the first distance change is that the distance between the vehicle and the left lane boundary is gradually reduced, and there is a new lane line on the left
  • the seventh implementation manner if the first distance change satisfies: the difference between the second distance and the first distance is less than the sixth threshold, the difference between the second distance and the fifth distance is less than the first threshold, and the second The distance change satisfies: the fourth distance is less than the third distance, and the difference between the third distance and the fourth distance is greater than the seventh threshold, the sixth distance is less than the fourth distance, and the difference between the fourth distance and the sixth distance If the value is greater than the seventh threshold, it can be determined that a new lane is added to the right of the first lane.
  • At least two time points include a first time point, a second time point, and a third time point
  • the first time point is before the second time point
  • the second time point is before the third time point
  • the first distance is the vehicle
  • the second distance is the distance between the vehicle and the left lane boundary at the second time point
  • the fifth distance is the distance between the vehicle and the left lane boundary at the second time point.
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point
  • the sixth distance is the vehicle and the right lane boundary at the third time point. the distance.
  • the first distance change is that the distance between the vehicle and the left lane boundary changes less, and the first distance change is that the distance between the vehicle and the right lane boundary is gradually reduced, and there is a new lane line on the right, you can It is judged that a lane is created on the right side of the lane, as shown in Figure 14.
  • the embodiments of the present application are not limited to judging the lane structure through the above seven implementation methods.
  • the corresponding lane structure can also be judged based on the change in the distance between the vehicle and the lane boundary in other lane structures. I won't list them all here.
  • the vehicle trajectory is greatly affected by the vehicle attitude information.
  • the vehicle may already be at a changing position of the road structure or changing lanes by itself.
  • the judgment of the subsequent lane structure can improve the accuracy of the lane structure judgment.
  • an embodiment of the present invention also provides a lane structure detection device 150, which is specifically used to implement the methods described in the embodiments described in FIG. 1 to FIG. 14.
  • the structure of the device is shown in FIG. 15 and includes: a communication unit 1501 and processing unit 1502.
  • the communication unit 1501 is configured to obtain lane boundary information, which includes the position information of the left lane boundary and the right lane boundary;
  • the processing unit 1502 is configured to obtain corresponding position information of the vehicle at at least two points in time; And, for each time point, determine the distance between the vehicle and the left lane boundary and the right lane boundary according to the position information corresponding to the vehicle at the time point; and, determine the first distance between the vehicle and the left lane boundary at least two time points The distance change and the second distance change between the vehicle and the right lane boundary at at least two points in time; and, the lane change is judged based on the first distance change and the second distance change.
  • the processing unit 1502 when judging the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the difference between the first distance and the second distance is smaller than the first distance change. Threshold, the second distance change satisfies: the third distance is less than the fourth distance, and the difference between the third distance and the fourth distance is greater than the second threshold, then it is determined that the right side of the first lane has changed, and the first lane is where the vehicle is Lane
  • At least two time points include a first time point and a second time point
  • the first time point is before the second time point
  • the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance Is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point .
  • the processing unit 1502 is further configured to: after judging that the lane change is a change on the right side of the first lane, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, The second distance change also satisfies: the sixth distance is greater than four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, it is determined that a new lane is added to the right of the first lane;
  • the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
  • the processing unit 1502 is further configured to: after judging that the lane change is a change on the right side of the first lane, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, The second distance change also satisfies: the sixth distance is less than four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, then it is determined that the lane on the right side of the first lane is merged into the first lane;
  • the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
  • the processing unit 1502 when judging the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the first distance is less than the second distance, and the first distance is less than the second distance The difference between the distances is greater than the second threshold, and the second distance change satisfies: the difference between the third distance and the fourth distance is less than the first threshold, then it is determined that the left side of the first lane has changed, and the first lane is where the vehicle is located Lane
  • the multiple time points include a first time point and a second time point.
  • the first time point is before the second time point
  • the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance is The distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  • processing unit 1502 is further configured to: after determining that the left side of the first lane has changed, if the first distance change still satisfies: the fifth distance is greater than the second distance, and the difference between the fifth distance and the second distance If the value is greater than the second threshold, the second distance change also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that a new lane is added to the left of the first lane;
  • the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
  • the processing unit 1502 is further configured to: after determining that the left side of the first lane has changed, if the first distance change still satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance Is greater than the second threshold, the second distance change also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that the lane on the left side of the first lane will be merged into the first lane;
  • the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
  • the processing unit 1502 when determining the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the first distance is greater than the second distance, and the first distance is greater than the second distance The distance difference is greater than the third threshold, and the second distance change satisfies: the fourth distance is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the fourth threshold, then it is determined that the first lane is to the right and the second lane When a merger occurs, the first lane is the lane where the vehicle is located, and the second lane is the lane to the right of the first lane;
  • At least two time points include a first time point and a second time point
  • the first time point is before the second time point
  • the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance Is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point .
  • the processing unit 1502 when judging the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the second distance is greater than the first distance, and the second distance is greater than the first distance.
  • the distance difference is greater than the fourth threshold, and the second distance change satisfies: the fourth distance is less than the third distance, and the difference between the fourth distance and the third distance is greater than the third threshold, then it is judged that the first lane is to the left and the fourth lane
  • the first lane is the lane where the vehicle is located, and the fourth lane is the left lane of the first lane;
  • At least two time points include a first time point and a second time point
  • the first time point is before the second time point
  • the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance Is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point .
  • the processing unit 1502 when judging the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the second distance is greater than the first distance, and the second distance is greater than the first distance.
  • the difference between the distances is greater than the sixth threshold, and the change in the second distance satisfies: the fourth distance is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the seventh threshold, then it is determined that the first lane has a road Separated, the first lane is the lane where the vehicle is located;
  • At least two time points include a first time point and a second time point
  • the first time point is before the second time point
  • the first distance is the distance between the vehicle at the first time point and the left lane boundary
  • the second distance Is the distance between the vehicle and the left lane boundary at the second time point
  • the third distance is the distance between the vehicle and the right lane boundary at the first time point
  • the fourth distance is the distance between the vehicle and the right lane boundary at the second time point .
  • the processing unit 1502 is further configured to: before acquiring the location information corresponding to the vehicle at at least two time points, respectively, determine the change in the distance between the vehicle's historical driving trajectory and the lane boundary within a preset time range Within the preset range.
  • the communication unit 1501 when acquiring lane boundary information, is specifically configured to: acquire data collected by sensors; and acquire lane boundary information in a driving environment based on the data collected by sensors.
  • the division of modules in the embodiments of this application is illustrative, and it is only a logical function division. In actual implementation, there may be other division methods.
  • the functional modules in the various embodiments of this application can be integrated into one process. In the device, it can also exist alone physically, or two or more modules can be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software functional modules.
  • the lane structure detection device may include a processor 1601.
  • the physical hardware corresponding to the foregoing module may be the processor 1601.
  • the processor 1601 may be a central processing unit (CPU), or a digital processing module, and so on.
  • the device also includes: a memory 1602, configured to store programs executed by the processor 1601.
  • the memory 1602 may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., and may also be a volatile memory (volatile memory), such as random access memory (random access memory). -access memory, RAM).
  • the memory 1602 is any other medium that can be used to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto.
  • the device may further include a communication interface 1603, and the processor 1601 may obtain data collected by the sensor, data collected by the camera, etc. through the communication interface 1603.
  • the processor 1601 is configured to execute the program code stored in the memory 1602, and is specifically configured to execute the method described in the embodiments shown in FIG. 1 to FIG. 14. Reference may be made to the methods described in the embodiments shown in FIG. 1 to FIG. 14, and details are not described herein again in this application.
  • the processor 1601 can implement the function of the lane detection device 150 shown in FIG. 15 by executing the program code stored in the memory 1602.
  • the specific connection medium between the processor 1601, the memory 1602, and the communication interface 1603 is not limited in the embodiment of the present application.
  • the processor 1601, the memory 1602, and the communication interface 1603 are connected by a bus 1604.
  • the bus is represented by a thick line in FIG. 16, and the connection modes between other components are merely illustrative. , Is not limited.
  • the bus can be divided into an address bus, a data bus, a control bus, and so on. For ease of representation, only one thick line is used in FIG. 16, but it does not mean that there is only one bus or one type of bus.
  • the embodiment of the present invention also provides a computer-readable storage medium for storing computer software instructions required to execute the above-mentioned processor, which contains a program required to execute the above-mentioned processor.
  • this application can be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Atmospheric Sciences (AREA)
  • Traffic Control Systems (AREA)

Abstract

A lane structure detection method and apparatus. The accuracy of lane structure detection can be improved by means of determining a change in a lane structure according to a change in the distance between a vehicle and a lane boundary. The method comprises: acquiring lane boundary information (S101), wherein the lane boundary information comprises position information of a left lane boundary and a right lane boundary; acquiring position information, respectively corresponding to at least two time points, of a vehicle (S102); determining, with regard to each time point, the distance between the vehicle and the left lane boundary and the distance between the vehicle and the right lane boundary according to the position information, corresponding to the time point, of the vehicle (S103); determining a change in a first distance between the vehicle and the left lane boundary at the at least two time points and a change in a second distance between the vehicle and the right lane boundary at the at least two time points (S104); and determining a lane change on the basis of the change in the first distance and the change in the second distance (S105).

Description

一种车道结构检测方法及装置Method and device for detecting lane structure
相关申请的交叉引用Cross-references to related applications
本申请要求在2020年02月28日提交中国国家知识产权局、申请号为202010131023.1、申请名称为“一种车道结构检测方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office of China, the application number is 202010131023.1, and the application name is "a method and device for lane structure detection" on February 28, 2020, the entire content of which is incorporated by reference In this application.
技术领域Technical field
本申请涉及自动驾驶领域,特别涉及一种车道结构检测方法及装置。This application relates to the field of automatic driving, and in particular to a method and device for detecting a lane structure.
背景技术Background technique
在行驶道路中,道路分离和合并的情况下常常伴随着变道等情况发生,因此在驾驶过程中,道路的合并或分离对于驾驶决策有着非常重要的影响,需要提前进行检测。In driving roads, road separation and merging are often accompanied by lane changes. Therefore, in the driving process, road merging or separation has a very important impact on driving decision-making and needs to be detected in advance.
目前,可以通过高精地图来获取车道结构信息,得到车道线分离和合并的信息。但是,高精地图有一定的覆盖程度,当车辆行驶到没有高精地图的区域时,则无法获取到道路结构,无法知道车道线合并点和分离点信息。同时,高精地图还存在着失效的问题,因为城市改造或施工等原因,一定时间后的地图有可能会失效,从而车辆无法获取准确的车道结构信息。At present, it is possible to obtain lane structure information through high-precision maps, and obtain information on the separation and merging of lane lines. However, the high-precision map has a certain degree of coverage. When the vehicle travels to an area without a high-precision map, the road structure cannot be obtained, and the information of the lane line merge point and separation point cannot be known. At the same time, high-precision maps still have the problem of failure. Due to urban renewal or construction, the map after a certain period of time may become invalid, so that the vehicle cannot obtain accurate lane structure information.
发明内容Summary of the invention
本申请提供一种车道结构检测方法及装置,用于提高获取车道结构信息的准确性。The present application provides a lane structure detection method and device, which are used to improve the accuracy of acquiring lane structure information.
第一方面,本申请实施例提供一种车道结构检测方法,该方法包括:获取车道边界信息,车道边界信息包括左侧车道边界以及右侧车道边界的位置信息;获取车辆在至少两个时间点分别对应的位置信息;针对每个时间点,根据车辆在时间点对应的位置信息确定车辆与左侧车道边界及右侧车道边界的距离;确定车辆在至少两个时间点与左侧车道边界的第一距离变化和车辆在至少两个时间点与右侧车道边界的第二距离变化;基于第一距离变化和第二距离变化判断车道变化。本申请实施例中,根据车辆与车道边界的距离变化判断车道结构的变化,相比于通过高精地图获取车道结构变化的方式,本申请实施例可以实现对道路结构的检测,从而可以告知前方道路环境的车道结构,有助于智能车辆在有合并或分离的道路结构环境下提前进行风险分析和路径规划,提高行车安全性。In a first aspect, an embodiment of the present application provides a lane structure detection method. The method includes: acquiring lane boundary information, where the lane boundary information includes position information of the left lane boundary and the right lane boundary; acquiring the vehicle at least two points in time Respectively corresponding location information; for each time point, determine the distance between the vehicle and the left lane boundary and the right lane boundary according to the vehicle's corresponding location information at the time point; determine the distance between the vehicle and the left lane boundary at at least two time points The first distance change and the second distance change between the vehicle and the right lane boundary at at least two points in time; the lane change is determined based on the first distance change and the second distance change. In the embodiment of the present application, the change of the lane structure is judged according to the change of the distance between the vehicle and the lane boundary. Compared with the method of acquiring the lane structure change through the high-precision map, the embodiment of the present application can realize the detection of the road structure, so as to inform the front The lane structure of the road environment helps intelligent vehicles to carry out risk analysis and path planning in advance under the combined or separated road structure environment, and improve driving safety.
在一种可能的设计中,基于第一距离变化和第二距离变化判断车道变化时,若第一距离变化满足:第一距离与第二距离之间的差值小于第一阈值,第二距离变化满足:第三距离小于第四距离、且第三距离与第四距离之间的差值大于第二阈值,则判断第一车道右侧发生变化,第一车道为车辆所在的车道;其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In a possible design, when judging the lane change based on the first distance change and the second distance change, if the first distance change satisfies: the difference between the first distance and the second distance is less than the first threshold, and the second distance The change satisfies: the third distance is less than the fourth distance, and the difference between the third distance and the fourth distance is greater than the second threshold, it is determined that the right side of the first lane has changed, and the first lane is the lane where the vehicle is located; At least two time points include a first time point and a second time point. The first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance is the vehicle The distance from the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
上述设计中,通过在车辆与左侧车道边界的距离变化较小,与右侧车道边界的距离变 化较大时,可以比较准确的判断车道右侧发生变化。In the above design, the change in the right side of the lane can be more accurately determined when the distance between the vehicle and the left lane boundary changes less and the distance from the right lane boundary changes greatly.
在一种可能的设计中,若第一距离变化还满足:第五距离与第二距离之间的差值小于第一阈值,第二距离变化还满足:第六距离大于四距离、且第六距离与第四距离之间的差值大于第二阈值,则判断第一车道右侧增加新的车道;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a possible design, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, the second distance change also satisfies: the sixth distance is greater than the fourth distance, and the sixth distance is greater than the fourth distance. If the difference between the distance and the fourth distance is greater than the second threshold, it is determined that a new lane is added to the right of the first lane; wherein, the multiple time points also include the third time point, and the third time point is after the second time point , The fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
上述实施方式中,由于车道右分道的情况下,车辆与左侧车道边界的距离变化较小,而车辆与右侧车道边界的距离会逐渐增大,并增加到车道宽度阈值或者是遇到新的车道线,因此当第一距离变化为:车辆与左侧车道边界的距离变化较小,第二距离变化为:车辆与右侧车道边界的距离逐渐增大,并增加到车道宽度阈值或者是遇到新的车道线,可以比较准确的判断发生车道右分道。In the above-mentioned embodiment, due to the right lane separation, the distance between the vehicle and the left lane boundary will be small, while the distance between the vehicle and the right lane boundary will gradually increase and increase to the lane width threshold or encounter The new lane line, so when the first distance changes: the distance between the vehicle and the left lane boundary changes less, the second distance change is: the distance between the vehicle and the right lane boundary gradually increases, and increases to the lane width threshold or When a new lane line is encountered, it can be more accurately judged that the right lane is divided.
在一种可能的设计中,若第一距离变化还满足:第五距离与第二距离之间的差值小于第一阈值,第二距离变化还满足:第六距离小于四距离、且第六距离与第四距离之间的差值大于第二阈值,则判断第一车道右侧的车道合并到第一车道;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a possible design, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, the second distance change also satisfies: the sixth distance is less than the fourth distance, and the sixth distance is less than the fourth distance. The difference between the distance and the fourth distance is greater than the second threshold, it is determined that the lane on the right side of the first lane is merged into the first lane; wherein, the multiple time points also include the third time point, and the third time point is in the second After the time point, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
上述实施方式中,由于车道右合道的情况下,车辆与左侧车道边界的距离变化较小,而车辆与右侧车道边界的距离会突然变大,然后逐渐减少到车道宽度,因此当第一距离变化为:车辆与左侧车道边界的距离变化较小,第二距离变化为车辆与右侧车道边界的距离突然变大,然后逐渐减少到车道宽度,则可以比较准确的判断发生车道右合道。In the above embodiment, when the lane is joined to the right, the distance between the vehicle and the left lane boundary changes little, and the distance between the vehicle and the right lane boundary suddenly increases, and then gradually decreases to the lane width, so when the first lane The first distance change is: the distance between the vehicle and the left lane boundary changes less, the second distance change is that the distance between the vehicle and the right lane boundary suddenly increases, and then gradually decreases to the lane width, then the right lane can be judged more accurately. Hedao.
在一种可能的设计中,基于第一距离变化和第二距离变化判断车道变化时,若第一距离变化满足:第一距离小于第二距离、且第一距离与第二距离之间的差值大于第二阈值,第二距离变化满足:第三距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧发生变化,第一车道为车辆所在的车道;其中,多个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In a possible design, when judging the lane change based on the first distance change and the second distance change, if the first distance change satisfies: the first distance is less than the second distance, and the difference between the first distance and the second distance If the value is greater than the second threshold, the second distance change satisfies: the difference between the third distance and the fourth distance is less than the first threshold, then it is determined that the left side of the first lane has changed, and the first lane is the lane where the vehicle is located; The multiple time points include a first time point and a second time point. The first time point is before the second time point. The first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance is the vehicle at the The distance between the second time point and the left lane boundary, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
由于车道左侧发生变化时,车辆与右侧车道边界的距离变化较小,而车辆与左侧车道边界的距离变化较大,因此通过车辆与左右车道边界的距离变化情况,可以比较准确的判断车道结构发生变化的方向。Because when the left side of the lane changes, the distance between the vehicle and the right lane boundary changes less, and the distance between the vehicle and the left lane boundary changes more, so the change in the distance between the vehicle and the left and right lane boundaries can be more accurate judgments The direction in which the lane structure changes.
在一种可能的设计中,若第一距离变化还满足:第五距离大于第二距离、且第五距离与第二距离之间的差值大于第二阈值,第二距离变化还满足:第六距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧增加新的车道;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a possible design, if the first distance change also satisfies: the fifth distance is greater than the second distance, and the difference between the fifth distance and the second distance is greater than the second threshold, the second distance change also satisfies: The difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that a new lane is added to the left of the first lane; wherein, the multiple time points also include the third time point, and the third time point is at the second time point After that, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
上述实施方式中,由于车道左分道的情况下,车辆与右侧车道边界的距离变化较小,而车辆与左侧车道边界的距离会逐渐增大,并增加到车道宽度阈值或者是遇到新的车道线,因此当第二距离变化为:车辆与右侧车道边界的距离变化较小,第一距离变化为车辆与左侧车道边界的距离逐渐增大,并增加到车道宽度阈值或者是遇到新的车道线,则可以比较准确的判断发生车道左分道。In the above embodiment, due to the left lane separation, the distance between the vehicle and the right lane boundary changes little, while the distance between the vehicle and the left lane boundary will gradually increase and increase to the lane width threshold or encounter The new lane line, so when the second distance changes: the distance between the vehicle and the right lane boundary changes less, the first distance change is that the distance between the vehicle and the left lane boundary gradually increases, and increases to the lane width threshold or When encountering a new lane line, it can be more accurately judged that the left lane is divided.
在一种可能的设计中,若第一距离变化还满足:第五距离小于第二距离、且第五距离与第二距离之间的差值大于第二阈值,第二距离变化还满足:第六距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧的车道将合并到第一车道;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a possible design, if the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the second threshold, the second distance change also satisfies: If the difference between the sixth distance and the fourth distance is less than the first threshold, it is determined that the lane on the left side of the first lane will be merged into the first lane; wherein, the multiple time points also include the third time point, and the third time point is at After the second time point, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
上述实施方式中,由于车道左合道的情况下,车辆与右侧车道边界的距离变化较小,而车辆与左侧车道边界的距离会突然变大,然后逐渐减少到车道宽度,因此当第二距离变化为:车辆与右侧车道边界的距离变化较小,第一距离变化为:车辆与左侧车道边界的距离突然变大,然后逐渐减少到车道宽度,则可以比较准确的判断发生车道左合道。In the above embodiment, when the lane is joined to the left, the distance between the vehicle and the right lane boundary changes little, and the distance between the vehicle and the left lane boundary suddenly increases, and then gradually decreases to the lane width. The second distance change is: the distance between the vehicle and the right lane boundary changes slightly, the first distance change is: the distance between the vehicle and the left lane boundary suddenly increases, and then gradually decreases to the lane width, then the occurrence lane can be judged more accurately Left Hedao.
在一种可能的设计中,基于第一距离变化和第二距离变化判断车道变化时,若第一距离变化满足:第一距离大于第二距离、且第一距离与第二距离的差值大于第三阈值,第二距离变化满足:第四距离大于第三距离,且第四距离与第三距离的差值大于第四阈值,则判断第一车道向右与第二车道发生合并,第一车道为车辆所在的车道,第二车道为第一车道右侧的车道;其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In a possible design, when judging the lane change based on the first distance change and the second distance change, if the first distance change satisfies: the first distance is greater than the second distance, and the difference between the first distance and the second distance is greater than The third threshold, the second distance change satisfies: the fourth distance is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the fourth threshold, it is determined that the first lane is merged with the second lane to the right, and the first The lane is the lane where the vehicle is located, and the second lane is the lane on the right side of the first lane; among them, at least two time points include the first time point and the second time point, the first time point is before the second time point, and the first time point is before the second time point. The distance is the distance between the vehicle and the left lane boundary at the first time point, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the distance between the vehicle and the right lane boundary at the first time point. Distance, the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
由于车道向右与车道发生合并时,车辆与右侧车道边界的距离变化逐渐变大,而车辆与左侧车道边界的距离变化逐渐减小,因此通过车辆与左右车道边界的距离变化情况,可以比较准确的判断车道结构发生变化的方向。When the lane merges with the lane to the right, the distance between the vehicle and the right lane boundary gradually changes, while the distance between the vehicle and the left lane boundary gradually decreases, so the change in the distance between the vehicle and the left and right lane boundary can be Judge the direction of the lane structure change more accurately.
在一种可能的设计中,若第一距离变化还满足:第五距离小于第二距离、且第五距离与第二距离的差值大于第三阈值,第二距离变化还满足:第六距离与第四距离的差值小于第一阈值,则判断第一车道合并到第二车道;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a possible design, if the first distance change still satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the third threshold, the second distance change still satisfies: the sixth distance If the difference between the fourth distance and the fourth distance is less than the first threshold, it is determined that the first lane is merged into the second lane; wherein the multiple time points also include the third time point, the third time point is after the second time point, and the fifth distance Is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
上述实施方式中,由于第一车道合并到右侧车道的情况下,车辆与左侧车道边界的距离逐渐变小,车辆与右侧车道边界的距离变大后变化较小,因此若第一距离变化为车辆与左侧车道边界的距离逐渐变小,第二距离变化为车辆与右侧车道边界的距离变大后变化较小,则可以比较准确的判断左车道会发生向右合道。In the above embodiment, when the first lane is merged into the right lane, the distance between the vehicle and the left lane boundary gradually decreases, and the distance between the vehicle and the right lane boundary increases and the change becomes smaller. Therefore, if the first distance The change is that the distance between the vehicle and the left lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the right lane boundary increases and the change is small, and it can be more accurately judged that the left lane will merge to the right.
在一种可能的设计中,若第一距离变化还满足:第五距离小于第二距离、且第五距离与第二距离的差值大于第三阈值,第二距离变化还满足:第六距离小于第四距离、且第六距离与第四距离之间的差值大于第五阈值,则判断第一车道与第二车道合并为第三车道,第三车道在第一车道的右侧且在第二车道的左侧;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a possible design, if the first distance change still satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the third threshold, the second distance change still satisfies: the sixth distance Is less than the fourth distance, and the difference between the sixth distance and the fourth distance is greater than the fifth threshold, it is determined that the first lane and the second lane are merged into the third lane, and the third lane is on the right side of the first lane and at The left side of the second lane; where the multiple time points also include the third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the first The six distance is the distance between the vehicle and the right lane boundary at the third time point.
上述实施方式中,由于车道与右侧车道合并为一个车道的情况下,车辆与左侧车道边界的距离逐渐减小,车辆与右侧车道边界的距离突然变大后逐渐减小,因此若第一距离变化为:车辆与左侧车道边界的距离逐渐减小,第二距离变化为车辆与右侧车道边界的距离突然变大后逐渐减小,可以比较准确的判断车辆通过左车道合并到一条车道上。In the above embodiment, when the lane and the right lane are merged into one lane, the distance between the vehicle and the left lane boundary gradually decreases, and the distance between the vehicle and the right lane boundary suddenly increases and then gradually decreases. The first distance change is: the distance between the vehicle and the left lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the right lane boundary suddenly increases and then gradually decreases. It can be more accurately judged that the vehicle merges into one through the left lane On the driveway.
在一种可能的设计中,基于第一距离变化和第二距离变化判断车道变化时,若第一距 离变化满足:第二距离大于第一距离,且第二距离与第一距离的差值大于第四阈值,第二距离变化满足:第四距离小于第三距离、且第四距离与第三距离的差值大于第三阈值,则判断第一车道向左与第四车道发生合并,第一车道为车辆所在的车道,第四车道为第一车道左侧的车道;其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In a possible design, when judging the lane change based on the first distance change and the second distance change, if the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than The fourth threshold, the second distance change satisfies: the fourth distance is less than the third distance, and the difference between the fourth distance and the third distance is greater than the third threshold, then it is determined that the first lane is merged with the fourth lane to the left. The lane is the lane where the vehicle is located, and the fourth lane is the lane to the left of the first lane; among them, at least two time points include the first time point and the second time point, the first time point is before the second time point, and the first time point is before the second time point. The distance is the distance between the vehicle and the left lane boundary at the first time point, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the distance between the vehicle and the right lane boundary at the first time point. Distance, the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
由于车道向左与车道发生合并时,车辆与左侧车道边界的距离变化逐渐变大,而车辆与右侧车道边界的距离变化逐渐减小,因此通过车辆与左右车道边界的距离变化情况,可以比较准确的判断车道结构发生变化的方向。When the lane merges with the lane to the left, the distance between the vehicle and the left lane boundary gradually changes, and the distance between the vehicle and the right lane boundary gradually decreases. Therefore, the change in the distance between the vehicle and the left and right lane boundary can be Judge the direction of the lane structure change more accurately.
在一种可能的设计中,若第一距离变化还满足:第五距离与第二距离的差值小于第一阈值,第二距离变化还满足:第六距离小于第四距离、且第六距离与第四距离的差值大于第三阈值,则判断第一车道合并到第四车道;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a possible design, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, the second distance change still satisfies: the sixth distance is less than the fourth distance, and the sixth distance If the difference between the fourth distance and the fourth distance is greater than the third threshold, it is determined that the first lane is merged into the fourth lane; wherein, the multiple time points also include the third time point, the third time point is after the second time point, and the fifth distance Is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
上述实施方式中,由于左车道发生向左合道的情况下,车辆与右侧车道边界的距离逐渐变小,车辆与左侧车道边界的距离变大后变化较小,因此在第一距离变化为车辆与右侧车道边界的距离逐渐变小,第二距离变化为车辆与左侧车道边界的距离变大后变化较小,可以准确的判断从左车道会发生向左合道。In the above embodiment, when the left lane merges to the left, the distance between the vehicle and the right lane boundary gradually decreases, and the distance between the vehicle and the left lane boundary increases and the change is small. Therefore, the first distance changes Because the distance between the vehicle and the right lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the left lane boundary increases and the change is small, it can be accurately judged that the left lane will merge to the left.
在一种可能的设计中,若第一距离变化还满足:第五距离小于第二距离、且第五距离与第二距离之间的差值大于第五阈值,第二距离变化还满足:第六距离小于第四距离、且第六距离与第四距离的差值大于第三阈值,则判断第一车道与第四车道合并为第五车道,第五车道在第一车道的左侧且在第四车道的右侧;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a possible design, if the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the fifth threshold, the second distance change also satisfies: If the sixth distance is less than the fourth distance, and the difference between the sixth distance and the fourth distance is greater than the third threshold, it is determined that the first lane and the fourth lane are merged into the fifth lane, and the fifth lane is on the left side of the first lane and in The right side of the fourth lane; where the multiple time points also include the third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the first The six distance is the distance between the vehicle and the right lane boundary at the third time point.
上述实施例中,车道与左侧车道合并为同一个车道的情况下,车辆与右侧车道边界的距离逐渐减小,车辆与左侧车道边界的距离变大后逐渐减少,因此若在第一距离变化为车辆与右侧车道边界的距离逐渐减小,第二距离变化为车辆与左侧车道边界的距离变大后逐渐减少,可以比较准确的判断车辆通过右车道合并到一条车道上去。In the above embodiment, when the lane and the left lane are merged into the same lane, the distance between the vehicle and the right lane boundary gradually decreases, and the distance between the vehicle and the left lane boundary increases and then gradually decreases. The distance change is that the distance between the vehicle and the right lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the left lane boundary increases and then gradually decreases. It can be more accurately judged that the vehicle merges into a lane through the right lane.
在一种可能的设计中,基于第一距离变化和第二距离变化判断车道变化时,若第一距离变化满足:第二距离大于第一距离、且第二距离与第一距离之间的差值大于第六阈值,第二距离变化满足:第四距离大于第三距离、且第四距离与第三距离之间的差值大于第七阈值,则判断第一车道发生道路分离,第一车道为车辆所在的车道;其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In a possible design, when judging the lane change based on the first distance change and the second distance change, if the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance If the value is greater than the sixth threshold, the second distance change satisfies: the fourth distance is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the seventh threshold, then it is judged that the first lane has a road separation, the first lane Is the lane where the vehicle is located; wherein, at least two time points include the first time point and the second time point, the first time point is before the second time point, and the first distance is the boundary between the vehicle at the first time point and the left lane The second distance is the distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the left lane boundary at the second time point. The distance of the right lane boundary.
上述实现方式中,车道发生道路的分离的情况下,车辆与左侧车道边界的距离、车辆与右侧车道边界的距离都逐渐增加至车道的宽度或有新的车道线,因此若第一距离变化为车辆与左侧车道边界的距离、车辆与右侧车道边界的距离都逐渐增加至车道的宽度或有新 的车道线,则可以表明车道发生道路的分离。In the above implementation, in the case of lane separation, the distance between the vehicle and the left lane boundary and the distance between the vehicle and the right lane boundary gradually increase to the width of the lane or there is a new lane line, so if the first distance Changes to the distance between the vehicle and the left lane boundary and the distance between the vehicle and the right lane boundary gradually increase to the width of the lane or there is a new lane line, which can indicate that the lane is separated from the road.
在一种可能的设计中,在获取车辆在至少两个时间点分别对应的位置信息之前,可以确定车辆在预设时间范围内的历史行车轨迹与车道边界之间的距离变化在预设范围内。上述方式中,自车行车轨迹受到车姿信息比较大的影响,在距离差别比较大的时候车辆可能已经处于道路结构变化位置或者自身在变道等,通过判断车行轨迹与车道边界处于平行或近似平行的时候进行后续车道结构的判断可以提高车道结构判断的准确性。In a possible design, before obtaining the location information corresponding to the vehicle at least two points in time, it can be determined that the change in the distance between the historical driving trajectory of the vehicle within the preset time range and the lane boundary is within the preset range . In the above method, the vehicle trajectory is greatly affected by the vehicle attitude information. When the distance difference is relatively large, the vehicle may already be at a changing position of the road structure or changing lanes by itself. By judging that the vehicle trajectory is parallel or parallel to the lane boundary. When the lane structure is approximately parallel, the judgment of the subsequent lane structure can improve the accuracy of the lane structure judgment.
在一种可能的设计中,获取车道边界信息时,可以获取传感器采集的数据;基于传感器采集的数据获取行车环境中的车道边界信息。通过上述设计,可以准确的获取车道边界信息。In a possible design, when acquiring the lane boundary information, the data collected by the sensor can be acquired; based on the data collected by the sensor, the lane boundary information in the driving environment is acquired. Through the above design, the lane boundary information can be accurately obtained.
第二方面,本申请提供一种车道结构检测装置,该装置具有实现上述第一方面和第一方面的任一种可能的设计的功能。所述功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。所述硬件或软件包括一个或多个与上述功能相对应的模块。In a second aspect, the present application provides a lane structure detection device, which has the function of realizing any one of the possible designs of the first aspect and the first aspect. The function can be realized by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-mentioned functions.
第三方面,本申请提供了一种电子设备,包括:处理器和存储器。存储器用于存储计算机执行指令,当该电子设备运行时,该处理器执行该存储器存储的该计算机执行指令,以使该装置执行如上述第一方面或第一方面中任一所述的方法。In the third aspect, the present application provides an electronic device, including: a processor and a memory. The memory is used to store computer-executable instructions. When the electronic device is running, the processor executes the computer-executable instructions stored in the memory, so that the device executes the method according to the first aspect or any one of the first aspects.
第四方面,提供了一种计算机存储介质,存储有计算机程序,该计算机程序包括用于执行上述各方面的方法的指令。In a fourth aspect, a computer storage medium is provided, and a computer program is stored, and the computer program includes instructions for executing the methods of the foregoing aspects.
第五方面,提供了一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行上述各方面所述的方法。In a fifth aspect, a computer program product containing instructions is provided, which when run on a computer, causes the computer to execute the methods described in the above aspects.
第六方面,本申请提供了一种芯片,所述芯片与存储器耦合,用于读取并执行所述存储器中存储的程序指令,以实现上述第一方面或第一方面的任意一种可能的设计中所述的方法。In a sixth aspect, the present application provides a chip, which is coupled with a memory, and is used to read and execute the program instructions stored in the memory, so as to realize the above-mentioned first aspect or any one of the possibilities of the first aspect. The method described in the design.
附图说明Description of the drawings
图1为本申请实施例提供的一种车道结构检测方法的流程示意图;FIG. 1 is a schematic flowchart of a method for detecting a lane structure according to an embodiment of the application;
图2为本申请实施例提供的一种车道结构检测流程的示意图;2 is a schematic diagram of a lane structure detection process provided by an embodiment of the application;
图3为本申请实施例提供的另一种车道结构检测流程的示意图;FIG. 3 is a schematic diagram of another lane structure detection process provided by an embodiment of the application;
图4为本申请实施例提供的一种车道结构示意图;FIG. 4 is a schematic diagram of a lane structure provided by an embodiment of the application;
图5为本申请实施例提供的一种车道结构示意图;FIG. 5 is a schematic diagram of a lane structure provided by an embodiment of the application;
图6为本申请实施例提供的一种车道结构示意图;FIG. 6 is a schematic diagram of a lane structure provided by an embodiment of the application;
图7为本申请实施例提供的一种车道结构示意图;FIG. 7 is a schematic diagram of a lane structure provided by an embodiment of the application;
图8为本申请实施例提供的一种车道结构示意图;FIG. 8 is a schematic diagram of a lane structure provided by an embodiment of the application;
图9为本申请实施例提供的一种车道结构示意图;FIG. 9 is a schematic diagram of a lane structure provided by an embodiment of the application;
图10为本申请实施例提供的一种车道结构示意图;FIG. 10 is a schematic diagram of a lane structure provided by an embodiment of the application;
图11为本申请实施例提供的一种车道结构示意图;FIG. 11 is a schematic diagram of a lane structure provided by an embodiment of the application;
图12为本申请实施例提供的一种车道结构示意图;FIG. 12 is a schematic diagram of a lane structure provided by an embodiment of the application;
图13为本申请实施例提供的一种车道结构示意图;FIG. 13 is a schematic diagram of a lane structure provided by an embodiment of the application;
图14为本申请实施例提供的一种车道结构示意图;FIG. 14 is a schematic diagram of a lane structure provided by an embodiment of the application;
图15为本申请实施例提供的一种车道结构检测装置的结构示意图;15 is a schematic structural diagram of a lane structure detection device provided by an embodiment of the application;
图16为本申请实施例提供的一种车道结构检测装置的结构示意图。FIG. 16 is a schematic structural diagram of a lane structure detection device provided by an embodiment of the application.
具体实施方式Detailed ways
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。In order to make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application.
随着智能驾驶的到来,智能车成为各大厂商重点研究的目标。With the advent of smart driving, smart cars have become the key research targets of major manufacturers.
智能驾驶包括辅助驾驶和自动驾驶,其实现的关键技术有:感知定位、规划决策(如路径规划、运动规划等)、执行控制等。例如,在自动驾驶和辅助驾驶中,智能车辆需要对周边的环境进行感知。在智能车辆上,典型的用到的传感器包括毫米波雷达、摄像头和激光雷达等,车辆可以通过这些传感器对车辆周边的环境进行检测、分类,并将这些信息传输到规划和控制模块,形成对车辆未来行驶路径的决策,并最终通过执行器来执行,完成整个辅助驾驶或自动驾驶的过程。Intelligent driving includes assisted driving and automatic driving. The key technologies for its realization include: perception and positioning, planning and decision-making (such as path planning, motion planning, etc.), executive control, and so on. For example, in autonomous driving and assisted driving, smart vehicles need to perceive the surrounding environment. In smart vehicles, the typical sensors used include millimeter wave radar, cameras, and lidar. The vehicle can detect and classify the environment around the vehicle through these sensors, and transmit this information to the planning and control module to form a pair The decision of the vehicle's future travel path is finally executed by the actuator, completing the entire process of assisted driving or automatic driving.
在行驶道路中,道路分离和合并的情况下常常表示道路结构的变化,同时也会伴随着车辆变道等情况的发生,存在着一定的安全风险。因此在驾驶过程中,道路的合并或分离对于驾驶决策有着非常重要的影响,需要提前进行检测。In the driving road, the separation and merging of roads often indicate changes in the road structure. At the same time, it is also accompanied by the occurrence of vehicle lane changes, which poses a certain safety risk. Therefore, in the driving process, the merger or separation of roads has a very important impact on driving decision-making, and it needs to be detected in advance.
目前,可以通过高精地图来获取车道结构信息,得到车道线分离和合并的信息。但是,高精地图有一定的覆盖程度,当车辆行驶到没有高精地图的区域时,则无法获取到道路结构,无法知道车道线合并点和分离点信息。同时,高精地图还存在着失效的问题,因为城市改造或施工等原因,一定时间后的地图数据有可能会失效,从而导致车辆无法获取准确的车道结构信息。At present, it is possible to obtain lane structure information through high-precision maps, and obtain information on the separation and merging of lane lines. However, the high-precision map has a certain degree of coverage. When the vehicle travels to an area without a high-precision map, the road structure cannot be obtained, and the information of the lane line merge point and separation point cannot be known. At the same time, high-precision maps still have the problem of failure. Due to urban renewal or construction, the map data after a certain period of time may be invalid, resulting in vehicles unable to obtain accurate lane structure information.
基于此,本申请实施例提供一种车道结构检测方法及装置,可以获取比较准确的车道结构信息,从而可以提高自动驾驶或者辅助驾驶的安全性。其中,方法和装置是基于同一构思的,由于方法及装置解决问题的原理相似,因此装置与方法的实施可以相互参见,重复之处不再赘述。Based on this, the embodiments of the present application provide a lane structure detection method and device, which can obtain more accurate lane structure information, thereby improving the safety of automatic driving or assisted driving. Among them, the method and the device are based on the same concept. Since the principles of the method and the device to solve the problem are similar, the implementation of the device and the method can be referred to each other, and the repetition will not be repeated.
本申请实施例提供的车道结构检测方法应用于电子设备中,该电子设备可应用于车辆中,特别是智能车。车辆可以但不限于包括毫米波雷达、激光雷达、超声波雷达、摄像头、定位系统如全球定位系统(global positioning system,GPS)、惯性传感器(inertial measurement unit,IMU)、速度传感器、加速度传感器、湿度传感器、光强度传感器、麦克风等传感器,还可以包括显示屏、外置功放、扬声器等播放设备。还可以包括其他设备,这里不再一一列举。The lane structure detection method provided by the embodiment of the present application is applied to an electronic device, and the electronic device can be applied to a vehicle, especially a smart car. Vehicles can include, but are not limited to, millimeter wave radar, lidar, ultrasonic radar, cameras, positioning systems such as global positioning system (GPS), inertial measurement unit (IMU), speed sensor, acceleration sensor, humidity sensor , Light intensity sensors, microphones and other sensors, can also include display screens, external power amplifiers, speakers and other playback devices. It can also include other devices, which will not be listed here.
示例性的,电子设备可以是车载控制器。Exemplarily, the electronic device may be a vehicle-mounted controller.
本申请实施例提供的车道结构检测方法可应用于自动驾驶场景,也可拓展至人工驾驶场景。The lane structure detection method provided by the embodiments of the present application can be applied to automatic driving scenarios, and can also be extended to manual driving scenarios.
应理解,本申请实施例中“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A、B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一(项)个”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a、b或c中的至少一项(个),可以表示:a,b,c,a和b,a和c,b和c,或a、b和c,其中a、b、c可以是单个,也可以是多个。It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "multiple" refers to two or more than two. "And/or" describes the association relationship of the associated object, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the associated objects before and after are in an "or" relationship. "The following at least one (item)" or similar expressions refers to any combination of these items, including any combination of a single item (a) or a plurality of items (a). For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c It can be single or multiple.
需要理解的是,在本申请的描述中,“第一”、“第二”等词汇,仅用于区分描述的目的,而不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。It should be understood that in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can it be understood as indicating or implying order.
下面将结合附图,对本申请实施例进行详细描述。The embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.
参阅图1所示,为本申请实施例提供的一种车道结构检测方法的流程图,所述方法由电子设备或者电子设备中的芯片或者芯片组执行,该电子设备可以为车载控制器,该整车控制器可以包括用于获取车道结构的功能模块,或者,该电子设备也可以为独立于车载控制器、用于获取车道结构的装置。该方法具体可以包括如下:1 is a flowchart of a method for detecting a lane structure according to an embodiment of this application. The method is executed by an electronic device or a chip or chipset in the electronic device. The electronic device may be a vehicle-mounted controller. The vehicle controller may include a functional module for acquiring the lane structure, or the electronic device may also be a device independent of the on-board controller for acquiring the lane structure. The method may specifically include the following:
S101,获取车道边界信息,车道边界信息包括左侧车道边界以及右侧车道边界的位置信息。S101: Acquire lane boundary information, where the lane boundary information includes position information of the left lane boundary and the right lane boundary.
示例性的,车道边界可以但不限于包括:车道线、路肩、路缘石、道路两旁的花坛、道路中间的花坛、或者其他分割车道的物体。Exemplarily, the lane boundary may include, but is not limited to: lane lines, road shoulders, curbs, flower beds on both sides of the road, flower beds in the middle of the road, or other objects that divide the lane.
一种可能的实施方式中,获取车道边界信息,可以通过如下过程实现:获取传感器采集的数据;基于传感器采集的数据获取行车环境中的车道边界信息。In a possible implementation manner, acquiring lane boundary information can be achieved through the following process: acquiring data collected by sensors; acquiring lane boundary information in a driving environment based on the data collected by sensors.
例如,可以获取摄像头传感器采集的数据,得到行车环境中的车道边界信息。For example, the data collected by the camera sensor can be obtained, and the lane boundary information in the driving environment can be obtained.
一种可选的方法是可以通过梯度阈值或者颜色阈值等来得到图像中的车道边界信息,包括车道线信息和道路边界信息;另一种可选方法是采用机器学习的方法,通过预训练的车道边界神经网络模型或其他数据模型,对图像中的车道信息进行检测,得到车道边界信息,包括车道线信息和道路边界信息。更具体的,在获取到车道信息的特征点后,继续可以通过拟合和跟踪等方法得到车道边界方程。An alternative method is to obtain lane boundary information in the image through gradient threshold or color threshold, including lane line information and road boundary information; another alternative method is to use machine learning methods through pre-training The lane boundary neural network model or other data model detects the lane information in the image to obtain lane boundary information, including lane line information and road boundary information. More specifically, after obtaining the characteristic points of the lane information, the lane boundary equation can be obtained by methods such as fitting and tracking.
一种车道边界方程的描述方式是:One way to describe the lane boundary equation is:
y(x)=C0+C1x+C2x 2+C3x 3 y(x)=C0+C1x+C2x 2 +C3x 3
其中,C0为车道边界横向偏移量,C1为车道边界航向角,C2为两倍的车道边界的曲率平均,C3为6倍的车道边界曲率变化率平均值。Among them, C0 is the lateral offset of the lane boundary, C1 is the heading angle of the lane boundary, C2 is the average curvature of the lane boundary twice, and C3 is the average curvature change rate of the lane boundary 6 times.
或者,也可以获取毫米波雷达、激光雷达等传感器数据,获取车道边界信息。一种可选的方法为可以获取道路边界如护栏等反射信息,并对其进行处理从而得到道路边界信息,也可以作为车道信息的一部分。Alternatively, sensor data such as millimeter wave radar and lidar can also be obtained to obtain lane boundary information. An optional method is to obtain the reflection information of the road boundary, such as guardrail, and process it to obtain the road boundary information, which can also be used as part of the lane information.
又例如,也可以通过多个传感器输出的结果进行融合输出最终的车道边界信息,如,将摄像头传感器采集的数据、毫米波雷达等传感器数据进行融合输出最终的车道边界信息。For another example, the final lane boundary information can also be output by fusing the results of multiple sensors, for example, fusing data collected by camera sensors, millimeter wave radar and other sensor data to output the final lane boundary information.
S102,获取车辆在至少两个时间点分别对应的位置信息。S102: Acquire location information corresponding to the vehicle at at least two points in time, respectively.
一种实现方式中,可以通过获取车辆的行车轨迹,并根据行车轨迹确定至少两个时间点分别对应的位置信息。其中,该至少两个时间点可以是未来的时间点,也可以理解为,根据车辆行驶轨迹确定未来的至少两个时间点分别对应的位置信息。In an implementation manner, the driving trajectory of the vehicle may be acquired, and the position information corresponding to at least two time points may be determined according to the driving trajectory. Wherein, the at least two points in time may be points in the future, and can also be understood as determining the location information corresponding to at least two points in the future according to the trajectory of the vehicle.
车辆的行驶轨迹可以通过如下方式确定:通过获取车辆传感器采集的数据以及摄像头采集的数据,根据传感器采集的数据以及摄像头采集额数据确定车辆的行驶轨迹。The driving trajectory of the vehicle can be determined in the following manner: by acquiring the data collected by the vehicle sensor and the data collected by the camera, the driving trajectory of the vehicle is determined according to the data collected by the sensor and the amount data collected by the camera.
一种示例性说明中,该至少两个时间点中任意两个相邻的时间点之间的时间间隔可以相同。例如,每间隔0.5s设置一个时间点。In an exemplary illustration, the time interval between any two adjacent time points in the at least two time points may be the same. For example, set a time point every 0.5s.
一种实现方式中,两个相邻的时间点之间的时间间隔可以根据车辆的行驶速度进行设置。例如,车辆的行驶速度越大,两个相邻的时间点之间的时间间隔可以越小。示例性的,当车辆的行驶速度大于100KM/h时,可以每0.2s设置一个时间点,即两个相邻的时间点之间间隔0.2s。当车辆的行驶速度在[50KM/h,100KM/h)时,可以每0.4s设置一个时间点,即两个相邻的时间点之间间隔0.4s。又例如,车辆的行驶速度越大,两个相邻的时间点之间的时间间隔可以越大。In one implementation, the time interval between two adjacent time points can be set according to the driving speed of the vehicle. For example, the greater the speed of the vehicle, the smaller the time interval between two adjacent points in time. Exemplarily, when the driving speed of the vehicle is greater than 100KM/h, a time point can be set every 0.2s, that is, the interval between two adjacent time points is 0.2s. When the driving speed of the vehicle is [50KM/h, 100KM/h), a time point can be set every 0.4s, that is, the interval between two adjacent time points is 0.4s. For another example, the greater the traveling speed of the vehicle, the greater the time interval between two adjacent time points.
另一种示例性说明中,该至少两个时间点中任意两个相邻的时间点之间的行驶距离可以相同。In another exemplary illustration, the driving distance between any two adjacent time points in the at least two time points may be the same.
一种实现方式中,两个相邻的时间点之间的行驶距离可以根据车辆的行驶速度进行设置。例如,车辆的行驶速度越大,两个相邻的时间点之间的行驶距离可以越大。示例性的,当车辆的行驶速度大于100KM/h时,两个相邻的时间点之间的行驶距离可以为100m。当车辆的行驶速度在[50KM/h,100KM/h)时,两个相邻的时间点之间的行驶距离可以为50m。In an implementation manner, the driving distance between two adjacent time points can be set according to the driving speed of the vehicle. For example, the greater the traveling speed of the vehicle, the greater the traveling distance between two adjacent points in time. Exemplarily, when the driving speed of the vehicle is greater than 100KM/h, the driving distance between two adjacent time points may be 100m. When the driving speed of the vehicle is [50KM/h, 100KM/h), the driving distance between two adjacent time points can be 50m.
又例如,车辆的行驶速度越大,两个相邻的时间点之间的行驶距离可以越小。For another example, the greater the traveling speed of the vehicle, the smaller the traveling distance between two adjacent points in time.
S103,可以针对每个时间点,根据车辆在时间点对应的位置信息确定车辆与左侧车道边界及右侧车道边界的距离。S103: For each time point, the distance between the vehicle and the left lane boundary and the right lane boundary may be determined according to the position information of the vehicle at the time point.
一种实现方式中,可以在不同的坐标系下来进行距离的计算,如采用像素值来描述,或者采用实际距离长度来描述。In one implementation, the distance can be calculated in different coordinate systems, such as using pixel values to describe, or using actual distance length to describe.
S104,确定车辆在至少两个时间点与左侧车道边界的第一距离变化和车辆在至少两个时间点与右侧车道边界的第二距离变化。S104: Determine the first distance change between the vehicle and the left lane boundary at at least two time points and the second distance change between the vehicle and the right lane boundary at at least two time points.
示例性的,第一距离变化可以为车辆在相邻两个时间点与左侧车道边界的距离差。第二距离变化可以为车辆在相邻两个时间点与右侧车道边界的距离差。Exemplarily, the first distance change may be the distance difference between the vehicle and the left lane boundary at two adjacent time points. The second distance change may be the distance difference between the vehicle and the right lane boundary at two adjacent time points.
例如,以两个时间点t1和t2为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R)。则,第一距离变化可以为车辆在t1和t2与左侧车道边界的距离差,即可以为L (2,L)-L (1,L)。第二距离变化可以为车辆在t1和t2与右侧车道边界的距离差,即可以为L (2,R)-L (1,R)For example, taking two time points t1 and t2 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L) . The distance between the vehicle and the right lane boundary at time t1 is L (1, R) , and the distance between the vehicle and the right lane boundary at time t2 is L (2, R) . Then, the first distance change can be the distance difference between the vehicle and the left lane boundary at t1 and t2, that is, L (2, L) -L (1, L) . The second distance change can be the distance difference between the vehicle and the right lane boundary at t1 and t2, that is, L (2, R) -L (1, R) .
又例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)。则,第一距离变化可以包括Δ (1,L)=L (2,L)-L (1,L),Δ (2,L)=L (3,L)-L (2,L)。第二距离变化可以包括Δ (1,R)=L (2,R)-L (1,R),Δ (2,R)=L (3,R)-L (2,R)For another example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 Is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) . Then, the first distance change may include Δ (1, L) = L (2, L) -L (1, L) , Δ (2, L) = L (3, L) -L (2, L) . The second distance change may include Δ (1,R) =L (2,R) -L (1,R) , Δ (2,R) =L (3,R) -L (2,R) .
S105,基于第一距离变化和第二距离变化判断车道变化。S105: Determine the lane change based on the first distance change and the second distance change.
由于不同的道路车道结构有着不同的车道距离变化,根据测量到的不同的距离变化可以判断车道结构,例如,一种车道结构是一边保持不变,另一边从小到大变化;又例如,一种车道结构是一边保持不变,另一边突然变大,然后慢慢变小;再例如,还有其他的距离变化方式来对应不同的车道结构。进一步的,可以结合邻车道信息来输出不同的车道结构,如道路合并或分离、道路左分道、道路右分道等,用于后面的规控等处理。示例性的,车道结构检测流程可以如图2或图3所示。Because different road lane structures have different lane distance changes, the lane structure can be judged according to the different measured distance changes. For example, a lane structure keeps one side unchanged while the other side changes from small to large; for example, one The lane structure remains unchanged on one side, suddenly becomes larger on the other side, and then gradually becomes smaller; for another example, there are other ways to change the distance to correspond to different lane structures. Further, the information of adjacent lanes can be combined to output different lane structures, such as road merging or separation, left-division road, right-division road, etc., for subsequent regulation and control. Exemplarily, the lane structure detection process may be as shown in FIG. 2 or FIG. 3.
本申请实施例中,根据车辆与车道边界的距离变化判断车道结构的变化,相比于通过高精地图获取车道结构变化的方式,本申请实施例可以实现对道路结构的完整检测,从而可以告知前方道路环境的车道结构,有助于智能车辆在有合并或分离的道路结构环境下提前进行风险分析和路径规划,提高行车安全性。In the embodiment of the present application, the change of the lane structure is judged according to the change of the distance between the vehicle and the lane boundary. Compared with the way of obtaining the lane structure change through the high-precision map, the embodiment of the present application can realize the complete detection of the road structure, so as to inform The lane structure of the road environment ahead helps intelligent vehicles to conduct risk analysis and path planning in advance in a combined or separated road structure environment, and improve driving safety.
在一些实施例中,步骤S104可以通过如下七种实现方式中任一种实现方式实现:In some embodiments, step S104 may be implemented in any one of the following seven implementation manners:
第一种实现方式中,若第一距离变化满足:第一距离与第二距离之间的差值小于第一阈值,第二距离变化满足:第三距离小于第四距离、且第三距离与第四距离之间的差值大 于第二阈值,则可以判断第一车道右侧发生变化,第一车道为车辆所在的车道。其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。示例性的,第一阈值可以小于第二阈值。In the first implementation manner, if the first distance change satisfies: the difference between the first distance and the second distance is less than the first threshold, the second distance change satisfies: the third distance is less than the fourth distance, and the third distance is less than the If the difference between the fourth distance is greater than the second threshold, it can be determined that the right side of the first lane has changed, and the first lane is the lane where the vehicle is located. Wherein, at least two time points include a first time point and a second time point, the first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance Is the distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point . Exemplarily, the first threshold may be smaller than the second threshold.
例如,以两个时间点t1和t2为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R)。若,|L (2,L)-L (1, L)|<ΔL1,L (1,R)<L (2,R)且L (2,R)-L (1,R)>ΔL2,可以判断第一车道右侧发生变化,第一车道为车辆所在的车道。示例性的,ΔL1可以小于ΔL3。 For example, taking two time points t1 and t2 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L) . The distance between the vehicle and the right lane boundary at time t1 is L (1, R) , and the distance between the vehicle and the right lane boundary at time t2 is L (2, R) . If, |L (2,L) -L (1, L) |<ΔL1, L (1,R) <L (2,R) and L (2,R) -L (1,R) >ΔL2, It can be judged that the right side of the first lane has changed, and the first lane is the lane where the vehicle is located. Exemplarily, ΔL1 may be smaller than ΔL3.
一种具体实施方式中,在判断车道变化为第一车道右侧发生变化之后,若第一距离变化还满足:第五距离与第二距离之间的差值小于第一阈值,第二距离变化还满足:第六距离大于四距离、且第六距离与第四距离之间的差值大于第二阈值,则可以判断第一车道右侧增加新的车道。其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a specific embodiment, after determining that the lane change is a change on the right side of the first lane, if the first distance change is still satisfied: the difference between the fifth distance and the second distance is less than the first threshold, and the second distance changes It is also satisfied that: the sixth distance is greater than four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, it can be determined that a new lane is added to the right of the first lane. Among them, the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)For example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) .
若,|L (2,L)-L (1,L)|<ΔL1,|L (3,L)-L (2,L)|<ΔL1,L (1,R)<L (2,R),L (2,R)<L (3, R)且L (2,R)-L (1,R)>ΔL2,L (3,R)-L (2,R)>ΔL2,可以判断第一车道右侧增加新的车道,第一车道为车辆所在的车道,例如,如图4所示。 If, |L (2,L) -L (1,L) |<ΔL1, |L (3,L) -L (2,L) |<ΔL1, L (1,R) <L (2,R) ) , L (2,R) <L (3, R) and L (2,R) -L (1,R) >ΔL2, L (3,R) -L (2,R) >ΔL2, it can be judged A new lane is added to the right of the first lane, and the first lane is the lane where the vehicle is located, for example, as shown in Figure 4.
上述实施方式中,第一距离变化为:车辆与左侧车道边界的距离变化较小,第二距离变化为:车辆与右侧车道边界的距离逐渐增大,并增加到车道宽度阈值或者是遇到新的车道线,可以判断发生车道右分道。In the above embodiment, the first distance change is: the distance between the vehicle and the left lane boundary changes slightly, and the second distance change is: the distance between the vehicle and the right lane boundary gradually increases, and increases to the lane width threshold or meets When the new lane line is reached, it can be judged that the lane divides to the right.
另一种具体的实施方式中,在判断车道变化为第一车道右侧发生变化之后,若第一距离变化还满足:第五距离与第二距离之间的差值小于第一阈值,第二距离变化还满足:第六距离小于四距离、且第六距离与第四距离之间的差值大于第二阈值,则可以判断第一车道右侧的车道合并到第一车道;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In another specific embodiment, after judging that the lane change is a change on the right side of the first lane, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, and the second The distance change also satisfies: the sixth distance is less than four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, it can be judged that the lane on the right side of the first lane merges into the first lane; The time point also includes the third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the distance between the vehicle and the right lane at the third time point. The distance of the side lane boundary.
例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)For example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) .
若,|L (2,L)-L (1,L)|<ΔL1,|L (3,L)-L (2,L)|<ΔL1,L (1,R)<L (2,R),L (2,R)>L (3, R)且L (2,R)-L (1,R)>ΔL2,L (2,R)-L (3,R)>ΔL2,可以判断第一车道右侧的车道合并到第一车道,第一车道为车辆所在的车道,例如,如图5所示。 If, |L (2,L) -L (1,L) |<ΔL1, |L (3,L) -L (2,L) |<ΔL1, L (1,R) <L (2,R) ) , L (2,R) >L (3, R) and L (2,R) -L (1,R) >ΔL2, L (2,R) -L (3,R) >ΔL2, it can be judged The lane on the right side of the first lane is merged into the first lane, and the first lane is the lane where the vehicle is located, for example, as shown in FIG. 5.
上述实施方式中,第一距离变化为:车辆与左侧车道边界的距离变化较小,第二距离 变化为车辆与右侧车道边界的距离突然变大,然后逐渐减少到车道宽度,则可以判断发生车道右合道。In the above embodiment, the first distance change is: the distance between the vehicle and the left lane boundary changes less, and the second distance change is that the distance between the vehicle and the right lane boundary suddenly increases, and then gradually decreases to the lane width, it can be judged The right lane of the incident occurred.
第二种实现方式中,若第一距离变化满足:第一距离小于第二距离、且第一距离与第二距离之间的差值大于第二阈值,第二距离变化满足:第三距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧发生变化,第一车道为车辆所在的车道;其中,多个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In the second implementation manner, if the first distance change satisfies: the first distance is less than the second distance, and the difference between the first distance and the second distance is greater than the second threshold, the second distance change satisfies: If the difference between the fourth distance is less than the first threshold, it is determined that the left side of the first lane has changed, and the first lane is the lane where the vehicle is located; wherein the multiple time points include the first time point and the second time point, and the first A time point is before the second time point, the first distance is the distance between the vehicle and the left lane boundary at the first time point, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is The distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
例如,以两个时间点t1和t2为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R)。若,|L (2,R)-L (1, R)|<ΔL1,L (1,L)<L (2,L)且L (2,L)-L (1,L)>ΔL2,可以判断第一车道左侧发生变化,第一车道为车辆所在的车道。 For example, taking two time points t1 and t2 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L) . The distance between the vehicle and the right lane boundary at time t1 is L (1, R) , and the distance between the vehicle and the right lane boundary at time t2 is L (2, R) . If, |L (2,R) -L (1, R) |<ΔL1, L (1,L) <L (2,L) and L (2,L) -L (1,L) >ΔL2, It can be judged that the left side of the first lane has changed, and the first lane is the lane where the vehicle is located.
一种具体的实施方式中,在判断第一车道左侧发生变化之后,若第一距离变化还满足:第五距离大于第二距离、且第五距离与第二距离之间的差值大于第二阈值,第二距离变化还满足:第六距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧增加新的车道。其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In a specific implementation, after determining that the left side of the first lane has changed, if the first distance change is still satisfied: the fifth distance is greater than the second distance, and the difference between the fifth distance and the second distance is greater than the first distance. Second threshold, the second distance change is still satisfied: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that a new lane is added to the left of the first lane. Among them, the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)For example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) .
若,|L (2,R)-L (1,R)|<ΔL1,|L (3,R)-L (2,R)|<ΔL1,L (1,L)<L (2,L),L (2,L)<L (3, L)且L (2,L)-L (1,L)>ΔL2,L (3,L)-L (2,L)>ΔL2,可以判断第一车道左侧增加新的车道,第一车道为车辆所在的车道,例如,如图6所示。 If, |L (2,R) -L (1,R) |<ΔL1, |L (3,R) -L (2,R) |<ΔL1, L (1,L) <L (2,L ) , L (2,L) <L (3, L) and L (2,L) -L (1,L) >ΔL2, L (3,L) -L (2,L) >ΔL2, it can be judged A new lane is added to the left of the first lane, and the first lane is the lane where the vehicle is located, for example, as shown in Figure 6.
上述实施方式中,第二距离变化为:车辆与右侧车道边界的距离变化较小,第一距离变化为车辆与左侧车道边界的距离逐渐增大,并增加到车道宽度阈值或者是遇到新的车道线,则可以判断发生车道左分道。In the above embodiment, the second distance change is: the distance between the vehicle and the right lane boundary changes slightly, and the first distance change is that the distance between the vehicle and the left lane boundary gradually increases and increases to the lane width threshold or encounters With the new lane line, it can be judged that the left lane is divided.
另一种可能的实施方式中,在判断第一车道左侧发生变化之后,若第一距离变化还满足:第五距离小于第二距离、且第五距离与第二距离之间的差值大于第二阈值,第二距离变化还满足:第六距离与第四距离之间的差值小于第一阈值,则可以判断第一车道左侧的车道将合并到第一车道;其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In another possible implementation manner, after determining that the left side of the first lane has changed, if the first distance change still satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than The second threshold, the second distance change also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, it can be judged that the lane on the left side of the first lane will be merged into the first lane; where, multiple times The point also includes the third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point to the right The distance of the lane boundary.
例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)For example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) .
若,|L (2,R)-L (1,R)|<ΔL1,|L (3,R)-L (2,R)|<ΔL1,L (1,L)<L (2,L),L (2,L)>L (3, L)且L (2,L)-L (1,L)>ΔL2,L (2,L)-L (3,L)>ΔL2,可以判断第一车道左侧的车道合并到第一车道,第一车道为车辆所在的车道,例如,如图7所示。 If, |L (2,R) -L (1,R) |<ΔL1, |L (3,R) -L (2,R) |<ΔL1, L (1,L) <L (2,L ) , L (2,L) >L (3, L) and L (2,L) -L (1,L) >ΔL2, L (2,L) -L (3,L) >ΔL2, it can be judged The left lane of the first lane is merged into the first lane, and the first lane is the lane where the vehicle is located, for example, as shown in FIG. 7.
上述实施方式中,第二距离变化为:车辆与右侧车道边界的距离变化较小,第一距离变化为:车辆与左侧车道边界的距离突然变大,然后逐渐减少到车道宽度,则可以判断发生车道左合道。In the above embodiment, the second distance change is: the distance between the vehicle and the right lane boundary changes slightly, and the first distance change is: the distance between the vehicle and the left lane boundary suddenly increases, and then gradually decreases to the lane width, then Judge the left side of the lane.
第三种实现方式中,若第一距离变化满足:第一距离大于第二距离、且第一距离与第二距离的差值大于第三阈值,第二距离变化满足:第四距离大于第三距离,且第四距离与第三距离的差值大于第四阈值,则判断第一车道向右与第二车道发生合并,第一车道为车辆所在的车道,第二车道为第一车道右侧的车道;其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In the third implementation manner, if the first distance change satisfies: the first distance is greater than the second distance, and the difference between the first distance and the second distance is greater than the third threshold, the second distance change satisfies: the fourth distance is greater than the third Distance, and the difference between the fourth distance and the third distance is greater than the fourth threshold, it is determined that the first lane to the right is merged with the second lane, the first lane is the lane where the vehicle is located, and the second lane is the right side of the first lane Where at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is the distance between the vehicle at the first time point and the left lane boundary, The second distance is the distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the vehicle and the right lane boundary at the second time point. The distance of the border.
例如,以两个时间点t1和t2为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R)。若,L (2,L)<L (1, L),L (1,L)-L (2,L)>ΔL3,L (1,R)<L (2,R)且L (2,R)-L (1,R)>ΔL4,可以判断第一车道向右与第二车道发生合并,第一车道为车辆所在的车道,第二车道为第一车道右侧的车道。 For example, taking two time points t1 and t2 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L) . The distance between the vehicle and the right lane boundary at time t1 is L (1, R) , and the distance between the vehicle and the right lane boundary at time t2 is L (2, R) . If, L (2,L) <L (1, L) , L (1,L) -L (2,L) >ΔL3, L (1,R) <L (2,R) and L (2, R) -L (1, R) > ΔL4, it can be judged that the first lane is merged with the second lane to the right, the first lane is the lane where the vehicle is located, and the second lane is the lane on the right side of the first lane.
一种具体实施方式中,若所述第一距离变化还满足:第五距离小于所述第二距离、且所述第五距离与所述第二距离的差值大于所述第三阈值,所述第二距离变化还满足:第六距离与所述第四距离的差值小于第一阈值,则判断所述第一车道合并到所述第二车道。其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。示例性的,第四阈值可以大于或等于车道的宽度,或者,第四阈值可以小于或等于车道宽度。In a specific embodiment, if the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the third threshold, so The second distance change also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that the first lane is merged into the second lane. Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point. Exemplarily, the fourth threshold may be greater than or equal to the width of the lane, or the fourth threshold may be less than or equal to the width of the lane.
例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)For example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) .
若,L (3,L)<L (2,L)<L (1,L),L (1,L)-L (2,L)>ΔL3,L (2,L)-L (3,L)>ΔL3,L (1,R)<L (2,R)且L (2,R)-L (1,R)>ΔL4,L (3,R)<L (2,R),可以判断所述第一车道合并到所述第二车道,如图8所示。 If, L (3,L) <L (2,L) <L (1,L) , L (1,L) -L (2,L) >ΔL3, L (2,L) -L (3, L) >ΔL3,L (1,R) <L (2,R) and L (2,R) -L (1,R) >ΔL4,L (3,R) <L (2,R) , yes It is determined that the first lane is merged into the second lane, as shown in FIG. 8.
上述实施方式中,第一距离变化为车辆与左侧车道边界的距离逐渐变小,第二距离变化为车辆与右侧车道边界的距离变大后变化较小,则可以判断左车道会发生向右合道。In the above embodiment, the first distance change is that the distance between the vehicle and the left lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the right lane boundary increases and the change is small. Right Hedao.
另一种具体实施方式中,若所述第一距离变化还满足:第五距离小于所述第二距离、且所述第五距离与所述第二距离的差值大于所述第三阈值,所述第二距离变化还满足:第六距离小于所述第四距离、且所述第六距离与所述第四距离之间的差值大于第五阈值,则判断所述第一车道与所述第二车道合并为第三车道,所述第三车道在所述第一车道的右侧且在所述第二车道的左侧;其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的 距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。In another specific embodiment, if the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the third threshold, The second distance change also satisfies: the sixth distance is less than the fourth distance, and the difference between the sixth distance and the fourth distance is greater than the fifth threshold, then it is determined that the first lane and the The second lane is merged into a third lane, and the third lane is on the right side of the first lane and on the left side of the second lane; wherein, the multiple time points further include a third time point, The third time point is after the second time point, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the vehicle The distance from the boundary of the right lane at the third time point.
例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)For example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) .
若,L (3,L)<L (2,L)<L (1,L),L (1,L)-L (2,L)>ΔL3,L (2,L)-L (3,L)>ΔL3,L (1,R)<L (2,R)且L (2,R)-L (1,R)>ΔL4,L (3,R)<L (2,R)且L (2,R)-L (3,R)>ΔL5,可以判断所述第一车道与所述第二车道合并为第三车道,所述第三车道在所述第一车道的右侧且在所述第二车道的左侧,如图9所示。 If, L (3,L) <L (2,L) <L (1,L) , L (1,L) -L (2,L) >ΔL3, L (2,L) -L (3, L) >ΔL3, L (1,R) <L (2,R) and L (2,R) -L (1,R) >ΔL4, L (3,R) <L (2,R) and L (2, R) -L (3, R) > ΔL5, it can be judged that the first lane and the second lane are merged into a third lane, and the third lane is on the right side of the first lane and at The left side of the second lane is as shown in FIG. 9.
上述实施方式中,第一距离变化为:车辆与左侧车道边界的距离逐渐减小,第二距离变化为车辆与右侧车道边界的距离突然变大后逐渐减小,可以判断车辆通过左车道合并到一条车道上。In the above embodiment, the first distance change is: the distance between the vehicle and the left lane boundary gradually decreases, and the second distance change is that the distance between the vehicle and the right lane boundary suddenly increases and then gradually decreases. It can be determined that the vehicle passes through the left lane. Merge into one lane.
第四种实现方式中,若第一距离变化满足:第二距离大于第一距离,且第二距离与第一距离的差值大于第四阈值,第二距离变化满足:第四距离小于第三距离、且第四距离与第三距离的差值大于第三阈值,则判断第一车道向左与第四车道发生合并,第一车道为车辆所在的车道,第四车道为第一车道左侧的车道;其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In the fourth implementation manner, if the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than the fourth threshold, the second distance change satisfies: the fourth distance is less than the third Distance, and the difference between the fourth distance and the third distance is greater than the third threshold, it is judged that the first lane to the left is merged with the fourth lane, the first lane is the lane where the vehicle is located, and the fourth lane is the left side of the first lane The lane; where at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is the distance between the vehicle at the first time point and the left lane boundary, The second distance is the distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the vehicle and the right lane boundary at the second time point. The distance of the border.
例如,以两个时间点t1和t2为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R)。若,L (2,R)<L (1, R),L (1,)R-L (2,R)>ΔL3,L (1,L)<L (2,L)且L (2,L)-L (1,L)>ΔL4,可以判断第一车道向左与第四车道发生合并,第一车道为车辆所在的车道,第四车道为第一车道左侧的车道。 For example, taking two time points t1 and t2 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L ( 2, L) . The distance between the vehicle and the right lane boundary at time t1 is L (1, R) , and the distance between the vehicle and the right lane boundary at time t2 is L (2, R) . If, L (2, R) <L (1, R) , L (1,) R- L (2, R) > ΔL3, L (1, L) <L (2, L) and L (2, L) -L (1,L) > ΔL4, it can be judged that the first lane is merged with the fourth lane to the left, the first lane is the lane where the vehicle is located, and the fourth lane is the left lane of the first lane.
一种具体的实施方式中,若所述第一距离变化还满足:第五距离与所述第二距离的差值小于第一阈值,所述第二距离变化还满足:第六距离小于所述第四距离、且所述第六距离与所述第四距离的差值大于所述第三阈值,则判断所述第一车道合并到所述第四车道。其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。In a specific implementation, if the first distance change also satisfies: the difference between the fifth distance and the second distance is less than the first threshold, the second distance change also satisfies: the sixth distance is less than the If the fourth distance and the difference between the sixth distance and the fourth distance are greater than the third threshold, it is determined that the first lane is merged into the fourth lane. Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)For example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) .
若,L (3,R)<L (2,R)<L (1,R),L (1,R)-L (2,R)>ΔL3,L (2,R)-L (3,R)>ΔL3,L (1,L)<L (2,L)且L (2,L)-L (1,L)>ΔL4,L (3,L)<L (2,L),可以判断所述第一车道合并到所述第二车道,如图10示。 If, L (3,R) <L (2,R) <L (1,R) , L (1,R) -L (2,R) >ΔL3, L (2,R) -L (3, R) >ΔL3,L (1,L) <L (2,L) and L (2,L) -L (1,L) >ΔL4,L (3,L) <L (2,L) , yes It is determined that the first lane is merged into the second lane, as shown in FIG. 10.
上述实施方式中,在第一距离变化为车辆与右侧车道边界的距离逐渐变小,第二距离变化为车辆与左侧车道边界的距离变大后变化较小,则表明从左车道会发生向左合道。In the above-mentioned embodiment, the first distance change means that the distance between the vehicle and the right lane boundary gradually decreases, and the second distance change means that the distance between the vehicle and the left lane boundary becomes larger and the change is smaller, which indicates that it will occur from the left lane. Hop left.
另一种具体的实施方式中,若所述第一距离变化还满足:第五距离小于所述第二距离、 且所述第五距离与所述第二距离之间的差值大于第五阈值,所述第二距离变化还满足:第六距离小于所述第四距离、且所述第六距离与所述第四距离的差值大于所述第三阈值,则判断所述第一车道与所述第四车道合并为第五车道,所述第五车道在所述第一车道的左侧且在所述第四车道的右侧;其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。In another specific implementation manner, if the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than a fifth threshold , The second distance change also satisfies: the sixth distance is less than the fourth distance, and the difference between the sixth distance and the fourth distance is greater than the third threshold, then it is determined that the first lane is The fourth lane is merged into a fifth lane, and the fifth lane is on the left side of the first lane and on the right side of the fourth lane; wherein, the multiple time points further include a third time point , The third time point is after the second time point, the fifth distance is the distance between the vehicle and the left lane boundary at the third time point, and the sixth distance is the The distance between the vehicle and the right lane boundary at the third time point.
例如,以三个时间点t1、t2和t3为例,假设,车辆在t1时间点与左侧车道边界的距离为L (1,L),车辆在t2时间点与左侧车道边界的距离为L (2,L),车辆在t3时间点与左侧车道边界的距离为L (3,L)。车辆在t1时间点与右侧车道边界的距离为L (1,R),车辆在t2时间点与右侧车道边界的距离为L (2,R),车辆在t3时间点与右侧车道边界的距离为L (3,R)For example, taking three time points t1, t2, and t3 as an example, suppose that the distance between the vehicle and the left lane boundary at time t1 is L (1, L) , and the distance between the vehicle and the left lane boundary at time t2 is L (2, L) , the distance between the vehicle and the left lane boundary at time t3 is L (3, L) . The distance between the vehicle and the right lane boundary at t1 is L (1, R) , the distance between the vehicle and the right lane boundary at t2 is L (2, R) , and the vehicle is at the right lane boundary at t3 The distance is L (3, R) .
若,L (3,R)<L (2,R)<L (1,R),L (1,R)-L (2,R)>ΔL3,L (2,R)-L (3,R)>ΔL3,L (1,L)<L (2,L)且L (2,L)-L (1,L)>ΔL4,L (3,L)<L (2,L)且L (2,L)-L (3,L)>ΔL5,可以判断所述第一车道与所述第四车道合并为第五车道,所述第五车道在所述第一车道的左侧且在所述第四车道的右侧,如图11所示。 If, L (3,R) <L (2,R) <L (1,R) , L (1,R) -L (2,R) >ΔL3, L (2,R) -L (3, R) >ΔL3, L (1,L) <L (2,L) and L (2,L) -L (1,L) >ΔL4, L (3,L) <L (2,L) and L (2, L) -L (3, L) > ΔL5, it can be judged that the first lane and the fourth lane are merged into the fifth lane, and the fifth lane is on the left side of the first lane and at The right side of the fourth lane is shown in Figure 11.
上述实施例中,在第一距离变化为车辆与右侧车道边界的距离逐渐减小,车辆与左侧车道边界的距离变大后逐渐减少,可以判断车辆通过右车道合并到一条车道上去。In the foregoing embodiment, when the first distance changes, the distance between the vehicle and the right lane boundary gradually decreases, and the distance between the vehicle and the left lane boundary increases and then gradually decreases. It can be determined that the vehicle merges into one lane through the right lane.
第五种实现方式中,若第一距离变化满足:第二距离大于第一距离、且第二距离与第一距离之间的差值大于第六阈值,第二距离变化满足:第四距离大于第三距离、且第四距离与第三距离之间的差值大于第七阈值,则判断第一车道发生道路分离,第一车道为车辆所在的车道;其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。In the fifth implementation manner, if the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than the sixth threshold, the second distance change satisfies: the fourth distance is greater than The third distance, and the difference between the fourth distance and the third distance is greater than the seventh threshold, then it is determined that road separation occurs in the first lane, and the first lane is the lane where the vehicle is located; wherein, at least two time points include the first Time point and second time point, the first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance is the distance between the vehicle and the left side at the second time point The distance of the lane boundary, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
上述实现方式中,若第一距离变化为车辆与左侧车道边界的距离、车辆与右侧车道边界的距离都逐渐增加至车道的宽度或有新的车道线,则可以表明车道发生道路的分离,如图12所示。In the above implementation, if the first distance changes to the distance between the vehicle and the left lane boundary, and the distance between the vehicle and the right lane boundary gradually increases to the width of the lane or there is a new lane line, it can indicate that the lane is separated from the road. , As shown in Figure 12.
第六种实现方式中,若第二距离变化满足:第四距离与第三距离之间的差值小于第六阈值,第四距离与第六距离之间的差值小于第一阈值,第一距离变化满足:第二距离小于第一距离、且第一距离与第二距离之间的差值大于第七阈值,第五距离小于第二距离、且第二距离与第五距离之间的差值大于第七阈值,则可以判断第一车道左侧增加新的车道。其中,至少两个时间点包括第一时间点和第二时间点和第三时间点,第一时间点在第二时间点之前,第二时间点在第三时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第五距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In the sixth implementation manner, if the second distance change satisfies: the difference between the fourth distance and the third distance is less than the sixth threshold, the difference between the fourth distance and the sixth distance is less than the first threshold, and the first The distance change satisfies: the second distance is less than the first distance, and the difference between the first distance and the second distance is greater than the seventh threshold, the fifth distance is less than the second distance, and the difference between the second distance and the fifth distance If the value is greater than the seventh threshold, it can be determined that a new lane is added to the left of the first lane. Wherein, at least two time points include a first time point, a second time point, and a third time point, the first time point is before the second time point, the second time point is before the third time point, and the first distance is the vehicle The distance from the left lane boundary at the first time point, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the fifth distance is the distance between the vehicle and the left lane boundary at the second time point. The third distance is the distance between the vehicle and the right lane boundary at the first time point, the fourth distance is the distance between the vehicle and the right lane boundary at the second time point, and the sixth distance is the vehicle and the right lane boundary at the third time point. the distance.
上述实现方式中,若第二距离变化为车辆与右侧车道边界的距离变化较小,第一距离变化为车辆与左侧车道边界的距离逐渐减少,并且左边有了新的车道线,则可以判断发生车道左边创建了条车道,如图13所示。In the above implementation, if the second distance change is that the distance between the vehicle and the right lane boundary changes less, and the first distance change is that the distance between the vehicle and the left lane boundary is gradually reduced, and there is a new lane line on the left, you can It is judged that a lane is created on the left side of the occurrence lane, as shown in Figure 13.
第七种实现方式中,若第一距离变化满足:第二距离与第一距离之间的差值小于第六 阈值,第二距离与第五距离之间的差值小于第一阈值,第二距离变化满足:第四距离小于第三距离、且第三距离与第四距离之间的差值大于第七阈值,第六距离小于第四距离、且第四距离与第六距离之间的差值大于第七阈值,则可以判断第一车道右侧增加新的车道。其中,至少两个时间点包括第一时间点和第二时间点和第三时间点,第一时间点在第二时间点之前,第二时间点在第三时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第五距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。In the seventh implementation manner, if the first distance change satisfies: the difference between the second distance and the first distance is less than the sixth threshold, the difference between the second distance and the fifth distance is less than the first threshold, and the second The distance change satisfies: the fourth distance is less than the third distance, and the difference between the third distance and the fourth distance is greater than the seventh threshold, the sixth distance is less than the fourth distance, and the difference between the fourth distance and the sixth distance If the value is greater than the seventh threshold, it can be determined that a new lane is added to the right of the first lane. Wherein, at least two time points include a first time point, a second time point, and a third time point, the first time point is before the second time point, the second time point is before the third time point, and the first distance is the vehicle The distance from the left lane boundary at the first time point, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the fifth distance is the distance between the vehicle and the left lane boundary at the second time point. The third distance is the distance between the vehicle and the right lane boundary at the first time point, the fourth distance is the distance between the vehicle and the right lane boundary at the second time point, and the sixth distance is the vehicle and the right lane boundary at the third time point. the distance.
上述实现方式中,若第一距离变化为车辆与左侧车道边界的距离变化较小,第一距离变化为车辆与右侧车道边界的距离逐渐减少,并且右边有了新的车道线,则可以判断发生车道右边创建了条车道,如图14所示。In the above implementation, if the first distance change is that the distance between the vehicle and the left lane boundary changes less, and the first distance change is that the distance between the vehicle and the right lane boundary is gradually reduced, and there is a new lane line on the right, you can It is judged that a lane is created on the right side of the lane, as shown in Figure 14.
可以理解的,本申请实施例中并不限定于通过上述七种实现方式判断车道结构,在具体实施中,也可以通过其他车道结构中车辆与车道边界之间的距离变化判断对应的车道结构,这里不再一一列举。It is understandable that the embodiments of the present application are not limited to judging the lane structure through the above seven implementation methods. In specific implementation, the corresponding lane structure can also be judged based on the change in the distance between the vehicle and the lane boundary in other lane structures. I won't list them all here.
在一些实施例中,在确定行驶轨迹与车道边界的距离变化之前,可以确定车辆在预设时间范围内的历史行车轨迹与车道边界之间的距离变化在预设范围内。上述方式中,自车行车轨迹受到车姿信息比较大的影响,在距离差别比较大的时候车辆可能已经处于道路结构变化位置或者自身在变道等,通过判断车行轨迹与车道边界处于平行或近似平行的时候进行后续车道结构的判断可以提高车道结构判断的准确性。In some embodiments, before determining the change in the distance between the driving trajectory and the lane boundary, it may be determined that the change in the distance between the historical driving trajectory of the vehicle within a preset time range and the lane boundary is within a preset range. In the above method, the vehicle trajectory is greatly affected by the vehicle attitude information. When the distance difference is relatively large, the vehicle may already be at a changing position of the road structure or changing lanes by itself. By judging that the vehicle trajectory is parallel or parallel to the lane boundary. When the lane structure is approximately parallel, the judgment of the subsequent lane structure can improve the accuracy of the lane structure judgment.
基于同一构思,本发明实施例还提供一种车道结构检测装置150,具体用于实现图1至图14所述的实施例描述的方法,该装置的结构如图15所示,包括:通信单元1501和处理单元1502。其中,通信单元1501,用于获取车道边界信息,车道边界信息包括左侧车道边界以及右侧车道边界的位置信息;处理单元1502,用于获取车辆在至少两个时间点分别对应的位置信息;以及,针对每个时间点,根据车辆在时间点对应的位置信息确定车辆与左侧车道边界及右侧车道边界的距离;以及,确定车辆在至少两个时间点与左侧车道边界的第一距离变化和车辆在至少两个时间点与右侧车道边界的第二距离变化;以及,基于第一距离变化和第二距离变化判断车道变化。Based on the same concept, an embodiment of the present invention also provides a lane structure detection device 150, which is specifically used to implement the methods described in the embodiments described in FIG. 1 to FIG. 14. The structure of the device is shown in FIG. 15 and includes: a communication unit 1501 and processing unit 1502. Wherein, the communication unit 1501 is configured to obtain lane boundary information, which includes the position information of the left lane boundary and the right lane boundary; the processing unit 1502 is configured to obtain corresponding position information of the vehicle at at least two points in time; And, for each time point, determine the distance between the vehicle and the left lane boundary and the right lane boundary according to the position information corresponding to the vehicle at the time point; and, determine the first distance between the vehicle and the left lane boundary at least two time points The distance change and the second distance change between the vehicle and the right lane boundary at at least two points in time; and, the lane change is judged based on the first distance change and the second distance change.
示例性的,处理单元1502,在基于第一距离变化和第二距离变化判断车道变化时,具体用于:若第一距离变化满足:第一距离与第二距离之间的差值小于第一阈值,第二距离变化满足:第三距离小于第四距离、且第三距离与第四距离之间的差值大于第二阈值,则判断第一车道右侧发生变化,第一车道为车辆所在的车道;Exemplarily, the processing unit 1502, when judging the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the difference between the first distance and the second distance is smaller than the first distance change. Threshold, the second distance change satisfies: the third distance is less than the fourth distance, and the difference between the third distance and the fourth distance is greater than the second threshold, then it is determined that the right side of the first lane has changed, and the first lane is where the vehicle is Lane
其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。Wherein, at least two time points include a first time point and a second time point, the first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance Is the distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point .
进一步的,处理单元1502,还用于:在判断车道变化为第一车道右侧发生变化之后,若第一距离变化还满足:第五距离与第二距离之间的差值小于第一阈值,第二距离变化还满足:第六距离大于四距离、且第六距离与第四距离之间的差值大于第二阈值,则判断第一车道右侧增加新的车道;Further, the processing unit 1502 is further configured to: after judging that the lane change is a change on the right side of the first lane, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, The second distance change also satisfies: the sixth distance is greater than four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, it is determined that a new lane is added to the right of the first lane;
其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。Among them, the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
或者,处理单元1502,还用于:在判断车道变化为第一车道右侧发生变化之后,若第一距离变化还满足:第五距离与第二距离之间的差值小于第一阈值,第二距离变化还满足:第六距离小于四距离、且第六距离与第四距离之间的差值大于第二阈值,则判断第一车道右侧的车道合并到第一车道;Alternatively, the processing unit 1502 is further configured to: after judging that the lane change is a change on the right side of the first lane, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, The second distance change also satisfies: the sixth distance is less than four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, then it is determined that the lane on the right side of the first lane is merged into the first lane;
其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。Among them, the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
示例性的,处理单元1502,在基于第一距离变化和第二距离变化判断车道变化时,具体用于:若第一距离变化满足:第一距离小于第二距离、且第一距离与第二距离之间的差值大于第二阈值,第二距离变化满足:第三距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧发生变化,第一车道为车辆所在的车道;Exemplarily, the processing unit 1502, when judging the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the first distance is less than the second distance, and the first distance is less than the second distance The difference between the distances is greater than the second threshold, and the second distance change satisfies: the difference between the third distance and the fourth distance is less than the first threshold, then it is determined that the left side of the first lane has changed, and the first lane is where the vehicle is located Lane
其中,多个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。The multiple time points include a first time point and a second time point. The first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance is The distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
进一步的,处理单元1502,还用于:在判断第一车道左侧发生变化之后,若第一距离变化还满足:第五距离大于第二距离、且第五距离与第二距离之间的差值大于第二阈值,第二距离变化还满足:第六距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧增加新的车道;Further, the processing unit 1502 is further configured to: after determining that the left side of the first lane has changed, if the first distance change still satisfies: the fifth distance is greater than the second distance, and the difference between the fifth distance and the second distance If the value is greater than the second threshold, the second distance change also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that a new lane is added to the left of the first lane;
其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。Among them, the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
或者,处理单元1502,还用于:在判断第一车道左侧发生变化之后,若第一距离变化还满足:第五距离小于第二距离、且第五距离与第二距离之间的差值大于第二阈值,第二距离变化还满足:第六距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧的车道将合并到第一车道;Alternatively, the processing unit 1502 is further configured to: after determining that the left side of the first lane has changed, if the first distance change still satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance Is greater than the second threshold, the second distance change also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that the lane on the left side of the first lane will be merged into the first lane;
其中,多个时间点还包括第三时间点,第三时间点在第二时间点之后,第五距离为车辆在第三时间点与左侧车道边界的距离,第六距离为车辆在第三时间点与右侧车道边界的距离。Among them, the multiple time points also include a third time point, the third time point is after the second time point, the fifth distance is the distance between the vehicle at the third time point and the left lane boundary, and the sixth distance is the vehicle at the third time point. The distance between the time point and the right lane boundary.
示例性的,处理单元1502,在基于第一距离变化和第二距离变化判断车道变化时,具体用于:若第一距离变化满足:第一距离大于第二距离、且第一距离与第二距离的差值大于第三阈值,第二距离变化满足:第四距离大于第三距离,且第四距离与第三距离的差值大于第四阈值,则判断第一车道向右与第二车道发生合并,第一车道为车辆所在的车道,第二车道为第一车道右侧的车道;Exemplarily, the processing unit 1502, when determining the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the first distance is greater than the second distance, and the first distance is greater than the second distance The distance difference is greater than the third threshold, and the second distance change satisfies: the fourth distance is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the fourth threshold, then it is determined that the first lane is to the right and the second lane When a merger occurs, the first lane is the lane where the vehicle is located, and the second lane is the lane to the right of the first lane;
其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车 辆在第二时间点与右侧车道边界的距离。Wherein, at least two time points include a first time point and a second time point, the first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance Is the distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point .
示例性的,处理单元1502,在基于第一距离变化和第二距离变化判断车道变化时,具体用于:若第一距离变化满足:第二距离大于第一距离,且第二距离与第一距离的差值大于第四阈值,第二距离变化满足:第四距离小于第三距离、且第四距离与第三距离的差值大于第三阈值,则判断第一车道向左与第四车道发生合并,第一车道为车辆所在的车道,第四车道为第一车道左侧的车道;Exemplarily, the processing unit 1502, when judging the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the second distance is greater than the first distance, and the second distance is greater than the first distance. The distance difference is greater than the fourth threshold, and the second distance change satisfies: the fourth distance is less than the third distance, and the difference between the fourth distance and the third distance is greater than the third threshold, then it is judged that the first lane is to the left and the fourth lane When a merger occurs, the first lane is the lane where the vehicle is located, and the fourth lane is the left lane of the first lane;
其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。Wherein, at least two time points include a first time point and a second time point, the first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance Is the distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point .
示例性的,处理单元1502,在基于第一距离变化和第二距离变化判断车道变化时,具体用于:若第一距离变化满足:第二距离大于第一距离、且第二距离与第一距离之间的差值大于第六阈值,第二距离变化满足:第四距离大于第三距离、且第四距离与第三距离之间的差值大于第七阈值,则判断第一车道发生道路分离,第一车道为车辆所在的车道;Exemplarily, the processing unit 1502, when judging the lane change based on the first distance change and the second distance change, is specifically configured to: if the first distance change satisfies: the second distance is greater than the first distance, and the second distance is greater than the first distance. The difference between the distances is greater than the sixth threshold, and the change in the second distance satisfies: the fourth distance is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the seventh threshold, then it is determined that the first lane has a road Separated, the first lane is the lane where the vehicle is located;
其中,至少两个时间点包括第一时间点和第二时间点,第一时间点在第二时间点之前,第一距离为车辆在第一时间点与左侧车道边界的距离,第二距离为车辆在第二时间点与左侧车道边界的距离,第三距离为车辆在第一时间点与右侧车道边界的距离,第四距离为车辆在第二时间点与右侧车道边界的距离。Wherein, at least two time points include a first time point and a second time point, the first time point is before the second time point, the first distance is the distance between the vehicle at the first time point and the left lane boundary, and the second distance Is the distance between the vehicle and the left lane boundary at the second time point, the third distance is the distance between the vehicle and the right lane boundary at the first time point, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point .
一种实现方式中,处理单元1502,还用于:在获取车辆在至少两个时间点分别对应的位置信息之前,确定车辆在预设时间范围内的历史行车轨迹与车道边界之间的距离变化在预设范围内。In an implementation manner, the processing unit 1502 is further configured to: before acquiring the location information corresponding to the vehicle at at least two time points, respectively, determine the change in the distance between the vehicle's historical driving trajectory and the lane boundary within a preset time range Within the preset range.
一种实现方式中,通信单元1501,在获取车道边界信息时,具体用于:获取传感器采集的数据;基于传感器采集的数据获取行车环境中的车道边界信息。In an implementation manner, when acquiring lane boundary information, the communication unit 1501 is specifically configured to: acquire data collected by sensors; and acquire lane boundary information in a driving environment based on the data collected by sensors.
本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,另外,在本申请各个实施例中的各功能模块可以集成在一个处理器中,也可以是单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。The division of modules in the embodiments of this application is illustrative, and it is only a logical function division. In actual implementation, there may be other division methods. In addition, the functional modules in the various embodiments of this application can be integrated into one process. In the device, it can also exist alone physically, or two or more modules can be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules.
其中,集成的模块既可以采用硬件的形式实现时,如图16所示,车道结构检测装置可以包括处理器1601。上述模块对应的实体的硬件可以为处理器1601。处理器1601,可以是一个中央处理模块(central processing unit,CPU),或者为数字处理模块等等。该装置还包括:存储器1602,用于存储处理器1601执行的程序。存储器1602可以是非易失性存储器,比如硬盘(hard disk drive,HDD)或固态硬盘(solid-state drive,SSD)等,还可以是易失性存储器(volatile memory),例如随机存取存储器(random-access memory,RAM)。存储器1602是能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。该装置还可以包括通信接口1603,处理器1601可以通过通信接口1603获取传感器采集的数据、摄像头采集的数据等。Wherein, when the integrated module may be implemented in the form of hardware, as shown in FIG. 16, the lane structure detection device may include a processor 1601. The physical hardware corresponding to the foregoing module may be the processor 1601. The processor 1601 may be a central processing unit (CPU), or a digital processing module, and so on. The device also includes: a memory 1602, configured to store programs executed by the processor 1601. The memory 1602 may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., and may also be a volatile memory (volatile memory), such as random access memory (random access memory). -access memory, RAM). The memory 1602 is any other medium that can be used to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto. The device may further include a communication interface 1603, and the processor 1601 may obtain data collected by the sensor, data collected by the camera, etc. through the communication interface 1603.
一种实现方式中,处理器1601用于执行存储器1602存储的程序代码,具体用于执行图1至图14所示实施例所述的方法。可以参见图1至图14所示实施例所述的方法,本申请在此不再赘述。该实现方式中,处理器1601通过执行存储器1602存储的程序代码,可以实现图15所示车道检测装置150的功能。In an implementation manner, the processor 1601 is configured to execute the program code stored in the memory 1602, and is specifically configured to execute the method described in the embodiments shown in FIG. 1 to FIG. 14. Reference may be made to the methods described in the embodiments shown in FIG. 1 to FIG. 14, and details are not described herein again in this application. In this implementation manner, the processor 1601 can implement the function of the lane detection device 150 shown in FIG. 15 by executing the program code stored in the memory 1602.
本申请实施例中不限定上述处理器1601、存储器1602以及通信接口1603之间的具体连接介质。本申请实施例在图16中以处理器1601、存储器1602以及通信接口1603之间通过总线1604连接,总线在图16中以粗线表示,其它部件之间的连接方式,仅是进行示意性说明,并不引以为限。所述总线可以分为地址总线、数据总线、控制总线等。为便于表示,图16中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。The specific connection medium between the processor 1601, the memory 1602, and the communication interface 1603 is not limited in the embodiment of the present application. In the embodiment of the present application in FIG. 16, the processor 1601, the memory 1602, and the communication interface 1603 are connected by a bus 1604. The bus is represented by a thick line in FIG. 16, and the connection modes between other components are merely illustrative. , Is not limited. The bus can be divided into an address bus, a data bus, a control bus, and so on. For ease of representation, only one thick line is used in FIG. 16, but it does not mean that there is only one bus or one type of bus.
本发明实施例还提供了一种计算机可读存储介质,用于存储为执行上述处理器所需执行的计算机软件指令,其包含用于执行上述处理器所需执行的程序。The embodiment of the present invention also provides a computer-readable storage medium for storing computer software instructions required to execute the above-mentioned processor, which contains a program required to execute the above-mentioned processor.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
本申请是参照根据本申请的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。This application is described with reference to flowcharts and/or block diagrams of methods, equipment (systems), and computer program products according to this application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are used to generate It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the application without departing from the spirit and scope of the application. In this way, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, then this application is also intended to include these modifications and variations.

Claims (27)

  1. 一种车道结构检测方法,其特征在于,该方法包括:A method for detecting lane structure, characterized in that the method includes:
    获取车道边界信息,所述车道边界信息包括左侧车道边界以及右侧车道边界的位置信息;Acquiring lane boundary information, where the lane boundary information includes position information of the left lane boundary and the right lane boundary;
    获取车辆在至少两个时间点分别对应的位置信息;Acquiring the location information corresponding to the vehicle at at least two points in time;
    针对每个时间点,根据所述车辆在所述时间点对应的位置信息确定所述车辆与所述左侧车道边界及右侧车道边界的距离;For each time point, determine the distance between the vehicle and the left lane boundary and the right lane boundary according to the location information corresponding to the vehicle at the time point;
    确定所述车辆在所述至少两个时间点与所述左侧车道边界的第一距离变化和所述车辆在所述至少两个时间点与所述右侧车道边界的第二距离变化;Determining a first distance change between the vehicle and the left lane boundary at the at least two time points and a second distance change between the vehicle and the right lane boundary at the at least two time points;
    基于所述第一距离变化和所述第二距离变化判断车道变化。The lane change is determined based on the first distance change and the second distance change.
  2. 如权利要求1所述的方法,其特征在于,基于所述第一距离变化和所述第二距离变化判断车道变化,包括:The method of claim 1, wherein judging a lane change based on the first distance change and the second distance change comprises:
    若所述第一距离变化满足:第一距离与第二距离之间的差值小于第一阈值,所述第二距离变化满足:第三距离小于第四距离、且所述第三距离与所述第四距离之间的差值大于第二阈值,则判断第一车道右侧发生变化,所述第一车道为所述车辆所在的车道;If the first distance change satisfies: the difference between the first distance and the second distance is less than the first threshold, the second distance change satisfies: the third distance is less than the fourth distance, and the third distance is less than the fourth distance. If the difference between the fourth distance is greater than the second threshold, it is determined that the right side of the first lane is changed, and the first lane is the lane where the vehicle is located;
    其中,所述至少两个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point Point and the left lane boundary, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the vehicle in the first The distance from the boundary of the right lane at a time point, and the fourth distance is the distance between the vehicle and the boundary of the right lane at the second time point.
  3. 如权利要求2所述的方法,其特征在于,在判断车道变化为第一车道右侧发生变化之后,所述方法还包括:The method according to claim 2, wherein after determining that the lane change is a change on the right side of the first lane, the method further comprises:
    若所述第一距离变化还满足:第五距离与所述第二距离之间的差值小于所述第一阈值,所述第二距离变化还满足:第六距离大于所述四距离、且所述第六距离与所述第四距离之间的差值大于所述第二阈值,则判断所述第一车道右侧增加新的车道;If the first distance change also satisfies: the difference between the fifth distance and the second distance is less than the first threshold, the second distance change also satisfies: the sixth distance is greater than the four distances, and If the difference between the sixth distance and the fourth distance is greater than the second threshold, it is determined that a new lane is added to the right of the first lane;
    其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  4. 如权利要求2所述的方法,其特征在于,在判断车道变化为第一车道右侧发生变化之后,所述方法还包括:The method according to claim 2, wherein after determining that the lane change is a change on the right side of the first lane, the method further comprises:
    若所述第一距离变化还满足:第五距离与所述第二距离之间的差值小于所述第一阈值,所述第二距离变化还满足:第六距离小于所述四距离、且所述第六距离与所述第四距离之间的差值大于所述第二阈值,则判断所述第一车道右侧的车道合并到所述第一车道;If the first distance change also satisfies: the difference between the fifth distance and the second distance is less than the first threshold, the second distance change also satisfies: the sixth distance is less than the four distances, and If the difference between the sixth distance and the fourth distance is greater than the second threshold, it is determined that the lane on the right side of the first lane is merged into the first lane;
    其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  5. 如权利要求1所述的方法,其特征在于,基于所述第一距离变化和所述第二距离变化判断车道变化,包括:The method of claim 1, wherein judging a lane change based on the first distance change and the second distance change comprises:
    若所述第一距离变化满足:第一距离小于第二距离、且所述第一距离与所述第二距离 之间的差值大于第二阈值,所述第二距离变化满足:第三距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧发生变化,所述第一车道为所述车辆所在的车道;If the first distance change satisfies: the first distance is less than the second distance, and the difference between the first distance and the second distance is greater than the second threshold, the second distance change satisfies: the third distance If the difference between the fourth distance and the fourth distance is less than the first threshold, it is determined that the left side of the first lane has changed, and the first lane is the lane where the vehicle is located;
    其中,所述多个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the multiple time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point The distance from the boundary of the left lane, the second distance is the distance between the vehicle and the boundary of the left lane at the second time point, and the third distance is the distance between the vehicle and the boundary of the first lane. The distance between the time point and the right lane boundary, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  6. 如权利要求5所述的方法,其特征在于,在判断第一车道左侧发生变化之后,所述方法还包括:The method according to claim 5, wherein after determining that the left side of the first lane has changed, the method further comprises:
    若所述第一距离变化还满足:第五距离大于所述第二距离、且所述第五距离与所述第二距离之间的差值大于所述第二阈值,所述第二距离变化还满足:第六距离与所述第四距离之间的差值小于所述第一阈值,则判断所述第一车道左侧增加新的车道;If the first distance change also satisfies: the fifth distance is greater than the second distance, and the difference between the fifth distance and the second distance is greater than the second threshold, the second distance changes It is also satisfied that: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that a new lane is added to the left of the first lane;
    其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  7. 如权利要求5所述的方法,其特征在于,在判断第一车道左侧发生变化之后,所述方法还包括:The method according to claim 5, wherein after determining that the left side of the first lane has changed, the method further comprises:
    若所述第一距离变化还满足:第五距离小于所述第二距离、且所述第五距离与所述第二距离之间的差值大于所述第二阈值,所述第二距离变化还满足:第六距离与所述第四距离之间的差值小于所述第一阈值,则判断所述第一车道左侧的车道将合并到所述第一车道;If the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than the second threshold, the second distance changes It is also satisfied that: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that the lane on the left side of the first lane will be merged into the first lane;
    其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  8. 如权利要求1所述的方法,其特征在于,基于所述第一距离变化和所述第二距离变化判断车道变化,包括:The method of claim 1, wherein judging a lane change based on the first distance change and the second distance change comprises:
    若所述第一距离变化满足:第一距离大于第二距离、且所述第一距离与所述第二距离的差值大于第三阈值,所述第二距离变化满足:第四距离大于第三距离,且所述第四距离与所述第三距离的差值大于第四阈值,则判断第一车道向右与第二车道发生合并,所述第一车道为所述车辆所在的车道,所述第二车道为所述第一车道右侧的车道;If the first distance change satisfies: the first distance is greater than the second distance, and the difference between the first distance and the second distance is greater than the third threshold, the second distance change satisfies: the fourth distance is greater than the first distance Three distances, and the difference between the fourth distance and the third distance is greater than the fourth threshold, then it is determined that the first lane to the right is merged with the second lane, and the first lane is the lane where the vehicle is located, The second lane is the lane on the right side of the first lane;
    其中,所述至少两个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point Point and the left lane boundary, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the vehicle in the first The distance from the boundary of the right lane at a time point, and the fourth distance is the distance between the vehicle and the boundary of the right lane at the second time point.
  9. 如权利要求1所述的方法,其特征在于,基于所述第一距离变化和所述第二距离变化判断车道变化,包括:The method of claim 1, wherein judging a lane change based on the first distance change and the second distance change comprises:
    若所述第一距离变化满足:第二距离大于第一距离,且所述第二距离与所述第一距离的差值大于第四阈值,所述第二距离变化满足:第四距离小于第三距离、且所述第四距离与所述第三距离的差值大于第三阈值,则判断第一车道向左与第四车道发生合并,所述第一车道为所述车辆所在的车道,所述第四车道为所述第一车道左侧的车道;If the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than the fourth threshold, the second distance change satisfies: the fourth distance is less than the first distance Three distances, and the difference between the fourth distance and the third distance is greater than the third threshold, then it is determined that the first lane is merged to the left with the fourth lane, and the first lane is the lane where the vehicle is located, The fourth lane is the lane on the left side of the first lane;
    其中,所述至少两个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point Point and the left lane boundary, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the vehicle in the first The distance from the boundary of the right lane at a time point, and the fourth distance is the distance between the vehicle and the boundary of the right lane at the second time point.
  10. 如权利要求1所述的方法,其特征在于,基于所述第一距离变化和所述第二距离变化判断车道变化,包括:The method of claim 1, wherein judging a lane change based on the first distance change and the second distance change comprises:
    若所述第一距离变化满足:第二距离大于第一距离、且所述第二距离与所述第一距离之间的差值大于第六阈值,所述第二距离变化满足:第四距离大于第三距离、且所述第四距离与所述第三距离之间的差值大于第七阈值,则判断第一车道发生道路分离,所述第一车道为所述车辆所在的车道;If the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than the sixth threshold, the second distance change satisfies: the fourth distance Is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the seventh threshold, then it is determined that a road separation occurs in the first lane, and the first lane is the lane where the vehicle is located;
    其中,所述至少两个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point Point and the left lane boundary, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the vehicle in the first The distance from the boundary of the right lane at a time point, and the fourth distance is the distance between the vehicle and the boundary of the right lane at the second time point.
  11. 如权利要求1至10任一项所述的方法,其特征在于,在获取车辆在至少两个时间点分别对应的位置信息之前,所述方法还包括:The method according to any one of claims 1 to 10, characterized in that, before acquiring the location information corresponding to the vehicle at at least two points in time, the method further comprises:
    确定所述车辆在预设时间范围内的历史行车轨迹与所述车道边界之间的距离变化在预设范围内。It is determined that the change in the distance between the historical driving trajectory of the vehicle within a preset time range and the lane boundary is within a preset range.
  12. 如权利要求1至11任一项所述的方法,其特征在于,获取车道边界信息,包括:The method according to any one of claims 1 to 11, wherein acquiring lane boundary information includes:
    获取传感器采集的数据;Obtain the data collected by the sensor;
    基于所述传感器采集的数据获取行车环境中的所述车道边界信息。Obtain the lane boundary information in the driving environment based on the data collected by the sensor.
  13. 一种车道结构检测装置,其特征在于,该装置包括:A lane structure detection device, characterized in that the device includes:
    通信单元,用于获取车道边界信息,所述车道边界信息包括左侧车道边界以及右侧车道边界的位置信息;A communication unit for acquiring lane boundary information, where the lane boundary information includes position information of the left lane boundary and the right lane boundary;
    处理单元,用于获取车辆在至少两个时间点分别对应的位置信息;A processing unit, configured to obtain location information corresponding to the vehicle at at least two points in time;
    以及,针对每个时间点,根据所述车辆在所述时间点对应的位置信息确定所述车辆与所述左侧车道边界及右侧车道边界的距离;And, for each time point, determine the distance between the vehicle and the left lane boundary and the right lane boundary according to the position information of the vehicle at the time point;
    以及,确定所述车辆在所述至少两个时间点与所述左侧车道边界的第一距离变化和所述车辆在所述至少两个时间点与所述右侧车道边界的第二距离变化;And, determining the first distance change between the vehicle and the left lane boundary at the at least two time points and the second distance change between the vehicle and the right lane boundary at the at least two time points ;
    以及,基于所述第一距离变化和所述第二距离变化判断车道变化。And, judging a lane change based on the first distance change and the second distance change.
  14. 如权利要求13所述的装置,其特征在于,所述处理单元,在基于所述第一距离变化和所述第二距离变化判断车道变化时,具体用于:The device according to claim 13, wherein the processing unit is specifically configured to: when judging a lane change based on the first distance change and the second distance change:
    若所述第一距离变化满足:第一距离与第二距离之间的差值小于第一阈值,所述第二距离变化满足:第三距离小于第四距离、且所述第三距离与所述第四距离之间的差值大于第二阈值,则判断第一车道右侧发生变化,所述第一车道为所述车辆所在的车道;If the first distance change satisfies: the difference between the first distance and the second distance is less than the first threshold, the second distance change satisfies: the third distance is less than the fourth distance, and the third distance is less than the fourth distance. If the difference between the fourth distance is greater than the second threshold, it is determined that the right side of the first lane is changed, and the first lane is the lane where the vehicle is located;
    其中,所述至少两个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为 所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point Point and the left lane boundary, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the vehicle in the first The distance from the boundary of the right lane at a time point, and the fourth distance is the distance between the vehicle and the boundary of the right lane at the second time point.
  15. 如权利要求14所述的装置,其特征在于,所述处理单元,还用于:The device according to claim 14, wherein the processing unit is further configured to:
    在判断车道变化为第一车道右侧发生变化之后,若所述第一距离变化还满足:第五距离与所述第二距离之间的差值小于所述第一阈值,所述第二距离变化还满足:第六距离大于所述四距离、且所述第六距离与所述第四距离之间的差值大于所述第二阈值,则判断所述第一车道右侧增加新的车道;After judging that the lane change is a change on the right side of the first lane, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, and the second distance The change also satisfies: the sixth distance is greater than the four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, then it is determined that a new lane is added to the right of the first lane ;
    其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  16. 如权利要求14所述的装置,其特征在于,所述处理单元,还用于:The device according to claim 14, wherein the processing unit is further configured to:
    在判断车道变化为第一车道右侧发生变化之后,若所述第一距离变化还满足:第五距离与所述第二距离之间的差值小于所述第一阈值,所述第二距离变化还满足:第六距离小于所述四距离、且所述第六距离与所述第四距离之间的差值大于所述第二阈值,则判断所述第一车道右侧的车道合并到所述第一车道;After judging that the lane change is a change on the right side of the first lane, if the first distance change still satisfies: the difference between the fifth distance and the second distance is less than the first threshold, and the second distance The change also satisfies: the sixth distance is less than the four distances, and the difference between the sixth distance and the fourth distance is greater than the second threshold, then it is determined that the lanes on the right of the first lane are merged into The first lane;
    其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  17. 如权利要求13所述的装置,其特征在于,所述处理单元,在基于所述第一距离变化和所述第二距离变化判断车道变化时,具体用于:The device according to claim 13, wherein the processing unit is specifically configured to: when judging a lane change based on the first distance change and the second distance change:
    若所述第一距离变化满足:第一距离小于第二距离、且所述第一距离与所述第二距离之间的差值大于第二阈值,所述第二距离变化满足:第三距离与第四距离之间的差值小于第一阈值,则判断第一车道左侧发生变化,所述第一车道为所述车辆所在的车道;If the first distance change satisfies: the first distance is less than the second distance, and the difference between the first distance and the second distance is greater than the second threshold, the second distance change satisfies: the third distance If the difference between the fourth distance and the fourth distance is less than the first threshold, it is determined that the left side of the first lane has changed, and the first lane is the lane where the vehicle is located;
    其中,所述多个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the multiple time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point The distance from the boundary of the left lane, the second distance is the distance between the vehicle and the boundary of the left lane at the second time point, and the third distance is the distance between the vehicle and the boundary of the first lane. The distance between the time point and the right lane boundary, and the fourth distance is the distance between the vehicle and the right lane boundary at the second time point.
  18. 如权利要求17所述的装置,其特征在于,所述处理单元,还用于:The device according to claim 17, wherein the processing unit is further configured to:
    在判断第一车道左侧发生变化之后,若所述第一距离变化还满足:第五距离大于所述第二距离、且所述第五距离与所述第二距离之间的差值大于所述第二阈值,所述第二距离变化还满足:第六距离与所述第四距离之间的差值小于所述第一阈值,则判断所述第一车道左侧增加新的车道;After determining that the left side of the first lane has changed, if the first distance change also satisfies: the fifth distance is greater than the second distance, and the difference between the fifth distance and the second distance is greater than all For the second threshold, the change in the second distance also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that a new lane is added to the left of the first lane;
    其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  19. 如权利要求17所述的装置,其特征在于,所述处理单元,还用于:The device according to claim 17, wherein the processing unit is further configured to:
    在判断第一车道左侧发生变化之后,若所述第一距离变化还满足:第五距离小于所述第二距离、且所述第五距离与所述第二距离之间的差值大于所述第二阈值,所述第二距离变化还满足:第六距离与所述第四距离之间的差值小于所述第一阈值,则判断所述第一车 道左侧的车道将合并到所述第一车道;After determining that the left side of the first lane has changed, if the first distance change also satisfies: the fifth distance is less than the second distance, and the difference between the fifth distance and the second distance is greater than all According to the second threshold, the second distance change also satisfies: the difference between the sixth distance and the fourth distance is less than the first threshold, then it is determined that the lane on the left side of the first lane will be merged into all the lanes. State the first lane;
    其中,所述多个时间点还包括第三时间点,所述第三时间点在所述第二时间点之后,所述第五距离为所述车辆在所述第三时间点与所述左侧车道边界的距离,所述第六距离为所述车辆在所述第三时间点与所述右侧车道边界的距离。Wherein, the multiple time points further include a third time point, the third time point is after the second time point, and the fifth distance is the distance between the vehicle and the left at the third time point. The distance of the side lane boundary, and the sixth distance is the distance between the vehicle and the right lane boundary at the third time point.
  20. 如权利要求13所述的装置,其特征在于,所述处理单元,在基于所述第一距离变化和所述第二距离变化判断车道变化时,具体用于:The device according to claim 13, wherein the processing unit is specifically configured to: when judging a lane change based on the first distance change and the second distance change:
    若所述第一距离变化满足:第一距离大于第二距离、且所述第一距离与所述第二距离的差值大于第三阈值,所述第二距离变化满足:第四距离大于第三距离,且所述第四距离与所述第三距离的差值大于第四阈值,则判断第一车道向右与第二车道发生合并,所述第一车道为所述车辆所在的车道,所述第二车道为所述第一车道右侧的车道;If the first distance change satisfies: the first distance is greater than the second distance, and the difference between the first distance and the second distance is greater than the third threshold, the second distance change satisfies: the fourth distance is greater than the first distance Three distances, and the difference between the fourth distance and the third distance is greater than the fourth threshold, then it is determined that the first lane to the right is merged with the second lane, and the first lane is the lane where the vehicle is located, The second lane is the lane on the right side of the first lane;
    其中,所述至少两个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point Point and the left lane boundary, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the vehicle in the first The distance from the boundary of the right lane at a time point, and the fourth distance is the distance between the vehicle and the boundary of the right lane at the second time point.
  21. 如权利要求13所述的装置,其特征在于,所述处理单元,在基于所述第一距离变化和所述第二距离变化判断车道变化时,具体用于:The device according to claim 13, wherein the processing unit is specifically configured to: when judging a lane change based on the first distance change and the second distance change:
    若所述第一距离变化满足:第二距离大于第一距离,且所述第二距离与所述第一距离的差值大于第四阈值,所述第二距离变化满足:第四距离小于第三距离、且所述第四距离与所述第三距离的差值大于第三阈值,则判断第一车道向左与第四车道发生合并,所述第一车道为所述车辆所在的车道,所述第四车道为所述第一车道左侧的车道;If the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than the fourth threshold, the second distance change satisfies: the fourth distance is less than the first distance Three distances, and the difference between the fourth distance and the third distance is greater than the third threshold, then it is determined that the first lane is merged to the left with the fourth lane, and the first lane is the lane where the vehicle is located, The fourth lane is the lane on the left side of the first lane;
    其中,所述至少两个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point Point and the left lane boundary, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the vehicle in the first The distance from the boundary of the right lane at a time point, and the fourth distance is the distance between the vehicle and the boundary of the right lane at the second time point.
  22. 如权利要求13所述的装置,其特征在于,所述处理单元,在基于所述第一距离变化和所述第二距离变化判断车道变化时,具体用于:The device according to claim 13, wherein the processing unit is specifically configured to: when judging a lane change based on the first distance change and the second distance change:
    若所述第一距离变化满足:第二距离大于第一距离、且所述第二距离与所述第一距离之间的差值大于第六阈值,所述第二距离变化满足:第四距离大于第三距离、且所述第四距离与所述第三距离之间的差值大于第七阈值,则判断第一车道发生道路分离,所述第一车道为所述车辆所在的车道;If the first distance change satisfies: the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than the sixth threshold, the second distance change satisfies: the fourth distance Is greater than the third distance, and the difference between the fourth distance and the third distance is greater than the seventh threshold, then it is determined that a road separation occurs in the first lane, and the first lane is the lane where the vehicle is located;
    其中,所述至少两个时间点包括第一时间点和第二时间点,所述第一时间点在所述第二时间点之前,所述第一距离为所述车辆在所述第一时间点与所述左侧车道边界的距离,所述第二距离为所述车辆在所述第二时间点与所述左侧车道边界的距离,所述第三距离为所述车辆在所述第一时间点与所述右侧车道边界的距离,所述第四距离为所述车辆在所述第二时间点与所述右侧车道边界的距离。Wherein, the at least two time points include a first time point and a second time point, the first time point is before the second time point, and the first distance is that the vehicle is at the first time point Point and the left lane boundary, the second distance is the distance between the vehicle and the left lane boundary at the second time point, and the third distance is the vehicle in the first The distance from the boundary of the right lane at a time point, and the fourth distance is the distance between the vehicle and the boundary of the right lane at the second time point.
  23. 如权利要求13至22任一项所述的装置,其特征在于,所述处理单元,还用于:The device according to any one of claims 13 to 22, wherein the processing unit is further configured to:
    在获取车辆在至少两个时间点分别对应的位置信息之前,确定所述车辆在预设时间范围内的历史行车轨迹与所述车道边界之间的距离变化在预设范围内。Before acquiring the location information corresponding to the vehicle at at least two time points, respectively, it is determined that the distance change between the historical driving track of the vehicle within a preset time range and the lane boundary is within a preset range.
  24. 如权利要求13至23任一项所述的装置,其特征在于,所述通信单元,在获取车道边界信息时,具体用于:The device according to any one of claims 13 to 23, wherein the communication unit is specifically configured to: when acquiring lane boundary information:
    获取传感器采集的数据;Obtain the data collected by the sensor;
    基于所述传感器采集的数据获取行车环境中的所述车道边界信息。Obtain the lane boundary information in the driving environment based on the data collected by the sensor.
  25. 一种计算机可读存储介质,其特征在于,所述计算机存储介质中存储有计算机可读指令,当计算机读取并执行所述计算机可读指令时,使得计算机执行如权利要求1-12任意一项所述的方法。A computer-readable storage medium, characterized in that computer-readable instructions are stored in the computer storage medium, and when the computer reads and executes the computer-readable instructions, the computer executes any one of claims 1-12. The method described in the item.
  26. 一种计算机程序产品,其特征在于,当计算机读取并执行所述计算机程序产品时,使得计算机执行如权利要求1-12任意一项所述的方法。A computer program product, characterized in that when a computer reads and executes the computer program product, the computer is caused to execute the method according to any one of claims 1-12.
  27. 一种芯片,其特征在于,所述芯片与存储器耦合,用于读取并执行所述存储器中存储的程序指令,以实现如权利要求1-12任意一项所述的方法。A chip, characterized in that the chip is coupled with a memory, and is used to read and execute program instructions stored in the memory, so as to implement the method according to any one of claims 1-12.
PCT/CN2021/078504 2020-02-28 2021-03-01 Lane structure detection method and apparatus WO2021170140A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010131023.1A CN113327456A (en) 2020-02-28 2020-02-28 Lane structure detection method and device
CN202010131023.1 2020-02-28

Publications (1)

Publication Number Publication Date
WO2021170140A1 true WO2021170140A1 (en) 2021-09-02

Family

ID=77412902

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/078504 WO2021170140A1 (en) 2020-02-28 2021-03-01 Lane structure detection method and apparatus

Country Status (2)

Country Link
CN (1) CN113327456A (en)
WO (1) WO2021170140A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117885765A (en) * 2024-03-15 2024-04-16 中国第一汽车股份有限公司 Vehicle control method and device and vehicle

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014210456A (en) * 2013-04-17 2014-11-13 本田技研工業株式会社 Steering control device for vehicle
US20150248588A1 (en) * 2014-03-03 2015-09-03 Denso Corporation Lane line recognition apparatus
JP2015191445A (en) * 2014-03-28 2015-11-02 トヨタ自動車株式会社 Driving assistance device
CN105984464A (en) * 2015-03-18 2016-10-05 丰田自动车株式会社 Vehicle control device
JP2017111142A (en) * 2015-12-15 2017-06-22 本田技研工業株式会社 System and method for verifying map data for vehicles
CN107148378A (en) * 2014-11-10 2017-09-08 罗伯特·博世有限公司 Method and driver assistance system for running driver assistance system
CN108021861A (en) * 2017-10-30 2018-05-11 哈尔滨理工大学 A kind of intelligent vehicle right-hand bend object detection method based on machine vision
CN108664016A (en) * 2017-03-31 2018-10-16 腾讯科技(深圳)有限公司 Determine the method and device of lane center
CN109476306A (en) * 2016-07-06 2019-03-15 日产自动车株式会社 Travel control method and travel controlling system
CN110361021A (en) * 2018-09-30 2019-10-22 长城汽车股份有限公司 Lane line approximating method and system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5276637B2 (en) * 2010-09-08 2013-08-28 富士重工業株式会社 Lane estimation device
JP6410949B2 (en) * 2015-08-19 2018-10-24 三菱電機株式会社 Lane recognition device and lane recognition method
JP6568437B2 (en) * 2015-09-17 2019-08-28 クラリオン株式会社 Lane marking recognition system
CN110163176B (en) * 2019-05-28 2021-06-18 北京百度网讯科技有限公司 Lane line change position identification method, device, equipment and medium
CN110263713B (en) * 2019-06-20 2021-08-10 百度在线网络技术(北京)有限公司 Lane line detection method, lane line detection device, electronic device, and storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014210456A (en) * 2013-04-17 2014-11-13 本田技研工業株式会社 Steering control device for vehicle
US20150248588A1 (en) * 2014-03-03 2015-09-03 Denso Corporation Lane line recognition apparatus
JP2015191445A (en) * 2014-03-28 2015-11-02 トヨタ自動車株式会社 Driving assistance device
CN107148378A (en) * 2014-11-10 2017-09-08 罗伯特·博世有限公司 Method and driver assistance system for running driver assistance system
CN105984464A (en) * 2015-03-18 2016-10-05 丰田自动车株式会社 Vehicle control device
JP2017111142A (en) * 2015-12-15 2017-06-22 本田技研工業株式会社 System and method for verifying map data for vehicles
CN109476306A (en) * 2016-07-06 2019-03-15 日产自动车株式会社 Travel control method and travel controlling system
CN108664016A (en) * 2017-03-31 2018-10-16 腾讯科技(深圳)有限公司 Determine the method and device of lane center
CN108021861A (en) * 2017-10-30 2018-05-11 哈尔滨理工大学 A kind of intelligent vehicle right-hand bend object detection method based on machine vision
CN110361021A (en) * 2018-09-30 2019-10-22 长城汽车股份有限公司 Lane line approximating method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117885765A (en) * 2024-03-15 2024-04-16 中国第一汽车股份有限公司 Vehicle control method and device and vehicle

Also Published As

Publication number Publication date
CN113327456A (en) 2021-08-31

Similar Documents

Publication Publication Date Title
US11854212B2 (en) Traffic light detection system for vehicle
US10853670B2 (en) Road surface characterization using pose observations of adjacent vehicles
US11545033B2 (en) Evaluation framework for predicted trajectories in autonomous driving vehicle traffic prediction
CN110248861B (en) Guiding a vehicle using a machine learning model during vehicle maneuvers
CN107798699B (en) Depth map estimation with stereo images
US10824153B2 (en) Cost design for path selection in autonomous driving technology
CA3083719C (en) Autonomous vehicle operational management scenarios
CN108688660B (en) Operating range determining device
US9340207B2 (en) Lateral maneuver planner for automated driving system
JP2021531208A (en) Collision prediction and avoidance for vehicles
KR102295577B1 (en) Ecu, autonomous vehicle including the ecu, and method of determing driving lane for the same
WO2019178548A1 (en) Determining drivable free-space for autonomous vehicles
RU2742213C1 (en) Method to control information on lanes, method of traffic control and device for control of information on lanes
EP3524494B1 (en) Lane self-localization system using multiple cameras for autonomous driving vehicles
US10860868B2 (en) Lane post-processing in an autonomous driving vehicle
US20210389133A1 (en) Systems and methods for deriving path-prior data using collected trajectories
US11225251B2 (en) Vehicle control device
US10909377B2 (en) Tracking objects with multiple cues
US20230236037A1 (en) Systems and methods for common speed mapping and navigation
US20220371583A1 (en) Systems and Methods for Selectively Decelerating a Vehicle
GB2599191A (en) Monocular 3D object detection from image semantics network
JP2021082286A (en) System and method for improving lane change detection, and non-temporary computer-readable medium
US11087147B2 (en) Vehicle lane mapping
WO2023129656A1 (en) Calculating vehicle speed for a road curve
US10839678B2 (en) Vehicle identifying device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21760370

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21760370

Country of ref document: EP

Kind code of ref document: A1