EP4018363A1 - Lane handling for merge prior to turn - Google Patents

Lane handling for merge prior to turn

Info

Publication number
EP4018363A1
EP4018363A1 EP20765156.3A EP20765156A EP4018363A1 EP 4018363 A1 EP4018363 A1 EP 4018363A1 EP 20765156 A EP20765156 A EP 20765156A EP 4018363 A1 EP4018363 A1 EP 4018363A1
Authority
EP
European Patent Office
Prior art keywords
lane
vehicle
determining
turn
merge
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20765156.3A
Other languages
German (de)
English (en)
French (fr)
Inventor
Timothy Caldwell
Matthew VAN HEUKELOM
William Anthony SILVA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zoox Inc
Original Assignee
Zoox Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/546,241 external-priority patent/US11468773B2/en
Priority claimed from US16/546,224 external-priority patent/US11353874B2/en
Application filed by Zoox Inc filed Critical Zoox Inc
Publication of EP4018363A1 publication Critical patent/EP4018363A1/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/18Propelling the vehicle
    • B60W30/18009Propelling the vehicle related to particular drive situations
    • B60W30/18163Lane change; Overtaking manoeuvres
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/18Propelling the vehicle
    • B60W30/18009Propelling the vehicle related to particular drive situations
    • B60W30/18145Cornering
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/001Planning or execution of driving tasks
    • B60W60/0015Planning or execution of driving tasks specially adapted for safety
    • B60W60/0017Planning or execution of driving tasks specially adapted for safety of other traffic participants
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/001Planning or execution of driving tasks
    • B60W60/0027Planning or execution of driving tasks using trajectory prediction for other traffic participants
    • B60W60/00272Planning or execution of driving tasks using trajectory prediction for other traffic participants relying on extrapolation of current movement
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/60Traffic rules, e.g. speed limits or right of way
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2556/45External transmission of data to or from the vehicle
    • B60W2556/50External transmission of data to or from the vehicle of positioning data, e.g. GPS [Global Positioning System] data

Definitions

  • FIG. 9 illustrates an example process for using a classification of a vehicle for performing lane handling techniques, as described herein.
  • Techniques described herein relate to performing, by a vehicle, lane handling techniques to control the vehicle in an environment.
  • the vehicle can be associated with a drive mission that requires the vehicle to perform a turn in association with a junction.
  • a turning lane can precede the junction such that the vehicle is to merge into the turning lane prior to executing the turn.
  • a turning lane can be associated with a bike lane. In such an example, the vehicle is to merge into the bike lane prior to executing the turn.
  • Techniques described herein enable the vehicle to merge (or otherwise maneuver) into a turning lane, as described above, prior to executing a turn at a junction while ensuring safety of any objects (vehicle, bikes, etc.) in such a lane.
  • the vehicle can consider one or more preconditions prior to generating an instruction to perform an action for controlling the vehicle to merge into a turning lane and execute a turn at a junction.
  • preconditions can include determining whether there is an indication of a junction upcoming in a drive mission of the vehicle, determining whether there is an indication of a second lane associated with the junction to facilitate a turn at the junction, determining whether the drive mission includes a turn at the junction, determining whether the vehicle can merge into the second lane (e.g., is there a valid action trajectory, no blockage, etc.), and so on.
  • FIG. 1 illustrates an example of a vehicle performing lane handling techniques, as described herein.
  • FIG. 1 depicts a portion of an environment 100, wherein a vehicle 102 is positioned.
  • the vehicle 102 can be an autonomous vehicle configured to operate according to a Level 5 classification issued by the U.S. National Highway Traffic Safety Administration, which describes a vehicle capable of performing all safety-critical functions for the entire trip, with the driver (or occupant) not being expected to control the vehicle at any time.
  • the vehicle 102 can be configured to control all functions from start to stop, including all parking functions, it can be unoccupied.
  • the environment 100 includes ajunction 104, where two or more roads are joined.
  • one of the roads can be associated with a driving lane 106 and a bike lane 108.
  • the driving lane 106 can be a lane in which the vehicle 102 can drive.
  • the bike lane 108 can be a lane in which bicycles (e.g., bikes, cyclists, etc.) can travel.
  • a bike lane before a junction can include a broken lane boundary, lane marking, or other indicator (hereinafter “indicator”) indicating that a vehicle is allowed to merge, at least partially, into the bike lane to execute a turn when completing a turn at such a junction.
  • indicator indicating that a vehicle is allowed to merge, at least partially, into the bike lane to execute a turn when completing a turn at such a junction.
  • the merging zone 112 can be associated with a beginning 114, which can correspond to a beginning of the indicator 110, and an end 116, which can correspond with the end of the bike lane 108 (e.g., where the bike lane 108 turns into the junction 104).
  • a bike lane 108 may exist for a finite distance from an intersection, be associated with a turn for a vehicle (as opposed to a bike), be located on the left for a left turn, be associated with a parking lane (as opposed to a bike lane), be associated with a bus lane (as opposed to a bus lane), or the like.
  • the vehicle 102 can modify the reference of the vehicle 102 from the reference 200 to the reference 202. Such a modification causes the vehicle 102 switch (laterally) from a first reference 200 to a second reference 202. The vehicle 102 can then track (e.g., follow) the reference 202 for the duration of the bike lane 108 (e.g., until the location of the vehicle 102 is determined to be associated with the end 116 of the merging zone 112).
  • the system(s) can identify and/or classify objects within the environment of the vehicle 600.
  • the system(s) can output bounding boxes associated objects identified in the environment of the vehicle 600.
  • the system(s) can store width and/or fraction data associated with a bounding box of the vehicle 600, which can be based on the span of the bounding box (e.g., perpendicular to the lane reference).
  • the bounding box can occupy multiple lanes.
  • the system(s) can determine a width of the bounding box as penetrated into each lane and a fraction of the span of the bounding box in each lane.
  • the system(s) can store the amount of bounding box area of the vehicle 600 in each lane.
  • Block 902 illustrates accessing a data structure associated with classifications of lanes in an environment of a vehicle.
  • the planning system 726 can access the data structure described in block 818 above.
  • the planning system 726 can determine that the vehicle 702 can perform the action. As such, the planning system 726 can initiate the action, as illustrated in block 906. In some examples, the cut-in analysis can be performed by the planning system 726 until the vehicle 702 is established in the target lane, at which point, the planning system 726 can terminate the cut-in analysis.
  • FIG. 10 illustrates an example process 1000 for performing lane handling techniques, as described herein.
  • Block 1106 illustrates determining whether the vehicle merging into the second lane negatively affects another object in the second lane.
  • the planning system 726 can analyze sensor data to determine whether the vehicle 702 merging into the second lane negatively affects another object, such as a cyclist, another vehicle, a pedestrian, or the like. That is, the planning system 726 can perform a cut-in analysis to determine whether it is safe for the vehicle 702 to merge into the second lane (e.g., free of collision and/or uncomfortable braking for the other object).
  • Such a modification causes the vehicle 702 switch (laterally) from a first reference in the first lane to a second reference in the second lane.
  • the vehicle 702 can then track (e.g., follow) the second reference in the second lane for the duration of the second lane (e.g., until the location of the vehicle 702 is determined to be associated with the end of the merging zone and/or the second lane).
  • the driving corridor can expand on the left side (e.g., to the width of the driving lane). Restricting the left side of the driving corridor during the turn can reduce the nudging or otherwise restrict the lateral motion of the vehicle 702.
  • the planning system 726 can utilize object fusion to modify the driving corridor based at least in part on the presence of objects in the environment, as described above.
  • Block 1114 illustrates generating an instruction to perform an alternate action.
  • the planning system 726 can generate an instruction for performing an alternate action, such as an abort action to prevent the vehicle 702 from merging into the second lane, at least temporarily.
  • an alternate action can cause the vehicle 702 to slow down or speed up to come within the threshold of negatively affecting the other object (e.g., so as not to negatively affect the other object).
  • the process 1100 can return to block 1104 to determine whether the vehicle merging into the second lane negatively affects another object in the second lane (again).
  • FIGS. 4 and 5 above describe two examples of abort actions.
  • the planning system 726 of the vehicle 702 may execute an abort action (e.g., instructions associated therewith) to control the vehicle 702 to come to a stop, for example, along the indicator or at the start of the second lane.
  • the planning system 726 can consider whether an abort action should be executed while the planning system 726 consider whether an action controlling the vehicle 702 to merge prior to turning right should be executed.
  • An autonomous vehicle comprising: one or more processors; and computer- readable media storing instructions, that when executed by the one or more processors, cause the autonomous vehicle to perform operations comprising: receiving, from a sensor associated with the autonomous vehicle, sensor data associated with an environment within which the autonomous vehicle is positioned; receiving map data associated with the environment; determining that the autonomous vehicle is to perform a turn; determining, based at least in part on at least one of the sensor data or the map data, that the turn passes through a bike lane disposed proximate a current lane in which the autonomous vehicle is positioned, the bike lane comprising a merging zone indicative of a merging region; determining to merge into the bike lane in the merging zone; determining, based at least in part on the sensor data and the map data, a location of the autonomous vehicle with respect to the merging zone; and causing, based at least in part on the location, the autonomous vehicle to merge into the bike lane prior to performing the turn.
  • M The method as paragraph L recites, further comprising causing the vehicle to turn into the first lane based at least in part on: determining, at an end of the second lane, a target lane of the vehicle, wherein the target lane is the first lane; determining a third reference line associated with the target lane along which the vehicle is to travel while in the target lane; and determining a third cost associated with a distance of the vehicle from the third reference line, wherein causing the vehicle to turn into the first lane is based at least in part on the third cost.
  • the one or more non-transitory computer-readable media as paragraph N or O recites, the operations further comprising: determining a first reference line with the first lane about which the vehicle is to follow while in the first lane; determining a second reference line associated with at least a portion of the second lane about which the vehicle is to follow while in the second lane; determining a first cost based at least in part on a first distance of the vehicle from the first reference line; and determining a second cost based at least in part on a second distance of the vehicle from the second reference line, wherein causing the vehicle to merge into the second lane is based at least in part on the first cost and the second cost.
  • T The one or more non-transitory computer-readable media as any of paragraphs N-S recite, the operations further comprising: determining, as a safety signal, that at least one of (i) an object comprising a bicycle or a second vehicle has established priority in the second lane or (ii) the vehicle merging into the second lane affects the object; and responsive to the safety signal, performing an alternative action to at least temporarily prevent the vehicle from merging into the second lane.
  • determining the classification of the lane comprises: determining, based at least in part on the signal, that the portion of the autonomous vehicle that occupies the lane is less than a threshold; and determining that the lane is classified as the occupied lane and not the established lane.
  • determining the classification of the lane comprises: determining, based at least in part on the signal, that the portion of the autonomous vehicle that occupies the lane meets or exceeds a threshold; and determining that the lane is classified as the occupied lane and the established lane.
  • controlling the vehicle comprises: determining a first classification of at least one lane left of the vehicle or a second classification of at least one lane right of the vehicle; and determining an action for controlling the vehicle based at least in part on the first classification or the second classification.
  • AD The method as any of paragraphs AA-AC recite, wherein the lane occupancy is based on at least one of sensor data received from a sensor associated with the vehicle or map data associated with the environment.
  • determining the classification of the lane comprises: determining, based at least in part on the signal, that an unoccupied portion of the lane is less than a threshold; and determining that the lane is classified as the occupied lane and the established lane.

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
EP20765156.3A 2019-08-20 2020-08-19 Lane handling for merge prior to turn Pending EP4018363A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/546,241 US11468773B2 (en) 2019-08-20 2019-08-20 Lane classification for improved vehicle handling
US16/546,224 US11353874B2 (en) 2019-08-20 2019-08-20 Lane handling for merge prior to turn
PCT/US2020/047058 WO2021034969A1 (en) 2019-08-20 2020-08-19 Lane handling for merge prior to turn

Publications (1)

Publication Number Publication Date
EP4018363A1 true EP4018363A1 (en) 2022-06-29

Family

ID=72322557

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20765156.3A Pending EP4018363A1 (en) 2019-08-20 2020-08-19 Lane handling for merge prior to turn

Country Status (4)

Country Link
EP (1) EP4018363A1 (zh)
JP (1) JP2022544835A (zh)
CN (1) CN114269618A (zh)
WO (1) WO2021034969A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113313949B (zh) * 2021-05-31 2022-03-25 长安大学 一种高速公路出口匝道客货车协同控制方法、装置和设备

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9612123B1 (en) 2015-11-04 2017-04-04 Zoox, Inc. Adaptive mapping to navigate autonomous vehicles responsive to physical environment changes
US10133275B1 (en) 2017-03-01 2018-11-20 Zoox, Inc. Trajectory generation using temporal logic and tree search
US11009875B2 (en) * 2017-03-09 2021-05-18 Waymo Llc Preparing autonomous vehicles for turns
US10983199B2 (en) 2017-08-11 2021-04-20 Zoox, Inc. Vehicle sensor calibration and localization
US11175132B2 (en) 2017-08-11 2021-11-16 Zoox, Inc. Sensor perturbation

Also Published As

Publication number Publication date
WO2021034969A1 (en) 2021-02-25
CN114269618A (zh) 2022-04-01
JP2022544835A (ja) 2022-10-21

Similar Documents

Publication Publication Date Title
US11353874B2 (en) Lane handling for merge prior to turn
US12115990B2 (en) Trajectory modifications based on a collision zone
US11450205B2 (en) Emergency vehicle detection and response
US11468773B2 (en) Lane classification for improved vehicle handling
US11643073B2 (en) Trajectory modifications based on a collision zone
US11755020B2 (en) Responsive vehicle control
US11703869B2 (en) Latency accommodation in trajectory generation
US11513519B1 (en) Sharing occlusion data
WO2021076369A1 (en) Dynamic vehicle warning signal emission
US20210269065A1 (en) Perpendicular cut-in detection
US12055935B2 (en) Perpendicular cut-in training
JP2022549832A (ja) 粒子状物質に対する調節のプランニング
WO2022132416A1 (en) Object determination in an occluded region
US11353877B2 (en) Blocked region guidance
US11801864B1 (en) Cost-based action determination
US11970164B1 (en) Adverse prediction planning
WO2021034969A1 (en) Lane handling for merge prior to turn
EP4146510A1 (en) Trajectory classification
US12055942B1 (en) Validating stopping behaviors of a vehicle
US12128887B1 (en) Dynamic object relevance determination
WO2021173395A1 (en) Perpendicular cut-in training

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220121

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240207