US11697410B2 - Vehicle-to-everything communication-based lane change collision avoidance warning - Google Patents
Vehicle-to-everything communication-based lane change collision avoidance warning Download PDFInfo
- Publication number
- US11697410B2 US11697410B2 US16/295,700 US201916295700A US11697410B2 US 11697410 B2 US11697410 B2 US 11697410B2 US 201916295700 A US201916295700 A US 201916295700A US 11697410 B2 US11697410 B2 US 11697410B2
- Authority
- US
- United States
- Prior art keywords
- vehicle
- remote
- ego vehicle
- ego
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 230000008859 change Effects 0.000 title claims abstract description 55
- 238000004891 communication Methods 0.000 title description 94
- 238000000034 method Methods 0.000 claims abstract description 65
- 230000015654 memory Effects 0.000 claims description 58
- 238000005259 measurement Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 14
- 238000012986 modification Methods 0.000 claims description 2
- 230000004048 modification Effects 0.000 claims description 2
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 description 29
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 description 29
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 description 29
- 230000005540 biological transmission Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 12
- 238000012552 review Methods 0.000 description 12
- 230000009471 action Effects 0.000 description 11
- 238000004458 analytical method Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000003044 adaptive effect Effects 0.000 description 4
- 230000010267 cellular communication Effects 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- UGFAIRIUMAVXCW-UHFFFAOYSA-N Carbon monoxide Chemical compound [O+]#[C-] UGFAIRIUMAVXCW-UHFFFAOYSA-N 0.000 description 1
- 238000005773 Enders reaction Methods 0.000 description 1
- 230000005355 Hall effect Effects 0.000 description 1
- 206010041349 Somnolence Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 229910002092 carbon dioxide Inorganic materials 0.000 description 1
- 239000001569 carbon dioxide Substances 0.000 description 1
- 229910002091 carbon monoxide Inorganic materials 0.000 description 1
- 239000002826 coolant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000004297 night vision Effects 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W30/09—Taking automatic action to avoid collision, e.g. braking and steering
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/008—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W30/095—Predicting travel path or likelihood of collision
- B60W30/0956—Predicting travel path or likelihood of collision the prediction being responsive to traffic or environmental parameters
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
- B60W30/18—Propelling the vehicle
- B60W30/18009—Propelling the vehicle related to particular drive situations
- B60W30/18163—Lane change; Overtaking manoeuvres
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
- G08G1/162—Decentralised systems, e.g. inter-vehicle communication event-triggered
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/90—Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/525—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking automatically indicating risk of collision between vehicles in traffic or with pedestrians, e.g. after risk assessment using the vehicle sensor data
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q5/00—Arrangement or adaptation of acoustic signal devices
- B60Q5/005—Arrangement or adaptation of acoustic signal devices automatically actuated
- B60Q5/006—Arrangement or adaptation of acoustic signal devices automatically actuated indicating risk of collision between vehicles or with pedestrians
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/002—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle
- B60Q9/004—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle using wave sensors
- B60Q9/005—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle using wave sensors using a video camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/002—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle
- B60Q9/004—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle using wave sensors
- B60Q9/006—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle using wave sensors using a distance sensor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/002—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle
- B60Q9/007—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for parking purposes, e.g. for warning the driver that his vehicle has contacted or is about to contact an obstacle providing information about the distance to an obstacle, e.g. varying sound
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
- B60T8/00—Arrangements for adjusting wheel-braking force to meet varying vehicular or ground-surface conditions, e.g. limiting or varying distribution of braking force
- B60T8/17—Using electrical or electronic regulation means to control braking
- B60T8/1755—Brake regulation specially adapted to control the stability of the vehicle, e.g. taking into account yaw rate or transverse acceleration in a curve
- B60T8/17558—Brake regulation specially adapted to control the stability of the vehicle, e.g. taking into account yaw rate or transverse acceleration in a curve specially adapted for collision avoidance or collision mitigation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/45—External transmission of data to or from the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/45—External transmission of data to or from the vehicle
- B60W2556/50—External transmission of data to or from the vehicle for navigation systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/45—External transmission of data to or from the vehicle
- B60W2556/60—External transmission of data to or from the vehicle using satellite communication
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/45—External transmission of data to or from the vehicle
- B60W2556/65—Data transmitted between vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
- G05D1/0214—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory in accordance with safety or protection criteria, e.g. avoiding hazardous areas
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2201/00—Application
- G05D2201/02—Control of position of land vehicles
- G05D2201/0213—Road vehicle, e.g. car or truck
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/06—Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/44—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/46—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for vehicle-to-vehicle communication [V2V]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
Definitions
- the specification relates to Vehicle-to-Everything (V2X) communication-based lane change collision avoidance warnings.
- V2X Vehicle-to-Everything
- this specification relates to modifying a vehicle component based on ranging and misbehavior information determined from digital data included in a V2X communication.
- ego vehicles frequently change lanes to target lanes in situations where they cannot view other remote vehicles that want to change lanes to the same target lane. For example, an ego vehicle and a remote vehicle each want to change lanes to a target lane (“lane X”) and the ego vehicle and the remote vehicle are occluded from one another. As a result, these vehicles are likely to collide with one another.
- FIG. 6 an example of this problem.
- Collisions are likely in these situations because (1) the drivers of the ego vehicle and the remote vehicle cannot see that other vehicles are trying to changes lanes to the same target lane, and so, they cannot respond with driving decisions that avoid a collision; and (2) the Advanced Driver Assistance Systems (ADAS systems) of these vehicles will not be able detect the potential collision because neither vehicle's onboard sensors will be able to measure the presence/movement of the other vehicle that is trying to change lanes to the same target lane, and so, the ADAS systems will not be able to respond with an output that decreases the likelihood of a collision. As a result, a collision is more likely to occur in these situations.
- ADAS systems Advanced Driver Assistance Systems
- the warning system beneficially solves the problem of providing a warning to a driver of an ego vehicle about a potential collision involving an occluded remote vehicle that is attempting to change lanes into the same target lane as the ego vehicle.
- This existing solution consists of an ego vehicle using its onboard sensors (e.g., LIDAR, radar, cameras, etc.) to detect the presence of a remote vehicle that is within a predetermined distance of the ego vehicle and then provide a collision warning to the driver of the ego vehicle.
- onboard sensors e.g., LIDAR, radar, cameras, etc.
- this existing solution is inadequate in situations where the remote vehicle is occluded so that the onboard sensors of the ego vehicle are unable to detect the presence of the remote vehicle.
- the embodiments of the warning system described herein use V2X communications to detect a presence of an occluded vehicle that is changing lanes to a same target lane as the ego vehicle and at approximately the same time as the ego vehicle such that a collision may occur. If such a potential collision is detected, the warning system provides warnings to the driver of the ego vehicle so that the driver can decide not to attempt changing lanes to the target vehicle at this time.
- the V2X communications include remote data that describe sensor measurements recorded by the onboard sensors of the remote vehicle. In this way, the warning system enables the ego vehicle to determine that a collision is likely using the sensor measurements that are recorded by the remote vehicle and not the onboard sensors of the ego vehicle.
- An example advantage or improvement provided by the warning system which is not provided by the existing solutions are the unique ways of determining a driver's lane change intent and the unique warnings provided to a driver to warn of a possible collision if they change lanes.
- the inventors are aware of no warning system that provides similar functionality.
- An additional advantage provided by the warning system includes the ability of an ego vehicle to use V2X communications to execute the following operations: proactively identify a potential collision involving an occluded remote vehicle that is attempting to change lanes into the same target lane as the ego vehicle at approximately the same time as the ego vehicle; and proactively provide a warning to the ego driver of the ego vehicle so that the ego driver does not attempt to change lanes to the same target lane as the remote vehicle or at the same time as the remote vehicle.
- the warning system includes software installed in an ECU of an ego vehicle.
- the ego vehicle is traveling in a roadway environment with a remote vehicle.
- the remote vehicle may also include an ECU that stores its own instance of the warning system.
- the ego vehicle and the remote vehicle are both connected vehicles that include a V2X radio.
- the ego vehicle's sensors are not able to measure information about the remote vehicles because they are occluded.
- a driver of the remote vehicle is referred to as a “remote driver” and a driver of the ego vehicle is referred to as an “ego driver.”
- the V2X radio of the remote vehicle transmits a V2X message including remote data.
- the remote data is digital data that describes information that indicates a lane change intent of the remote vehicle.
- the remote data is digital data that describes one or more of the following: (1) whether the turn signal of the remote vehicle is engaged; (2) the turning direction for the turn signal if it is engaged; (3) changes in the remote vehicle's lateral position over time; (4) changes in the remote vehicle's heading position over time; and (5) changes in the remote vehicle's steering wheel angle over time.
- the remote vehicle may include a warning system that uses the onboard sensors of the remote vehicle to gather the remote data which is transmitted to the ego vehicle.
- the remote vehicle does not include a warning system.
- the remote data may be included in part 2 of a Basic Safety Message (“BSM” if singular, “BSMs” if plural) that is transmitted by the V2X radio of the remote vehicle at some regular interval (e.g., once every 0.10 seconds). See FIG. 5 for an example payload for a BSM.
- BSM Basic Safety Message
- the warning system of the ego vehicle receives the V2X message and parses out the remote data from the V2X message.
- the warning system of the ego vehicle stores the remote data in a memory of the ego vehicle.
- the warning system of the ego vehicle cause the onboard sensors of the ego vehicle to record ego data describing the lane change intent of the ego vehicle.
- the ego data is digital data that describes one or more of the following: (1) whether the turn signal of the ego vehicle is engaged; (2) the turning direction for the turn signal if it is engaged; (3) changes in the ego vehicle's lateral position over time; (4) changes in the ego vehicle's heading position over time; and (5) changes in the ego vehicle's steering wheel angle over time.
- the warning system of the ego vehicle stores the ego data in the memory of the ego vehicle
- the warning system of the ego vehicle includes code and routines that are operable, when executed by the ECU of the ego vehicle, to cause the ECU to analyze the remote data and the ego data and execute one or more of the following example steps: (1) determine whether the ego vehicle is estimated to change lanes to a particular lane [i.e., “lane X”] in the future; (2) determine whether the remote vehicle is estimated to change lanes to lane X in the future; (3) determine ego time information describing a time when the ego vehicle is likely to arrive at lane X; (4) determine remote time information describing a time when the remote vehicle is likely to arrive at lane X; (5) determine whether the ego vehicle is likely to collide with the remote vehicle when it arrives at lane X because both the ego vehicle and the remote vehicle are changing lanes to lane X at approximately the same time; and (6) if a collision is determined to be likely to occur at step 5, then proactively provide a warning to the ego driver of the ego vehicle before the
- warnings provided by the warning system include one or more of the following: providing a small counter-steering force on the steering wheel; vibrating the steering wheel; generating a warning message that is displayed on a screen or heads-up display unit (HUD) of the ego vehicle; and generating a warning sound/message that is played over the speakers of the ego vehicle.
- HUD heads-up display unit
- An example advantage or improvement provided by the embodiments of the warning system that is not provided by the existing solutions includes the operation of the warning system to determine the future actions of the remote vehicle based on remote data that is recorded by the remote vehicle itself and transmitted to the ego vehicle using V2X communication; the ego vehicle does not rely on its own sensor measurements when determining the future actions of the remote vehicle.
- a system of one or more computers can be configured to perform particular operations or actions by virtue of having software, firmware, hardware, or a combination of them installed on the system that in operation causes or cause the system to perform the actions.
- One or more computer programs can be configured to perform particular operations or actions by virtue of including instructions that, when executed by data processing apparatus, cause the apparatus to perform the actions.
- One general aspect includes a method executed by an ego vehicle, the method including: determining, based on a payload for a V2X message originated by a remote vehicle, whether the remote vehicle is changing lanes to a target lane at a target time; determining that the ego vehicle is changing lanes to the target lane at approximately the target time; estimating that the ego vehicle and the remote vehicle will collide at the target lane at the target time; and modifying an operation of a vehicle component of the ego vehicle so that the ego vehicle does not change lanes to the target lane at the target time.
- Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.
- Implementations may include one or more of the following features.
- the method where the V2X message is a dedicated short-range communication message.
- the method where the V2X message is not one of the following: a WiFi message; a 3G message; a 4G message; a 5G message; a long-term evolution (LTE) message; a millimeter wave communication message; a Bluetooth message; and a satellite communication.
- the method where the V2X message is received by a V2X radio.
- the method where the V2X radio is not an element of the ego vehicle.
- the method where the V2X radio includes a plurality of channels including a reserved channel that is reserved for receiving the V2X message.
- the method where the reserved channel is reserved for a BSM.
- the method where the vehicle component is selected from a group that includes: an advanced driver assistance system; an autonomous driving system; a communication unit; a speaker; a display; a heads-up display unit; and an actuator.
- Implementations of the described techniques may include hardware, a method or process, or computer software on a computer-accessible medium.
- One general aspect includes a system included in an ego vehicle, the system including: a processor communicatively coupled to a V2X radio and a non-transitory memory, where the V2X radio is operable to receive a V2X message and the non-transitory memory stores computer code that is operable, when executed by the processor, to cause the processor to: determine, based on a payload for a V2X message originated by a remote vehicle, whether the remote vehicle is changing lanes to a target lane at a target time; determine that the ego vehicle is changing lanes to the target lane at approximately the target time; estimate that the ego vehicle and the remote vehicle will collide at the target lane at the target time; and modify an operation of a vehicle component of the ego vehicle so that the ego vehicle does not change lanes to the target lane at the target time.
- Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.
- Implementations may include one or more of the following features.
- the system where the V2X message is a dedicated short-range communication message.
- the system where the V2X message is not one of the following: a WiFi message; a 3G message; a 4G message; a 5G message; an LTE message; a millimeter wave communication message; a Bluetooth message; and a satellite communication.
- the system where the V2X message is received by a V2X radio.
- the system where the V2X radio is not an element of the ego vehicle.
- the system where the V2X radio includes a plurality of channels including a reserved channel that is reserved for receiving the V2X message.
- the system where the reserved channel is reserved for a BSM.
- the system where the vehicle component is selected from a group that includes: an advanced driver assistance system; an autonomous driving system; a communication unit; a speaker; a display; a heads-up display unit; and an actuator.
- Implementations of the described techniques may include hardware, a method or process, or computer software on a computer-accessible medium.
- One general aspect includes a computer program product including instructions that, when executed by a processor, causes the processor to perform operations including: determining, based on a payload for a V2X message originated by a remote vehicle, whether the remote vehicle is changing lanes to a target lane at a target time; determining that an ego vehicle is changing lanes to the target lane at approximately the target time; estimating that the ego vehicle and the remote vehicle will collide at the target lane at the target time; and modifying an operation of a vehicle component of the ego vehicle so that the ego vehicle does not change lanes to the target lane at the target time.
- Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.
- Implementations may include one or more of the following features.
- the computer program product where modifying the operation of the vehicle component includes one of the following: modifying the vehicle component so that the vehicle component does not steer the ego vehicle to the target lane; modifying the operation of the vehicle component includes modifying the vehicle component so that the vehicle component only steers the ego vehicle to the target lane at a modified time that is different than the target time.
- FIG. 1 A is a block diagram illustrating an operating environment for a warning system according to some embodiments.
- FIG. 1 B is a block diagram illustrating a set of V2X radios and a warning system according to some embodiments.
- FIG. 2 is a block diagram illustrating an example computer system including the warning system according to some embodiments.
- FIG. 3 depicts a method for to modifying a vehicle component of an ego vehicle based on a payload of a V2X communication so that the ego vehicle does not collide with a remote vehicle according to some embodiments.
- FIGS. 4 and 5 are block diagrams illustrating an example of BSM data according to some embodiments.
- FIG. 6 is a block diagram illustrating a first use case for the warning system according to some embodiments.
- FIG. 7 is a block diagram illustrating an example benefit of the warning system according to some embodiments.
- FIGS. 8 A and 8 B depicts a method for to modifying a vehicle component of an ego vehicle based on a payload of a V2X communication so that the ego vehicle does not collide with a remote vehicle according to some embodiments.
- warning system Embodiments of the warning system are now described. Although the warning system is described herein at times with reference to BSMs, the warning system will also work with any other type of V2X message and radio technologies (e.g., LTE-V2X, 5G-V2X, etc.).
- V2X message and radio technologies e.g., LTE-V2X, 5G-V2X, etc.
- the warning system is operable, when executed by a processor of a connected vehicle, to cause the processor to modify an operation of a vehicle component of the connected vehicle based on a payload of a V2X communication.
- V2X communication include one or more of the following: DSRC (including BSMs and PSMs, among other types of DSRC communication); LTE; millimeter wave communication; 3G; 4G; 5G; LTE-Vehicle-to-Everything (LTE-V2X); LTE-Vehicle-to-Vehicle (LTE-V2V); LTE-Device-to-Device (LTE-D2D); Voice over LTE (VoLTE); etc.
- the V2X communication does not include one or more of the following: DSRC; 3G, 4G; 5G; LTE-V2X; LTE-V2V; LTE-D2D; and VoLTE.
- the connected vehicle that includes the warning system is a DSRC-equipped vehicle.
- a DSRC-equipped vehicle is a vehicle which: (1) includes a DSRC radio; (2) includes a DSRC-compliant Global Positioning System (GPS) unit; and (3) is operable to lawfully send and receive DSRC messages in a jurisdiction where the DSRC-equipped vehicle is located.
- a DSRC radio is hardware that includes a DSRC receiver and a DSRC transmitter. The DSRC radio is operable to wirelessly send and receive DSRC messages.
- a DSRC-compliant GPS unit is operable to provide positional information for a vehicle (or some other DSRC-equipped device that includes the DSRC-compliant GPS unit) that has lane-level accuracy. The DSRC-compliant GPS unit is described in more detail below
- a “DSRC-equipped” device is a processor-based device that includes a DSRC radio, a DSRC-compliant GPS unit and is operable to lawfully send and receive DSRC messages in a jurisdiction where the DSRC-equipped device is located.
- Various endpoints may be DSRC-equipped devices, including, for example, a roadside unit (RSU), a smartphone, a tablet computer and any other processor-based computing device that includes a DSRC radio and is operable to lawfully send and receive DSRC messages as described above.
- RSU roadside unit
- an RSU that is a DSRC-equipped device does not include a DSRC-compliant GPS unit, but does include a non-transitory memory that stores digital data describing positional information for the RSU having lane-level accuracy, and the DSRC radio or some other system of the RSU inserts a copy of this digital data in the BSM data that is transmitted by the DSRC radio of the RSU.
- the RSU does not include a DSRC-compliant GPS unit but is still operable to distribute BSM data that satisfies the requirements for the DSRC standard.
- the BSM data is described in more detail below with reference to FIGS. 4 and 5 according to some embodiments.
- a DSRC message is a wireless message that is specially configured to be sent and received by highly mobile devices such as vehicles, and is compliant with one or more of the following DSRC standards, including any derivative or fork thereof: EN 12253:2004 Dedicated Short-Range Communication—Physical layer using microwave at 5.8 GHz (review); EN 12795:2002 Dedicated Short-Range Communication (DSRC)—DSRC Data link layer: Medium Access and Logical Link Control (review); EN 12834:2002 Dedicated Short-Range Communication—Application layer (review); and EN 13372:2004 Dedicated Short-Range Communication (DSRC)—DSRC profiles for RTTT applications (review); EN ISO 14906:2004 Electronic Fee Collection—Application interface.
- DSRC Dedicated Short-Range Communication
- DSRC messages are transmitted at 5.9 GHz.
- DSRC messages are allocated 75 MHz of spectrum in the 5.9 GHz band.
- DSRC messages are allocated 30 MHz of spectrum in the 5.9 GHz band.
- a wireless message therefore, is not a DSRC message unless it operates in the 5.9 GHz band.
- a wireless message is also not a DSRC message unless it is transmitted by a DSRC transmitter of a DSRC radio.
- a DSRC message is not any of the following: a WiFi message; a 3G message; a 4G message; an LTE message; a millimeter wave communication message; a Bluetooth message; a satellite communication; and a short-range radio message transmitted or broadcast by a key fob at 315 MHz or 433.92 MHz.
- key fobs for remote keyless systems include a short-range radio transmitter which operates at 315 MHz, and transmissions or broadcasts from this short-range radio transmitter are not DSRC messages since, for example, such transmissions or broadcasts do not comply with any DSRC standard, are not transmitted by a DSRC transmitter of a DSRC radio and are not transmitted at 5.9 GHz.
- key fobs for remote keyless systems include a short-range radio transmitter which operates at 433.92 MHz, and transmissions or broadcasts from this short-range radio transmitter are not DSRC messages for similar reasons as those described above for remote keyless systems in the United States.
- the wireless messages of key fobs made as a component of a remote keyless entry system are not DSRC messages for additional reasons.
- the payload for a DSRC message is also required to include digital data describing a rich amount of vehicular data of various types of data.
- a DSRC message always includes, at a minimum, a unique identifier of the vehicle which transmits the DSRC message as well as the GPS data for that vehicle. This amount of data requires a larger bandwidth than what is possible for other types of non-DSRC wireless messages.
- FIGS. 4 and 5 depict examples of a permissible payload for a particular type of DSRC message referred to as a BSM.
- the wireless messages of key fobs as a component of a remote keyless entry system are not DSRC messages because they do not include a payload which is permissible under the DSRC standard.
- a key fob merely transmits a wireless message including a digital key which is known to a vehicle which is paired with the key fob; there is not sufficient bandwidth for other data to be included in the payload because the bandwidth allocated for these transmissions is very small.
- DSRC messages are allocated large amounts of bandwidth and are required to include a far richer amount of data, including, for example, a unique identifier and the GPS data for the vehicle which transmitted the DSRC message.
- a DSRC-equipped vehicle does not include a conventional global positioning system unit (“GPS unit”), and instead includes a DSRC-compliant GPS unit.
- GPS unit global positioning system unit
- a conventional GPS unit provides positional information that describes a position of the conventional GPS unit with an accuracy of plus or minus 10 meters of the actual position of the conventional GPS unit.
- a DSRC-compliant GPS unit provides GPS data that describes a position of the DSRC-compliant GPS unit with an accuracy of plus or minus 1.5 meters of the actual position of the DSRC-compliant GPS unit. This degree of accuracy is referred to as “lane-level accuracy” since, for example, a lane of a roadway is generally about 3 meters wide, and an accuracy of plus or minus 1.5 meters is sufficient to identify which lane a vehicle is traveling in on a roadway.
- a DSRC-compliant GPS unit is operable to identify, monitor and track its two-dimensional position within 1.5 meters of its actual position 68% of the time under an open sky.
- V2X-equipped vehicles include: (1) onboard sensors that are operable to record data describing the path history and kinematic information about the vehicle (e.g., heading, speed, braking patterns such as hard braking, etc.); and (2) at least one V2X radio that is operable to transmit V2X messages, including BSMs which are transmitted at a user-configurable interval (the default interval is once every 0.10 seconds) and include BSM data that describes, among other things, historical and future actions of the vehicle that originally transmits the V2X message and the historical and future states of the vehicle that originally transmits the V2X message.
- BSMs user-configurable interval
- a vehicle that originally transmits a V2X message is referred to as an originator of the V2X message.
- a vehicle that originally broadcasts a BSM is the originator of that BSM and the payload for that BSM will describe this originating vehicle.
- the warning system described herein is operable, when executed by a processor of a connected vehicle, to cause the processor to execute one or more steps of the methods 300 , 800 depicted in FIGS. 3 and 8 A through 8 B , respectively.
- the warning system includes code and routines that are installed on an Electronic Control Unit (ECU) of an ego vehicle.
- the ego vehicle is a connected vehicle.
- the ego vehicle is an autonomous or semi-autonomous vehicle.
- the ego vehicle includes a V2X radio that is operable to receive V2X messages such as DSRC communications.
- warning system is not limited to DSRC technology.
- the method described in the preceding paragraph refers to BSMs, but the warning system is operable to provide its functionality using other types of V2X messages and the digital data payload that is included in these V2X messages.
- the operating environment 100 includes the following elements: an ego vehicle 123 ; a set of remote vehicles 124 ; and an RSU 104 . These elements are communicatively coupled to one another by a network 105 .
- the operating environment 100 may include one or more vehicles 123 , one or more RSUs 104 , and one or more networks 105 .
- the set of remote vehicles 124 includes one or more connected vehicles.
- the connected vehicles included in the set of remote vehicles 124 include similar functionality as the ego vehicle 123 .
- the connected vehicles included in the set of remote vehicles 124 are referred to herein as: (1) a “remote vehicle” or “remote vehicle 124 ” (if singular); or (2) the “remote vehicles” or “remote vehicles 124 ” (if plural).
- the network 105 may be a conventional type, wired or wireless, and may have numerous different configurations including a star configuration, token ring configuration, or other configurations. Furthermore, the network 105 may include a local area network (LAN), a wide area network (WAN) (e.g., the Internet), or other interconnected data paths across which multiple devices and/or entities may communicate. In some embodiments, the network 105 may include a peer-to-peer network. The network 105 may also be coupled to or may include portions of a telecommunications network for sending data in a variety of different communication protocols.
- LAN local area network
- WAN wide area network
- the network 105 may also be coupled to or may include portions of a telecommunications network for sending data in a variety of different communication protocols.
- the network 105 includes Bluetooth® communication networks or a cellular communications network for sending and receiving data including via short messaging service (SMS), multimedia messaging service (MMS), hypertext transfer protocol (HTTP), direct data connection, wireless application protocol (WAP), e-mail, DSRC, full-duplex wireless communication, mmWave, WiFi (infrastructure mode), WiFi (ad-hoc mode), visible light communication, TV white space communication and satellite communication.
- the network 105 may also include a mobile data network that may include 3G, 4G, LTE, LTE-V2V, LTE-V2X, LTE-D2D, VoLTE, LTE-5G or any other mobile data network or combination of mobile data networks.
- the network 105 may include one or more IEEE 802.11 wireless networks.
- the RSU 104 is a roadside unit.
- the RSU 104 is operable to relay or re-broadcasts any V2X messages it receives.
- the RSU 104 receives a BSM and re-broadcasts the BSM to other endpoints, thereby extending the range of the BSM so that it may be received by more endpoints.
- the ego vehicle 123 is any type of connected vehicle.
- the ego vehicle 123 is one of the following types of vehicles: a car; a truck; a sports utility vehicle; a bus; a semi-truck; a robotic car; a drone or any other roadway-based conveyance.
- the ego vehicle 123 is a DSRC-equipped vehicle.
- the ego vehicle 123 is an autonomous vehicle or a semi-autonomous vehicle.
- the ego vehicle 123 includes a set of Advanced Driver Assistance Systems 180 (a set of “ADAS systems” 180 ) which provide autonomous features to the ego vehicle 123 which are sufficient to render the ego vehicle 123 an autonomous vehicle.
- ADAS systems Advanced Driver Assistance Systems
- the National Highway Traffic Safety Administration (“NHTSA”) has defined different “levels” of autonomous vehicles, e.g., Level 0, Level 1, Level 2, Level 3, Level 4, and Level 5. If an autonomous vehicle has a higher-level number than another autonomous vehicle (e.g., Level 3 is a higher-level number than Levels 2 or 1), then the autonomous vehicle with a higher-level number offers a greater combination and quantity of autonomous features relative to the vehicle with the lower level number.
- level 3 is a higher-level number than Levels 2 or 1
- the different levels of autonomous vehicles are described briefly below.
- Level 0 The set of ADAS systems 180 installed in a vehicle have no vehicle control. The set of ADAS systems 180 may issue warnings to the driver of the vehicle. A vehicle which is Level 0 is not an autonomous or semi-autonomous vehicle.
- Level 1 The driver must be ready to take driving control of the autonomous vehicle at any time.
- the set of ADAS systems 180 installed in the autonomous vehicle may provide autonomous features such as one or more of the following: Adaptive Cruise Control (“ACC”); and Parking Assistance with automated steering and Lane Keeping Assistance (“LKA”) Type II, in any combination.
- ACC Adaptive Cruise Control
- LKA Lane Keeping Assistance
- Level 2 The driver is obliged to detect objects and events in the roadway environment and respond if the set of ADAS systems 180 installed in the autonomous vehicle fail to respond properly (based on the driver's subjective judgement).
- the set of ADAS systems 180 installed in the autonomous vehicle executes accelerating, braking, and steering.
- the set of ADAS systems 180 installed in the autonomous vehicle can deactivate immediately upon takeover by the driver.
- Level 3 Within known, limited environments (such as freeways), the driver can safely turn their attention away from driving tasks but must still be prepared to take control of the autonomous vehicle when needed.
- Level 4 The set of ADAS systems 180 installed in the autonomous vehicle can control the autonomous vehicle in all but a few environments such as severe weather.
- the driver must enable the automated system (which is comprised of the set of ADAS systems 180 installed in the vehicle) only when it is safe to do so.
- the automated system is enabled, driver attention is not required for the autonomous vehicle to operate safely and consistent with accepted norms.
- Level 5 Other than setting the destination and starting the system, no human intervention is required.
- the automated system can drive to any location where it is legal to drive and make its own decision (which may vary based on the jurisdiction where the vehicle is located).
- a highly autonomous vehicle is an autonomous vehicle that is Level 3 or higher.
- the ego vehicle 123 is one of the following: a Level 1 autonomous vehicle; a Level 2 autonomous vehicle; a Level 3 autonomous vehicle; a Level 4 autonomous vehicle; a Level 5 autonomous vehicle; and an HAV.
- Examples of the ADAS systems included in the set of ADAS systems 180 may include one or more of the following elements of the vehicle 123 : an adaptive cruise control (“ACC”) system; an adaptive high beam system; an adaptive light control system; an automatic parking system; an automotive night vision system; a blind spot monitor; a collision avoidance system; a crosswind stabilization system; a driver drowsiness detection system; a driver monitoring system; an emergency driver assistance system; a forward collision warning system; an intersection assistance system; an intelligent speed adaption system; a lane departure warning system; a pedestrian protection system; a traffic sign recognition system; a turning assistant; and a wrong-way driving warning system.
- ACC adaptive cruise control
- the autonomous driving system 181 is any computer system whose operation renders the ego vehicle 123 an autonomous vehicle.
- the autonomous driving system 181 includes an onboard unit having a set of ADAS systems 180 installed therein and the onboard unit executes the set of ADAS systems 180 to ender the ego vehicle 123 an autonomous vehicle.
- the autonomous driving system 181 is an optional element of the ego vehicle 123 .
- the ego vehicle 123 does not have to be autonomous for the warning system 199 to provide its functionality.
- the ego vehicle 123 includes the following elements: the set of ADAS systems 180 ; the autonomous driving system 181 ; a display system 182 ; an audio system 183 ; a processor 125 ; a memory 127 ; a communication unit 145 ; an electronic control unit 193 (ECU 193 ); and a warning system 199 .
- the ego vehicle 123 includes an actuator.
- the actuator may be installed in a steering wheel of the ego vehicle.
- the actuator may be operable to cause the steering wheel to vibrate or turn.
- the processor 125 and the memory 127 may be elements of an onboard vehicle computer system (such as computer system 200 described below with reference to FIG. 2 ).
- the onboard vehicle computer system may be operable to cause or control the operation of the warning system 199 of the ego vehicle 123 .
- the onboard vehicle computer system may be operable to access and execute the data stored on the memory 127 to provide the functionality described herein for the warning system 199 of the ego vehicle 123 or its elements (see, e.g., FIG. 2 ).
- the onboard vehicle computer system may be operable to execute the warning system 199 which causes the onboard vehicle computer system to execute one or more steps of one or more of the method 300 described below with reference to FIG. 3 and/or the method 800 described below with reference to FIGS. 8 A and 8 B .
- the processor 125 and the memory 127 may be elements of an onboard unit.
- the onboard unit includes the ECU 193 or some other onboard vehicle computer system that may be operable to cause or control the operation of the warning system 199 .
- the onboard unit may be operable to access and execute the data stored on the memory 127 to provide the functionality described herein for the warning system 199 or its elements.
- the onboard unit may be operable to execute the warning system 199 which causes the onboard unit to execute one or more steps of one or more of the method 300 described below with reference to FIG. 3 and/or the method 800 described below with reference to FIGS. 8 A and 8 B .
- the computer system 200 depicted in FIG. 2 is an example of an onboard unit.
- the computer system 200 is an example of an ECU 193 .
- the ego vehicle 123 may include a sensor set.
- the sensor set may include one or more sensors that are operable to measure one or more of the physical environment outside of the ego vehicle 123 , the state of the ego vehicle 123 , and the historical behavior of the ego vehicle 123 .
- the sensor set may include one or more sensors that record one or more physical characteristics of the physical environment that is proximate to the ego vehicle 123 .
- the memory 127 may store sensor data that describes the one or more physical characteristics recorded by the sensor set.
- the sensors included in the sensor set include range finding and position locating sensors such as LIDAR, radar, and GPS, as well as any other sensors that may be used to determine changes in a vehicle's lateral position, heading, steering wheel angle, etc.
- the sensor set of the ego vehicle 123 may include one or more of the following vehicle sensors: a camera; a LIDAR sensor; a radar sensor; a laser altimeter; an infrared detector; a motion detector; a thermostat; a sound detector, a carbon monoxide sensor; a carbon dioxide sensor; an oxygen sensor; a mass air flow sensor; an engine coolant temperature sensor; a throttle position sensor; a crank shaft position sensor; an automobile engine sensor; a valve timer; an air-fuel ratio meter; a blind spot meter; a curb feeler; a defect detector; a Hall effect sensor, a manifold absolute pressure sensor; a parking sensor; a radar gun; a speedometer; a speed sensor; a tire-pressure monitoring sensor; a torque sensor; a transmission fluid temperature sensor; a turbine speed sensor (TSS); a variable reluctance sensor; a vehicle speed sensor (VSS); a water sensor; a wheel speed sensor; and any other type of automotive sensor.
- vehicle sensors
- the processor 125 includes an arithmetic logic unit, a microprocessor, a general-purpose controller, or some other processor array to perform computations and provide electronic display signals to a display device.
- the processor 125 processes data signals and may include various computing architectures including a complex instruction set computer (CISC) architecture, a reduced instruction set computer (RISC) architecture, or an architecture implementing a combination of instruction sets.
- the ego vehicle 123 may include one or more processors 125 . Other processors, operating systems, sensors, displays, and physical configurations may be possible.
- the memory 127 is a non-transitory memory that stores instructions or data that may be accessed and executed by the processor 125 .
- the instructions or data may include code for performing the techniques described herein.
- the memory 127 may be a dynamic random-access memory (DRAM) device, a static random-access memory (SRAM) device, flash memory, or some other memory device.
- the memory 127 also includes a non-volatile memory or similar permanent storage device and media including a hard disk drive, a floppy disk drive, a CD-ROM device, a DVD-ROM device, a DVD-RAM device, a DVD-RW device, a flash memory device, or some other mass storage device for storing information on a more permanent basis.
- a portion of the memory 127 may be reserved for use as a buffer or virtual random-access memory (virtual RAM).
- the ego vehicle 123 may include one or more memories 127 .
- the memory 127 stores, as digital data, any data described herein. In some embodiments, the memory 127 stores any data that is necessary for the warning system 199 to provide its functionality.
- the memory 127 stores the following types of digital data: BSM data 195 ; sensor data 185 ; ego data 186 ; analysis data 187 ; warning data 188 ; and remote data 194 .
- the BSM data 195 includes the digital data that is the payload for a V2X message. Examples of the BSM data 195 are depicted in FIGS. 4 and 5 .
- the sensor data 185 includes digital data that describes the sensor measurements that are measured and recorded by the sensor set.
- the sensor data 185 is digital data that is included in the BSM data 195 that is received from a remote vehicle included in the set of remote vehicles 124 .
- the sensor data 185 includes digital data that describes sensor measurements that are measured and recorded by the sensor set of a remote vehicle included in the set of remote vehicles 124 .
- the warning system 199 of the ego vehicle 123 causes the onboard sensors of the ego vehicle 123 to record ego data 186 describing the lane change intent of the ego vehicle 123 .
- the ego data 186 is digital data that describes one or more of the following: (1) whether the turn signal of the ego vehicle 123 is engaged; (2) the turning direction for the turn signal if it is engaged; (3) changes in the lateral position of the ego vehicle 123 over time; (4) changes in the heading position of the ego vehicle 123 over time; and (5) changes in a steering wheel angle of the ego vehicle 123 over time.
- the analysis data 187 is digital data that describes the results of the analysis described below with reference to steps 818 - 826 as depicted in FIG. 8 B .
- the analysis data 187 is digital data that describes one or more of the following: whether the ego vehicle 123 is estimated to change lanes to a target lane; a target time when the ego vehicle 123 is estimated to change lanes to the target lane; whether a remote vehicle 124 is estimated to change lanes to the target lane; whether the remote vehicle 124 is likely to arrive at the target lane at the target time or a time that is cotemporaneous to the target time; whether the ego vehicle 123 and the remote vehicle 124 are likely to collide because they both change lanes to the same target lane at the same target time (or approximately at the same target time).
- the warning data 188 is digital data that is operable to modify an operation of a vehicle component of the ego vehicle 123 so that a collision between the ego vehicle 123 and a remote vehicle 124 does not occur.
- the warning data 188 is digital data that is operable, when inputted to the display system 182 or the audio system 183 , to provide a warning to the driver of the ego vehicle 123 by: (1) causing the display system 182 to display a visual warning (e.g., a graphical user interface is displayed on an electronic display of the display system 182 and depicts a visual warning message); or (2) causing the audio system 183 to generate a auditory warning (e.g., a speaker of the audio system 183 vibrates to generate audio that provides a auditory warning message).
- a visual warning e.g., a graphical user interface is displayed on an electronic display of the display system 182 and depicts a visual warning message
- causing the audio system 183 to generate a auditory warning e.g., a speaker of the audio system 183 vibrates to generate audio that provides a auditory warning message.
- a steering wheel of the ego vehicle 123 includes an actuator.
- the warning data 188 is digital data that is operable, when inputted to the actuator, to cause the actuator to provide a counter-steering force on the steering wheel of the ego vehicle 123 or cause this steering wheel to vibrate.
- the warning data 188 is operable to modify an operation of the ADAS system 180 or the autonomous driving system 181 so that these components of the ego vehicle 123 : (1) do not steer the ego vehicle 123 into the target lane; or (2) do not steer the ego vehicle 123 into the target lane at the target time.
- a V2X radio of the remote vehicle 124 transmits a V2X message including remote data 194 within its payload.
- the remote data 194 is an element of the BSM data 195 which is the payload for the V2X message.
- the remote data 194 is digital data that describes one or more of the following: (1) whether the turn signal of the remote vehicle 124 is engaged; (2) the turning direction for the turn signal if it is engaged; (3) changes in a lateral position of the remote vehicle 124 over time; changes in a heading position of the remote vehicle 124 over time; and (4) changes in a steering wheel angle of the remote vehicle 124 over time.
- the remote data 194 is an element of the BSM data 195 .
- the communication unit 145 transmits and receives data to and from a network 105 or to another communication channel.
- the communication unit 145 may include a DSRC transceiver, a DSRC receiver and other hardware or software necessary to make the ego vehicle 123 a DSRC-equipped device.
- the communication unit 145 includes a port for direct physical connection to the network 105 or to another communication channel.
- the communication unit 145 includes a USB, SD, CAT-5, or similar port for wired communication with the network 105 .
- the communication unit 145 includes a wireless transceiver for exchanging data with the network 105 or other communication channels using one or more wireless communication methods, including: IEEE 802.11; IEEE 802.16, BLUETOOTH®; EN ISO 14906:2004 Electronic Fee Collection—Application interface EN 11253:2004 Dedicated Short-Range Communication—Physical layer using microwave at 5.8 GHz (review); EN 12795:2002 Dedicated Short-Range Communication (DSRC)—DSRC Data link layer: Medium Access and Logical Link Control (review); EN 12834:2002 Dedicated Short-Range Communication—Application layer (review); EN 13372:2004 Dedicated Short-Range Communication (DSRC)—DSRC profiles for RTTT applications (review); the communication method described in
- the communication unit 145 includes a full-duplex coordination system as described in U.S. patent application Ser. No. 14/471,387 filed on Aug. 28, 2014 and entitled “Full-Duplex Coordination System,” the entirety of which is incorporated herein by reference.
- the communication unit 145 includes a cellular communications transceiver for sending and receiving data over a cellular communications network including via short messaging service (SMS), multimedia messaging service (MMS), hypertext transfer protocol (HTTP), direct data connection, WAP, e-mail, or another suitable type of electronic communication.
- SMS short messaging service
- MMS multimedia messaging service
- HTTP hypertext transfer protocol
- the communication unit 145 includes a wired port and a wireless transceiver.
- the communication unit 145 also provides other conventional connections to the network 105 for distribution of files or media objects using standard network protocols including TCP/IP, HTTP, HTTPS, and SMTP, millimeter wave, DSRC, etc.
- the communication unit 145 includes: a first V2X radio 147 ; and a second V2X radio 148 .
- the first V2X radio 147 is an electronic device that includes a V2X transmitter and a V2X receiver that is operable to send and receive wireless messages via any V2X protocol.
- the first V2X radio 147 is operable to send and receive wireless messages via DSRC.
- the V2X transmitter is operable to transmit and broadcast DSRC messages over the 5.9 GHz band.
- the V2X receiver is operable to receive DSRC messages over the 5.9 GHz band.
- the first V2X radio 147 includes seven channels (e.g., DSRC channel numbers 172 , 174 , 176 , 178 , 180 , 182 and 184 ) with at least one of these channels reserved for sending and receiving BSMs (e.g., DSRC channel number 172 is reserved for BSMs). In some embodiments, at least one of these channels is reserved for sending and receiving Pedestrian Safety Messages (PSMs) as described in U.S. patent application Ser. No. 15/796,296 filed on Oct. 27, 2017 and entitled “PSM Message-based Device Discovery for a Vehicular Mesh Network,” the entirety of which is hereby incorporated by reference. In some embodiments, DSRC channel number 172 is reserved for sending and receiving PSMs. In some embodiments, DSRC channel number 176 is reserved for sending and receiving PSMs.
- PSMs Pedestrian Safety Messages
- the first V2X radio 147 includes a non-transitory memory which stores digital data that controls the frequency for broadcasting BSMs.
- the non-transitory memory stores a buffered version of the GPS data for the ego vehicle 123 so that the GPS data for the ego vehicle 123 is broadcast as an element of the BSMs which are regularly broadcast by the first V2X radio 147 .
- the first V2X radio 147 includes any hardware or software which is necessary to make the ego vehicle 123 compliant with the DSRC standards.
- the DSRC-compliant GPS unit 250 depicted in FIG. 2 is an element of the first V2X radio 147 .
- the second V2X radio 148 is an electronic device that includes a V2X transmitter and a V2X receiver that is operable to send and receive wireless messages via any V2X protocol.
- the second V2X radio 148 provides functionality that is similar to the first V2X radio 147 , and so, that description will not be repeated here.
- the first V2X radio 147 includes a single channel that is dedicated to sending and/or receiving a particular type of wireless message.
- the first V2X radio 147 includes a single channel that is dedicated to sending and receiving BSMs. See, for example, FIG. 1 B in which the first V2X radio 147 includes channel 172 which is dedicated to sending and receiving BSMs.
- the first V2X radio 147 includes a single channel that is dedicated to sending and receiving BSMs and the second V2X radio 148 includes a plurality of other channels that are operable to send and receive any V2X messages that are not BSMs.
- the second V2X radio 148 includes six other channels as depicted in FIG. 1 B that are operable to send and receive any V2X messages that are not BSMs.
- the first V2X radio 147 includes a single channel that is dedicated to receiving PSMs and the second V2X radio 148 includes a plurality of other channels that are operable to send and receive any V2X messages that are not PSMs.
- the first V2X radio 147 is a first DSRC radio dedicated to sending and receiving BSMs.
- the first V2X radio 147 includes a first DSRC radio transceiver.
- the second V2X radio 148 is a second DSRC radio that sends and receives any DSRC messages which are not BSMs.
- the second V2X radio 148 includes a second DSRC radio transceiver.
- the ego vehicle 123 is a DSRC-enabled vehicle that includes two different DSRC radios.
- the warning system 199 includes software that is operable, when executed by the processor 125 , to cause the processor 125 to execute one or more steps of the method 300 described below with reference to FIG. 3 and/or the method 800 described below with reference to FIGS. 8 A and 8 B .
- the functionality of the warning system 199 is described in more detail below according to some embodiments.
- the warning system 199 is implemented using hardware including a field-programmable gate array (“FPGA”) or an application-specific integrated circuit (“ASIC”). In some other embodiments, the warning system 199 implemented using a combination of hardware and software.
- FPGA field-programmable gate array
- ASIC application-specific integrated circuit
- a remote vehicle 124 includes elements similar to the ego vehicle 123 .
- a remote vehicle includes one or more of the following elements: a processor 125 ; an ECU 193 ; a warning system 199 ; a communication unit 145 ; a set of ADAS systems 180 ; an autonomous driving system 181 ; and a memory 127 storing digital data similar to that which is stored by the memory 127 of the ego vehicle 123 .
- the remote vehicle is a manufactured by a same manufacturer as the ego vehicle 123 and these vehicles are configured or otherwise operable to cooperate with one another to provide the functionality of the warning system 199 .
- the remote vehicle 124 does not include a warning system 199 .
- the remote vehicle 124 is an electronic device that is operable to send and receive V2X communications.
- the remote vehicle is an DSRC-equipped device that is operable to send and receive DSRC messages, BSMs, or some other type of V2X messages including the BSM data 195 as its payload.
- the RSU 104 is a DSRC-equipped roadside unit. In some embodiments, the RSU 104 includes a communication unit similar to the communication unit 145 included in the ego vehicle 123 . In some embodiments, the RSU 104 is operable to receive and relay V2X communications.
- the RSU 104 is any electronic device that is operable to send and receive V2X communications.
- RSU 104 is an electronic device, or another connected vehicle, including a communication unit similar to the communication unit 145 .
- the RSU 104 is a smartphone, tablet computer, personal computer, roadside unit, or some other processor-based computing device that includes a communication unit 145 .
- RSU 104 is a DSRC-equipped device that is operable to send and receive DSRC messages, BSMs, or some other type of V2X messages including the BSM data 195 as its payload.
- DSRC is increasingly being included in vehicles because it is a source of sensor data 185 which is required for many ADAS systems (such as those included in the set of ADAS systems 180 ) or autonomous driving systems 181 to provide their functionality.
- ADAS systems such as those included in the set of ADAS systems 180
- autonomous driving systems 181 to provide their functionality.
- seven different channels are dedicated to DSRC, with one of these seven channels generally used for transmission of BSMs.
- the channel generally used for transmission of BSMs is used about 99% of the time for BSM transmissions, and so, for the purposes of this description, this channel is referred to as “the channel dedicated to BSMs” or “the channel reserved for BSMs.”
- the channel dedicated to BSMs i.e., channel 172
- receives a lot of use because each DSRC-enabled vehicle on the roadway transmits BSMs at regular intervals (e.g., one every 0.10 seconds).
- Another of these seven channels may be generally used for PSMs in a manner similar to how channel 172 is generally used for BSMs, and so, this channel is referred to as being “dedicated to PSMs” or “reserved for PSMs.”
- channel 176 may be generally used for PSMs.
- these two channels i.e., the first for BSMs and the second for PSMs
- these two channels are in near constant use, almost always sending or receiving BSMs or PSMs.
- the ego vehicle 123 is equipped with two or more different DSRC radios (e.g., the first V2X radio 147 and the second V2X radio 148 ).
- Each of the DSRC radios includes a DSRC transmitter and a DSRC receiver.
- One of the DSRC radios is dedicated solely to receiving BSMs.
- the other DSRC radio(s) is used to receive any other non-BSM DSRC messages.
- the memory 127 stores mask data.
- the mask data includes digital data that describes the transmission mask for each of the seven DSRC channels.
- the warning system 199 includes code and routines that are operable, when executed by the processor 125 , to cause the processor 125 to monitor each of the seven DSRC channels.
- the processor 125 has access to the mask data which is stored in the memory 127 .
- the mask data is stored in a buffer of one or more of the first V2X radio 147 and the second V2X radio 148 so that it is quickly retrievable by the processor 125 .
- the warning system 199 includes code and routines that are operable, when executed by the processor 125 , to cause the processor 125 to continuously analyze each of the DSRC channels when a DSRC packet is sent (e.g., every 0.10 seconds).
- the warning system 199 includes code and routines that are operable, when executed by the processor 125 , to cause the processor 125 to execute one or more of the steps of the method 800 depicted in FIGS. 8 A and 8 B (or one or more steps of the method 300 depicted in FIG. 3 ) responsive to receipt of a V2X message on one or more of the seven DSRC channels.
- a transmission event is a V2X transmission (e.g., a DSRC transmission) on a particular channel of a V2X radio (e.g., a DSRC channel of a DSRC radio or some other V2X channel of a V2X radio).
- a V2X transmission e.g., a DSRC transmission
- a particular channel of a V2X radio e.g., a DSRC channel of a DSRC radio or some other V2X channel of a V2X radio.
- the warning system 199 includes software that is operable, when executed by the processor 125 , to cause the processor 125 to monitor each of the DSRC channels available to the first V2X radio 147 and the second V2X radio 148 .
- This software has access to the mask data which is stored in the memory 127 .
- the warning system 199 includes software that is operable, when executed by the processor 125 , to cause the processor 125 to continuously analyze each of the DSRC channels at transmission events. For each transmission event and each DSRC channel, the warning system 199 includes software that is operable, when executed by the processor 125 , to cause the processor 125 to execute one or more of the steps of the method 800 depicted in FIGS. 8 A and 8 B (or one or more steps of the method 300 depicted in FIG. 3 ) responsive to receipt of a V2X message on one or more of the seven DSRC channels.
- the BSM data 195 is a payload for a V2X message.
- the BSM data 195 and the remote data 194 included in the BSM data 195 is a payload for the V2X message.
- the V2X message is a BSM.
- the BSM data 195 is the payload for a DSRC message or any other type of V2X message.
- the BSM data 195 includes the sensor data 185 recorded by the sensors of a connected vehicle which originated the V2X message which includes the BSM data 195 as its payload.
- FIG. 1 B depicted is an is an operating environment 101 that includes a set of V2X radios 147 , 148 and the warning system 199 according to some embodiments.
- V2X channel #172 is the channel is reserved for BSMs.
- the first V2X radio 147 is dedicated to sending and receiving BSMs using V2X channel #172.
- the other six V2X channels (#174, #176, #178, #180, #182 and #184) are accessible to the second V2X radio 148 .
- channel #176 is reserved for receiving PSMs.
- the computer system 200 may include a special-purpose computer system that is programmed to perform one or more steps of one or more of the method 300 described below with reference to FIG. 3 (one or more steps of one or more of the method 800 described below with reference to FIGS. 8 A and 8 B ).
- the computer system 200 is an onboard vehicle computer of the ego vehicle 123 .
- the computer system 200 is an onboard unit of the ego vehicle 123 .
- the computer system 200 is an ECU, head unit or some other processor-based computing device of the ego vehicle 123 .
- the computer system 200 includes one or more of the following elements according to some examples: the warning system 199 ; a processor 225 ; a communication unit 245 ; a memory 227 ; an ECU 294 ; a set of ADAS systems 280 ; an autonomous driving system 281 ; a DSRC-compliant GPS unit 250 ; the display system 282 ; the audio system 283 ; and the steering wheel actuator 284 .
- the components of the computer system 200 are communicatively coupled by a bus 220 .
- the processor 225 is communicatively coupled to the bus 220 via a signal line 238 .
- the communication unit 245 is communicatively coupled to the bus 220 via a signal line 240 .
- the memory 127 is communicatively coupled to the bus 220 via a signal line 242 .
- the ECU 294 is communicatively coupled to the bus 220 via a signal line 243 .
- the set of ADAS systems 280 is communicatively coupled to the bus 220 via a signal line 244 .
- the autonomous driving system 281 is communicatively coupled to the bus 220 via a signal line 246 .
- the DSRC-compliant GPS unit 250 is communicatively coupled to the bus 220 via a signal line 244 .
- the display system 282 is communicatively coupled to the bus 220 via a signal line 248 .
- the audio system 283 is communicatively coupled to the bus 220 via a signal line 249 .
- the steering wheel actuator 284 is communicatively coupled to the bus 220 via a signal line 251 .
- the processor 225 provides similar functionality as the processor 125 described above with reference to FIG. 1 A , and so, that description will not be repeated here.
- the communication unit 245 provides similar functionality as the communication unit 245 described above with reference to FIG. 1 A , and so, that description will not be repeated here.
- the memory 227 provides similar functionality as the memory 127 described above with reference to FIG. 1 A , and so, that description will not be repeated here.
- the ECU 294 provides similar functionality as the ECU 193 described above with reference to FIG. 1 A , and so, that description will not be repeated here.
- the set of ADAS systems 280 provides similar functionality as the set of ADAS systems 180 described above with reference to FIG. 1 A , and so, that description will not be repeated here.
- the autonomous driving system 281 provides similar functionality as the autonomous driving system 181 described above with reference to FIG. 1 A , and so, that description will not be repeated here.
- the display system 282 provides similar functionality as the display system 182 described above with reference to FIG. 1 A , and so, that description will not be repeated here.
- the audio system 283 provides similar functionality as the audio system 183 described above with reference to FIG. 1 A , and so, that description will not be repeated here.
- the memory 227 may store any of the data described above with reference to FIGS. 1 A and 1 B or below with reference to FIGS. 2 - 8 B .
- the memory 227 may store any digital data needed for the computer system 200 to provide its functionality.
- the DSRC-compliant GPS unit 250 includes any hardware and software necessary to make the ego vehicle 123 , computer system 200 , or the DSRC-compliant GPS unit 250 compliant with one or more of the following DSRC standards, including any derivative or fork thereof: EN 12253:2004 Dedicated Short-Range Communication—Physical layer using microwave at 5.8 GHz (review); EN 12795:2002 Dedicated Short-Range Communication (DSRC)—DSRC Data link layer: Medium Access and Logical Link Control (review); EN 12834:2002 Dedicated Short-Range Communication—Application layer (review); and EN 13372:2004 Dedicated Short-Range Communication (DSRC)—DSRC profiles for RTTT applications (review); EN ISO 14906:2004 Electronic Fee Collection—Application interface.
- DSRC Dedicated Short-Range Communication
- the DSRC-compliant GPS unit 250 is operable to provide GPS data describing the location of the ego vehicle 123 with lane-level accuracy.
- the ego vehicle 123 is traveling in a lane of a roadway.
- Lane-level accuracy means that the location of the ego vehicle 123 is described by the GPS data so accurately that the lane of travel of the ego vehicle 123 within the roadway may be accurately determined based on the GPS data for this ego vehicle 123 as provided by the DSRC-compliant GPS unit 250 .
- the GPS data is an element of the BSM data 195 (see, e.g., FIGS. 4 and 5 ).
- the DSRC-compliant GPS unit 250 includes hardware that wirelessly communicates with a GPS satellite to retrieve GPS data that describes the geographic location of the ego vehicle 123 with a precision that is compliant with the DSRC standard.
- the DSRC standard requires that GPS data be precise enough to infer if two vehicles (one of which is, for example, the ego vehicle 123 ) are located in adjacent lanes of travel.
- the DSRC-compliant GPS unit 250 is operable to identify, monitor and track its two-dimensional position within 1.5 meters of its actual position 68% of the time under an open sky.
- the warning system 199 described herein may analyze the GPS data provided by the DSRC-compliant GPS unit 250 and determine what lane the ego vehicle 123 is traveling in based on the relative positions of two or more different vehicles (one of which is, for example, the ego vehicle 123 ) traveling on the roadway at the same time.
- a conventional GPS unit which is not compliant with the DSRC standard is unable to determine the location of an ego vehicle 123 with lane-level accuracy.
- a typical roadway lane is approximately 3 meters wide.
- a conventional GPS unit only has an accuracy of plus or minus 10 meters relative to the actual location of the ego vehicle 123 .
- such conventional GPS units are not sufficiently accurate to identify a lane of travel for an ego vehicle 123 based on GPS data alone; instead, systems having only conventional GPS units must utilize sensors such as cameras to identify the lane of travel of the ego vehicle 123 .
- Identifying a lane of travel of a vehicle is beneficial, for example, because in some embodiments it may enable the warning system 199 to more accurately identify a location of an ego vehicle 123 including the computer system 200 and traveling in a roadway having multiple lanes of travel.
- the steering wheel actuator 284 includes an actuator that is installed in a steering wheel of a vehicle (e.g., the ego vehicle 123 ) and is operable to cause the steering wheel to vibrate or provide a counter-steering force on the steering wheel.
- one or more of the following elements are examples of a vehicle component: the display system 282 ; the audio system 283 ; the steering wheel actuator 284 ; an ADAS system included in the set of ADAS systems 280 ; and the autonomous driving system 281 .
- the warning system 199 includes: a communication module 202 ; and a determination module 204 .
- the communication module 202 can be software including routines for handling communications between the warning system 199 and other components of the operating environments 100 and 101 of FIGS. 1 A and 1 B , respectively.
- the communication module 202 can be a set of instructions executable by the processor 225 to provide the functionality described below for handling communications between the warning system 199 and other components of the computer system 200 .
- the communication module 202 can be stored in the memory 227 of the computer system 200 and can be accessible and executable by the processor 225 .
- the communication module 202 may be adapted for cooperation and communication with the processor 225 and other components of the computer system 200 via signal line 222 .
- the communication module 202 sends and receives data, via the communication unit 245 , to and from one or more elements of the operating environment 100 .
- the communication module 202 receives or transmits, via the communication unit 245 , some or all of the digital data stored on the memory 127 .
- the communication module 202 may send or receive any of the digital data or messages described above with reference to FIGS. 1 A and 1 B or below with reference to FIGS. 2 - 8 B , via the communication unit 245 .
- the communication module 202 receives data from components of the warning system 199 and stores the data in the memory 227 (or a buffer or cache of the memory 227 , or a standalone buffer or cache which is not depicted in FIG. 2 ).
- the communication module 202 receives the BSM data 195 from the communication unit 245 and stores the BSM data 195 in the memory 227 .
- the communication module 202 may handle communications between components of the warning system 199 .
- the communication module 202 transmits the BSM data 195 from the memory 227 to the determination module 204 .
- the determination module 204 can be a set of instructions executable by the processor 225 which are operable, when executed by the processor 225 , to cause the processor 225 to execute one or more steps of the method 300 described below with reference to FIG. 3 (or one or more steps of the method 800 described below with reference to FIGS. 8 A and 8 B ).
- the determination module 204 can be stored in the memory 227 of the computer system 200 and can be accessible and executable by the processor 225 .
- the determination module 204 may be adapted for cooperation and communication with the processor 225 and other components of the computer system 200 via signal line 224 .
- FIG. 3 depicted a method 300 for to modifying a vehicle component of an ego vehicle based on a payload of a V2X communication so that the ego vehicle does not collide with a remote vehicle according to some embodiments.
- the steps of the method 300 are executable in any order, and not necessarily the order depicted in FIG. 3 .
- the steps of the method 300 are now described according to some embodiments.
- Step 301 Determine whether the ego vehicle is estimated to change lanes to a particular lane [i.e., “lane X”] in the future (e.g., at a target time).
- step 303 determine whether the remote vehicle is estimated to change lanes to lane X in the future.
- step 305 determine ego time information describing a time when the ego vehicle is likely to arrive at lane X.
- step 307 determine remote time information describing a time when the remote vehicle is likely to arrive at lane X.
- step 308 determine whether the ego vehicle is likely to collide with the remote vehicle when it arrives at lane X because both the ego vehicle and the remote vehicle are changing lanes to lane X at approximately the same time.
- step 309 if a collision is determined to be likely to occur at step 308 , then proactively provide a warning to the ego driver of the ego vehicle before the ego driver attempts to change lanes to lane X so that the ego driver can decide not to change lanes to lane X and thereby avoid the collision with the remote vehicle.
- the BSM data 195 includes the sensor data 185 .
- the regular interval for transmitting BSMs may be user configurable. In some embodiments, a default setting for this interval may be transmitting the BSM every 0.10 seconds or substantially every 0.10 seconds.
- a BSM is broadcasted over the 5.9 GHz DSRC band.
- DSRC range may be substantially 1,000 meters. In some embodiments, DSRC range may include a range of substantially 100 meters to substantially 1,000 meters. DSRC range is generally 300 to 500 meters depending on variables such as topography and occlusions between DSRC-equipped endpoints.
- FIG. 5 depicted is a block diagram illustrating an example of BSM data 195 according to some embodiments.
- a BSM may include two parts. These two parts may include different BSM data 195 as shown in FIG. 5 .
- Part 1 of the BSM data 195 may describe one or more of the following: the GPS data of the vehicle; vehicle heading; vehicle speed; vehicle acceleration; vehicle steering wheel angle; and vehicle size.
- Part 2 of the BSM data 195 may include a variable set of data elements drawn from a list of optional elements. Some of the BSM data 195 included in Part 2 of the BSM are selected based on event triggers, e.g., anti-locking brake system (“ABS”) being activated may trigger BSM data 195 relevant to the ABS system of the vehicle.
- ABS anti-locking brake system
- some of the elements of Part 2 are transmitted less frequently in order to conserve bandwidth.
- the BSM data 195 included in a BSM includes current snapshots of a vehicle (e.g., an ego vehicle or a remote vehicle).
- FIG. 6 depicted is a block diagram illustrating a first use case 600 for the warning system according to some embodiments.
- the first use case 600 includes a lane change event where two vehicles are attempting to change lanes to the same target lane but cannot see one another for some reason. For example, in FIG. 6 the vehicles (or their drivers) cannot see one another because they are separated by a bus that occludes them from one another.
- FIG. 6 depicts an embodiment of this example because the vehicles each want to change lanes to the same target lane and their presence is unknown to one another because the school bus occludes their presence from being viewable to one another. As a result, these vehicles may collide with one another if they each change lanes to the same lane as the school bus (e.g., the target lane) at the same time (e.g., the target time):
- Collisions are likely in these situations because (1) the drivers of the ego vehicle and the remote vehicle cannot see that other vehicles are trying to changes lanes to the same target lane, and so, they cannot respond with driving decisions that avoid a collision; and (2) the ADAS systems or autonomous driving systems of these vehicles will not be able detect the potential collision because neither vehicle's onboard sensors will be able to measure the presence/movement of the other vehicle that is trying to change lanes to the same target lane, and so, the ADAS systems will not be able to respond with an output that decreases the likelihood of a collision. As a result, a collision is more likely to occur in these situations.
- FIG. 7 depicted is a block diagram illustrating an example benefit 700 of the warning system according to some embodiments.
- the equations and use cases depicted in FIG. 7 are illustrative and not intended to be limiting. Other equations and use cases are possible.
- FIGS. 8 A and 8 B depicted is a method 800 for to modifying a vehicle component of an ego vehicle based on a payload of a V2X communication (e.g., BSM data and/or the remote data included in the BSM data) so that the ego vehicle does not collide with a remote vehicle according to some embodiments.
- a V2X communication e.g., BSM data and/or the remote data included in the BSM data
- the sensor measurements describe information about the remote vehicle. For example, the sensor measurements describe the information that is depicted in FIG. 4 or 5 .
- the sensor measurements are included in the payload for the V2X message.
- the remote data is generated based on these sensor measurements.
- the remote data is digital data that describes sensor measurements which indicate a lane change intent of the remote vehicle.
- a lane change intent indicates both a target lane and a target time for a lane change event executed by the remote vehicle.
- step 804 transmit the V2X message.
- the payload for this V2X message includes the remote data.
- This V2X message may be broadcast.
- This V2X message may be received by an RSU and then relayed by the RSU.
- a V2X radio of the ego vehicle receives the V2X message.
- the remote data is parsed from the payload of the V2X message.
- the remote data is stored in a non-transitory memory.
- the sensor measurements describe information about the ego vehicle.
- the ego data is generated based on these sensor measurements.
- the ego data is digital data that describes sensor measurements which indicate a lane change intent of the ego vehicle.
- a lane change intent indicates both a target lane and a target time for a lane change event executed by the ego vehicle.
- An example of a lane change event is depicted in FIGS. 6 and 7 .
- ego data is generated.
- the ego data is generated based on the sensor measurements recorded at step 812 .
- the ego data and the remote data is provided as an input to the warning system.
- the warning system provides the analysis depicted in steps 818 - 826 based on these inputs.
- the output of this analysis is the analysis data. Accordingly, the warning system receives the ego data and the remote data as inputs and outputs the analysis data.
- a first time when the ego vehicle is likely to arrive at the target lane is determined. This first time is a “target time.”
- the target time is described by the ego time information.
- a second time when the remote vehicle is likely to arrive at the target lane is determined.
- the second time may be the same or substantially the same as the target time.
- the warning system proactively generates warning data that is provided to a vehicle component of the ego vehicle.
- the vehicle component is then executed using this warning data as an input.
- the warning data is operable to modify an operation of the vehicle component. For example, if the vehicle component is a display system or audio system, then the vehicle component provides a warning responsive to being executed using the warning data as an input. If the vehicle components are an ADAS system or autonomous driving system, then the vehicle component modifies the steering of the ego vehicle so that it does not steer into the target lane at the target time responsive to being executed using the warning data as an input. If the vehicle component is a steering wheel actuator, then the vehicle component causes the steering wheel to vibrate or provide a counter steering force responsive to being executed using the warning data as an input.
- the present embodiments of the specification can also relate to an apparatus for performing the operations herein.
- This apparatus may be specially constructed for the required purposes, or it may include a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer.
- a computer program may be stored in a computer-readable storage medium, including, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, and magnetic disks, read-only memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, magnetic or optical cards, flash memories including USB keys with non-volatile memory, or any type of media suitable for storing electronic instructions, each coupled to a computer system bus.
- the specification can take the form of some entirely hardware embodiments, some entirely software embodiments or some embodiments containing both hardware and software elements.
- the specification is implemented in software, which includes, but is not limited to, firmware, resident software, microcode, etc.
- a computer-usable or computer-readable medium can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
- a data processing system suitable for storing or executing program code will include at least one processor coupled directly or indirectly to memory elements through a system bus.
- the memory elements can include local memory employed during actual execution of the program code, bulk storage, and cache memories which provide temporary storage of at least some program code in order to reduce the number of times code must be retrieved from bulk storage during execution.
- I/O devices including, but not limited, to keyboards, displays, pointing devices, etc.
- I/O controllers can be coupled to the system either directly or through intervening I/O controllers.
- Network adapters may also be coupled to the system to enable the data processing system to become coupled to other data processing systems or remote printers or storage devices through intervening private or public networks.
- Modems, cable modem, and Ethernet cards are just a few of the currently available types of network adapters.
- modules, routines, features, attributes, methodologies, and other aspects of the disclosure can be implemented as software, hardware, firmware, or any combination of the three.
- a component an example of which is a module, of the specification is implemented as software
- the component can be implemented as a standalone program, as part of a larger program, as a plurality of separate programs, as a statically or dynamically linked library, as a kernel-loadable module, as a device driver, or in every and any other way known now or in the future to those of ordinary skill in the art of computer programming.
- the disclosure is in no way limited to embodiment in any specific programming language, or for any specific operating system or environment. Accordingly, the disclosure is intended to be illustrative, but not limiting, of the scope of the specification, which is set forth in the following claims.
Abstract
Description
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/295,700 US11697410B2 (en) | 2019-03-07 | 2019-03-07 | Vehicle-to-everything communication-based lane change collision avoidance warning |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/295,700 US11697410B2 (en) | 2019-03-07 | 2019-03-07 | Vehicle-to-everything communication-based lane change collision avoidance warning |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200282981A1 US20200282981A1 (en) | 2020-09-10 |
US11697410B2 true US11697410B2 (en) | 2023-07-11 |
Family
ID=72336139
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/295,700 Active 2039-12-27 US11697410B2 (en) | 2019-03-07 | 2019-03-07 | Vehicle-to-everything communication-based lane change collision avoidance warning |
Country Status (1)
Country | Link |
---|---|
US (1) | US11697410B2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220172618A1 (en) * | 2019-04-12 | 2022-06-02 | Continental Automotive Systems, Inc. | Electronic Control Device For A Vehicle And Method For Reducing Intersection False-Positive Detection |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11170640B2 (en) * | 2019-05-14 | 2021-11-09 | Ford Global Technologies, Llc | Method and apparatus for bridging and optimizing V2X networks |
KR20210053385A (en) * | 2019-11-01 | 2021-05-12 | 엘지전자 주식회사 | Vehicle Having a Dangerous Situation Notification Function and Control Method thereof |
US11368826B2 (en) * | 2020-01-27 | 2022-06-21 | Ford Global Technologies, Llc | Method and apparatus for bridging and optimizing V2X networks in vehicles |
CN113923625B (en) * | 2021-12-14 | 2022-06-17 | 智道网联科技(北京)有限公司 | Information processing method and device based on V2X communication |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150123778A1 (en) * | 2013-11-01 | 2015-05-07 | Nissan North America, Inc. | Vehicle contact avoidance system |
WO2015120953A1 (en) * | 2014-02-15 | 2015-08-20 | Audi Ag | Method for operating a driver assistance system for passing maneuvers, and motor vehicle |
US20170210282A1 (en) * | 2014-07-24 | 2017-07-27 | Alejandro Rodriguez Barros | Multifunctional assembly comprising a laser emitter for the door of a motor vehicle |
US9802614B1 (en) * | 2016-05-27 | 2017-10-31 | Hyundai Motor Company | Apparatus and method for controlling lane change considering priority |
CN107993489A (en) * | 2017-12-14 | 2018-05-04 | 北京汽车集团有限公司 | Vehicle avoiding device, method, vehicle and system |
US20180173230A1 (en) * | 2016-12-20 | 2018-06-21 | GM Global Technology Operations LLC | Contextual-assessment vehicle systems |
CN108482250A (en) * | 2018-04-18 | 2018-09-04 | 芜湖博高光电科技股份有限公司 | It is a kind of to be cared the car tailstock anti-collision early warning system and its method for early warning based on millimeter wave |
US10098014B1 (en) | 2018-01-31 | 2018-10-09 | Toyota Jidosha Kabushiki Kaisha | Beam alignment using shared driving intention for vehicular mmWave communication |
US20190071013A1 (en) * | 2017-09-05 | 2019-03-07 | GM Global Technology Operations LLC | Systems and methods for providing relative lane assignment of objects at distances from the vehicle |
US20200008086A1 (en) * | 2018-06-29 | 2020-01-02 | Toyota Jidosha Kabushiki Kaisha | Reducing Adjacent Channel Interference for Wireless Vehicular Messages |
US20200019176A1 (en) * | 2017-03-17 | 2020-01-16 | Veoneer Us Inc. | Communication for high accuracy cooperative positioning solutions |
CN110808804A (en) * | 2019-10-30 | 2020-02-18 | 中电科仪器仪表有限公司 | Structure and method for realizing receiving synchronization of multipath RapidIO test board cards and test equipment |
CN110809904A (en) * | 2017-07-01 | 2020-02-18 | 英特尔公司 | Method and apparatus for vehicle radio communication |
US20200247412A1 (en) * | 2019-02-06 | 2020-08-06 | Toyota Jidosha Kabushiki Kaisha | Virtualized Driver Assistance |
US20200409387A1 (en) * | 2017-12-05 | 2020-12-31 | Sony Corporation | Image processing apparatus, image processing method, and program |
-
2019
- 2019-03-07 US US16/295,700 patent/US11697410B2/en active Active
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150123778A1 (en) * | 2013-11-01 | 2015-05-07 | Nissan North America, Inc. | Vehicle contact avoidance system |
WO2015120953A1 (en) * | 2014-02-15 | 2015-08-20 | Audi Ag | Method for operating a driver assistance system for passing maneuvers, and motor vehicle |
US20170210282A1 (en) * | 2014-07-24 | 2017-07-27 | Alejandro Rodriguez Barros | Multifunctional assembly comprising a laser emitter for the door of a motor vehicle |
US9802614B1 (en) * | 2016-05-27 | 2017-10-31 | Hyundai Motor Company | Apparatus and method for controlling lane change considering priority |
US20180173230A1 (en) * | 2016-12-20 | 2018-06-21 | GM Global Technology Operations LLC | Contextual-assessment vehicle systems |
US20200019176A1 (en) * | 2017-03-17 | 2020-01-16 | Veoneer Us Inc. | Communication for high accuracy cooperative positioning solutions |
CN110809904A (en) * | 2017-07-01 | 2020-02-18 | 英特尔公司 | Method and apparatus for vehicle radio communication |
US20190071013A1 (en) * | 2017-09-05 | 2019-03-07 | GM Global Technology Operations LLC | Systems and methods for providing relative lane assignment of objects at distances from the vehicle |
US20200409387A1 (en) * | 2017-12-05 | 2020-12-31 | Sony Corporation | Image processing apparatus, image processing method, and program |
CN107993489A (en) * | 2017-12-14 | 2018-05-04 | 北京汽车集团有限公司 | Vehicle avoiding device, method, vehicle and system |
US10098014B1 (en) | 2018-01-31 | 2018-10-09 | Toyota Jidosha Kabushiki Kaisha | Beam alignment using shared driving intention for vehicular mmWave communication |
CN108482250A (en) * | 2018-04-18 | 2018-09-04 | 芜湖博高光电科技股份有限公司 | It is a kind of to be cared the car tailstock anti-collision early warning system and its method for early warning based on millimeter wave |
US20200008086A1 (en) * | 2018-06-29 | 2020-01-02 | Toyota Jidosha Kabushiki Kaisha | Reducing Adjacent Channel Interference for Wireless Vehicular Messages |
US20200247412A1 (en) * | 2019-02-06 | 2020-08-06 | Toyota Jidosha Kabushiki Kaisha | Virtualized Driver Assistance |
CN110808804A (en) * | 2019-10-30 | 2020-02-18 | 中电科仪器仪表有限公司 | Structure and method for realizing receiving synchronization of multipath RapidIO test board cards and test equipment |
Non-Patent Citations (2)
Title |
---|
EPO, Communication Pursuant to Article 94(3) EPC for European Patent Application No. 20151624.2, dated Sep. 3, 2021, 4 pages. |
Federal Register / vol. 82, No. 8 / Thursday, Jan. 12, 2017 / Proposed Rules Federal Motor Vehicle Safety Standards; V2V Communications (Year: 2017). * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220172618A1 (en) * | 2019-04-12 | 2022-06-02 | Continental Automotive Systems, Inc. | Electronic Control Device For A Vehicle And Method For Reducing Intersection False-Positive Detection |
Also Published As
Publication number | Publication date |
---|---|
US20200282981A1 (en) | 2020-09-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3557893B1 (en) | Multi-level hybrid vehicle-to-anything communications for cooperative perception | |
US10796175B2 (en) | Detection of a drowsy driver based on vehicle-to-everything communications | |
US11676427B2 (en) | Vehicle component modification based on vehicle-to-everything communications | |
US11069245B2 (en) | Lane change timing indicator | |
US10248410B2 (en) | Implementation decision to provide ADAS function update for a vehicle | |
US11697410B2 (en) | Vehicle-to-everything communication-based lane change collision avoidance warning | |
US10762363B2 (en) | Road sign recognition for connected vehicles | |
US11113969B2 (en) | Data-to-camera (D2C) based filters for improved object detection in images based on vehicle-to-everything communication | |
US10802110B2 (en) | Vehicular radar interference management using basic safety messages | |
US10819389B2 (en) | Reducing adjacent channel interference for wireless vehicular messages | |
US20200307580A1 (en) | Proactive message transmitter identification system | |
CN110944298B (en) | V2X full duplex location assistance for vehicle to all V2X recipients | |
JP7078022B2 (en) | Context system to improve understanding of V2X communication by V2X receiver | |
EP3557900B1 (en) | Cloud-based network optimizer for connected vehicles | |
EP3565286B1 (en) | Disaster mitigation system for connected vehicles having hidden vehicle functionality |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
AS | Assignment |
Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, BAEKGYU;HAN, KYUNGTAE;WANG, ZIRAN;REEL/FRAME:063013/0387 Effective date: 20230310 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |