CN107810127B - Cognitive driver assistance with variable alerts for automated vehicles - Google Patents

Cognitive driver assistance with variable alerts for automated vehicles Download PDF

Info

Publication number
CN107810127B
CN107810127B CN201680036887.7A CN201680036887A CN107810127B CN 107810127 B CN107810127 B CN 107810127B CN 201680036887 A CN201680036887 A CN 201680036887A CN 107810127 B CN107810127 B CN 107810127B
Authority
CN
China
Prior art keywords
vehicle
operator
host
controller
collision
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680036887.7A
Other languages
Chinese (zh)
Other versions
CN107810127A (en
Inventor
M·H·劳尔
S·兰贝尔蒙特
J·P·阿布斯迈尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Delphi Technologies Inc
Original Assignee
Delphi Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Delphi Technologies Inc filed Critical Delphi Technologies Inc
Priority to CN202011083810.XA priority Critical patent/CN112158132A/en
Publication of CN107810127A publication Critical patent/CN107810127A/en
Application granted granted Critical
Publication of CN107810127B publication Critical patent/CN107810127B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/008Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • B60K28/066Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/095Predicting travel path or likelihood of collision
    • B60W30/0953Predicting travel path or likelihood of collision the prediction being responsive to vehicle dynamic parameters
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/095Predicting travel path or likelihood of collision
    • B60W30/0956Predicting travel path or likelihood of collision the prediction being responsive to traffic or environmental parameters
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/18Propelling the vehicle
    • B60W30/18009Propelling the vehicle related to particular drive situations
    • B60W30/18163Lane change; Overtaking manoeuvres
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W40/09Driving style or behaviour
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/12Limiting control by the driver depending on vehicle state, e.g. interlocking means for the control input for preventing unsafe operation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W50/16Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/166Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/167Driving aids for lane monitoring, lane changing, e.g. blind spot detection
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/408Radar; Laser, e.g. lidar
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/22Psychological state; Stress level or workload
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/225Direction of gaze
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/229Attention level, e.g. attentive to driving, reading or sleeping
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/30Driving style
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/20Static objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/40Dynamic objects, e.g. animals, windblown objects
    • B60W2554/402Type
    • B60W2554/4029Pedestrians
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/80Spatial relation or speed relative to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/60Traffic rules, e.g. speed limits or right of way
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2556/45External transmission of data to or from the vehicle
    • B60W2556/65Data transmitted between vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Traffic Control Systems (AREA)

Abstract

A cognitive driver assistance system (10) includes an object detection device (18), an operator detection device (22), and a controller (20). The object-detection device (18) is operable to detect when an object (16) is proximate to the host-vehicle (14). An operator-detection device (22) is operable to determine when an operator (12) of the host-vehicle (14) is aware of the object (16). The controller (20) is configured to output an alert signal (24) for an operator (12) of the host vehicle (14) when the object detection device (18) detects the object (16). The alarm signal (24) is characterized by a variable alarm intensity (28). The controller (20) is configured to increase the alert intensity (28) when the operator (12) is unaware of the object (16).

Description

Cognitive driver assistance with variable alerts for automated vehicles
Technical Field
The present disclosure relates generally to cognitive driver assistance systems and, more particularly, to systems that output alerts at increased intensity when an operator of a vehicle is unaware of an object approaching the vehicle.
Background
It is known to equip a vehicle with a system that warns an operator of an object approaching the host vehicle driven by the operator, or that takes over control of the host vehicle from the operator to avoid collision with an object approaching the host vehicle. However, in some cases, if the operator is alert and fully aware of the presence/location of an object, an alarm or take over control may be unnecessary and/or tedious.
Disclosure of Invention
Described herein is a cognitive driver assistance system that changes the warning intensity of a warning or changes the degree to which the system takes over control of a host vehicle driven by an operator. The intensity of the alarm and the authority to take over are determined from a measure of the extent to which the operator is aware of a particular object in proximity to the host vehicle or in the path of travel of the host vehicle. For example, if the operator appears tired or inattentive, the alert intensity of the alert may be increased to wake the operator, and/or the amount of operator authority to allow the operator to manually operate the host-vehicle may be limited, such that automated control provided for automated vehicle operation may override the manual control operated by the operator and temporarily take over control of the host-vehicle. Note that the automated operation of the host vehicle includes a wide range of options, from partial automation in which, for example, only speed control is automated to full automation (i.e., autonomous operation) in which the operator of the host vehicle participates in the operation of the host vehicle as much as the passenger.
According to one embodiment, a cognitive driver assistance system is provided. The system includes an object detection device, an operator detection device, and a controller. The object-detection device is operable to detect when an object is proximate to the host-vehicle. The operator-detection device is operable to determine when an operator of the host-vehicle is aware of the object. The controller is configured to output an alarm signal for an operator of the host vehicle when the object detection device detects an object. The alarm signal is characterized by a variable alarm intensity. The controller is configured to increase the alarm intensity when the operator is unaware of the object.
Other features and advantages will appear more clearly on reading the following detailed description of preferred embodiments, which are given by way of non-limiting example only and with reference to the accompanying drawings.
Drawings
The invention will now be described, by way of example, with reference to the accompanying drawings, in which:
FIG. 1 is a diagram of a cognitive driver assistance system according to one embodiment;
FIG. 2 is an exemplary traffic situation experienced by the system of FIG. 1, according to one embodiment;
FIG. 3 is an exemplary traffic situation experienced by the system of FIG. 1, according to one embodiment;
FIG. 4 is an exemplary traffic situation experienced by the system of FIG. 1, according to one embodiment;
FIG. 5 is an exemplary traffic situation experienced by the system of FIG. 1, according to one embodiment; and
FIG. 6 is an exemplary traffic situation experienced by the system of FIG. 1, according to one embodiment.
Detailed Description
Fig. 1 shows a non-limiting example of a cognitive driver assistance system 10 (hereinafter system 10). In general, the system 10 is configured to assist the operator 12 in manually operating the host-vehicle 14 based on the cognitive state of the operator 12 with respect to the object 16 proximate to the host-vehicle 14. As described in more detail below, the level of assistance provided by the system 10 to the operator 12 may vary from as simple as something that illuminates an alarm indicator when an object 16, such as another vehicle, is present in the so-called blind spot of the operator 12, to something that is complex to take over full control of the host-vehicle 14 (i.e., completely override the operator 12) to avoid a collision with the object 16. The system 10 is described herein as having an advantage over prior art driver assistance systems in that the system 10 takes into account the cognitive state of the operator 12 so that the level of assistance necessary to assist the operator 12 can be determined. For example, if the operator 12 is not aware of a particular object associated with an alarm, the loudness of the audible alarm indicator may be increased.
Accordingly, the system 10 includes an object-detection device 18 operable or operable to detect when an object 16 is proximate to the host-vehicle 14. The object-detection device 18 may include, but is not limited to, a camera, a radar unit, and/or a lidar unit suitably configured to detect various objects around the host-vehicle 14. By way of further example and not limitation, a camera may be used to capture images of objects such as other vehicles, buildings, road signs, pedestrians, lane markings, road hazards, architectural area markings, and other objects proximate to the host-vehicle 14 or disposed about the host-vehicle 14.
The information from the camera may be combined with detection information from the radar unit and/or lidar unit to form a two-dimensional or three-dimensional map of various objects in the area surrounding the host-vehicle 14. Information collected by operation of the object detection device 18 may be provided to the controller 20 for further analysis. That is, the object-detecting device 18 may not be able to actually determine the location or classification of the object 16 by itself. Typically, this task falls to the controller 20, but this is not a requirement of the system 10. In other words, either the object detection device 18 or the controller 20 may perform the data or signal processing necessary to determine the relative position or classification of the object 16.
The object detection device 18 may also include a vehicle-to-vehicle (V2V) transceiver. If the object 16 is another vehicle that is also equipped with a V2V transceiver, the system 10 can notify the operator 12 that another vehicle is approaching, even if the operator 12 cannot see the other vehicle because the line of sight between the two vehicles is obstructed.
System 10 may be configured to classify object 16 based on signals received from object detection device 18. For example, if the object 16 is a pedestrian walking perpendicular to the direction of travel of the host-vehicle 14, the signal from the lidar unit or the radar unit may have a unique signature due to the alternating motion of the legs of the pedestrian. Similarly, radar returns reflected from a moving vehicle may include minor fluctuations due to rotational motion of the wheels of the moving vehicle. This information may optionally be combined with other known image processing techniques to classify the object as, for example, a pedestrian, another vehicle, a building area marker, an animal, a road obstacle, etc. It is also possible to use information about the movement of the object 16 to classify the object 16 and to assign parameters to the object 16 related to the movement, such as speed, trajectory, acceleration/deceleration, etc. As such, the object-detection device 18 is operable to detect when the object 16 is approaching, i.e., approaching, or otherwise approaching the travel path of the host-vehicle 14 within the travel path.
It should be apparent to those skilled in the art that the controller 20 may include a processor (not specifically shown), such as a microprocessor or other control circuitry, such as analog and/or digital control circuitry, including an Application Specific Integrated Circuit (ASIC) for processing data. The controller 20 may include memory (not specifically shown), including non-volatile memory, such as electrically erasable programmable read-only memory (EEPROM), for storing one or more routines, thresholds, and collected data. The one or more routines may be executed by the processor to perform steps for processing signals received by the controller 20 to operate the host-vehicle 14 as described herein.
The system 10 also includes an operator-detection device 22 operable or useful for determining when the operator 12 of the host-vehicle 14 is aware of the object 16. Operator-detection device 22 may include a camera configured to take images of operator 12 in the visible and/or infrared spectrum, and a light source that emits light in appropriate portions of the spectrum to enable the camera to see operator 12 regardless of ambient lighting conditions. The image of the operator 12 may be processed/analyzed by the operator-detection device 22 or the controller 20 to, for example, determine whether the eyes of the operator 12 are closed (closure indicating that the operator 12 is sleeping), determine whether the head pose of the operator is changing in a manner that indicates fatigue of the operator 12, and/or determine whether the eye gaze direction of the operator 12 indicates that the operator 12 has or has not seen the object 16. Image processing techniques are well known that determine the cognitive state of the operator 12, such as where the operator is looking (eye gaze direction) and/or whether the operator 12 is alert (eye blinking, head pose change).
If it is observed or determined via operator detection device 22 that the eye gaze direction of operator 12 is not in a direction that allows operator 12 to see object 16 directly, via mirrors, or via peripheral vision, then that may be an indication that operator 12 is not aware of object 16. If the system 10 determines that the operator 12 is unaware of the object 16 and that the relative position of the object 16 with respect to the host-vehicle 14 is such that a collision or conflict is likely, the system 10 may take various actions to assist the operator 12 in avoiding a collision or conflict with the object 16. As used herein, a collision with an object 16 means that the trajectories of the host-vehicle 14 and the object 16 are such that a collision may occur if either is not altered. By way of example and not limitation, a conflict occurs when the object 16 is another vehicle traveling in a lane beside the host-vehicle 14 and in the blind spot of the operator 12, and the operator 12 operates the host-vehicle 14 in a manner that causes the other vehicle to turn to avoid a collision. That is, no collision occurs, but a collision is avoided due to the action of another vehicle to avoid a collision with the own vehicle 14.
In one embodiment of the system 10, the controller 20 may be configured to output an alert signal 24 to the operator 12 of the host-vehicle 14 when the object 16 is detected by the object-detection device 18. The alert signal 24 is provided to an alert device 26. the alert device 26 may include, for example, a visual alert device (e.g., an illuminated indicator or highlight region of a reconfigurable display), an audible alert device (e.g., a buzzer or speaker), and/or a tactile alert device (e.g., a vibrating device located in the seat or steering wheel of the host vehicle 14).
In the present embodiment, the alarm signal 24 is characterized by a variable alarm intensity 28. For example, the intensity of the alert of the alerting device 26 can be increased by increasing the loudness of the audible alert, increasing or blinking the highlighting intensity of the visual alert, and/or combining two or more of the types of alerts available from the alerting device 26 simultaneously. It is envisaged that the alarm intensity 28 may be initially set to zero or none, such that no alarm is given, i.e. no alarm means are activated, and increasing the alarm intensity 28 corresponds to changing from no alarm being given to some alarm being given. That is, not requiring an increase in the alert intensity 28 necessarily means that the initial alert intensity is not zero or none.
The system 10 described herein is an improvement over prior art systems in that the controller 20 is configured to increase the alert intensity 28 when the operator 12 is not aware of the object 16. That is, rather than issuing an alarm at the same intensity when the operator 12 is alert and aware of the object 16, and when the operator 12 is drowsy and not aware of the object 16, the system 10 varies the alarm intensity 28 based on the cognitive state of awareness of the operator 12, and in particular whether the operator 12 is aware of the presence of the object 16. Several specific traffic scenarios are described later in this document, which will make the advantages of the system 10 described herein readily apparent.
In another embodiment, the system 10 includes a control override device 30 operable to limit operator authority 32 of the operator 12 while the operator 12 is driving the host-vehicle 14. As used herein, "limiting operator authority" means limiting the ability of an operator to manually control some aspect of the operation of the host-vehicle 14, i.e., preventing or to some extent limiting the ability of the operator 12 to fully manually control the host-vehicle 14. The controller 20 instructs to limit the operator authority 32 by setting the operator authority 32 to an authority other than "full authority". The controller 20 replaces manual control of the host vehicle 14, in whole or in part, by activating the control override device 30. By way of example and not limitation, the control override device 30 may include one or more of a steering override device 34, an accelerator override device 36, and a brake override device 38.
By way of further example, the steering override device 34 may be operated by the controller 20 to override steering wheel inputs from the operator 12 to prevent the operator 12 from making a lane change because the object detection device 18 has detected another vehicle in the vicinity of the host-vehicle 14 and would cause a collision if a lane change were made. Similarly, the steering override device 34 may be operated by the controller 20 to steer the host vehicle 14 in place of the operator 12 holding the steering wheel in a fixed position so as to avoid certain debris in the driving lane of the host vehicle 14.
In one non-limiting configuration, the steering override device 34 may apply a force to the steering system of the host-vehicle 14 that physically overrides any attempt by the operator 12 to affect steering of the host-vehicle 14. This configuration may be preferred when there is an uninterruptible mechanical connection between the steering wheel used by the operator 12 to steer the host-vehicle 14 and the steered wheels (e.g., front wheels) of the host-vehicle 14. In alternative constructions, the steering system may include a steering clutch operable to mechanically decouple the steering wheel from the front wheels, or the steering system may be a steer-by-wire type system, such that steering wheel rotations by the operator 12 may be readily ignored.
As described in the examples above and in other examples given below, where the operator 12 is unaware of the presence of the object 16 and a collision or conflict may occur, what the operator 12 indicates for the desired operation of the host-vehicle 14 may be limited or ignored in favor of operating the host-vehicle 14 in accordance with the controller 20. That is, the controller 20 may be configured to operatively control the override device 30 to override the operator 12 in accordance with the operator authority 32 to avoid conflict with the object 16 when the operator 12 is unaware of the object 16.
Fig. 1 shows that there are two levels of permissions: full rights and restricted rights. However, many levels of partial authority are contemplated, and the specified level will be based on periodic observations of the operator by the operator detection device 22. It is also contemplated that the actions of providing an alert to operator 12 and overriding the effort of operator 12 to manually control the host-vehicle may be combined. For example, when the controller 20 determines that the operator 12 is not aware of the object 16, the controller 20 may first activate the alert device 26 at a lower level of alert intensity 28, and then increase the alert intensity 28 to a higher level before the controller 20 determines to limit the operator's privileges 32 by activating the control override device 30.
The controller 20 may also be configured to determine an operator behavior characteristic 40 of the operator 12 based on previous traffic maneuvers 42 performed by the operator 12. As used herein, the operator behavior characteristics 40 are used to characterize the driving habits or driving style of the operator 12. The operator behavior characteristics 40 may include or relate to, but are not limited to, how fast the operator 12 is driving relative to the published speed limit, i.e., how many miles per hour the operator 12 typically travels over or under the published speed limit. Other examples include how fast the operator 12 accelerates from a stop, how fast the operator 12 decelerates to a stop when approaching an intersection, how often the operator 12 looks at the rear and side mirrors or otherwise scans the area near the host-vehicle 14, and how long the operator 12 activates the turn signal before making a lane change. Controller 20 may calculate a previous object detection score 44 based on a percentage of time that operator 12 appears to have actually detected the presence of an object detected and/or tracked by system 10.
The controller 20 may also be configured to determine a collision risk 46 indicative of a probability of collision between the host-vehicle 14 and the object 16. As used herein, "probability of collision" includes, but is not limited to, an estimate of the probability of an actual collision, and/or an estimate of the probability of some change in the observed behavior of the operator 12, the host-vehicle 14, or some other vehicle (or object) in proximity to the host-vehicle 14 necessary to avoid a collision. The controller 20 may determine the alert intensity 28 and/or the operator authority 32 based on the previous traffic maneuver 42 and the risk of collision 46. Examples of various traffic situations are provided next to further explain how the controller 20 described thus far operates to assist the operator 12 in operating the host-vehicle 14.
FIG. 2 illustrates a non-limiting example of a truck 48 traveling on an approaching road 50 where the truck 48 is traveling slower than the host-vehicle 14 and in the same lane, and thus the host-vehicle 14 may be about to overtake the truck 48. In this example, the object 16 is another vehicle 52 that is traveling faster than the host-vehicle 14 and is in a lane in which the host-vehicle 14 may be used beyond the truck 48. The operator-behavior characteristics 40 observed by the controller 20 may include an indication that the operator 12 tends to slow down as it approaches another vehicle in front of the host-vehicle 14, rather than maintaining a constant speed and making a lane change in time. Also, while the operator 12 is performing a lane change, the controller 20 may be configured to measure the time it takes the operator 12 to complete the lane change. That is, the operator behavior characteristics 40 may include a lane change duration (not shown) stored in the controller 20 and based on a previous lane change (previous traffic maneuver 42) performed by the operator 12.
Thus, the risk of collision 46 may include an estimate of the time to collision 54 left for a collision between another vehicle 52 and the host-vehicle 14. The controller 20 may be configured to determine the alert intensity 28 based on a comparison of the lane change duration to the time left 54 for the conflict to occur. For example, the loudness of the alert may increase as the time left 54 (FIG. 1) for the conflict to occur decreases while the operator 12 appears to be considering lane changes. Alternatively, or in combination with changing the alert intensity 28, the controller 20 may limit the operator authority 32 when another vehicle 52 is approaching too quickly and prevent the operator 12 from changing lanes beyond the truck 48 to avoid significant collisions.
With continued reference to another example of FIG. 2, the object 16 may be another vehicle 56 traveling in a so-called blind spot of the operator 12 of the host vehicle. The operator-behavior characteristics 40 may include a measure of a lane-position-change 58 of the host-vehicle 14 as the host-vehicle 14 is steered by the operator 12. The controller 20 may also determine similar characteristics of the other vehicle 56 based on a previous travel path 59 of the other vehicle 56. The determination of the risk of collision 46 by the controller 20 may include determining a probability of collision (not specifically shown) between another vehicle 56 and the host-vehicle 14 when the other vehicle 56 is alongside the host-vehicle 14. That is, the controller 20 may estimate the risk of a collision occurring due to the host-vehicle 14 and/or another vehicle 56 traveling.
If the vehicle is not traveling and the operator 12 is aware of another vehicle 56, the controller 20 may issue an alert with a lower intensity blind spot alert. However, if the estimated probability of collision is greater than a risk threshold (not shown) stored in the controller 20, the controller 20 may increase the alert intensity 28 by making the audible alert louder and/or displaying a message on the display to indicate that the operator 12 is over-traversing when another vehicle 56 approaches the host-vehicle 14. Alternatively, or in combination with increasing the alert intensity 28, the controller 20 may limit the operator authority 32 and prevent the operator 12 from traversing by providing some steering damping to the steering system via the steering override device 34 in an attempt to reduce the value of the lane position change 58.
FIG. 3 illustrates another non-limiting example in which the host-vehicle 14 is traveling on a road 60 and the object 16 is stationary at a location in the path of travel 62 of the host-vehicle 14. For example, the object 16 may be debris 64 dropped from a truck (not shown) previously traveling on the roadway 60. The controller 20 may be further configured to estimate a time remaining for the host-vehicle 14 to impact the object 16 (debris 64) (FIG. 1). It is contemplated that the time to impact 66 is calculated based on an assumption that the host vehicle continues along the travel path 62 without a change in speed or trajectory.
If the time left until impact occurs is long, such as greater than five seconds, the controller 20 may set the alert intensity 28 to be relatively low and illuminate only indicators that may be observed by the operator 12 of the host-vehicle 14. However, if the time left for impact 66 is less than a time threshold (not shown) stored in the controller 20, such as less than 2 seconds, and/or the gaze direction of the operator 12 indicates that the operator is not aware of the debris 64, the controller 20 may increase the alert intensity 28 by additionally activating an audible alert and/or activating a haptic device to vibrate the seat of the operator 12. Alternatively, or in combination with increasing the alert intensity 28, the controller 20 may restrict the operator's authority 32, activate the steering override device 34, and operate the steering override device 34 to avoid the object 16 when the operator 12 is unaware of the object 16.
With continued reference to fig. 3, the object 16 may be a pedestrian or animal 68 proximate the travel path 62 of the host-vehicle 14. The controller 20 may be further configured to estimate a time-to-impact 66 based on the speed or relative trajectory of the pedestrian or animal 68 and the host-vehicle 14. If the object is a pedestrian (e.g., a person), the gaze direction of the pedestrian may be determined using the camera of the object detection device 18 to determine whether the pedestrian is aware of the host-vehicle 14. The controller 20 may increase the alert intensity 28 when the time remaining for impact 66 is less than a time threshold (e.g., 2 seconds) and the operator 12 is not aware of the pedestrian or animal 68. Alternatively, or in combination with increasing the alert intensity 28, the controller 20 may activate or operate the brake override device 38 and/or the accelerator override device 36 to stop the host vehicle 14 when the operator 12 is unaware of the pedestrian or animal 68.
FIG. 4 illustrates another non-limiting example in which the host-vehicle 14 is traveling on a road 70 and the object 16 is a traffic light 72 on a path of travel 74 of the host-vehicle 14. The controller 20 (fig. 1) may be further configured to: if the operator 12 does not initiate braking and stop the host-vehicle at the intersection 78, the time-to-violation 76 (FIG. 1) of the traffic light 72 by the host-vehicle 14 is estimated, and the alert intensity 28 is increased when the time-to-violation 76 is less than a time threshold (e.g., three seconds) and the operator 12 is not aware of the object 16 (traffic light 72). It is contemplated that the threshold time may vary based on the current travel speed of the host-vehicle 14, e.g., for greater travel speeds, the threshold time may be greater. Alternatively, or in combination with increasing the alert intensity 28, the controller 20 may activate or operate the brake override device 38 and/or the accelerator override device 36 to stop the host-vehicle 14 prior to entering the intersection 78 when the operator 12 is unaware of the traffic light 72.
Fig. 5 shows another non-limiting example in which the host-vehicle 14 is traveling on a road 80 and the object 16 is another vehicle 82 approaching an intersection 84 via an intersection lane 86 of the intersection 84. In this situation, the host vehicle 14 is stopped and ready to enter the intersection 84 to begin turning or straight-driving. There is no need to stop traffic on the intersecting lane 86, so if the host-vehicle 14 continues to enter the intersection 84 before another vehicle 82 reaches the intersection 84, the time left until a collision occurs (FIG. 1) and/or the time left until a collision 66 should be considered. Preferably, the control override device 30 includes an accelerator override device 36, and the controller 20 may operate the accelerator override device 36 to prevent the operator 12 from entering the intersection 84 when the operator 12 is unaware of another vehicle 82. Alternatively, or in combination with operating the brake override device 38, the controller 20 may increase the alert intensity 28 when the operator 12 is unaware of the other vehicle 82, and/or the controller 20 may activate or operate the accelerator override device 36 to move the host-vehicle 14 away from the illustrated position.
An alternative scenario associated with fig. 5 is when the host vehicle 14 is stopped and ready to turn right as shown, and there is a bicycle (not shown) approaching the intersection behind the host vehicle 14. The system 10 may determine that the bicycle would collide or conflict with the host-vehicle 14 if a right turn were initiated and increase the alert intensity 28 before the conflict occurs.
Fig. 6 shows another non-limiting example in which the host vehicle 14 is traveling on a road 90 and the object 16 is a train 92 approaching a railroad highway intersection 94 of the road 90. The control override device 30 advantageously includes a brake override device 38, and the controller 20 operates the brake override device 38 to prevent the operator 12 from stopping at the railroad road intersection 94 when the operator 12 is unaware of the train 92. It is contemplated that the host vehicle 14 may need to continue to travel and contact the stopped vehicle 96 to avoid being hit by the train 92. Alternatively, or in combination with operating the accelerator override device 36, the controller may increase the alert intensity 28 when the operator 12 is not aware of the train 92, and/or the controller 20 may activate or operate the brake override device 38 to maintain the host vehicle 14 at the illustrated position.
Accordingly, a cognitive driver assistance system (system 10) and a controller 20 for the system 10 are provided. The controller 20 is capable of determining the cognitive state of the operator 12, such as determining when the operator is alert and aware of objects disposed around the host-vehicle 14, and when the operator is not alert and aware of a particular object (object 16). If the controller 20 determines that some action is being taken by the operator 12 other than the action that the operator is doing when the operator is unaware of the object 16, the controller may increase the alert intensity 28 of the alert provided to the operator 12 and/or take over control of the host-vehicle 14 in whole or in part and operate the host-vehicle 14 to avoid a collision or conflict with the object 16.
While the present invention has been described with respect to the preferred embodiments thereof, it is not intended to be limited thereto, but rather only to the extent set forth in the following claims.

Claims (5)

1. A cognitive driver assistance system (10), the system (10) comprising:
an object detection device (18) operable to detect when an object (16) is proximate to the host-vehicle (14);
an operator-detection device (22) operable to determine when an operator (12) of the host-vehicle (14) is aware of the object (16); and
a controller (20) configured to output an alert signal (24) for the operator (12) of the host-vehicle (14) when the object (16) is detected by the object-detection device (18), the alert signal (24) characterized by a variable alert intensity (28), wherein the controller (20) is configured to increase the alert intensity (28) when the operator (12) is unaware of the object (16);
wherein the controller (20) is further configured to: determining an operator behavior characteristic (40) of the operator (12) based on a previous traffic maneuver (42) performed by the operator (12); and determining the alert intensity (28) based on the previous traffic maneuver (42) and a collision risk (46) indicative of a probability of collision between the host-vehicle (14) and the object (16); and wherein the object (16) comprises another vehicle (52), the operator-behavior characteristic (40) comprises a lane-change duration based on a previous lane change performed by the operator (12), the collision risk (46) comprises an estimate of a time-to-collision (54) remaining for a collision between the other vehicle (52) and the host-vehicle (14), and the alert intensity (28) is determined in part by comparing the lane-change duration and the time-to-collision (54).
2. The system (10) in accordance with claim 1, wherein the operator-behavior characteristic (40) includes a lane-position-change (58) of the host-vehicle (14) as the host-vehicle (14) is steered by the operator (12), the risk of collision (46) includes a probability of collision between the host-vehicle (14) and the other-vehicle (52) when the other-vehicle (52) is beside the host-vehicle (14), and the alert intensity (28) is determined in part by comparing the probability of collision to a risk threshold.
3. The system (10) in accordance with claim 1, wherein the object (16) comprises a stationary object at a location in a travel path (62) of the host-vehicle (14), said controller (20) further configured to estimate a time-to-collision (66) of the host-vehicle (14) with the object (16), and increase the alert intensity (28) when the time-to-collision (66) is less than a time threshold and the operator (12) is unaware of the object (16).
4. The system (10) in accordance with claim 1, wherein the object (16) includes a pedestrian or animal (68) proximate a travel path (62) of the host vehicle (14), the controller (20) further configured to estimate a time-to-impact (66) of the host vehicle (14) with the pedestrian or animal (68), and increase the alert intensity (28) when the time-to-impact (66) is less than a time threshold and the operator (12) is not aware of the pedestrian or animal (68).
5. The system (10) in accordance with claim 1, wherein the object (16) comprises a traffic light (72) of a travel path (62) of the host-vehicle (14), the controller (20) further configured to estimate a time-to-violation (76) of the traffic light (72) by the host-vehicle (14), and increase the alert intensity (28) when the time-to-violation (76) is less than a time threshold and the operator (12) is unaware of the object (16).
CN201680036887.7A 2015-06-24 2016-05-18 Cognitive driver assistance with variable alerts for automated vehicles Active CN107810127B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011083810.XA CN112158132A (en) 2015-06-24 2016-05-18 Cognitive driver assistance with variable alerts for automated vehicles

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/748,522 US9493118B1 (en) 2015-06-24 2015-06-24 Cognitive driver assist with variable warning for automated vehicles
US14/748,522 2015-06-24
PCT/US2016/032987 WO2016209423A1 (en) 2015-06-24 2016-05-18 Cognitive drive assist with variable warning for automated vehicles

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202011083810.XA Division CN112158132A (en) 2015-06-24 2016-05-18 Cognitive driver assistance with variable alerts for automated vehicles

Publications (2)

Publication Number Publication Date
CN107810127A CN107810127A (en) 2018-03-16
CN107810127B true CN107810127B (en) 2020-11-03

Family

ID=57234818

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201680036887.7A Active CN107810127B (en) 2015-06-24 2016-05-18 Cognitive driver assistance with variable alerts for automated vehicles
CN202011083810.XA Pending CN112158132A (en) 2015-06-24 2016-05-18 Cognitive driver assistance with variable alerts for automated vehicles

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202011083810.XA Pending CN112158132A (en) 2015-06-24 2016-05-18 Cognitive driver assistance with variable alerts for automated vehicles

Country Status (4)

Country Link
US (1) US9493118B1 (en)
EP (1) EP3313706B1 (en)
CN (2) CN107810127B (en)
WO (1) WO2016209423A1 (en)

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE112014007241T5 (en) * 2014-12-09 2017-09-28 Mitsubishi Electric Corporation Collision Risk Calculator, Collision Risk Indicator and Vehicle Body Controller
US9878663B1 (en) * 2016-12-07 2018-01-30 International Business Machines Corporation Cognitive dialog system for driving safety
JP6778872B2 (en) * 2016-06-28 2020-11-04 パナソニックIpマネジメント株式会社 Driving support device and driving support method
US10852725B2 (en) * 2016-06-29 2020-12-01 Faraday & Future Inc. Activate/deactivate functionality in response to environmental conditions
US10260898B2 (en) * 2016-07-12 2019-04-16 Toyota Motor Engineering & Manufacturing North America, Inc. Apparatus and method of determining an optimized route for a highly automated vehicle
US10543852B2 (en) * 2016-08-20 2020-01-28 Toyota Motor Engineering & Manufacturing North America, Inc. Environmental driver comfort feedback for autonomous vehicle
US11423783B2 (en) * 2016-08-30 2022-08-23 Hyundai Motor Company Apparatus and method for implementing LCDAS
US10832148B2 (en) 2016-12-07 2020-11-10 International Business Machines Corporation Cognitive dialog system for driving safety
KR101996419B1 (en) * 2016-12-30 2019-07-04 현대자동차주식회사 Sensor integration based pedestrian detection and pedestrian collision prevention apparatus and method
KR101996418B1 (en) * 2016-12-30 2019-07-04 현대자동차주식회사 Sensor integration based pedestrian detection and pedestrian collision prevention apparatus and method
US20180208203A1 (en) * 2017-01-26 2018-07-26 International Business Machines Corporation System, method and computer program product for braking control when approaching a traffic signal
EP3372465B1 (en) * 2017-03-10 2022-08-24 The Hi-Tech Robotic Systemz Ltd Method and system for vehicle status based advanced driver assistance
JP7016351B2 (en) * 2017-03-31 2022-02-14 本田技研工業株式会社 In-vehicle devices, information management servers, information management systems, and methods
US10377377B2 (en) * 2017-06-08 2019-08-13 GM Global Technology Operations LLC Active lane positioning for blind zone mitigation
EP3456599A1 (en) * 2017-09-18 2019-03-20 The Hi-Tech Robotic Systemz Ltd Monitoring drivers and external environment for vehicles
EP3474253B1 (en) * 2017-10-20 2024-04-10 Honda Research Institute Europe GmbH Gaze-guided communication for assistance in mobility
GB2568504B (en) * 2017-11-17 2020-05-06 Jaguar Land Rover Ltd Controller and method
US10471968B2 (en) * 2018-01-12 2019-11-12 Ford Global Technologies, Llc Methods and apparatus to facilitate safety checks for high-performance vehicle features
EP3540710A1 (en) * 2018-03-14 2019-09-18 Honda Research Institute Europe GmbH Method for assisting operation of an ego-vehicle, method for assisting other traffic participants and corresponding assistance systems and vehicles
CN108725441A (en) * 2018-05-28 2018-11-02 深圳创维汽车智能有限公司 Monitoring method, device and the computer readable storage medium of vehicle traveling
DE102018208935A1 (en) * 2018-06-06 2019-12-12 Continental Automotive Gmbh Driver stress level analysis device for a vehicle
CN109094457B (en) * 2018-07-16 2021-09-14 武汉理工大学 Vehicle anti-collision early warning system and method considering peripheral vision of driver
CN109334666B (en) * 2018-08-09 2020-06-05 智车优行科技(北京)有限公司 Lane changing assisting method and system and vehicle with system
CN109204307B (en) * 2018-10-30 2020-06-23 吉林大学 Method, storage medium and system for acquiring self-adaptive anti-collision early warning distance
US10807605B2 (en) 2018-12-19 2020-10-20 Waymo Llc Systems and methods for detecting and dynamically mitigating driver fatigue
US10553118B1 (en) 2019-01-31 2020-02-04 StradVision, Inc. Method and device for learning generating lane departure warning (LDW) alarm by referring to information on driving situation to be used for ADAS, V2X or driver safety required to satisfy level 4 and level 5 of autonomous vehicles
FR3097820B1 (en) * 2019-06-25 2021-08-20 Valeo Vision METHOD OF PREVENTING A COLLISION OF A MOTOR VEHICLE WITH AN OBJECT IMPLEMENTING A LIGHT MODULE
EP3795441A1 (en) 2019-09-17 2021-03-24 Aptiv Technologies Limited Method and device for determining an estimate of the capability of a vehicle driver to take over control of a vehicle
CN113370990A (en) * 2020-03-10 2021-09-10 华为技术有限公司 Driving assistance method and driving assistance device
CN111619479B (en) * 2020-05-20 2022-03-01 重庆金康赛力斯新能源汽车设计院有限公司 Driving takeover prompting method, device and system, vehicle-mounted controller and storage medium
US11597408B2 (en) 2020-07-09 2023-03-07 Aptiv Technologies Limited Vehicle control system
JP2022140032A (en) * 2021-03-12 2022-09-26 本田技研工業株式会社 Driving support device and vehicle
WO2023012671A1 (en) * 2021-08-02 2023-02-09 Mobileye Vision Technologies Ltd. Vulnerable road user (vru) collision avoidance system
CN114506344B (en) * 2022-03-10 2024-03-08 福瑞泰克智能系统有限公司 Method and device for determining vehicle track

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102656613A (en) * 2009-12-18 2012-09-05 本田技研工业株式会社 A predictive human-machine interface using eye gaze technology, blind spot indicators and driver experience
CN103370252A (en) * 2011-02-18 2013-10-23 本田技研工业株式会社 System and method for responding to driver behavior
CN103448719A (en) * 2012-06-01 2013-12-18 通用汽车环球科技运作有限责任公司 Neuro-cognitive driver state processing
CN104093618A (en) * 2012-01-13 2014-10-08 脉冲函数F6有限公司 Apparatus, system and method for risk indicator calculation for driving behaviour and for reconstructing a vehicle trajectory

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2970384B2 (en) * 1993-11-24 1999-11-02 トヨタ自動車株式会社 Drowsy driving detection device
US6470273B2 (en) * 2000-11-08 2002-10-22 Milton Halsted Collision warning system
US7510038B2 (en) * 2003-06-11 2009-03-31 Delphi Technologies, Inc. Steering system with lane keeping integration
US20080012697A1 (en) * 2006-07-14 2008-01-17 Smith Matthew R Vehicle light warning system and method
US7839292B2 (en) * 2007-04-11 2010-11-23 Nec Laboratories America, Inc. Real-time driving danger level prediction
US7719431B2 (en) * 2007-10-05 2010-05-18 Gm Global Technology Operations, Inc. Systems, methods and computer products for drowsy driver detection and response
DE102009017731A1 (en) 2008-04-30 2009-11-05 Continental Teves Ag & Co. Ohg Self-learning map based on environmental sensors
US20100007479A1 (en) * 2008-07-08 2010-01-14 Smith Matthew R Adaptive driver warning methodology
TWI335280B (en) * 2008-10-14 2011-01-01 Univ Nat Taiwan Image security warning system for vehicle use
US8599027B2 (en) * 2010-10-19 2013-12-03 Deere & Company Apparatus and method for alerting machine operator responsive to the gaze zone
US9050930B2 (en) * 2011-10-14 2015-06-09 Xerox Corporation Collision avoidance signal
EP2752348A1 (en) * 2013-01-04 2014-07-09 Continental Automotive Systems, Inc. Adaptive emergency brake and steer assist system based on driver focus
US9342074B2 (en) 2013-04-05 2016-05-17 Google Inc. Systems and methods for transitioning control of an autonomous vehicle to a driver
US8874301B1 (en) * 2013-07-09 2014-10-28 Ford Global Technologies, Llc Autonomous vehicle with driver presence and physiological monitoring
EP2848488B2 (en) * 2013-09-12 2022-04-13 Volvo Car Corporation Method and arrangement for handover warning in a vehicle having autonomous driving capabilities
US20150158495A1 (en) * 2013-12-05 2015-06-11 Elwha Llc Systems and methods for reporting characteristics of operator performance

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102656613A (en) * 2009-12-18 2012-09-05 本田技研工业株式会社 A predictive human-machine interface using eye gaze technology, blind spot indicators and driver experience
CN103370252A (en) * 2011-02-18 2013-10-23 本田技研工业株式会社 System and method for responding to driver behavior
CN104093618A (en) * 2012-01-13 2014-10-08 脉冲函数F6有限公司 Apparatus, system and method for risk indicator calculation for driving behaviour and for reconstructing a vehicle trajectory
CN103448719A (en) * 2012-06-01 2013-12-18 通用汽车环球科技运作有限责任公司 Neuro-cognitive driver state processing

Also Published As

Publication number Publication date
US9493118B1 (en) 2016-11-15
EP3313706A1 (en) 2018-05-02
CN112158132A (en) 2021-01-01
EP3313706A4 (en) 2019-02-27
WO2016209423A1 (en) 2016-12-29
CN107810127A (en) 2018-03-16
EP3313706B1 (en) 2021-08-25

Similar Documents

Publication Publication Date Title
CN107810127B (en) Cognitive driver assistance with variable alerts for automated vehicles
CN107787282B (en) Cognitive driver assistance with variable assistance for automated vehicles
JP6815048B2 (en) Autonomous driving control device and vehicle
US10710580B2 (en) Tailgating situation handling by an automated driving vehicle
EP3313703B1 (en) Automated vehicle control with time to take-over compensation
CN106945669B (en) Determine driver intention to avoid car crass at traffic cross-road
US9487139B1 (en) Determining a driver alert level for a vehicle alert system and method of use
JP5163991B2 (en) Vehicle speed control method in complex traffic situations
US10435022B2 (en) Adaptive cruise control system and vehicle comprising an adaptive cruise control system
EP3254919A1 (en) Adaptive cruise control system and vehicle comprising an adaptive cruise control system
US20170001636A1 (en) Automated Vehicle Response To Imminent Rear-End Collision
KR101999079B1 (en) Display device control method and display device
JP4876772B2 (en) Interrupting vehicle determination device
CN110626356A (en) Method and system for assisting a driver in preventive driving
KR20200017971A (en) Vehicle and method for controlling thereof
CN110712646A (en) Verification of vehicle operator awareness prior to transitioning from autonomous mode to manual mode
JP2004224093A (en) Automatic speed control device for vehicle
JP7484959B2 (en) Vehicle notification control device and vehicle notification control method
LeBlanc et al. Functional requirements for integrated vehicle-based safety system (IVBSS)–light vehicle platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant