EP3362308A1 - Method for examining a perception of a visual warning notice by a vehicle user, driver assistance system and motor vehicle - Google Patents

Method for examining a perception of a visual warning notice by a vehicle user, driver assistance system and motor vehicle

Info

Publication number
EP3362308A1
EP3362308A1 EP16775221.1A EP16775221A EP3362308A1 EP 3362308 A1 EP3362308 A1 EP 3362308A1 EP 16775221 A EP16775221 A EP 16775221A EP 3362308 A1 EP3362308 A1 EP 3362308A1
Authority
EP
European Patent Office
Prior art keywords
motor vehicle
visual
visual warning
warning notice
vehicle user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP16775221.1A
Other languages
German (de)
French (fr)
Inventor
Abdulsalam GIUMAA
Michael Burke
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Connaught Electronics Ltd
Original Assignee
Connaught Electronics Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Connaught Electronics Ltd filed Critical Connaught Electronics Ltd
Publication of EP3362308A1 publication Critical patent/EP3362308A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/25—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using haptic output
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B60K35/285—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver for improving awareness by directing driver's gaze direction or eye points
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/65—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
    • B60K35/658—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive the instruments being ergonomically adjustable to the user
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W50/16—Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1113—Local tracking of patients, e.g. in a hospital or private home
    • A61B5/1114—Tracking parts of the body
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/486—Biofeedback
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/743—Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/149—Instrument input by detecting viewing direction not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18—Information management
    • B60K2360/195—Blocking or enabling display functions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/60—Structural details of dashboards or instruments
    • B60K2360/65—Features of dashboards
    • B60K2360/658—Dashboard parts used as air ducts
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143—Alarm means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/225—Direction of gaze
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2720/00—Output or target parameters relating to overall vehicle dynamics
    • B60W2720/10—Longitudinal speed
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0181—Adaptation to the pilot/driver

Definitions

  • the invention relates to a method for examining a perception of a visual warning notice in a motor vehicle to a vehicle user of the motor vehicle by the vehicle user.
  • the invention also relates to a driver assistance system as well as to a motor vehicle with a driver assistance system.
  • the visual warning notice can for example be output by lighting up of an oil level indicator lamp in the motor vehicle. Therein, it can occur that the vehicle user does not perceive the visual warning notice. Thereby, the further operation of the motor vehicle possibly no longer properly proceeding is disadvantageous, whereby the safety of the motor vehicle and of other traffic participants can also be impaired.
  • this object is solved by a method, by a driver assistance system as well as by a motor vehicle having the features according to the respective independent claims.
  • a perception of a visual warning notice in a motor vehicle which is output to a vehicle user of the motor vehicle, by a vehicle user, is examined in particular by an evaluation system of the motor vehicle.
  • the visual warning notice is output in a predetermined position within the motor vehicle by means of an indicating element of the motor vehicle disposed in an interior of the motor vehicle, and a viewing direction of the vehicle user is captured by means of at least one camera of the motor vehicle.
  • a visual zone of the vehicle user in which the vehicle user perceives information, is determined based on the viewing direction. It is examined if the visual warning notice is within the visual zone.
  • the visual warning notice is assumed to be recognized by an evaluation system of the motor vehicle if the visual warning notice is within the visual zone.
  • the examination of the perception of the visual warning notice by the vehicle user can be considerably improved. It can be more effectively and reliably examined if the vehicle user has perceived the visual warning notice. It is no longer only output a warning notice without generating a statement about the perception probability of the warning notice by the vehicle user. Rather, now, it is basically also assessed if the vehicle user can perceive the warning notice at all or has perceived it. Thereto, based on specific manners of evaluation, it is estimated if perception could have been effected. Depending on these probability estimations, perception is then assumed or not.
  • the visual warning notice for example, an oil level indicator lamp, a navigation indication warning, a speed limit warning or another warning with respect to an operating state of the motor vehicle is output.
  • the visual warning notice is output by the indicating element in a predetermined position within the motor vehicle.
  • an oil level warning is to be output, it is for example indicated on the indicating element in the predetermined position.
  • the respective predetermined position of the indicating element can be inferred from the respective type of the visual warning notice.
  • the indicating element is in particular disposed on a dashboard of the motor vehicle or on a cockpit of the motor vehicle.
  • the capture of the viewing direction of the vehicle user by means of the camera can for example be effected by evaluating images captured by the camera.
  • orientation of a pupil of the vehicle user can for example be identified in the images.
  • the viewing direction of the vehicle user can then for example be determined.
  • the orientation of the pupil can for example be identified by a usual object recognition method from the field of machine vision.
  • the orientation of the pupil can also be tracked over multiple images provided by the camera, whereby change of the viewing direction of the vehicle user can also be identified.
  • the database can have eyes with different pupil orientations.
  • Each of these pupil orientations can then for example be linked to a certain viewing direction.
  • it can then be determined, to which eye from the database the captured eye best matches.
  • the viewing direction associated with the best matching eye from the database can then be assumed as the viewing direction of the vehicle user.
  • a matching method according to the principle of cross- correlation and/or mutual information can be used.
  • the viewing direction of the vehicle user can be also captured by means of several cameras of the motor vehicle.
  • the visual zone of the vehicle user can then be
  • the visual zone can for example be described as a field of view.
  • the field of view in the physiology and ophthalmology, one denotes all of central and peripheral points and objects of the exterior space, which can be visually perceived with steady, straight posture of the head and straight oriented, immobile view also without directly fixing them.
  • the visual zone can for example also be taken from a database, in which for example various visual zones are associated with various viewing directions.
  • the visual warning notice is within the visual zone.
  • a light signal radiated by the indicating element has effects to within the visual zone.
  • photons from the indicating element strike the visual zone of the vehicle user. If the examination reveals that the visual warning notice is within the visual zone, thus, the visual warning notice is assumed to be recognized by the vehicle user by the evaluation system. Thus, it can then be assumed that the vehicle user has perceived the visual warning notice.
  • the vehicle user becomes aware of the visual warning notice output by the indicating element by the perception.
  • the visual warning notice is assumed not to be recognized by the vehicle user by the evaluation system if the visual warning notice is outside of the visual zone, wherein an attention increase signal is then generated in the motor vehicle for the vehicle user.
  • the visual warning notice is outside of the visual zone if photons output by the indicating element do not enter the visual zone. Then, it can be assumed that the visual warning notice is not perceived by the vehicle user.
  • the attention increase signal is in particular generated in the motor vehicle for the vehicle user. By the attention increase signal, the attention of the vehicle user is to be directed to the visual warning notice.
  • the vehicle user is to be caused to perceive the visual warning notice based on the attention increase signal.
  • this can also be effected already in that the vehicle user thoroughly looks around in the interior of the motor vehicle after generating the attention increase signal to determine the reason for the generation of the attention increase signal.
  • the attention increase signal is visually and/or acoustically and/or haptically output.
  • the visual attention increase signal can for example be output by an illumination and/or illumination variation within the motor vehicle.
  • the acoustic attention increase signal can for example be output via an audio system of the motor vehicle.
  • a warning sound or a warning signal can for example be output in the motor vehicle as the acoustic attention increase signal.
  • a text with the exact background of the visual warning notice can also for example be output as the warning signal.
  • the visual warning notice can thereby for example be put in words and thereby be provided to the vehicle user by the words in acoustic manner.
  • vibration of a motor vehicle part in contact with the vehicle user can be provided as the haptic attention increase signal.
  • a steering wheel, a vehicle seat or a safety belt of the motor vehicle can be formed as the vibrating motor vehicle part.
  • the attention increase signal can thereby be variously output detectable by multiple senses of the vehicle user such that the perception can be more effectively and insistently effected.
  • a visual warning signal is output by means of an interior illumination of the motor vehicle as the attention increase signal.
  • the interior illumination in particular serves for illuminating the interior.
  • the interior illumination is usually formed by lamps in the vehicle roof in passenger cars with closed construction.
  • the interior illumination can for example be provided by festoon lamps and/or light emitting diodes (LEDs).
  • the interior illumination can for example also include a glovebox illumination and/or a trunk illumination.
  • a reading lamp can also be
  • the attention increase signal can be more effectively and insistently output.
  • the visual color signal is varied in the tint and/or in the brightness.
  • a characteristic of a color sensed as fundamental by the human is described by the tint.
  • the tint denotes the characteristic, according to which one differentiates color sensations for example according to red, yellow or green.
  • the attention increase signal can be more clearly and insistently output.
  • the human is particularly sensitive to tint variations and/or brightness variations in his visual zone.
  • the interior illumination is in particular configured such that light radiated by the interior illumination can arrive in all differently positioned visual zones of the vehicle user as possible.
  • the brightness is a generic term of subjective impressions and objective measurement parameters for the intensity of visual perception of visible light.
  • the attention increase signal can be more clearly and insistently generated for the vehicle user.
  • the interior illumination can also be configured in flashing manner. In the flashing configuration, the interior illumination is for example turned on and off in predetermined intervals, in particular in short intervals, for example below one second. Thereby, the attention increase signal can again be more effectively and insistently output such that the attention of the vehicle user is directed to the presence of the visual warning notice.
  • a safety relevance of the visual warning notice is determined and the tint of the visual warning signal is adjusted depending on the safety relevance.
  • the safety relevance can for example be characterized in how important the visual warning notice is for the safe operation of the motor vehicle.
  • it can for example be differentiated if a temperature of an engine of the motor vehicle is too high and the engine is in danger of overheating, whereby lasting damages to the engine and/or a cooling circuit of the motor vehicle can arise, or if the safety relevance is ranked low as it can for example be the case with absent wiping water liquid.
  • the tint can for example be only slightly varied with low safety relevance and be severely varied with high safety relevance.
  • a red tint can for example be output by the interior illumination.
  • the tint can for example be not varied at all or else only in fine shades such that the vehicle user is not frightened by the interior illumination and thereby is possibly distracted from the traffic scene. Thereby, the motor vehicle can be more safely operated.
  • a speed of the motor vehicle is adapted depending on the generation of the attention increase signal.
  • the visual warning notice is assumed not to be recognized by the vehicle user by the evaluation system and thereby the speed of the motor vehicle is adapted.
  • a currently valid speed limit for the motor vehicle is output during the travel of the motor vehicle by the visual warning notice and the vehicle user has not perceived this visual warning notice according to the evaluation system.
  • intervention in the speed of the motor vehicle can then be performed to for example keep the speed of the motor vehicle within the prescribed scope.
  • it can also be intervened in a control of the motor vehicle if the vehicle user has not perceived the visual warning notice according to the evaluation system.
  • the motor vehicle can be more safely operated.
  • the vehicle user is examined for wearing an eye cover, such as in particular for example, especially tinted, glasses, in particular if capturing the viewing direction of the vehicle user fails.
  • examination of the vehicle user for wearing the eye cover is performed.
  • the eye cover can for example be formed as sunglasses or eye patch.
  • the examination for wearing the eye cover can for example also be performed by an object recognition method from the field of machine vision.
  • the examination can for example be performed in predetermined time intervals or else only if capturing the viewing direction of the vehicle user fails.
  • the evaluation system can thus discontinue determining the viewing direction until wearing the eye cover is no longer detected.
  • An energy consumption of the evaluation system can therefore be kept lower and/or computing capacity of the evaluation system can thus be used for other applications.
  • an orientation of the head of the vehicle user is captured by means of the camera instead of the viewing direction and the visual zone is determined based on the orientation of the head, and it is examined if the visual warning notice is within the visual zone, wherein the visual warning notice is assumed to be recognized by the vehicle user by the evaluation system of the motor vehicle if the visual warning notice is within the visual zone.
  • the visual zone can be determined based on the orientation of the head.
  • the visual zone can also be determined if the vehicle user wears the eye cover. After determining the visual zone based on the orientation of the head, it can then again be examined if the visual warning notice is within the visual zone.
  • the vehicle user has perceived the visual warning notice. If the visual warning notice is outside of the visual zone determined based on the orientation of the head, the attention increase signal can then also again be generated and output, respectively. Thereby, the motor vehicle can also be more safely operated if the vehicle user wears the eye cover.
  • the visual warning notice is output by a warning lamp as the indicating element.
  • the warning lamp for example, an indicator lamp of the motor vehicle and/or another warning notice emitter in the interior of the motor vehicle can be described.
  • the warning lamp can for example be formed as an engine temperature indicator lamp or as an oil level indicator lamp.
  • the visual warning notice is output by means of the indicating element disposed in a cockpit of the motor vehicle.
  • the indicating element is therefore in particular disposed in the cockpit of the motor vehicle and not in an area of the interior, which cannot be seen at all by the vehicle user with usual viewing direction during travel. It is advantageous that the presentation of the perception of the visual warning notice can thereby be more appropriately adapted to the situation of the vehicle user during vehicle drive.
  • the invention relates to a driver assistance system for a motor vehicle including at least one camera and an evaluation system.
  • the driver assistance system is formed to perform a method according to the invention.
  • the evaluation system can for example be formed separately from the camera or else be integrated in the camera.
  • the camera is formed as a 3D camera, in particular as a plenoptic camera.
  • the vehicle user can be at least partially captured in three-dimensional manner by the 3D camera.
  • An image of the vehicle user captured by the 3D camera can for example thereby be provided with a depth value.
  • the viewing direction and/or the orientation of the head can be more precisely and reliably determined.
  • the 3D camera can be formed as a time-of-flight (TOF) camera or else as a plenoptic camera.
  • the plenoptic camera can be described as a light field camera and provides a 4D light field of the captured scene, in particular of the vehicle user. By the 3D camera, it can also be precisely identified if the vehicle user wears the eye cover.
  • the invention also relates to a motor vehicle with a driver assistance system according to the invention.
  • Fig. 1 a schematic plan view of an embodiment of a motor vehicle according to the invention with a driver assistance system
  • Fig. 2 a schematic side view of the motor vehicle according to the invention with the driver assistance system.
  • a motor vehicle 1 with a driver assistance system 2 is schematically illustrated.
  • the driver assistance system 2 includes an indicating element 3, a camera 4 and an evaluation system 5.
  • the evaluation system 5 can for example be integrated in the camera 4 or else be formed separately from the camera 4.
  • the camera 4 is disposed in an interior 6 of the motor vehicle 1 .
  • the camera 4 is disposed such that a face 7 of a vehicle user 8 can be captured.
  • the camera 4 can also be formed as a 3D camera, for example as a plenoptic camera.
  • a viewing direction 9 of the vehicle user 8 is captured.
  • the viewing direction 9 can for example be described by a main orientation of the eyes of the vehicle user 8.
  • a visual zone 10 of the vehicle user can be determined.
  • the vehicle user 8 perceives information.
  • the visual zone 10 for example corresponds to a field of view.
  • the physiology and ophthalmology one denotes all of the central and peripheral points and object of the exterior space as the field of view, which can be visually perceived with steady, straight posture of the head and straight oriented, immobile view also without directly fixing them.
  • the viewing direction 9 can for example be determined by methods from the fields of machine vision and machine learning.
  • a classifier or multiple classifiers can be generated to classify the eye of the vehicle user 8 captured by the camera 4 with respect to the viewing direction 9 and thereby to determine the direction of the view of the vehicle user 8.
  • the visual zone 10 extends in horizontal and vertical direction with respect to a vehicle transverse plane of the motor vehicle 1 and is thus formed as a three-dimensional zone.
  • the indicating element 3 is disposed in the interior 6. According to the embodiment of Fig. 1 , the indicating element 3 is disposed on a cockpit 1 1 of the motor vehicle 1 .
  • the indicating element 3 can for example be formed as a warning lamp and/or indicator lamp of the motor vehicle 1 .
  • an illumination element on a dashboard 12 of the motor vehicle 1 can also be encompassed by the indicating element 3.
  • the motor vehicle 1 has an interior illumination 13.
  • the interior illumination 13 can for example include festoon lamps and/or light emitting diodes (LEDs).
  • the interior 6 is at least partially illuminated by the interior illumination 13.
  • a visual warning notice is output in a predetermined position 14 within the motor vehicle 1 by means of the indicating element 3 disposed in the interior 6.
  • the visual warning notice can for example be related to an oil level of the motor vehicle 1 .
  • the predetermined position 14 it is known, at which location in the interior 6 of the motor vehicle 1 the visual warning notice is output.
  • the visual zone 10 is determined based on the viewing direction 9 captured by the camera 4. Furthermore, it is examined if the visual warning notice is within the visual zone 10. If the visual warning notice is within the visual zone 10, thus, the visual warning notice is assumed to be recognized by the vehicle user 8 by the evaluation system 5. Thus, it is assumed by the evaluation system 5 that the vehicle user 8 has perceived the visual warning notice.
  • the visual warning notice is outside of the visual zone 10
  • the visual warning notice is assumed not to be recognized by the vehicle user 8 by the evaluation system 5.
  • an attention increase signal 15 is then generated in the motor vehicle 1 for the vehicle user 8.
  • the attention increase signal 15 the vehicle user 8 is insistently made aware of the presence of the visual warning notice.
  • the attention increase signal 15 can for example be visually and/or acoustically and/or haptically output.
  • the attention increase signal 15 can for example be output via an audio system of the motor vehicle 1 .
  • the attention increase signal 15 can for example also be output by means of the interior illumination 13.
  • a visual warning signal output by means of the interior illumination 13 as the attention increase signal 15 can be characterized in that a tint and/or a brightness of the visual warning signal is varied.
  • the vehicle user 8 can for example be made aware of the fact that the visual warning notice is output by a tint change of the interior illumination 13 from white to red. The vehicle user 8 can then change his viewing direction 9 and search for the visual warning notice within the interior 6.
  • a text message can also be output, which describes the warning notice in words and/or describes, at which location of the interior 6 the indicating element 3 is located and thus where the predetermined position 14 is.
  • a safety relevance of the visual warning notice is determined. Thereby, it is determined, how important or significant the visual warning notice is to the vehicle user 8 or to the safety of the motor vehicle 1 .
  • the tint of the attention increase signal 15 is then adjusted.
  • a green tint can for example be output with a less important visual warning notice
  • a red tint of the attention increase signal 15 can be output with a very important visual warning notice.
  • a speed of the motor vehicle 1 can also be adapted depending on the generation of the attention increase signal 15. If it is for example determined that the visual warning notice is not within the visual zone 10 and thereby exceeding a currently valid speed limit remains unrecognized, thus, the speed of the motor vehicle 1 can for example be adapted.
  • the attention increase signal 15 can then for example also be present as a control signal, by which the speed of the motor vehicle 1 is adapted.
  • the vehicle user 8 is preferably examined for wearing an eye cover. For example, this can only be performed if capturing the viewing direction 9 of the vehicle user 8 fails. If wearing the eye cover is then for example identified at the vehicle user 8, thus, an orientation of a head 16 of the vehicle user 8 can be determined instead of the viewing direction 9. Based on the orientation of the head 16, then, the visual zone 10 can again be determined, and it can be examined whether or not the visual warning notice is within the visual zone 10. Therein, the eye cover can for example be formed as sunglasses.
  • Fig. 2 shows a part of the motor vehicle 1 in a lateral sectional illustration.
  • the vehicle user 8 is shown in a lateral illustration with the viewing direction 9 directed into an environmental region of the motor vehicle 1 .
  • the viewing direction 9 is surrounded by the visual zone 10.
  • the indicating element 3 is disposed.
  • the vehicle user 8 does not perceive the visual warning notice, which is output by the indicating element 3, thus from the view of the evaluation system 5 according to the embodiment of Fig. 2.
  • the attention increase signal 15 is for example generated and output by the interior illumination 13.
  • the vehicle user 8 is made aware of the fact that in particular in the area of the cockpit 1 1 and/or the dashboard 12, the visual warning notice is located, by the attention increase signal 15.
  • the vehicle user 8 drives in the direction of the sun with the motor vehicle 1 and therefore is distracted from the visual warning notice by the solar radiation.
  • the solar radiation By the solar radiation, it can be more difficult to perceive the visual warning notice.
  • the visual zone 10 can change in case of blinding by solar radiation and/or extreme brightness, in particular decrease compared to the case without the solar radiation and/or the presence of the extreme brightness.
  • the visual warning notice is within the visual zone 10 without the disturbing solar radiation and therefore is recognized by the vehicle user 8, but in presence of the disturbing solar radiation, the visual warning notice is outside of the visual zone 10 although the viewing direction 9 of the vehicle user 8 is maintained.
  • a brightness in the motor vehicle 1 is measured and if the brightness exceeds a brightness limit value, the attention increase signal 15 is acoustically output alternatively or instead of the visual output.
  • the acoustic output can then be effected via an audio system of the motor vehicle 1 , as already mentioned.

Landscapes

  • Engineering & Computer Science (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Optics & Photonics (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biomedical Technology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Traffic Control Systems (AREA)
  • Instrument Panels (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The invention relates to a method for examining a perception of a visual warning notice in a motor vehicle (1) to a vehicle user (8) of the motor vehicle (1) by the vehicle user (8), in which the following steps are performed: outputting the visual warning notice in a predetermined position (14) within the motor vehicle (1) by means of an indicating element (3) of the motor vehicle (1) disposed in an interior (6) of the motor vehicle (1); capturing a viewing direction (9) of the vehicle user (8) by means of a camera (4) of the motor vehicle (1); determining a visual zone (10) of the vehicle user (8), in which the vehicle user (8) perceives information, based on the viewing direction (9); examining if the visual warning notice is within the visual zone (10); wherein the visual warning notice is assumed to be recognized by the vehicle user (8) by an evaluation system (5) of the motor vehicle (1) if the visual warning notice is within the visual zone (10).

Description

Method for examining a perception of a visual warning notice by a vehicle user, driver assistance system and motor vehicle
The invention relates to a method for examining a perception of a visual warning notice in a motor vehicle to a vehicle user of the motor vehicle by the vehicle user. The invention also relates to a driver assistance system as well as to a motor vehicle with a driver assistance system.
Usually, in an interior of a motor vehicle, at least one indicating element for outputting a visual warning notice to a vehicle user of the motor vehicle is disposed. Thus, the visual warning notice can for example be output by lighting up of an oil level indicator lamp in the motor vehicle. Therein, it can occur that the vehicle user does not perceive the visual warning notice. Thereby, the further operation of the motor vehicle possibly no longer properly proceeding is disadvantageous, whereby the safety of the motor vehicle and of other traffic participants can also be impaired.
It is the object of the invention to provide a method, a driver assistance system as well as a motor vehicle, by means of which or in which the vehicle user-effected perception of a visual warning notice generated in the motor vehicle is improved.
According to the invention, this object is solved by a method, by a driver assistance system as well as by a motor vehicle having the features according to the respective independent claims.
In a method according to the invention, a perception of a visual warning notice in a motor vehicle, which is output to a vehicle user of the motor vehicle, by a vehicle user, is examined in particular by an evaluation system of the motor vehicle. The visual warning notice is output in a predetermined position within the motor vehicle by means of an indicating element of the motor vehicle disposed in an interior of the motor vehicle, and a viewing direction of the vehicle user is captured by means of at least one camera of the motor vehicle. Furthermore, a visual zone of the vehicle user, in which the vehicle user perceives information, is determined based on the viewing direction. It is examined if the visual warning notice is within the visual zone. The visual warning notice is assumed to be recognized by an evaluation system of the motor vehicle if the visual warning notice is within the visual zone. By the method according to the invention, the examination of the perception of the visual warning notice by the vehicle user can be considerably improved. It can be more effectively and reliably examined if the vehicle user has perceived the visual warning notice. It is no longer only output a warning notice without generating a statement about the perception probability of the warning notice by the vehicle user. Rather, now, it is basically also assessed if the vehicle user can perceive the warning notice at all or has perceived it. Thereto, based on specific manners of evaluation, it is estimated if perception could have been effected. Depending on these probability estimations, perception is then assumed or not.
As the visual warning notice, for example, an oil level indicator lamp, a navigation indication warning, a speed limit warning or another warning with respect to an operating state of the motor vehicle is output. The visual warning notice is output by the indicating element in a predetermined position within the motor vehicle. Thus, it is for example known that if an oil level warning is to be output, it is for example indicated on the indicating element in the predetermined position. Thus, the respective predetermined position of the indicating element can be inferred from the respective type of the visual warning notice. The indicating element is in particular disposed on a dashboard of the motor vehicle or on a cockpit of the motor vehicle.
The capture of the viewing direction of the vehicle user by means of the camera can for example be effected by evaluating images captured by the camera. Thus, orientation of a pupil of the vehicle user can for example be identified in the images. Based on the orientation of the pupil, the viewing direction of the vehicle user can then for example be determined. The orientation of the pupil can for example be identified by a usual object recognition method from the field of machine vision. Herein, the orientation of the pupil can also be tracked over multiple images provided by the camera, whereby change of the viewing direction of the vehicle user can also be identified. For example, it can be that at least one eye of the vehicle user is captured by the camera and the at least one captured eye is compared to eyes in a database. For example, the database can have eyes with different pupil orientations. Each of these pupil orientations can then for example be linked to a certain viewing direction. Thus, based on a similarity measurement, it can then be determined, to which eye from the database the captured eye best matches. The viewing direction associated with the best matching eye from the database can then be assumed as the viewing direction of the vehicle user. For comparing the captured eye to the eyes in the database, for example, a matching method according to the principle of cross- correlation and/or mutual information can be used. The viewing direction of the vehicle user can be also captured by means of several cameras of the motor vehicle.
Based on the viewing direction, the visual zone of the vehicle user can then be
determined. Within the visual zone, the vehicle user perceives information. The visual zone can for example be described as a field of view. By the field of view, in the physiology and ophthalmology, one denotes all of central and peripheral points and objects of the exterior space, which can be visually perceived with steady, straight posture of the head and straight oriented, immobile view also without directly fixing them. Thus, the visual zone can for example also be taken from a database, in which for example various visual zones are associated with various viewing directions.
It is examined if the visual warning notice is within the visual zone. Thus, it can for example be examined if a light signal radiated by the indicating element has effects to within the visual zone. Thus, it is for example examined if photons from the indicating element strike the visual zone of the vehicle user. If the examination reveals that the visual warning notice is within the visual zone, thus, the visual warning notice is assumed to be recognized by the vehicle user by the evaluation system. Thus, it can then be assumed that the vehicle user has perceived the visual warning notice. Thus, the vehicle user becomes aware of the visual warning notice output by the indicating element by the perception.
In particular, it is provided that the visual warning notice is assumed not to be recognized by the vehicle user by the evaluation system if the visual warning notice is outside of the visual zone, wherein an attention increase signal is then generated in the motor vehicle for the vehicle user. In particular, the visual warning notice is outside of the visual zone if photons output by the indicating element do not enter the visual zone. Then, it can be assumed that the visual warning notice is not perceived by the vehicle user. Thus, the attention of the vehicle user is thereby not directed to the visual warning notice. As a result, the attention increase signal is in particular generated in the motor vehicle for the vehicle user. By the attention increase signal, the attention of the vehicle user is to be directed to the visual warning notice. Thus, the vehicle user is to be caused to perceive the visual warning notice based on the attention increase signal. For example, this can also be effected already in that the vehicle user thoroughly looks around in the interior of the motor vehicle after generating the attention increase signal to determine the reason for the generation of the attention increase signal. Preferably, it is provided that the attention increase signal is visually and/or acoustically and/or haptically output. Thus, the visual attention increase signal can for example be output by an illumination and/or illumination variation within the motor vehicle. The acoustic attention increase signal can for example be output via an audio system of the motor vehicle. Thus, a warning sound or a warning signal can for example be output in the motor vehicle as the acoustic attention increase signal. For example, a text with the exact background of the visual warning notice can also for example be output as the warning signal. Thus, the visual warning notice can thereby for example be put in words and thereby be provided to the vehicle user by the words in acoustic manner. For example, vibration of a motor vehicle part in contact with the vehicle user can be provided as the haptic attention increase signal. Thus, for example, a steering wheel, a vehicle seat or a safety belt of the motor vehicle can be formed as the vibrating motor vehicle part. Overall, the attention increase signal can thereby be variously output detectable by multiple senses of the vehicle user such that the perception can be more effectively and insistently effected.
Furthermore, it is preferably provided that a visual warning signal is output by means of an interior illumination of the motor vehicle as the attention increase signal. Therein, the interior illumination in particular serves for illuminating the interior. The interior illumination is usually formed by lamps in the vehicle roof in passenger cars with closed construction. The interior illumination can for example be provided by festoon lamps and/or light emitting diodes (LEDs). However, the interior illumination can for example also include a glovebox illumination and/or a trunk illumination. A reading lamp can also be
encompassed by the vehicle interior illumination. By the interior illumination, the attention increase signal can be more effectively and insistently output.
In particular, it is provided that the visual color signal is varied in the tint and/or in the brightness. A characteristic of a color sensed as fundamental by the human is described by the tint. In the color theory, the tint denotes the characteristic, according to which one differentiates color sensations for example according to red, yellow or green. By the variation of the tint of the visual warning signal, the attention increase signal can be more clearly and insistently output. Thus, the human is particularly sensitive to tint variations and/or brightness variations in his visual zone. The interior illumination is in particular configured such that light radiated by the interior illumination can arrive in all differently positioned visual zones of the vehicle user as possible. The brightness is a generic term of subjective impressions and objective measurement parameters for the intensity of visual perception of visible light. By varying the brightness, the attention increase signal can be more clearly and insistently generated for the vehicle user. Additionally or alternatively, however, the interior illumination can also be configured in flashing manner. In the flashing configuration, the interior illumination is for example turned on and off in predetermined intervals, in particular in short intervals, for example below one second. Thereby, the attention increase signal can again be more effectively and insistently output such that the attention of the vehicle user is directed to the presence of the visual warning notice.
In a further embodiment, it can be provided that a safety relevance of the visual warning notice is determined and the tint of the visual warning signal is adjusted depending on the safety relevance. Thus, the safety relevance can for example be characterized in how important the visual warning notice is for the safe operation of the motor vehicle. Here, it can for example be differentiated if a temperature of an engine of the motor vehicle is too high and the engine is in danger of overheating, whereby lasting damages to the engine and/or a cooling circuit of the motor vehicle can arise, or if the safety relevance is ranked low as it can for example be the case with absent wiping water liquid. Now, the tint can for example be only slightly varied with low safety relevance and be severely varied with high safety relevance. Thus, with severe safety relevance, a red tint can for example be output by the interior illumination. With the low safety relevance, the tint can for example be not varied at all or else only in fine shades such that the vehicle user is not frightened by the interior illumination and thereby is possibly distracted from the traffic scene. Thereby, the motor vehicle can be more safely operated.
In a further embodiment, it can be provided that depending on the generation of the attention increase signal, a speed of the motor vehicle is adapted. Thus, it can for example be the case that the visual warning notice is assumed not to be recognized by the vehicle user by the evaluation system and thereby the speed of the motor vehicle is adapted. Thus, it can for example be that a currently valid speed limit for the motor vehicle is output during the travel of the motor vehicle by the visual warning notice and the vehicle user has not perceived this visual warning notice according to the evaluation system. Thus, intervention in the speed of the motor vehicle can then be performed to for example keep the speed of the motor vehicle within the prescribed scope. Additionally or alternatively, for example, it can also be intervened in a control of the motor vehicle if the vehicle user has not perceived the visual warning notice according to the evaluation system. By adapting the speed of the motor vehicle depending on the generation of the attention increase signal, the motor vehicle can be more safely operated. In a further embodiment, it can be provided that the vehicle user is examined for wearing an eye cover, such as in particular for example, especially tinted, glasses, in particular if capturing the viewing direction of the vehicle user fails. Thus, it can be provided that if capturing the viewing direction of the vehicle user fails, examination of the vehicle user for wearing the eye cover is performed. Therein, the eye cover can for example be formed as sunglasses or eye patch. The examination for wearing the eye cover can for example also be performed by an object recognition method from the field of machine vision. Thus, the examination can for example be performed in predetermined time intervals or else only if capturing the viewing direction of the vehicle user fails. Thereby, a reason can be found for the evaluation system why the viewing direction of the vehicle user cannot be identified. Thereby, the evaluation system can thus discontinue determining the viewing direction until wearing the eye cover is no longer detected. An energy consumption of the evaluation system can therefore be kept lower and/or computing capacity of the evaluation system can thus be used for other applications.
Furthermore, it can be provided that if wearing the eye cover is identified at the vehicle user, an orientation of the head of the vehicle user is captured by means of the camera instead of the viewing direction and the visual zone is determined based on the orientation of the head, and it is examined if the visual warning notice is within the visual zone, wherein the visual warning notice is assumed to be recognized by the vehicle user by the evaluation system of the motor vehicle if the visual warning notice is within the visual zone. Thus, the visual zone can be determined based on the orientation of the head. Thus, the visual zone can also be determined if the vehicle user wears the eye cover. After determining the visual zone based on the orientation of the head, it can then again be examined if the visual warning notice is within the visual zone. If this is the case, it is assumed by the evaluation system that the vehicle user has perceived the visual warning notice. If the visual warning notice is outside of the visual zone determined based on the orientation of the head, the attention increase signal can then also again be generated and output, respectively. Thereby, the motor vehicle can also be more safely operated if the vehicle user wears the eye cover.
Furthermore, it can be provided that the visual warning notice is output by a warning lamp as the indicating element. By the warning lamp, for example, an indicator lamp of the motor vehicle and/or another warning notice emitter in the interior of the motor vehicle can be described. Thus, the warning lamp can for example be formed as an engine temperature indicator lamp or as an oil level indicator lamp. Furthermore, it can be provided that the visual warning notice is output by means of the indicating element disposed in a cockpit of the motor vehicle. Thus, the indicating element is therefore in particular disposed in the cockpit of the motor vehicle and not in an area of the interior, which cannot be seen at all by the vehicle user with usual viewing direction during travel. It is advantageous that the presentation of the perception of the visual warning notice can thereby be more appropriately adapted to the situation of the vehicle user during vehicle drive.
The invention relates to a driver assistance system for a motor vehicle including at least one camera and an evaluation system. The driver assistance system is formed to perform a method according to the invention. The evaluation system can for example be formed separately from the camera or else be integrated in the camera.
Preferably, it is provided that the camera is formed as a 3D camera, in particular as a plenoptic camera. The vehicle user can be at least partially captured in three-dimensional manner by the 3D camera. An image of the vehicle user captured by the 3D camera can for example thereby be provided with a depth value. Thereby, the viewing direction and/or the orientation of the head can be more precisely and reliably determined. For example, the 3D camera can be formed as a time-of-flight (TOF) camera or else as a plenoptic camera. The plenoptic camera can be described as a light field camera and provides a 4D light field of the captured scene, in particular of the vehicle user. By the 3D camera, it can also be precisely identified if the vehicle user wears the eye cover.
The invention also relates to a motor vehicle with a driver assistance system according to the invention.
The preferred embodiments presented with respect to the method according to the invention and the advantages thereof correspondingly apply to the driver assistance system according to the invention as well as to the motor vehicle according to the invention.
With statements of "top", "bottom", "front", "rear", "horizontal", "vertical" etc., the positions and orientations given with intended use and intended arrangement of the camera are specified.
Further features of the invention are apparent from the claims, the figures and the description of figures. The features and feature combinations mentioned above in the description as well as the features and feature combinations mentioned below in the description of figures and/or shown in the figures alone are usable not only in the respectively specified combination, but also in other combinations or alone, without departing from the scope of the invention. Thus, implementations are also to be considered as encompassed and disclosed by the invention, which are not explicitly shown in the figures and explained, but arise from and can be generated by separated feature combinations from the explained implementations. Implementations and feature combinations are also to be considered as disclosed, which thus do not have all of the features of an originally formulated independent claim.
Below, the embodiments of the invention are explained in more detail based on schematic drawings.
There show:
Fig. 1 a schematic plan view of an embodiment of a motor vehicle according to the invention with a driver assistance system; and
Fig. 2 a schematic side view of the motor vehicle according to the invention with the driver assistance system.
In the figures, identical or functionally identical elements are provided with the same reference characters.
In Fig. 1 a motor vehicle 1 with a driver assistance system 2 is schematically illustrated. In the embodiment, the driver assistance system 2 includes an indicating element 3, a camera 4 and an evaluation system 5. The evaluation system 5 can for example be integrated in the camera 4 or else be formed separately from the camera 4. According to the embodiment, the camera 4 is disposed in an interior 6 of the motor vehicle 1 .
Preferably, the camera 4 is disposed such that a face 7 of a vehicle user 8 can be captured. The camera 4 can also be formed as a 3D camera, for example as a plenoptic camera.
By means of the camera 4, a viewing direction 9 of the vehicle user 8 is captured. The viewing direction 9 can for example be described by a main orientation of the eyes of the vehicle user 8. Based on the viewing direction 9, a visual zone 10 of the vehicle user can be determined. In the visual zone 10, the vehicle user 8 perceives information. The visual zone 10 for example corresponds to a field of view. In the physiology and ophthalmology, one denotes all of the central and peripheral points and object of the exterior space as the field of view, which can be visually perceived with steady, straight posture of the head and straight oriented, immobile view also without directly fixing them.
The viewing direction 9 can for example be determined by methods from the fields of machine vision and machine learning. Thus, for example based on a training data set of viewing directions, which are associated with eyes with certain pupil positions, a classifier or multiple classifiers can be generated to classify the eye of the vehicle user 8 captured by the camera 4 with respect to the viewing direction 9 and thereby to determine the direction of the view of the vehicle user 8. The visual zone 10 extends in horizontal and vertical direction with respect to a vehicle transverse plane of the motor vehicle 1 and is thus formed as a three-dimensional zone.
The indicating element 3 is disposed in the interior 6. According to the embodiment of Fig. 1 , the indicating element 3 is disposed on a cockpit 1 1 of the motor vehicle 1 . The indicating element 3 can for example be formed as a warning lamp and/or indicator lamp of the motor vehicle 1 . Thus, by the indicating element 3, for example, an illumination element on a dashboard 12 of the motor vehicle 1 can also be encompassed by the indicating element 3.
Furthermore, the motor vehicle 1 has an interior illumination 13. The interior illumination 13 can for example include festoon lamps and/or light emitting diodes (LEDs). In particular, the interior 6 is at least partially illuminated by the interior illumination 13.
Now, the method according to the invention for example proceeds as follows. A visual warning notice is output in a predetermined position 14 within the motor vehicle 1 by means of the indicating element 3 disposed in the interior 6. The visual warning notice can for example be related to an oil level of the motor vehicle 1 . By the predetermined position 14, it is known, at which location in the interior 6 of the motor vehicle 1 the visual warning notice is output. Now the visual zone 10 is determined based on the viewing direction 9 captured by the camera 4. Furthermore, it is examined if the visual warning notice is within the visual zone 10. If the visual warning notice is within the visual zone 10, thus, the visual warning notice is assumed to be recognized by the vehicle user 8 by the evaluation system 5. Thus, it is assumed by the evaluation system 5 that the vehicle user 8 has perceived the visual warning notice. In case the visual warning notice is outside of the visual zone 10, the visual warning notice is assumed not to be recognized by the vehicle user 8 by the evaluation system 5. In this case, an attention increase signal 15 is then generated in the motor vehicle 1 for the vehicle user 8. By the attention increase signal 15, the vehicle user 8 is insistently made aware of the presence of the visual warning notice.
Therein, the attention increase signal 15 can for example be visually and/or acoustically and/or haptically output. Thus, the attention increase signal 15 can for example be output via an audio system of the motor vehicle 1 . Additionally or alternatively, the attention increase signal 15 can for example also be output by means of the interior illumination 13. Thus, a visual warning signal output by means of the interior illumination 13 as the attention increase signal 15 can be characterized in that a tint and/or a brightness of the visual warning signal is varied. Thus, the vehicle user 8 can for example be made aware of the fact that the visual warning notice is output by a tint change of the interior illumination 13 from white to red. The vehicle user 8 can then change his viewing direction 9 and search for the visual warning notice within the interior 6. With the acoustic attention increase signal 15, for example, a text message can also be output, which describes the warning notice in words and/or describes, at which location of the interior 6 the indicating element 3 is located and thus where the predetermined position 14 is. Additionally or alternatively, a safety relevance of the visual warning notice is determined. Thereby, it is determined, how important or significant the visual warning notice is to the vehicle user 8 or to the safety of the motor vehicle 1 . Depending on the safety relevance, the tint of the attention increase signal 15 is then adjusted. Thus, a green tint can for example be output with a less important visual warning notice, while a red tint of the attention increase signal 15 can be output with a very important visual warning notice.
Moreover, for example, a speed of the motor vehicle 1 can also be adapted depending on the generation of the attention increase signal 15. If it is for example determined that the visual warning notice is not within the visual zone 10 and thereby exceeding a currently valid speed limit remains unrecognized, thus, the speed of the motor vehicle 1 can for example be adapted. The attention increase signal 15 can then for example also be present as a control signal, by which the speed of the motor vehicle 1 is adapted.
Furthermore, the vehicle user 8 is preferably examined for wearing an eye cover. For example, this can only be performed if capturing the viewing direction 9 of the vehicle user 8 fails. If wearing the eye cover is then for example identified at the vehicle user 8, thus, an orientation of a head 16 of the vehicle user 8 can be determined instead of the viewing direction 9. Based on the orientation of the head 16, then, the visual zone 10 can again be determined, and it can be examined whether or not the visual warning notice is within the visual zone 10. Therein, the eye cover can for example be formed as sunglasses.
Fig. 2 shows a part of the motor vehicle 1 in a lateral sectional illustration. The vehicle user 8 is shown in a lateral illustration with the viewing direction 9 directed into an environmental region of the motor vehicle 1 . The viewing direction 9 is surrounded by the visual zone 10. Outside of the visual zone 10, the indicating element 3 is disposed. The vehicle user 8 does not perceive the visual warning notice, which is output by the indicating element 3, thus from the view of the evaluation system 5 according to the embodiment of Fig. 2. Thus, as a result, the attention increase signal 15 is for example generated and output by the interior illumination 13. The vehicle user 8 is made aware of the fact that in particular in the area of the cockpit 1 1 and/or the dashboard 12, the visual warning notice is located, by the attention increase signal 15.
Thus, it can for example occur that the vehicle user 8 drives in the direction of the sun with the motor vehicle 1 and therefore is distracted from the visual warning notice by the solar radiation. By the solar radiation, it can be more difficult to perceive the visual warning notice. Thus, the visual zone 10 can change in case of blinding by solar radiation and/or extreme brightness, in particular decrease compared to the case without the solar radiation and/or the presence of the extreme brightness. Thus, it can be possible that the visual warning notice is within the visual zone 10 without the disturbing solar radiation and therefore is recognized by the vehicle user 8, but in presence of the disturbing solar radiation, the visual warning notice is outside of the visual zone 10 although the viewing direction 9 of the vehicle user 8 is maintained.
Furthermore, it can be provided that a brightness in the motor vehicle 1 is measured and if the brightness exceeds a brightness limit value, the attention increase signal 15 is acoustically output alternatively or instead of the visual output. The acoustic output can then be effected via an audio system of the motor vehicle 1 , as already mentioned.

Claims

Claims
1 . Method for examining a perception of a visual warning notice in a motor vehicle (1 ) to a vehicle user (8) of the motor vehicle (1 ) by the vehicle user (8), in which the following steps are performed:
- outputting the visual warning notice in a predetermined position (14) within the motor vehicle (1 ) by means of an indicating element (3) of the motor vehicle (1 ) disposed in an interior (6) of the motor vehicle (1 );
- capturing a viewing direction (9) of the vehicle user (8) by means of at least one camera (4) of the motor vehicle (1 );
determining a visual zone (10) of the vehicle user (8), in which the vehicle user
(8) perceives information, based on the viewing direction (9);
examining if the visual warning notice is within the visual zone (10); wherein
- the visual warning notice is assumed to be recognized by the vehicle user (8) by an evaluation system (5) of the motor vehicle (1 ) if the visual warning notice is within the visual zone (10).
2. Method according to claim 1 ,
characterized in that
the visual warning notice is assumed not to be recognized by the vehicle user (8) by the evaluation system (5) if the visual warning notice is outside of the visual zone (10), wherein an attention increase signal (15) is then generated in the motor vehicle (1 ) for the vehicle user (8).
3. Method according to claim 2,
characterized in that
the attention increase signal (15) is visually and/or acoustically and/or haptically output.
4. Method according to claim 3,
characterized in that
a visual warning signal is output by means of an interior illumination (13) of the motor vehicle (1 ) as the attention increase signal (15).
5. Method according to claim 4,
characterized in that
the visual warning signal (15) is varied in the tint and/or in the brightness.
6. Method according to claim 5,
characterized in that
a safety relevance of the visual warning notice is determined, and the tint of the visual warning signal (15) is adjusted depending on the safety relevance.
7. Method according to any one of claims 2 to 6,
characterized in that
a speed of the motor vehicle (1 ) is adapted depending on the generation of the attention increase signal (15).
8. Method according to any one of the preceding claims,
characterized in that
the vehicle user (8) is examined for wearing an eye cover, in particular only if capturing the viewing direction (9) of the vehicle user (8) fails.
9. Method according to claim 8,
characterized in that
if wearing the eye cover is identified at the vehicle user (8), an orientation of the head (16) of the vehicle user (8) is captured by means of the camera (4) instead of the viewing direction (9), and the visual zone (10) is determined based on the orientation of the head (16), and it is examined if the visual warning notice is within the visual zone (10), wherein the visual warning notice is assumed to be recognized by the vehicle user (8) by the evaluation system (5) of the motor vehicle (1 ) if the visual warning notice is within the visual zone (10).
10. Method according to any one of the preceding claims,
characterized in that
the visual warning notice is output by a warning lamp as the indicating element (3).
1 1 . Method according to any one of the preceding claims,
characterized in that the visual warning notice is output by means of the indicating element (3) disposed in a cockpit (1 1 ) of the motor vehicle (1 ).
12. Driver assistance system (2) with at least one camera (4) and an evaluation system (5), which is formed for performing a method according to any one of the preceding claims.
13. Driver assistance system (2) according to claim 12,
characterized in that
the camera (4) is formed as a 3D camera, in particular as a plenoptic camera.
14. Motor vehicle (1 ) with a driver assistance system (2) according to claim 12 or 13.
EP16775221.1A 2015-10-16 2016-09-29 Method for examining a perception of a visual warning notice by a vehicle user, driver assistance system and motor vehicle Withdrawn EP3362308A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102015117610.6A DE102015117610A1 (en) 2015-10-16 2015-10-16 A method for checking a perception of a visual warning by a vehicle user, driver assistance system and motor vehicle
PCT/EP2016/073223 WO2017063892A1 (en) 2015-10-16 2016-09-29 Method for examining a perception of a visual warning notice by a vehicle user, driver assistance system and motor vehicle

Publications (1)

Publication Number Publication Date
EP3362308A1 true EP3362308A1 (en) 2018-08-22

Family

ID=57047223

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16775221.1A Withdrawn EP3362308A1 (en) 2015-10-16 2016-09-29 Method for examining a perception of a visual warning notice by a vehicle user, driver assistance system and motor vehicle

Country Status (3)

Country Link
EP (1) EP3362308A1 (en)
DE (1) DE102015117610A1 (en)
WO (1) WO2017063892A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017213679A1 (en) * 2017-08-07 2019-02-07 Bayerische Motoren Werke Aktiengesellschaft Driver condition assessment method and apparatus and vehicle
DE102017118365B4 (en) * 2017-08-11 2019-09-19 Valeo Schalter Und Sensoren Gmbh Head-up display with several optional filters for one vehicle
DE102017130628A1 (en) 2017-12-20 2019-07-11 Autoliv Development Ab System, method and computer program product for increasing driving safety in traffic
DE102018213230A1 (en) * 2018-08-07 2020-02-13 Volkswagen Aktiengesellschaft Method and control device for warning a driver of a motor vehicle and motor vehicle with such a control device
CN116678634A (en) * 2023-05-24 2023-09-01 一汽奔腾轿车有限公司 A method for checking the visibility of the upper part of the glove box
US20250271929A1 (en) * 2024-02-28 2025-08-28 Robert Bosch Gmbh Displaying in-vehicle messaging and activating vehicle functions based on driver gaze direction
DE102024124585A1 (en) * 2024-08-28 2026-03-05 Bayerische Motoren Werke Aktiengesellschaft Method for assessing an action-reaction scenario between a human and a vehicle output unit, as well as an assessment and documentation system.

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19921488A1 (en) * 1999-05-08 2000-11-16 Bosch Gmbh Robert Method and device for monitoring the interior and surroundings of a vehicle
WO2010131331A1 (en) * 2009-05-12 2010-11-18 トヨタ自動車株式会社 Visual recognition area estimation device and driving support device
JP5821859B2 (en) * 2013-01-18 2015-11-24 株式会社デンソー Display system
DE102013206739A1 (en) * 2013-04-16 2014-10-16 Bayerische Motoren Werke Aktiengesellschaft Method for determining whether an occupant of a vehicle notices relevant objects in the vicinity of the vehicle

Also Published As

Publication number Publication date
DE102015117610A1 (en) 2017-04-20
WO2017063892A1 (en) 2017-04-20

Similar Documents

Publication Publication Date Title
WO2017063892A1 (en) Method for examining a perception of a visual warning notice by a vehicle user, driver assistance system and motor vehicle
US10279683B2 (en) Vehicle display system and method of controlling vehicle display system
US9616809B1 (en) Lane change prediction and turn signal activation upon observation of head and eye movement
CN109795413B (en) Driving assistance device and driving assistance method
CN101512617A (en) Driving Information Provider
EP1668386B1 (en) Method for improving vision in a motor vehicle
JP2018156172A (en) Vehicle display system and method for controlling vehicle display system
CN105411072A (en) Safety Device For Motorcycle Riders And Method For Operating A Safety Device For Motorcycle Riders
CN110448316A (en) Data processing apparatus and method, monitoring system, wake-up system, and recording medium
EP3650991B1 (en) Monitoring system
JP6811743B2 (en) Safe driving support device
JP2009292296A (en) On-vehicle display system
JP2017039373A (en) Vehicle video display system
JP4872245B2 (en) Pedestrian recognition device
CN110313007B (en) Systems and methods for identifying vehicle driver fatigue
JP5621558B2 (en) Vehicle display device
CN107640160B (en) Vehicle safety driving assistance system and control method thereof
JP2017039461A (en) Vehicle display device and control method thereof
JP5576198B2 (en) Armpit judging device
EP4493440A1 (en) Systems and methods for eye gaze based alertness measurement
JP7342637B2 (en) Vehicle control device and driver condition determination method
JP7342636B2 (en) Vehicle control device and driver condition determination method
JP7331632B2 (en) Driving support device, driving support method, and driving support program
CN222080682U (en) Imaging system for vehicle
KR101916426B1 (en) Display Apparatus for Vehicle

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20180503

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20190103