GB2571121A - Method for use in a vehicle - Google Patents
Method for use in a vehicle Download PDFInfo
- Publication number
- GB2571121A GB2571121A GB1802629.4A GB201802629A GB2571121A GB 2571121 A GB2571121 A GB 2571121A GB 201802629 A GB201802629 A GB 201802629A GB 2571121 A GB2571121 A GB 2571121A
- Authority
- GB
- United Kingdom
- Prior art keywords
- driver
- vehicle
- concentration level
- biometric data
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 52
- 230000007613 environmental effect Effects 0.000 claims abstract description 8
- 238000004891 communication Methods 0.000 claims description 17
- 230000009467 reduction Effects 0.000 claims description 13
- 230000001419 dependent effect Effects 0.000 claims description 4
- 230000005236 sound signal Effects 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 claims description 2
- 230000009471 action Effects 0.000 abstract description 6
- 230000004397 blinking Effects 0.000 abstract description 2
- 230000004886 head movement Effects 0.000 description 4
- 230000036387 respiratory rate Effects 0.000 description 4
- 230000036626 alertness Effects 0.000 description 3
- 230000036760 body temperature Effects 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 3
- 238000005286 illumination Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 206010041349 Somnolence Diseases 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 210000004087 cornea Anatomy 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/0022—Monitoring a patient using a global network, e.g. telephone networks, internet
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02438—Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
- A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/681—Wristwatch-type devices
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6891—Furniture
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7455—Details of notification to user or communication with user or patient ; user input means characterised by tactile indication, e.g. vibration or electrical stimulation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7465—Arrangements for interactive communication between patient and care services, e.g. by using a telephone network
- A61B5/747—Arrangements for interactive communication between patient and care services, e.g. by using a telephone network in case of emergency, i.e. alerting emergency services
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
- B60K28/066—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W50/16—Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
- A61B2562/02—Details of sensors specially adapted for in-vivo measurements
- A61B2562/0204—Acoustic sensors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo or light sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/10—Longitudinal speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/01—Occupants other than the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/049—Number of occupants
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/221—Physiology, e.g. weight, heartbeat, health or special needs
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2552/00—Input parameters relating to infrastructure
- B60W2552/35—Road bumpiness, e.g. pavement or potholes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2552/00—Input parameters relating to infrastructure
- B60W2552/40—Coefficient of friction
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/40—Dynamic objects, e.g. animals, windblown objects
- B60W2554/406—Traffic density
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
- B60W2555/20—Ambient conditions, e.g. wind or rain
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2756/00—Output or target parameters relating to data
- B60W2756/10—Involving external transmission of data to or from the vehicle
Abstract
The non-driver (e.g. passenger) of a vehicle 10 is alerted to a drop in concentration level of a driver of the vehicle 10. Sensors (12, figure 1) measure parameters related to the concentration level of the driver e.g. blinking, degree of opening of driver’s eyes and heart rate. In dependence on the measured data. It is determined whether the concentration level of the driver is below a threshold concentration level. The non-driver is alerted to the loss of concentration when the determined concentration level is below the threshold concentration level. An overall concentration level may be generated from the multiple measured parameters, and the threshold may depend on the current driving conditions (e.g. environmental conditions, meteorological conditions, traffic). The warning may include instructions setting out what action a passenger is required to take (e.g. operate steering wheel, activate emergency lights or operate the horn). If there is no competent occupant aboard the vehicle, instead of alerting a passenger, the warning may be sent to an emergency contact external to the vehicle.
Description
METHOD FOR USE IN A VEHICLE
TECHNICAL FIELD
The present disclosure relates to a method for use in a vehicle and particularly, but not exclusively, to a method of alerting at least one non-driver of a vehicle to a reduction in concentration level of a driver of the vehicle. Aspects of the invention relate to a method, to a controller, to a system and to vehicle.
BACKGROUND
Some motor vehicles, e.g. cars, include systems that detect a level of fatigue of the vehicle driver. If the detected level of fatigue is determined to be above a critical level of fatigue then the system is operable to alert the driver that their concentration levels may have dropped below an acceptable level. Such systems may be operable to alert the vehicle driver by means of an audio signal or by causing a steering wheel and or the driver’s seat to vibrate, for example.
These known systems will not be of use in scenarios where it is not possible to alert the vehicle driver of a drop in their concentration levels by the above means.
It is an aim of the present invention to address disadvantages associated with the prior art.
SUMMARY OF THE INVENTION
According to an aspect of the present invention there is provided a method of alerting at least one non-driver of a vehicle to a reduction in concentration level of a driver of the vehicle. The method may comprise sensing at least one form of biometric data associated with the driver, the biometric data having a correlation with the concentration level of the driver. The method may also comprise determining, in dependence on the sensed biometric data, whether the concentration level of the driver is below a threshold concentration level. The method may also comprise providing a communication to the at least one non-driver when the determined concentration level is below the threshold concentration level so as to alert the at least one non-driver of the reduction in the driver’s concentration level.
More generally, the sensed biometric data may correlate to a particular driver state, and the biometric data may be used to classify the driver state. For example, the driver state may include a driver alertness state, and the biometric data may be used to determine whether the driver alertness state is ‘alert’, ‘fatigued’ or ‘incapacitated’. The method may comprise providing the communication to the non-driver when the driver state is determined to be either of the latter of these two states, i.e. when the driver is determined to be ‘fatigued’ or ‘incapacitated’. Alternatively, for example, the driver state may include a driver awareness state, and the biometric data may be used to determine whether the driver awareness state is ‘aware’ or ‘distracted’.
The present invention is advantageous in that at least one non-driver of the vehicle is alerted when the vehicle driver’s concentration level falls below a threshold value, so that the non-driver may take action to alert the driver to the drop in concentration level or so that the non-driver may take action to control the vehicle themselves in the event that the driver is unable to do so. The method is beneficial in that a non-driver will know more about the state of the driver in advance of a critical situation developing.
The driver concentration level may be monitored and determined substantially continuously or may be determined periodically. The driver’s concentration level falling below a threshold value may be indicative that the driver is not in control of the vehicle, that the driver is struggling to keep control of the vehicle, and/or that there is an increased possibility of an critical situation developing. The invention is advantageous in that the non-driver is informed of the fall in the driver’s concentration level in advance of a critical situation so that corrective measures may be taken before such a critical situation develops.
The invention may be useful in vehicles utilising autonomous driving.
The biometric data may comprise blink rate data.
The method may comprise capturing image data comprising a sequence of images of at least one of the driver’s eyes. The method may comprise identifying, from the image data, when a blink has taken place. The method may comprise counting a plurality of blinks over one or more periods of time, thereby generating the blink rate data.
The biometric data may comprise blink duration data.
The method may comprise capturing image data comprising a sequence of images of at least one of the driver’s eyes. The method may comprise identifying, from the captured image data, when a blink has started and when a blink has ended. The method may comprise calculating an average time interval between the start and end of a blink for a plurality of blinks over one or more periods of time, thereby generating the blink duration data.
The biometric data may comprise data relating to a degree of opening of at least one of the driver’s eyes. This may be indicative of a level of drowsiness of the driver.
The biometric data may comprise heart rate data.
The sensing step may comprise receiving, from a heart rate monitor, the heart rate data. The heart rate monitor may be worn by the driver, for example on a wrist of the driver. The heart rate monitor may be located close to the driver, for example embedded in the driver’s seat or positioned on the dashboard within the vehicle cabin.
The biometric data may comprise respiratory rate data and/or driver body temperature data.
The at least one non-driver comprises a non-driving occupant of the vehicle. The method may advantageously target or alert a specific non-driving occupant of the vehicle so that the specific non-driving occupant is aware that they are the one that must take action in view of the driver’s reduced concentration level. The method may involve alerting more than one non-driving occupant of the vehicle.
The step of providing the communication to the at least one non-driver may comprise providing instructions for the non-driver to carry out.
The instructions may be dependent on one or more external factors of the vehicle.
The external factors may include at least one of: time of day or night; external environmental conditions; meteorological conditions; terrain and/or traction conditions; traffic in the vicinity of the vehicle; and, speed of the vehicle.
The instructions may be in the form of one or both of: an audio signal; and, a visual signal directed to the non-driver of the vehicle.
The instructions may include one or more of instructions to: alert the driver; operate a braking system or control such as a handbrake of the vehicle; operate a steering wheel of the vehicle; activate emergency lights of the vehicle; and, operate a horn of the vehicle.
The step of providing the communication to the at least one non-driver may comprise haptic feedback.
The haptic feedback may comprise vibration of a vehicle seat in which the non-driver is seated.
The instructions may be provided via a human-machine interface specific to the nondriver.
The at least one non-driver may include an emergency contact external to the vehicle.
The step of providing the communication to the at least one non-driver may comprise contacting the non-driver by means of at least one of: a telephone call; a voicemail; a text message; and, an electronic mail.
The method may comprise determining whether there is at least one non-driver present in the vehicle, wherein providing the communication to the at least one nondriver is made in dependence on said determination.
The step of determining whether there is at least one non-driver present in the vehicle may comprise determining whether there is at least one competent non-driver in the vehicle.
The method may comprise providing the communication to the emergency contact only when it is determined that there is no competent non-driver in the vehicle.
The threshold concentration level may depend on a current driver context.
The current driver context may comprise any one or more of the following: environmental conditions; meteorological conditions; time of day or night; external light levels; interior temperature levels; presence of one or more passengers; driver vocalisation; and, terrain and/or traction conditions.
The method may comprise determining the current driver context prior to determining whether the driver’s concentration level is below the threshold concentration level.
According to another aspect of the present invention there is provided a controller for alerting at least one non-driver of a vehicle to a reduction in concentration level of a driver of the vehicle. The controller comprises an input configured to receive at least one form of biometric data associated with the driver, the biometric data having a correlation with the concentration level of the driver. The controller also comprises a processor configured to determine, in dependence on the received biometric data, whether the concentration level of the driver is below a threshold concentration level. The controller also comprises an output configured to send a control signal to provide a communication to the at least one non-driver when the determined concentration level is below the threshold concentration level so as to alert the at least one nondriver of the reduction in the driver’s concentration level.
According to another aspect of the present invention there is provided a system for alerting at least one non-driver of a vehicle to a reduction in concentration level of a driver of the vehicle. The system comprises sensing means configured to sense at least one form of biometric data associated with the driver, the biometric data having a correlation with the concentration level of the driver. The system also comprises processing means configured to determine, in dependence on the sensed biometric data, whether the concentration level of the driver is below a threshold concentration level. The system also comprises output means configured to provide a communication to the at least one non-driver when the determined concentration level is below the threshold concentration level so as to alert the at least one non-driver of the reduction in the driver’s concentration level.
The sensing means may comprise a camera and/or a heart rate sensor.
According to another aspect of the present invention there is provided a vehicle comprising a system as described above.
According to another aspect of the present invention there is provided a non-transitory, computer-readable storage medium storing instructions thereon that when executed by one or more processors causes the one or more processors to carry out the method described above.
Within the scope of this application it is expressly intended that the various aspects, embodiments, examples and alternatives set out in the preceding paragraphs, in the claims and/or in the following description and drawings, and in particular the individual features thereof, may be taken independently or in any combination. That is, all embodiments and/or features of any embodiment can be combined in any way and/or combination, unless such features are incompatible. The applicant reserves the right to change any originally filed claim or file any new claim accordingly, including the right to amend any originally filed claim to depend from and/or incorporate any feature of any other claim although not originally claimed in that manner.
BRIEF DESCRIPTION OF THE DRAWINGS
One or more embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
Figure 1 is a schematic plan view of a vehicle including the component parts of a system according to an embodiment of an aspect of the invention; and,
Figure 2 shows the steps of a method undertaken by the system of Figure 1.
DETAILED DESCRIPTION
The present invention provides a method of alerting a non-driver of a vehicle, such as a non-driving passenger, when a driver of the vehicle experiences increased levels of fatigue or lowered levels of concentration, so that the non-driver may take appropriate action such as to alert the driver or take control of the vehicle.
Figure 1 shows a vehicle 10 including a system of components for determining when a driver of the vehicle 10 is fatigued and for alerting a non-driver of the vehicle 10 to such a determination. The non-driver may be a passenger in the vehicle or may be located remote from the vehicle.
The vehicle 10 includes several biometric sensors 12 for monitoring various biometrics associated with the vehicle driver. In particular, the vehicle 10 includes an eyemonitoring sensor or camera 14. The eye camera 14 is positioned on the dashboard of the vehicle 10 and configured to receive data relating to various aspects of the driver’s eyes. For example, the received data includes data indicative of when the driver blinks (including the start point and end point of a blink) as well as data indicative of the degree to which the driver’s eyes are open or closed. The received data may also include data indicative of more general head movement of the driver.
The eye camera 14 may be configured to include a means to illuminate the subject being viewed, for example by sending signals or waves, such as infrared signals, towards the driver’s eyes. Additionally or alternatively, there may be provided means for infrared illumination of the driver separate from the camera 14, arranged to provide infrared illumination of the driver’s face to aid the camera 14 obtain useful information pertaining to the driver’s eye movement and blinking. These signals are reflected from the driver’s eyes, for example from the cornea, back towards the eye camera 14 and subsequently received by the eye camera 14. The eye camera 14 may track just a single one of the driver’s eyes, or may track both of the driver’s eyes separately.
The biometric sensors 12 also include one or more vital signs sensors 16 configured to receive data indicative of one or more vital signs of the driver. For example, the vital signs sensors 16 include a heart rate monitor/sensor configured to measure or sense the driver’s heart rate. The heart rate monitor may be in the form of an item worn by the driver, such as a wristband. Alternatively, the heart rate monitor may be separate from (not in contact with), but located close to, the driver. For example, this can be in the form of a vital signs sensor embedded within the driver’s seat, steering wheel, or located on the dashboard, within the vehicle cabin. The vital signs sensor is configured to send (ultra-wide bandwidth) radar signals towards the driver’s heart and to receive signals reflected back from the heart, which are then used to determine the pulsing movement of the heart so as to determine the driver’s heart rate.
The vital signs sensors 16 similarly include sensors for determining the driver’s respiratory rate and body temperature. These sensors may also be worn by the driver, and conveniently a single sensor worn by the driver receives signals indicative of all of the above-mentioned driver vital signs. The vital signs sensor 16 located on the vehicle dashboard or in the driver’s seat used for sensing the driver’s heart rate can also be used to sense the driver’s respiratory rate, this time by receiving radar signals reflected back from the driver’s lungs.
The vehicle 10 also includes various other sensors or systems that are used in both the determination as to whether the vehicle driver is fatigued, and if so, then who the alert should be directed to and how the alert should be communicated. These are referred to collectively here as external factor sensors 18, and will be described in more detail below.
The vehicle 10 includes a processor 20 that is configured to determine whether the driver’s concentration level has fallen below an acceptable level, or whether the driver’s fatigue level has risen above an acceptable level. In particular, the processor 20 receives via an input 22 biometric data from the biometric sensors 12, and this received biometric data is correlated into an overall concentration level of the driver. The processor 20 then compares this overall concentration level against a threshold concentration level to determine whether it is below a required value, and therefore whether a non-driver of the vehicle 10 needs to be alerted to a fall in the driver’s concentration level.
The vehicle 10 includes several means by which a non-driver may be alerted in the event that the driver’s concentration level falls below the threshold value. For example, the vehicle 10 includes one or more human-machine interfaces (HMIs) 24 within the vehicle cabin. Each HMI 24 is specific to a particular non-driving occupant of the vehicle 10, i.e. a non-driving occupant in either a front passenger seat or one of the rear passenger seats of the vehicle 10. Each HMI 24 typically includes a touch-screen keyboard, dial, or voice activation to enable user selection of a particular input for the various vehicle entertainment systems which are available to non-driving occupants or passengers of the vehicle 10. The HMIs 24 may allow passengers to watch videos/movies, access the Internet/emails, make phone calls and/or send text messages etc.
A non-driving occupant of the vehicle 10 may be alerted to a drop in the driver’s concentration level via the passenger-specific HMI 24, for example by means of a message on a display screen of the HMI 24 or by means of an audio signal from a loudspeaker associated with the HMI 24. The non-driving occupant may instead, or additionally, be alerted to a drop in the driver’s concentration level via the vehicle seat 26 in which they are seated, for example by causing vibrations I haptic feedback in the vehicle seat.
The alert need not be sent to I directed towards a non-driving occupant of the vehicle 10. Instead, in the event that the driver’s concentration level falls below an acceptable level then an alert message or signal may be sent off-board the vehicle 10 by means of a telecom device 28 of the vehicle 10. In particular, the telecom device 28 includes a transmitter configured to send a wireless alert message to an emergency contact of the vehicle driver in such a scenario. The wireless alert may be in the form of a text message, a phone call, etc. to an emergency contact of the vehicle driver.
Figure 2 shows the steps of a method 40 undertaken by the processor 20 in order to determine whether the driver’s concentration level has fallen below an acceptable value and if so, how to alert a specific non-driver of the vehicle 10 to this determination.
At step 42, the processor 20 receives biometric sensor output data from the biometric sensors 12 indicative of the received image data from the driver’s eyes. Sensor output data from the eye sensor 14 is used by the processor 20 to calculate the driver’s blink rate and blink duration at step 44. In particular, the received biometric data includes blink rate data in order to calculate the driver’s blink rate. The blink rate data allows the processor 20 to determine when a blink has taken place. Specifically, an average blink rate of the driver is calculated by counting the number of blinks that has taken place over a prescribed period of time, for example 60 seconds, and then dividing the counted number of blinks by the period of time.
The received biometric data also includes blink duration data in order to calculate an average duration of each of the driver’s blinks. In particular, the blink duration data allows the processor 20 to determine a start point and an end point for each one of the driver’s blinks. The processor 20 determines the duration of each blink by calculating the elapsed time from a blink start point to a blink end point, and repeats this for a specific number of blinks. The processor 20 then uses this calculated data to calculate the current average duration of the driver’s blinks.
At step 46, the processor 20 calculates one or more threshold values that are indicative of a threshold concentration level of the driver. For example, one or more of an increased blink rate, blink duration, head movement, heart rate, respiratory rate, and body temperature, or a decreased degree of driver eye opening, may be indicative of falling levels of driver concentration.
In the present embodiment, each of the above-mentioned biometrics has an associated threshold value, and each of these threshold values are determined based on a so-called ‘current driver context’ from the external factor data received by the processor 20 from the external factors sensors and systems 18. The current driver context relates to the current driving conditions that are being experienced by the driver. The received data from the biometric sensors 12 may be expected to vary depending on the current driving conditions.
For example, if it is determined that there is at least one non-driving passenger in the vehicle 10 then it may be expected that the received biometric data indicates increased levels of driver head movement. This is because the driver may turn their head towards the non-driving passenger if engaging in conversation with them while driving. Therefore, in this case a threshold value associated with levels of driver head movement may be set at a higher value than in the case where the driver is the only occupant of the vehicle 10. For this purpose, the external factors sensors 18 includes sensors 80, for example weight or motion sensors or detected wireless phone signals, in one or more of the passenger seats of the vehicle 10 for determining whether a nondriving passenger is present a given seat.
A measure of the concentration level of the driver may similarly be expected to decrease if the driver is carrying out a telephone call while driving. To this end, the external factors sensors 18 include a microphone 86 in the vehicle cabin to detect driver vocalisation levels, i.e. to detect when the driver is speaking on the telephone, and one or more of the biometric threshold values may be adjusted if it is determined that the driver is speaking on the phone or to another passenger of the vehicle 10.
The particular time of day or night may impact on one or more of the biometric threshold values. For example, if driving at night when there are decreased levels of external light then it may be expected that the degree of driver eye opening sensed by the biometric sensors 14 increases to allow more light to enter the driver’s eyes. Therefore, during night-time hours or when it is detected that there are decreased levels of light external to the vehicle 10 then a threshold value associated with a degree of driver eye opening may be set at a lower value than in the case of daylight driving. For this purpose, the external factors sensors 18 include a clock 82 and a vehicle external light sensor 84.
Certain meteorological conditions may naturally result in the driver needing to concentrate harder than compared with others. For example, if the driver is driving in icy conditions where the chances of vehicle slip are increased, then one or more of the sensed driver biometrics may vary compared with driving in non-icy conditions, for example an increased heart rate may be sensed. Therefore, when it is detected that the meteorological conditions are such that driving the vehicle 10 is made more challenging (e.g. snow, ice, heavy rain, fog etc.) then a threshold value associated with the driver’s heart rate may be set at a higher value than in the case of less challenging conditions. For this purpose, the external factors sensors 18 include sensors 88 for detecting various weather conditions.
Similarly, the type of terrain over which the vehicle 10 is travelling may impact the levels of concentration the driver must dedicate to controlling the vehicle 10. The processor 20 receives data indicative of the type of terrain over which the vehicle 10 travelling from a terrain identification system 90, for example a Terrain Response® system, of the vehicle 10. Therefore, one or more of the biometric threshold values may be adjusted in dependence on the current terrain type communicated to the processor 20.
Environmental conditions such as how busy with other traffic a road on which the vehicle 10 is travelling is may also impact on the degree of concentration needed from the vehicle driver in order to control the vehicle 10. Sensors 92, such as forward, side and/or rear facing cameras, radar sensors or acoustic sensors, provide data to the processor 20 indicative of such environmental conditions and the value of one or more of the biometric threshold values may be adjusted based on this received environmental condition data.
Furthermore, one or more of the driver biometrics may vary in dependence on an interior temperature within the vehicle cabin. Therefore, the sensors 18 include an interior temperature sensor 94 which provides data relating to a current interior vehicle temperature, and one or more of the biometric threshold values may be determined based on this received interior temperature data.
Once each of the biometric threshold values, collectively referred to as the threshold concentration level, has been determined then at step 50 the processor 20 compares a current level of driver concentration based on the received biometric data with the threshold concentration level. Each current biometric data value is compared against its respective determined threshold value. For some biometrics, the associated threshold value is a lower bound below which the driver’s concentration is deemed to be less than an acceptable level. For example, the degree of driver eye opening is such a biometric. For other biometrics, the associated threshold value is an upper bound above which the driver’s concentration is deemed to be less than an acceptable level. For example, the driver’s heart rate is such a biometric.
In the described embodiment, if one of the sensed biometric values either exceeds or falls below its associated upper or lower bound threshold value, as appropriate, then the driver’s overall concentration level is deemed to have fallen below a minimum required threshold value at step 50.
In different embodiments, more than one of the sensed biometric values may be needed to exceed or fall below its threshold value, as appropriate, before the driver’s overall concentration level is deemed to have fallen below the minimum required level. In further different embodiments, a more complex combination of the biometrics whose threshold values have been crossed may be calculated to determine whether the overall driver concentration level is below the minimum required level. For example, some biometrics may be weighted more than others in determining the driver’s concentration level. In further embodiments, one or more of the threshold values, and/or the overall threshold concentration level, may be a predetermined value.
At step 50, if the overall driver concentration is determined to be at an adequate level,
i.e. it has not fallen below the overall threshold concentration value, then the process loops back to step 46.
If, on the other hand, the overall driver concentration is determined to be at an inadequate level, i.e. it has fallen below the overall threshold concentration value, then the process moves on to step 52.
At step 52, the processor 20 determines whether there are any non-driving occupants or passengers in the vehicle 10 that are deemed to be ‘competent’. By competent is meant that the non-driving occupant is deemed to be capable of acting upon an alert directed specifically at them that the vehicle driver’s concentration levels are not at a sufficiently high level. For example, children under, or even over, a specific age may be deemed to be not competent for these purposes. The driver may indicate to the system before the start of a journey whether there are any competent non-driving occupants in the vehicle 10. Alternatively, this may be determined automatically, for example by sensing the presence of a known person to the system by received signals from one of their wireless devices such as a mobile phone.
If it is determined at step 52 that there is a competent non-driving passenger in the vehicle 10 then at step 54 the processor 20 outputs an alert directed towards that nondriving passenger(s). The alert may be in a form that simply raises the awareness of the non-driving occupant that the something needs their attention, for example by causing haptic feedback in their seat 26, or flashing a light or emitting a sound through their HMI 24. Alternatively, the alert may be in the form of an instruction detailing the action that the non-driving occupant should take. For example, the HMI 24 specific to that passenger may display instructions via the HMI display screen, or may convey instructions via the HMI speaker, for the non-driving occupant to take.
The instructions can be for the non-driving occupant to do one or more of the following: alert the driver to the fact that their concentration level has dropped; control the vehicle steering wheel; apply the vehicle brakes, for example by applying the handbrake; operate the vehicle hazard lights; operate the vehicle horn, etc.
The particular instructions directed at the non-driving occupant can be dependent on one or more external factors of the vehicle 10 based on the received external factor data from the sensors 18. The sensors 18 can include a speedometer 96 indicating the current speed of the vehicle 10, and it may be determined that the particular instructions delivered to the non-driving occupant, or the particular order of instructions, may vary depending on the current speed of the vehicle. Also, the processor may use data from the proximity sensors or cameras, or the terrain identification system 90, to determine the communicated instructions depending on whether the vehicle 10 is on or off road, or whether the vehicle 10 is in heavy traffic or a quiet country road.
If on the other hand it is determined at step 52 that there is no competent non-driving passenger in the vehicle 10 then at step 56 the processor 20 outputs a signal to the telecom device 28 to send an alert off-board the vehicle 10 to an emergency contact of the vehicle driver.
Many modifications may be made to the above examples without departing from the scope of the present invention as defined in the accompanying claims.
In the above-described embodiments, the processor 20 calculates an overall driver concentration level based on various sensed biometric values, which is then compared against a threshold value in order to determine if the driver’s concentration level is not sufficient in order to control the vehicle. In different embodiment, the processor 20 uses the received biometric data to determine driver alertness state from a plurality of different possible driver states. In particular, the possible driver states include ‘alert’, ‘fatigued’ and ‘incapacitated’. For example, the driver state may be determined to be ‘fatigued’ if the driver eye opening level falls below a prescribed value. Also, the driver state may be determined to be ‘incapacitated’ if the sensed driver’s heart rate exceeds a prescribed value. In such embodiments, the processor 20 is configured to send an alert to a non-driver of the vehicle if the determined driver state is ‘fatigued’ or ‘incapacitated’, but not when the driver state is ‘alert’. The specific non-driver to which the alert is sent, and the particular form that the alert takes, may differ depending on whether the driver state is determined to be ‘fatigued’ or ‘incapacitated’.
Similarly, in further different embodiments the processor 20 uses the received biometric data to determine driver awareness state, i.e. whether the driver is deemed to be ‘aware’ (no non-driver alert needed) or ‘distracted’ (non-driver alert needed).
Claims (27)
1. A method of alerting at least one non-driver of a vehicle to a reduction in concentration level of a driver of the vehicle, the method comprising:
sensing at least one form of biometric data associated with the driver, the biometric data having a correlation with the concentration level of the driver;
determining, in dependence on the sensed biometric data, whether the
10 concentration level of the driver is below a threshold concentration level;
and, providing a communication to the at least one non-driver when the determined concentration level is below the threshold concentration level so
05 12 18 as to alert the at least one non-driver of the reduction in the driver’s concentration level; wherein the at least one non-driver comprises a non-driving occupant of the vehicle; wherein providing the communication to the at least one non-driver comprises providing instructions for the non-driver to carry out.
2. The method of Claim 1, wherein the biometric data comprises blink rate data.
3. The method of Claim 2, comprising:
capturing image data comprising a sequence of images of at least one of the driver’s eyes;
identifying, from the image data, when a blink has taken place; and counting a plurality of blinks over one or more periods of time, thereby generating the blink rate data.
05 12 18
4. The method of any previous claim, wherein the biometric data comprises
5 blink duration data.
5. The method of Claim 4, comprising:
capturing image data comprising a sequence of images of at least one of
10 the driver’s eyes;
identifying, from the captured image data, when a blink has started and when a blink has ended; and
15 calculating an average time interval between the start and end of a blink for a plurality of blinks over one or more periods of time, thereby generating the blink duration data.
6. The method of any previous claim, wherein the biometric data comprises
20 data relating to a degree of opening of at least one of the driver’s eyes.
7. The method of any previous claim, wherein the biometric data comprises heart rate data.
8. The method of Claim 7, wherein the sensing comprises receiving, from a heart rate monitor, the heart rate data.
9. The method of any preceding claim, wherein the instructions are dependent on one or more factors external to the vehicle.
10. The method of Claim 9, wherein the external factors include at least one of: time of day or night; external environmental conditions; meteorological conditions; terrain and/or traction conditions; traffic in the vicinity of the vehicle; and, speed of the vehicle.
11. The method of any preceding claim, wherein the instructions are in the form of one or both of: an audio signal; and, a visual signal directed to the nondriver of the vehicle.
12. The method of Claim 11, wherein the instructions include one or more of instructions to: alert the driver; operate a handbrake of the vehicle; operate a steering wheel of the vehicle; activate emergency lights of the vehicle; and, operate a horn of the vehicle.
13. The method of any preceding, wherein providing the communication to the at least one non-driver comprises haptic feedback.
14. The method of Claim 13, wherein the haptic feedback comprises vibration of a vehicle seat in which the non-driver is seated.
15. The method of any preceding claim, wherein the instructions are provided
05 12 18 via a human-machine interface specific to the non-driver.
16. The method of any previous claim, wherein the at least one non-driver includes an emergency contact external to the vehicle.
17. The method of Claim 16, wherein providing the communication to the at least one non-driver comprises contacting the non-driver by means of at least one of: a telephone call; a voicemail; a text message; and, an electronic mail.
18. The method of any previous claim, comprising determining whether there is at least one non-driver present in the vehicle, wherein providing the communication to the at least one non-driver is made in dependence on said determination.
19. The method of Claim 18, wherein determining whether there is at least one non-driver present in the vehicle comprises determining whether there is at least one competent non-driver in the vehicle.
20. The method of Claim 19, when dependent on Claim 16, comprising providing the communication to the emergency contact only when it is determined that there is no competent non-driver in the vehicle.
21. The method of any previous claim, wherein the threshold concentration level depends on a current driver context and the current driver context comprises any one or more of the following:
environmental conditions;
meteorological conditions;
time of day or night;
external light levels;
interior temperature levels;
presence of one or more passengers;
driver vocalisation; and terrain and/or traction conditions.
05 12 18
22. The method of Claim 21, comprising determining the current driver context prior to determining whether the driver’s concentration level is below the threshold concentration level.
23. A controller for alerting at least one non-driver of a vehicle to a reduction in concentration level of a driver of the vehicle, the controller comprising:
an input configured to receive at least one form of biometric data 25 associated with the driver, the biometric data having a correlation with the concentration level of the driver;
a processor configured to determine, in dependence on the received biometric data, whether the concentration level of the driver is below a 30 threshold concentration level; and, an output configured to send a control signal to provide a communication providing instructions to the at least one non-driver to carry out when the determined concentration level is below the threshold concentration level so
05 12 18 as to alert the at least one non-driver of the reduction in the driver’s concentration level; wherein, the at least one non-driver comprises a non-driving occupant of the vehicle.
24. A system for alerting at least one non-driver of a vehicle to a reduction in concentration level of a driver of the vehicle, the system comprising:
sensing means configured to sense at least one form of biometric data associated with the driver, the biometric data having a correlation with the concentration level of the driver;
processing means configured to determine, in dependence on the sensed biometric data, whether the concentration level of the driver is below a threshold concentration level; and, output means configured to provide a communication providing instructions to the at least one non-driver to carry out when the determined concentration level is below the threshold concentration level so as to alert the at least one non-driver of the reduction in the driver’s concentration level; wherein, the at least one non-driver comprises a non-driving occupant of the vehicle
25. A system according to Claim 24, wherein the sensing means comprises a camera and/or a heart rate sensor.
26. A vehicle comprising a system according to Claim 24 or Claim 25.
27. A non-transitory, computer-readable storage medium storing instructions thereon that when executed by one or more processors causes the one or more processors to carry out the method of any of Claims 1 to 22.
Intellectual Property Office
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB1802629.4A GB2571121B (en) | 2018-02-19 | 2018-02-19 | Alerting a non-driver of a vehicle to the driver's reduction in concentration |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB1802629.4A GB2571121B (en) | 2018-02-19 | 2018-02-19 | Alerting a non-driver of a vehicle to the driver's reduction in concentration |
Publications (3)
Publication Number | Publication Date |
---|---|
GB201802629D0 GB201802629D0 (en) | 2018-04-04 |
GB2571121A true GB2571121A (en) | 2019-08-21 |
GB2571121B GB2571121B (en) | 2022-09-28 |
Family
ID=61783727
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
GB1802629.4A Active GB2571121B (en) | 2018-02-19 | 2018-02-19 | Alerting a non-driver of a vehicle to the driver's reduction in concentration |
Country Status (1)
Country | Link |
---|---|
GB (1) | GB2571121B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113460073A (en) * | 2021-06-30 | 2021-10-01 | 恒大新能源汽车投资控股集团有限公司 | Fatigue driving reminding method, device and system |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090121882A1 (en) * | 2007-11-14 | 2009-05-14 | Al-Mutairi Sami H | Warning device for drivers and the like |
US8022831B1 (en) * | 2008-01-03 | 2011-09-20 | Pamela Wood-Eyre | Interactive fatigue management system and method |
US20160090097A1 (en) * | 2014-09-29 | 2016-03-31 | The Boeing Company | System for fatigue detection using a suite of physiological measurement devices |
WO2016103468A1 (en) * | 2014-12-26 | 2016-06-30 | 横浜ゴム株式会社 | Collision avoidance system and collision avoidance method |
US20160311440A1 (en) * | 2015-04-22 | 2016-10-27 | Motorola Mobility Llc | Drowsy driver detection |
US20170177959A1 (en) * | 2015-12-16 | 2017-06-22 | Robert Bosch Gmbh | Method for outputting a drowsiness warning and control unit |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8725311B1 (en) * | 2011-03-14 | 2014-05-13 | American Vehicular Sciences, LLC | Driver health and fatigue monitoring system and method |
EP2942012A1 (en) * | 2014-05-08 | 2015-11-11 | Continental Automotive GmbH | Driver assistance system |
US9883369B2 (en) * | 2015-10-13 | 2018-01-30 | Sony Corporation | System and method for providing assistance during medical emergency |
US9898004B2 (en) * | 2015-10-20 | 2018-02-20 | GM Global Technology Operations LLC | Method and system for operating a vehicle when an occupant experiences a potential medical condition |
-
2018
- 2018-02-19 GB GB1802629.4A patent/GB2571121B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090121882A1 (en) * | 2007-11-14 | 2009-05-14 | Al-Mutairi Sami H | Warning device for drivers and the like |
US8022831B1 (en) * | 2008-01-03 | 2011-09-20 | Pamela Wood-Eyre | Interactive fatigue management system and method |
US20160090097A1 (en) * | 2014-09-29 | 2016-03-31 | The Boeing Company | System for fatigue detection using a suite of physiological measurement devices |
WO2016103468A1 (en) * | 2014-12-26 | 2016-06-30 | 横浜ゴム株式会社 | Collision avoidance system and collision avoidance method |
US20160311440A1 (en) * | 2015-04-22 | 2016-10-27 | Motorola Mobility Llc | Drowsy driver detection |
US20170177959A1 (en) * | 2015-12-16 | 2017-06-22 | Robert Bosch Gmbh | Method for outputting a drowsiness warning and control unit |
Also Published As
Publication number | Publication date |
---|---|
GB2571121B (en) | 2022-09-28 |
GB201802629D0 (en) | 2018-04-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11787417B2 (en) | Assessing driver ability to operate an autonomous vehicle | |
US10569650B1 (en) | System and method to monitor and alert vehicle operator of impairment | |
US10723365B2 (en) | Driving assistance device | |
CN108205731B (en) | Situation assessment vehicle system | |
JP7455456B2 (en) | Method and system for enhanced warning based on driver status in hybrid driving | |
CN107539318B (en) | Driving support device and driving support method | |
JP6323549B2 (en) | Vehicle information presentation device | |
EP3825981B1 (en) | Warning apparatus and driving tendency analysis device | |
JP6641916B2 (en) | Automatic driving support device, automatic driving support system, automatic driving support method, and automatic driving support program | |
JP6696679B2 (en) | Driving support device | |
US9007198B2 (en) | Adaptive Actuator interface for active driver warning | |
EP1891490B1 (en) | Dialogue system | |
EP1769969A2 (en) | Apparatus and method for controlling notification, recording media, and program | |
CN109690654B (en) | Concentration ratio determination device, concentration ratio determination method, and program for concentration ratio determination | |
US11866073B2 (en) | Information processing device, information processing system, and information processing method for wearable information terminal for a driver of an automatic driving vehicle | |
US20240000354A1 (en) | Driving characteristic determination device, driving characteristic determination method, and recording medium | |
CN112292081A (en) | Occupant awareness monitoring for autonomous vehicles | |
GB2571121A (en) | Method for use in a vehicle | |
WO2018168048A1 (en) | Degree of concentration determination device, degree of concentration determination method, and program for determining degree of concentration | |
JP7422177B2 (en) | Traffic safety support system | |
WO2020250645A1 (en) | In-vehicle communication device, vehicle remote control system, communication method, and program | |
JP2006182324A (en) | Alarm device for vehicle | |
EP4271601A1 (en) | Device for analysing a vehicle driver's perception of a danger and associated method |