EP3424031A1 - Dispositif et méthode de surveillance d'un conducteur d'un véhicule automobile - Google Patents
Dispositif et méthode de surveillance d'un conducteur d'un véhicule automobileInfo
- Publication number
- EP3424031A1 EP3424031A1 EP17707902.7A EP17707902A EP3424031A1 EP 3424031 A1 EP3424031 A1 EP 3424031A1 EP 17707902 A EP17707902 A EP 17707902A EP 3424031 A1 EP3424031 A1 EP 3424031A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- driver
- state
- alarm signal
- monitoring
- alertness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 61
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000036626 alertness Effects 0.000 claims description 66
- 206010041349 Somnolence Diseases 0.000 claims description 28
- 230000000007 visual effect Effects 0.000 claims description 20
- 208000032140 Sleepiness Diseases 0.000 claims description 14
- 230000005540 biological transmission Effects 0.000 claims description 13
- 238000012360 testing method Methods 0.000 claims description 11
- 230000037321 sleepiness Effects 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 3
- 230000008859 change Effects 0.000 claims description 2
- 210000003128 head Anatomy 0.000 description 12
- 238000012806 monitoring device Methods 0.000 description 10
- 210000000744 eyelid Anatomy 0.000 description 7
- 238000005259 measurement Methods 0.000 description 5
- 230000001149 cognitive effect Effects 0.000 description 4
- 230000008602 contraction Effects 0.000 description 4
- 230000007423 decrease Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000007177 brain activity Effects 0.000 description 3
- 210000001097 facial muscle Anatomy 0.000 description 3
- 210000003205 muscle Anatomy 0.000 description 3
- 210000001747 pupil Anatomy 0.000 description 3
- 206010048232 Yawning Diseases 0.000 description 2
- 230000004913 activation Effects 0.000 description 2
- 239000004020 conductor Substances 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- WQZGKKKJIJFFOK-GASJEMHNSA-N Glucose Natural products OC[C@H]1OC(O)[C@H](O)[C@@H](O)[C@@H]1O WQZGKKKJIJFFOK-GASJEMHNSA-N 0.000 description 1
- 241001282135 Poromitra oscitans Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000037007 arousal Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000001364 causal effect Effects 0.000 description 1
- 230000036461 convulsion Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000004399 eye closure Effects 0.000 description 1
- 230000000193 eyeblink Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 239000008103 glucose Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 210000001589 microsome Anatomy 0.000 description 1
- 230000004118 muscle contraction Effects 0.000 description 1
- 230000035484 reaction time Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000036387 respiratory rate Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000004599 slow eye movement Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4806—Sleep evaluation
- A61B5/4812—Detecting sleep stages or cycles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
- B60K28/066—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver actuating a signalling device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2556/00—Input parameters relating to data
- B60W2556/45—External transmission of data to or from the vehicle
- B60W2556/50—External transmission of data to or from the vehicle of positioning data, e.g. GPS [Global Positioning System] data
Definitions
- the present invention relates generally to the field of monitoring the driver of a motor vehicle.
- It relates more particularly to a device and a method of monitoring this driver.
- this decline in fitness may result from drowsiness and / or driver distraction.
- a driver monitoring parameter is measured and interpreted by a control unit to derive information on the state of vigilance of the driver. If necessary, an alarm signal is issued to inform the driver of his state of alertness.
- the present invention proposes a monitoring method and a device allowing the driver to customize the transmission of the alarm signal or signals when a decrease in the driver's vigilance, namely a reduction in the level of alertness and / or the level of attention of the driver.
- SUBSTITUTE SHEET (RULE 26) a) estimation of a state of vigilance of said driver and, b) emission of at least one alarm signal intended to inform the driver of his state of alertness, according to the estimated state of alertness of said driver,
- the driver monitoring method of the invention advantageously allows the selection by the driver of the preferred alarm signal (s) and the constitution of a conductive plug in relation to an identifier of the driver.
- the driver monitoring method and the device according to the invention personalized by the driver himself, are better accepted and can thus fulfill their role in terms of safety.
- the driver chooses each alarm signal from among one or more signals of a visual, sound, haptic nature, or any of their combinations;
- the driver furthermore chooses to carry out a predefined number of repetitions of the transmission of said alarm signal as well as possibly a delay between two repetitions of this alarm signal and, at the same time, the recording step, the number of repetitions and the delay between two repetitions are recorded in said personalized database, in correspondence with the identifier of the driver;
- said estimated state of alertness belonging to a predetermined set of possible states of alertness at the choice stage the driver associates each selected alarm signal with one of said possible states of alertness of the driver, and, at the recording step the selected alarm signal is recorded in correspondence with the possible state of alertness associated;
- SUBSTITUTE SHEET (RULE 26) - the state of alertness estimate includes the estimation of a state of drowsiness or distraction;
- step a) the driver's state of drowsiness can be judged as alert awake, hypovigilance or sleepiness, and the driver's state of distraction can be judged as concentrated, poorly distracted or highly distracted, and step b), said alarm signal is emitted when the state of somnolence of the driver indicates that it is under hypovigilance, or falling asleep or when the state of distraction of the driver indicates that it is weakly or highly distracted;
- the driver associates the selected alarm signal with each state of distraction or somnolence possible, and in the recording step, said selected alarm signal is recorded in the personalized database in correspondence with the state of distraction or possible somnolence associated;
- the identifier of the driver of the vehicle is automatically determined and, in step b), the alarm signal recorded in the personalized database is sent in correspondence with this identifier and corresponding to the state of vigilance of the estimated driver in step b);
- the identifier of the driver of the vehicle is automatically determined, the personalized database associated with this identifier is retrieved and the driver is invited to modify, if necessary, each alarm signal chosen for the journey in progress;
- the driver Prior to the selection step, the driver performs a test of each alarm signal;
- the invention also relates to a device for monitoring the driver of a motor vehicle comprising:
- a device for estimating a state of vigilance of the driver a device for transmitting an alarm signal intended to inform the driver of his state of alertness, according to the estimated state of vigilance of the driver,
- SUBSTITUTE SHEET selecting one or more alarm signals adapted to be transmitted by the transmitting device from among a predetermined set of alarm signals
- each selected alarm signal is recorded in correspondence with a driver identifier.
- FIG. 1 shows schematically the different steps of the monitoring method according to the invention
- FIG. 2 shows schematically the various elements of the monitoring device according to the invention.
- FIG. 2 diagrammatically shows the various elements of a monitoring device according to the invention.
- the monitoring device 500 comprises:
- a device 300 capable of estimating a state of alertness of the driver, - a device for transmitting an alarm signal 400 according to the estimated state of vigilance of the driver and intended to inform the driver of his state of alertness,
- a dialogue interface 100 with the driver authorizing the latter to choose one or more alarm signals adapted to be transmitted by the transmission device from among a predetermined set of alarm signals, and
- a personalized database 200 in which each selected alarm signal is recorded in correspondence with an identifier of the driver.
- the device 300 able to estimate the state of alertness of the driver advantageously identifies different states of alertness in the driver.
- the device capable of estimating the state of vigilance of the driver can estimate at least two states of alertness, including at least a satisfactory state of alertness and an unsatisfactory state of alertness.
- the device capable of estimating the state of vigilance of the
- SUBSTITUTE SHEET (RULE 26) driver considers a state of alertness belonging to a predetermined set of possible states of alertness.
- the device 300 capable of estimating the driver's state of alertness comprises a device for measuring a driver's monitoring parameter and a control unit which receives information from this measurement device and which is programmed to estimate in function information received the state of vigilance of the driver.
- the measuring device records information on the driver without interacting with it, therefore without disturbing it.
- the measuring device emits no signal towards the driver. This has the advantage of allowing the measuring device to record the natural behavior of the driver, in the absence of any disturbance or constraint by the measuring device.
- the device for measuring the driver monitoring parameter is then without interaction with the driver.
- a measuring device in interaction with the driver, which emits for example a signal intended for the driver and detects the response thereof.
- the measuring device comprises at least one image capture device of the driver's head.
- This image capture device comprises for example a camera arranged facing the driver, for example at the dashboard of the vehicle, near the speed meters and / or laps of the vehicle.
- it may include any image capture device positioned so that the driver's face, in its driving position, enters the field of this image capture device.
- said monitoring parameter measured by the measuring device is relative to the direction of gaze of the driver and / or the movements of the eyes and / or the fixation of the gaze and / or the laying of the driver's head, and / or closing the driver's eyelids, and / or contraction of the muscles of the driver's face, and / or movements of the driver's lips.
- This measured driver monitoring parameter is determined according to at least one image of the driver's head captured by the device
- This parameter can also be determined from two or more images of the driver's head.
- the image capture device may include any device for monitoring the direction of gaze known to those skilled in the art.
- the monitoring parameter relating to the direction of the gaze of the driver may in particular be the direction of gaze in a repository related to the image capture device or in a repository related to the driver's head, or the position of the driver's pupils in a such reference. It may include a duration and / or a frequency of diversion of the driver's view of the road.
- It may also include a duration of fixing the same point, that is to say the duration during which the gaze direction is constant, a frequency of the moments of attachment of the same point, a frequency and a duration of jerks of the eyes, that is to say movements of the eyes between two moments of fixation of the same point.
- the monitoring parameter may also comprise statistical information on a set of viewing directions measured from a plurality of image captures made during a predetermined duration, for example an average direction of view, a standard deviation at this mean direction , a description of the statistical distribution of gaze directions.
- the driver monitoring parameter relating to the laying of the head may include a position and orientation of the driver's head in the repository related to the image capture device. It may also comprise, for example, statistical information on a set of poses measured from a plurality of image captures made during a predetermined duration, a frequency spectrum of the movements of the head, or an average position of the head in a given time interval.
- the driver monitoring parameter for closing the driver's eyelids may include a blink frequency
- SUBSTITUTE SHEET (RULE 26) eyelid closure time, eyelid closing speed, eye blink duration, classification of the different types of eye closure, or statistical information on the frequency or duration of closure of the middle driver's eyelids or standard deviation.
- the monitoring parameter for facial muscle contraction typically includes a frequency of contraction of the facial muscles, or statistical information of the average type or statistical distribution of the contraction frequency of the facial muscles. This contraction of the muscles of the face indicates for example a yawn.
- the measuring device may also include two image capture devices allowing the reconstruction of an image of the driver's head in three dimensions, by stereoscopy.
- the measurement device may comprise other types of sensors making it possible to measure other types of monitoring parameter, in addition to at least one of the monitoring parameters already mentioned, or in replacement of this monitoring parameter.
- the measuring device may comprise a sensor adapted to measure the pressure of the hands on the steering wheel of the vehicle.
- the measuring device may comprise, for example, a sound sensor capable of measuring the sound volume in the passenger compartment of the vehicle.
- the measuring device may also comprise, for example, one or more biometric sensors making it possible, for example, to measure the heart rate and / or the respiratory rate and / or the frequency and / or the amplitude of a variation in the pupil's pupil size. and / or the body temperature of the driver, and / or the blood glucose of the driver and / or the brain activity of the driver.
- the control unit of the device 300 able to estimate the state of alertness of the driver is programmed to estimate a state of vigilance of the driver according to an estimation rule and according to the measured value of said monitoring parameter.
- the estimation rule is implemented by an estimation module of the control unit.
- the measured monitoring parameter is relative to the driver's gaze direction
- the first case it is the level of attention of the driver which is insufficient, while in the second case it is the level of awakening of the driver.
- the device for estimating the state of vigilance of the driver is able to estimate the state of vigilance of the driver among a predetermined set of possible states of alertness.
- the device for assessing the state of vigilance of the driver can estimate the state of alertness more accurately according to a state of distraction and / or drowsiness.
- the estimation rule preferably includes at the output several states of possible distraction and / or somnolence of the driver, corresponding to different states of alertness of the possible driver.
- the following states of alertness can be used to estimate the driver's state of distraction: concentrated, poorly distracted, highly distracted.
- the "concentrated" state of distraction of the driver corresponds to a satisfactory state of alertness to drive.
- Such a situation typically occurs when the driver turns his eyes away from the road to, for example, consult his phone or look inside the passenger compartment of the vehicle.
- This situation corresponds to a visual distraction of the driver.
- the measured monitoring parameter is here for example a parameter relating to the direction of the driver's gaze.
- the driver can also divert his attention from driving due to a sound distraction. Such a situation typically occurs when
- SUBSTITUTE SHEET (RULE 26) Excessive noise is present in the passenger compartment of the vehicle, for example due to a ringing of the phone, the broadcast of music or due to a heated discussion.
- the driver may also divert his attention from driving due to cognitive distraction. Such a situation typically occurs when the driver is absorbed in a discussion, on the phone for example, or by his own thoughts.
- These last two situations can for example be detected by measuring a monitoring parameter relating to the movements of the eyes and / or fixing the gaze.
- the processing of the images recorded by the measuring device can give indications on the nature of the distraction. It is also possible to use, for example, in addition to the image capture device of the measuring device, a sound sensor placed in the passenger compartment.
- the following states of distraction can be provided: low visual and / or sound and / or cognitive distraction and strong visual and / or auditory and / or cognitive distraction.
- the following states are advantageously provided to estimate the driver's state of drowsiness: alert awakening, hypovigilance and falling asleep.
- Alert awakening is considered a state of satisfactory vigilance of the driver.
- hypovigilance and falling asleep correspond to an unsatisfactory state of alertness of the driver.
- Hypovigilance also called relaxed awakening, corresponds to a lowered level of arousal characterized by specific patterns of brain activity, including the presence of alpha brain waves whose frequency varies from 8 to 12 Hertz (Hz).
- Body movements are rarer than alert alertness, the reaction time is lengthened. Attention is more labile, so it's harder to focus on a task.
- Sleep is an intermediate state between sleep and awakening characterized by specific patterns of brain activity, including the presence of theta brainwaves with a frequency range of 3.5 to 7.5 Hz.
- SUBSTITUTE SHEET (RULE 26) slow eye movements and reduced muscle tone. The presence of yawning can be detected. If the driver struggles against falling asleep, microsomes can be observed.
- said estimation rule comprises a comparison between the measured value of the driver monitoring parameter and a threshold value of this monitoring parameter.
- the first estimation rule may include comparing the measured value of frequency or duration with a threshold value of frequency or duration. duration. When the measured value of frequency or duration is greater than the threshold value of frequency or duration, the first estimation rule returns at the output an unsatisfactory state of vigilance of the driver, for example indicating that it is hypovigilant, poorly distracted , very distracted, even falling asleep.
- a state of low distraction may for example be determined when the driver turns his eyes away from the road for a period of time ranging from 1, 6 to 2 seconds; and a state of high distraction may for example be determined when the driver turns his eyes away from the road for a period of time strictly greater than 2 seconds.
- said estimation rule is determined by a learning algorithm adapted to establish a causal structure between the monitoring parameter and the state of vigilance of the driver.
- This learning algorithm is initially driven using a predetermined initial database comprising input variable pairs comprising a predetermined associated monitoring parameter and vigilance state.
- This initial database includes data relating to different drivers, so that the initial performance of the estimation rule is satisfactory for a majority of drivers.
- the initial database is distinct from the custom database 200 by the user.
- the learning algorithm for example determines, on the basis of this initial database, the probability of observing a state of alertness, and of
- SUBSTITUTE SHEET (RULE 26) preferably the state of distraction or somnolence given in the driver, knowing that the monitoring parameter has said measured value.
- the estimation rule returns, on the basis of the learning algorithm, the state of alertness, and in particular the state of sleepiness or distraction that is most likely as a function of the measured value of the monitoring parameter of the driver.
- a plurality of measured values of the monitoring parameter are measured and the state of vigilance of the driver, and in particular the state of sleepiness or distraction, is estimated as a function of this plurality of values. measured values.
- control unit can further receive data transmitted by other devices of the vehicle, such as GPS data, acceleration / braking, activation of certain functions of the vehicle, such as for example the activation of the wireless connection from a mobile phone to the vehicle.
- data transmitted by other devices of the vehicle such as GPS data, acceleration / braking, activation of certain functions of the vehicle, such as for example the activation of the wireless connection from a mobile phone to the vehicle.
- Data indicating a course that is not suited to the road can be taken into account in the estimation rule to determine the state of alertness of the driver.
- These data may include, for example, the lateral deviation of the vehicle from the center of its path, the lateral stability of the vehicle, the frequency and the amplitude of micro-corrections exerted by the driver on the steering wheel.
- These data can also constitute, alternatively, the measured monitoring parameters of the driver.
- the monitoring device of the invention 500 further comprises a device for transmitting an alarm signal 400 (FIG. 1).
- This alarm signal makes it possible to inform the driver of a state of insufficient vigilance.
- the driver can then act to improve his state of alertness, for example by taking a break to rest or by interrupting a telephone conversation.
- the alarm signal emitted by the device for emitting the warning signal may be of a visual, sound and / or haptic nature.
- the visual signal may consist of a warning light, a flashing light or a flash of light emitted at the dashboard, the central rearview mirror and / or the front side pillars of the vehicle.
- the audible warning may be a recorded message or sound possibly selected from a set of ringtones or music
- SUBSTITUTE SHEET (RULE 26) optionally selected from a set of musical pieces.
- the haptic signal may consist of a vibration in the steering wheel, the seat belt and / or the driver's seat.
- the monitoring device also comprises a dialogue interface with the driver allowing the latter to choose one or more alarm signals adapted to be transmitted by the transmission device, from a predetermined set of alarm signals. .
- the driver monitoring device comprises a personalized database relating to the alarm signals; wherein each selected alarm signal is recorded in correspondence with an identifier of the driver.
- the personalized database 200 relating to the alarm signals of the monitoring device may allow the establishment of conductive plugs, each plug comprising for a given conductor, or the alarm signals selected by said driver.
- the personalized database 200 relating to the alarm signals (and in particular the driver cards) can for example be integrated in the control unit defined above.
- the driver can identify himself, for example through a dialogue box, as soon as it is installed in the motor vehicle.
- the motor vehicle concerned may advantageously further comprise a driver recognition system.
- This recognition system automatically identifies the driver of the vehicle from a list of stored drivers.
- This recognition system is based, for example, on the facial recognition of the driver on an image of the driver's head, on the processing of biometric information (such as a fingerprint), or on the identification of a key. contact used by the driver.
- This recognition system may, for example, transmit the identifier of the driver to the control unit, which is then programmed to select the information of the personalized database 200 relating to the alarm signals in relation to this driver identifier.
- the control unit can be programmed to select the conductive plug corresponding to the identifier transmitted by the recognition system.
- FIG. 1 diagrammatically shows the steps of the monitoring method according to the invention.
- the driver drives the vehicle as usual, without any particular constraints.
- the monitoring method according to the invention is implemented during the driving of the vehicle by the driver. This process comprises the following steps:
- emission 40 of at least one alarm signal intended to inform the driver of his state of alertness, according to the estimated state of alertness of said driver.
- step b) choice by the driver of one or more alarm signals adapted to be emitted in step b) from among a predetermined set of alarm signals
- the driver's state of alertness advantageously belongs to a predetermined set of possible states of alertness of the driver.
- the estimate of the state of alertness includes the estimation of a state of somnolence or a state of distraction in the driver, as defined above.
- the driver associates each selected alarm signal with one of the possible states of alertness of the driver, and in the recording step, the selected alarm signal is recorded in correspondence. with the possible state of alertness associated.
- the estimate of the vigilance state advantageously comprises a step of measuring at least one driver monitoring parameter, and a step of using at least one measured value of the at least one measured monitoring parameter to estimate a state of alertness of the driver according to said estimation rule and according to the measured value of said monitoring parameter.
- control unit controls or not the transmission of an alarm signal to the driver.
- Said alarm signal is emitted when the device for estimating the vigilance state returns an unsatisfactory state of alertness as defined above.
- an alarm signal is emitted when at least one of the following states of distraction or sleepiness is detected: low distraction (visual and / or sound), strong distraction (visual and / or sound), hypovigilance or sleepiness.
- the transmission of the alarm signal is personalized by the driver, so that this emitted signal is better accepted by this driver.
- At least one of the following characteristics of the alarm signal can be customized by the driver:
- the nature of the alarm signal for example, visual, sound, and / or haptic, as defined above;
- each of these characteristics is preferably recorded in said personalized database 200, in correspondence with the identifier of the bearer.
- one or more of these characteristics are recorded in said personalized database 200 in correspondence with this identifier of the bearer.
- the number of repetitions of the alarm signal is an integer that can be zero.
- the alarm signal can for example be repeated once or twice. Under these conditions, the driver can choose to change or not the alarm signal at each repetition.
- the alarm signal can select a first visual signal and then a sound signal. He can also choose to increase the intensity of the alarm signal at each repetition. When the alarm signal is repeated more than once, the
- FIRE I LLE OF REM PLACEM ENT (RULE 26) driver can select different delays between each repetition of the alarm signal.
- the driver also chooses the sound frequency or the frequency of the vibrations emitted by the device for transmitting the alarm signal.
- the driver associates a different alarm signal according to the state of drowsiness or distraction detected.
- it can assign a different alarm signal depending on the state of distraction or drowsiness detected, in particular, depending on whether the low distraction, high distraction, hypovigilance or sleepiness is detected.
- different alarm signals can be combined.
- the driver can choose a combination of several alarm signals to be issued simultaneously.
- not all alarm signals can be associated with all states of alertness. More specifically, the association of certain alarm signals with certain states of vigilance may be prohibited.
- the association by the driver of a visual alarm signal in a state of drowsiness corresponding to falling asleep may be excluded.
- the driver chooses a visual signal to be issued when a state of drowsiness is detected, the combination with another alarm signal may be imposed.
- the method of the invention may also exclude the possibility of associating an audible alarm signal with a loud (weak or loud) distraction and a visual signal with a visual (weak or strong) distraction.
- a haptic alarm signal is associated with any visual or audible alarm signal.
- certain characteristics of the alarm signals may be provided by default for certain states of alertness, without the driver being able to modify them.
- the intensity of the alarm signal associated with the states of distraction and drowsiness associated with the strong distraction or sleep of the driver can be programmed by default to the maximum.
- the intensity of the alarm signal associated with the states of distraction and drowsiness associated with the strong distraction or sleep of the driver can be programmed by default to the maximum.
- the intensity of the alarm signal associated with the states of distraction and drowsiness associated with the strong distraction or sleep of the driver can be programmed by default to the maximum.
- it can be programmed by default an audible alarm and / or a
- FIRE I LLE OF REM PLACEM ENT (RULE 26) combination of audible, visual and / or haptic alarm, which is excluded from personalization.
- each selected alarm signal is recorded in a personalized database 200 in correspondence with an identifier of the driver.
- driver cards containing all of the driver's choices concerning the customizable characteristics of the alarm signal or signals are recorded in correspondence with the driver identifier.
- the driver when the driver is installed in the vehicle, it is either automatically identified by the recognition device as described above when starting the vehicle, or it identifies itself.
- the personalized database 200 corresponding to the identified driver, is then recovered. Under these conditions, when an unsatisfactory state of alertness is detected, the alarm signal (s) corresponding to the choices of the identified driver are emitted.
- the method of the invention allows, once the driver is identified:
- step a) to estimate the state of vigilance of the driver, preferably belonging to a predetermined set of possible states of alertness, for example belonging to the states of vigilance as defined above, and,
- step b) of the method of the invention if necessary transmit, the alarm signal recorded in the personalized database 200 in correspondence with the identifier of the identified driver and whose state of vigilance possible partner corresponds to the state of vigilance of the driver estimated in step a)
- the monitoring method according to the invention may also comprise a step, when the driver has been identified and the corresponding personalized database 200 retrieved, in which the driver is invited to modify his previous personalization choices of the signal or signals of alarm.
- an alarm signal of a visual or haptic nature may be preferred and chosen for the path in progress, so as to
- the method of the invention allows the driver to test the different types of alarm signal, prior to the step of choosing the alarm signal. Since the driver has selected his preferred type of alarm knowingly, the transmission of the alarm signal when an unsatisfactory state of alertness of the driver is detected, is better accepted.
- the driver monitoring method according to the invention may also comprise a step, prior to the choice by the driver of one or more alarm signals adapted to be transmitted in step b), of testing the efficiency of each alarm signal.
- the device for transmitting an alarm signal emits an alarm test signal of a predetermined nature and intensity.
- Such a signal is preferably emitted, in a test phase, when the device for estimating the state of alertness has detected an unsatisfactory state of alertness. Under these conditions, the alarm test signal is judged effective if a satisfactory state of alertness is detected after transmission of said alarm test signal or if the driver decides to stop driving within a predetermined time.
- the alarm signal or signals proposed to the driver are pre-tested and preselected for their effectiveness on a set of conductors.
- the alarm signal or signals proposed to the driver are pre-tested and preselected for their specific effectiveness on the driver of the vehicle.
- the test of the effectiveness of the alarm signal then advantageously makes it possible to determine an intensity (visual, audible or haptic) threshold of the alarm signal, below which the alarm signal is not effective for inform the driver of his state of alertness.
- this threshold intensity is stored for each type of alarm, preferably in correspondence with the identifier of the driver, so that the driver can choose an intensity lower than this threshold intensity.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Automation & Control Theory (AREA)
- Animal Behavior & Ethology (AREA)
- Heart & Thoracic Surgery (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Social Psychology (AREA)
- Child & Adolescent Psychology (AREA)
- Hospice & Palliative Care (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Educational Technology (AREA)
- Developmental Disabilities (AREA)
- Physiology (AREA)
- Traffic Control Systems (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Auxiliary Drives, Propulsion Controls, And Safety Devices (AREA)
- Emergency Alarm Devices (AREA)
- Electric Propulsion And Braking For Vehicles (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1651689A FR3048544B1 (fr) | 2016-03-01 | 2016-03-01 | Dispositif et methode de surveillance d'un conducteur d'un vehicule automobile |
PCT/EP2017/054833 WO2017149047A1 (fr) | 2016-03-01 | 2017-03-01 | Dispositif et méthode de surveillance d'un conducteur d'un véhicule automobile |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3424031A1 true EP3424031A1 (fr) | 2019-01-09 |
Family
ID=55808694
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17707902.7A Withdrawn EP3424031A1 (fr) | 2016-03-01 | 2017-03-01 | Dispositif et méthode de surveillance d'un conducteur d'un véhicule automobile |
Country Status (6)
Country | Link |
---|---|
US (1) | US20190122525A1 (fr) |
EP (1) | EP3424031A1 (fr) |
JP (1) | JP2019512780A (fr) |
CN (1) | CN109791722A (fr) |
FR (1) | FR3048544B1 (fr) |
WO (1) | WO2017149047A1 (fr) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3487280B1 (fr) * | 2016-07-22 | 2022-03-30 | Harman International Industries, Incorporated | Système de guidage de conduite haptique |
CN109803583A (zh) * | 2017-08-10 | 2019-05-24 | 北京市商汤科技开发有限公司 | 驾驶状态监控方法、装置和电子设备 |
EP3576074A1 (fr) * | 2018-06-01 | 2019-12-04 | Volvo Car Corporation | Procédé et système pour aider des conducteurs à conduire avec précaution |
US10915769B2 (en) | 2018-06-04 | 2021-02-09 | Shanghai Sensetime Intelligent Technology Co., Ltd | Driving management methods and systems, vehicle-mounted intelligent systems, electronic devices, and medium |
CN109002757A (zh) * | 2018-06-04 | 2018-12-14 | 上海商汤智能科技有限公司 | 驾驶管理方法和系统、车载智能系统、电子设备、介质 |
US10970571B2 (en) | 2018-06-04 | 2021-04-06 | Shanghai Sensetime Intelligent Technology Co., Ltd. | Vehicle control method and system, vehicle-mounted intelligent system, electronic device, and medium |
US11180158B1 (en) * | 2018-07-31 | 2021-11-23 | United Services Automobile Association (Usaa) | Routing or driving systems and methods based on sleep pattern information |
CN111079476B (zh) | 2018-10-19 | 2024-03-26 | 上海商汤智能科技有限公司 | 驾驶状态分析方法和装置、驾驶员监控系统、车辆 |
EP3730331B1 (fr) * | 2019-04-26 | 2023-03-08 | Zenuity AB | Procédé et dispositif pour contrôler une assistance à la conduite |
KR102218526B1 (ko) * | 2019-07-26 | 2021-02-19 | 엘지전자 주식회사 | 졸음 운전을 방지하기 위한 방법, 시스템 및 차량 |
JP7328828B2 (ja) * | 2019-08-27 | 2023-08-17 | フォルシアクラリオン・エレクトロニクス株式会社 | 状態推定装置、状態推定プログラムおよび状態推定方法 |
KR20220000536A (ko) * | 2020-06-26 | 2022-01-04 | 현대자동차주식회사 | 차량 주행 제어 장치 및 방법 |
JP2022063952A (ja) * | 2020-10-13 | 2022-04-25 | 株式会社東海理化電機製作所 | 制御装置、提示システム、及びプログラム |
WO2023119763A1 (fr) * | 2021-12-21 | 2023-06-29 | パナソニックIpマネジメント株式会社 | Dispositif d'estimation d'état de conducteur |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4603264B2 (ja) * | 2002-02-19 | 2010-12-22 | ボルボ テクノロジー コーポレイション | 運転者注意負荷の監視と管理とを行なうシステムおよび方法 |
US7589643B2 (en) * | 2005-06-30 | 2009-09-15 | Gm Global Technology Operations, Inc. | Vehicle speed monitoring system |
US7415977B2 (en) * | 2005-08-04 | 2008-08-26 | Speed Paintball Co., Ltd. | Three-in-one high-pressure gas cylinder magazine |
CN101466305B (zh) * | 2006-06-11 | 2012-05-30 | 沃尔沃技术公司 | 用于确定和分析视觉兴趣位置的方法 |
US20080042814A1 (en) * | 2006-08-18 | 2008-02-21 | Motorola, Inc. | Mode sensitive vehicle hazard warning apparatuses and method |
US7710248B2 (en) * | 2007-06-12 | 2010-05-04 | Palo Alto Research Center Incorporated | Human-machine-interface (HMI) customization based on collision assessments |
ITBO20080081A1 (it) * | 2008-02-07 | 2009-08-08 | Ferrari Spa | Metodo di controllo di un veicolo per adattare il comportamento dinamico del veicolo stesso allo stato psico-fisico del guidatore |
CN101540090B (zh) * | 2009-04-14 | 2011-06-15 | 华南理工大学 | 基于多元信息融合的驾驶员疲劳监测方法 |
JP5519413B2 (ja) * | 2010-06-03 | 2014-06-11 | パナソニック株式会社 | 瞳孔隠蔽状態検出装置及びそれを備えた車載カメラ |
JP5184596B2 (ja) * | 2010-09-03 | 2013-04-17 | 本田技研工業株式会社 | 脇見判定装置 |
US20140276090A1 (en) * | 2011-03-14 | 2014-09-18 | American Vehcular Sciences Llc | Driver health and fatigue monitoring system and method using optics |
US9132774B2 (en) * | 2012-06-22 | 2015-09-15 | GM Global Technology Operations LLC | Alert systems and methods for a vehicle |
US9425654B2 (en) * | 2013-09-30 | 2016-08-23 | Google Inc. | Contactless electrical coupling for a rotatable LIDAR device |
CN104794856B (zh) * | 2014-01-22 | 2018-06-22 | 径卫视觉科技(上海)有限公司 | 驾驶员注意力综合测评系统 |
DE102014207807A1 (de) * | 2014-04-25 | 2015-10-29 | Bayerische Motoren Werke Aktiengesellschaft | Personenbezogene Fahrerunterstützung |
US9669758B2 (en) * | 2015-07-30 | 2017-06-06 | Honda Motor Co., Ltd. | System for alerting a driver and method thereof |
CN105354987B (zh) * | 2015-11-26 | 2018-06-08 | 南京工程学院 | 车载型疲劳驾驶检测与身份认证装置及其检测方法 |
-
2016
- 2016-03-01 FR FR1651689A patent/FR3048544B1/fr active Active
-
2017
- 2017-03-01 JP JP2018546442A patent/JP2019512780A/ja active Pending
- 2017-03-01 EP EP17707902.7A patent/EP3424031A1/fr not_active Withdrawn
- 2017-03-01 WO PCT/EP2017/054833 patent/WO2017149047A1/fr active Application Filing
- 2017-03-01 CN CN201780025237.7A patent/CN109791722A/zh active Pending
- 2017-03-01 US US16/082,171 patent/US20190122525A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
JP2019512780A (ja) | 2019-05-16 |
US20190122525A1 (en) | 2019-04-25 |
FR3048544A1 (fr) | 2017-09-08 |
WO2017149047A1 (fr) | 2017-09-08 |
FR3048544B1 (fr) | 2021-04-02 |
CN109791722A (zh) | 2019-05-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3424031A1 (fr) | Dispositif et méthode de surveillance d'un conducteur d'un véhicule automobile | |
Chang et al. | Design and implementation of a drowsiness-fatigue-detection system based on wearable smart glasses to increase road safety | |
WO2017149045A1 (fr) | Dispositif et méthode de surveillance personnalisés d'un conducteur d'un véhicule automobile | |
WO2017149046A1 (fr) | Dispositif et méthode de surveillance d'un conducteur d'un véhicule de transport | |
EP3265334B1 (fr) | Dispositif et procede de prediction d'un niveau de vigilance chez un conducteur d'un vehicule automobile | |
FR2747346A1 (fr) | Appareil et procede d'estimation du niveau de somnolence du conducteur d'un vehicule | |
WO2017093439A1 (fr) | Dispositif de commande vocale d'un appareil de capture d'images | |
WO2020066757A1 (fr) | Dispositif de prévention de conduite dangereuse | |
US20220036101A1 (en) | Methods, systems and computer program products for driver monitoring | |
WO2016087734A1 (fr) | Procédé d'assistance à au moins un occupant d'un véhicule accidenté et système d'assistance dédié | |
CN105383497B (zh) | 车载系统 | |
WO2017137612A1 (fr) | Dispositif et méthode anti-collision pour un véhicule automobile | |
US11960621B2 (en) | Systems and methods for ensuring privacy in an autonomous vehicle | |
FR3057517A1 (fr) | Dispositif de prevention des situations dangereuses pour un conducteur d'un vehicule de transport et procede associe | |
EP3895142A1 (fr) | Procédé de détermination d'un niveau de somnolence d'un conducteur de véhicule | |
FR3097514A1 (fr) | Procédé pour permettre à un conducteur de faire de manière ciblée un sommeil court | |
EP4271601A1 (fr) | Dispositif d'analyse de la perception d'un danger par un conducteur de véhicule et procédé associé | |
FR3012029A1 (fr) | Procede de detection de la baisse de vigilance du conducteur d'un vehicule automobile | |
FR3057516A1 (fr) | Dispositif de prevention des situations dangereuses pour un conducteur d'un vehicule de transport et procede associe | |
FR3107495A1 (fr) | Dispositif de surveillance pour surveiller une personne qui conduit un véhicule | |
EP4041606B1 (fr) | Détermination d'un état d'utilisateur conduisant activement ou non un véhicule automobile | |
EP4296987B1 (fr) | Système d'attention du conducteur | |
CN114212093B (zh) | 一种安全驾驶监控方法、系统及可存储介质 | |
FR3052421A1 (fr) | Dispositif et methode d'information d'un conducteur d'un vehicule de transport sur son etat de vigilance | |
CN116279517A (zh) | 车辆辅助控制方法及相关设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20181001 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20190424 |