CN106740862A - Driver status monitoring method and monitoring controller for driver state - Google Patents
Driver status monitoring method and monitoring controller for driver state Download PDFInfo
- Publication number
- CN106740862A CN106740862A CN201611076757.4A CN201611076757A CN106740862A CN 106740862 A CN106740862 A CN 106740862A CN 201611076757 A CN201611076757 A CN 201611076757A CN 106740862 A CN106740862 A CN 106740862A
- Authority
- CN
- China
- Prior art keywords
- driver
- driving
- state
- vehicle
- driving condition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/008—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Automation & Control Theory (AREA)
- Human Computer Interaction (AREA)
- Transportation (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a kind of driver status monitoring method and monitoring controller for driver state, the driver status monitoring method includes：When driver is detected in driving condition, the facial feature data of driver is gathered；According to the facial feature data, detect whether the driving condition of driver is in distraction state；When the driving condition for detecting driver is in distraction state, the driving states of vehicle are controlled, to ensure driving safety.The present invention detects driving condition of the driver in driving procedure by gathering the facial characteristics of driver, and driving states to vehicle carry out auxiliary control, have greatly ensured the driving safety in driving procedure.
Description
Technical field
The present invention relates to driver status monitoring technology field, more particularly to a kind of driver status monitoring method and driving
Member's state monitoring device.
Background technology
In actual life, driver drive vehicle when, its driving condition be have influence on driving safety problem it is important because
Element.To ensure the driving safety in driving procedure, it is necessary to be monitored to the driving condition of driver, and according to its monitoring result
Coordinate the driving states of control vehicle.
In the prior art, the device usually bracelet of driver status monitoring function is realized.Driver wears the bracelet,
The data such as the heart rate of Sensor monitoring function monitor driver using bracelet, when heart rate is more than a certain threshold value, then judge to drive
The person of sailing is in distraction state, sends alerting signal prompting driver and notes driving safety.
But, the above method exist a defect, driver drive vehicle during, its physical trait data influence
Factor is larger, the emotional change of such as driver, change of temperature etc., can all cause the ripple of the data such as the heart rate of driver
Dynamic, the data for causing bracelet to measure are not rigorous so that the reliability of the judged result based on these data is not high, it is impossible to true
Reflect the real driving condition of driver, cause driving condition that cannot be exactly to driver to be monitored, greatly
Have impact on the driving safety in driving procedure.
The content of the invention
It is a primary object of the present invention to provide a kind of driver status monitoring method and monitoring controller for driver state, purport
Driver is being solved in driving procedure, it is impossible to which the driving condition to driver is monitored exactly, in causing driving procedure
The technical problem that driving safety cannot be ensured.
To achieve the above object, the embodiment of the present invention provides a kind of driver status monitoring method, the driver status
Monitoring method includes：
When driver is detected in driving condition, the facial feature data of driver is gathered；
According to the facial feature data, detect whether the driving condition of driver is in distraction state；
When the driving condition for detecting driver is in distraction state, the driving states of vehicle are controlled, to protect
Barrier driving safety.
Alternatively, the facial feature data includes frequency of wink, eye-closing period, frequency of bowing,
It is described according to the facial feature data, detect the driving condition of driver whether in distraction state
Step also includes：
It is more than default frequency of wink, eye-closing period more than default eye-closing period, frequency of bowing when the frequency of wink is detected
When rate is set up more than a condition in default frequency of bowing or multiple conditions, judge that the driving condition of driver is in spirit not
Collected state.
Alternatively, it is described according to the facial feature data, detect whether the driving condition of driver does not collect in spirit
The step of middle state, also includes：
Detect whether the driving time of driver is more than predetermined threshold value；
When the driving time for detecting driver is more than predetermined threshold value, then judge that the driving condition of driver is in spirit
Not collected state.
Alternatively, it is described when the driving condition for detecting driver is in distraction state, control the row of vehicle
Car state, also includes the step of to ensure driving safety：
When the driving condition for detecting driver is in distraction state, then the driving speed of vehicle driving states is reduced
The Function for Automatic Pilot of degree and/or startup vehicle, to control the driving states of vehicle, ensures driving safety.
Alternatively, it is described when the driving condition for detecting driver is in distraction state, control the row of vehicle
Car state, also includes the step of to ensure driving safety：
When the driving condition for detecting driver is in distraction state, send cue to carry to driver
Show that driver notes driving safety, and other vehicles to vehicle periphery where driver send early warning signal.
Additionally, to achieve the above object, the present invention also provides a kind of monitoring controller for driver state, the driver status
Supervising device includes：
Acquisition module, for when driver is detected in driving condition, gathering the facial feature data of driver；
Detection module, for according to the facial feature data, detecting whether the driving condition of driver is in spirit not
Collected state；
Control module, for when the driving condition for detecting driver is in distraction state, controlling vehicle
Driving states, to ensure driving safety.
Alternatively, the facial feature data includes frequency of wink, eye-closing period, frequency of bowing, and the detection module is also
For：
It is more than default frequency of wink, eye-closing period more than default eye-closing period, frequency of bowing when the frequency of wink is detected
When rate is set up more than a condition in default frequency of bowing or multiple conditions, judge that the driving condition of driver is in spirit not
Collected state.
Alternatively, the detection module also includes：
Detection unit, for detecting the driving time of driver whether more than predetermined threshold value；
Judging unit, for when the driving time for detecting driver is more than predetermined threshold value, then judging driving for driver
Sail state and be in distraction state.
Alternatively, the control module is additionally operable to：
When the driving condition for detecting driver is in distraction state, then the driving speed of vehicle driving states is reduced
The Function for Automatic Pilot of degree and/or startup vehicle, to control the driving states of vehicle, ensures driving safety.
Alternatively, the control module is additionally operable to：
When the driving condition for detecting driver is in distraction state, send cue to carry to driver
Show that driver notes driving safety, and other vehicles to vehicle periphery where driver send early warning signal.
In technical solution of the present invention, first when driver is detected in driving condition, the face of driver is gathered
Characteristic；Then according to the facial feature data, detect whether the driving condition of driver is in distraction state；
Finally when the driving condition for detecting driver is in distraction state, the driving states of vehicle are controlled, driven with ensureing
Sail safety.Through the above way, the driving condition of driver can accurately be monitored during vehicle is driven, truly
The driving condition of driver is reacted, and makes corresponding control to vehicle to the driving condition according to driver, ensure driver
Driving safety in driving procedure.
Brief description of the drawings
Fig. 1 is the optional schematic diagram of a scenario of each embodiment in driver status monitoring method of the present invention；
Fig. 2 is the schematic flow sheet of driver status monitoring method first embodiment of the present invention；
Fig. 3 is according to the facial feature data, inspection described in driver status monitoring method 3rd embodiment of the present invention
The schematic flow sheet of the step of whether surveying the driving condition of driver in distraction state；
Fig. 4 is the module diagram of monitoring controller for driver state first embodiment of the present invention；
Fig. 5 is the refinement module schematic diagram of detection module in monitoring controller for driver state 3rd embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, and refer to the attached drawing is described further.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The monitoring controller for driver state of each embodiment of the invention is realized referring now to Description of Drawings.Retouched in follow-up
In stating, using the suffix of such as " module ", " part " or " unit " for representing element only for being conducive to theory of the invention
It is bright, itself do not have specific meaning.Therefore, " module " can be used mixedly with " part ".
With reference to Fig. 2, the present invention provides a kind of driver status monitoring method, and the driver status monitoring method is mainly applied
In on monitoring controller for driver state, in driver status monitoring method first embodiment, the driver status monitoring method
Including：
Step S10, when driver is detected in driving condition, gathers the facial feature data of driver；
Reference picture 1, Fig. 1 is a schematic diagram of a scenario of each embodiment of the invention, and A is monitoring controller for driver state, and B is
Driver, C is vehicle.Above-mentioned monitoring controller for driver state A can be the equipment such as vehicle mounted imaging apparatus, closed-circuit control device,
Monitoring controller for driver state A generally is equipped with camera and analyzing and processing element, and wherein camera is mainly used in detection
With collection facial feature datas of the driver B in driving procedure, and analyze and process element and be mainly used in analysis camera institute
The facial feature data for detecting and collecting, to obtain analysis knots of the monitoring controller for driver state A to driver's B state of mind
Really.In the present embodiment, the driving condition refers to the state that driver B controls vehicle C starts to exercise, and its agent object is
Driver B.The facial feature data is important reference data in technical solution of the present invention, including but not limited to following to be lifted
Example：Eye-closing period, frequency of wink, the frequency yawned etc..The citing of these facial characteristics is special with universal face
Levy and representative, the collection to driver's B facial feature datas enables to monitoring controller for driver state A more accurately to divide
The driving condition of analysis driver B, is the precondition performed to next step function.
Step S20, according to the facial feature data, detects whether the driving condition of driver is in distraction shape
State；
According to the facial feature data of the driver for collecting, monitoring controller for driver state can detect that the face is special
Data are levied, to obtain the driving condition of driver, by the analysis to driver's driving condition, the driving condition of driver is known
Whether distraction state is in.The facial characteristics of driver is capable of the state of mind of actual response driver, actual life
In, if driver frequently yawns, it is meant that the state that driver drives vehicle has been in fatigue state；If driver is double
Eye is closed always, then prove that driver is not concerned with the front of vehicle traveling direction in driving procedure, now at driver
In the state of dangerous driving.Citing above is the explanation of actual life middle part branch scape, and above-mentioned scene is quantified
It is the detection function in monitoring controller for driver state, when the frequency yawned equivalent to detection driver or driver close one's eyes
Between, compare by with the reference data being pre-stored in monitoring controller for driver state, so that correspondence obtains driving for driver
Whether state is sailed in distraction state.
Step S30, when the driving condition for detecting driver is in distraction state, controls the driving shape of vehicle
State, to ensure driving safety.
If the driving condition that monitoring controller for driver state detects driver is in distraction state, then think
The driving safety for now driver is subject to certain threat.Now, because the driving condition of driver is quickly to carry out
Adjustment, and driver is probably unconscious to oneself driving condition in itself, i.e., driver not yet recognizes driving for vehicle
Sailing safety may just be threatened, therefore monitoring controller for driver state needs to make the driving states of vehicle certain tune
It is whole, to aid in controlling the driving states of vehicle, ensure the driving safety of driver and vehicle.
In technical solution of the present invention, first when driver is detected in driving condition, the face of collection driver is special
Levy data；Then according to the facial feature data, detect whether the driving condition of driver is in distraction state；Most
Afterwards when the driving condition for detecting driver is in distraction state, the driving states of vehicle are controlled, to ensure driving
Safety.Through the above way, the driving condition of driver can accurately be monitored during vehicle is driven, it is true anti-
The driving condition of driver is answered, and makes corresponding control to vehicle to the driving condition according to driver, ensure that driver exists
Driving safety in driving states.
Further, on the basis of driver status monitoring method first embodiment of the present invention, driver status are proposed
Monitoring method second embodiment, the difference between the second embodiment and first embodiment is, the facial feature data
Including frequency of wink, eye-closing period, frequency of bowing,
It is described according to the facial feature data, detect the driving condition of driver whether in distraction state
Step also includes：
It is more than default frequency of wink, eye-closing period more than default eye-closing period, frequency of bowing when the frequency of wink is detected
When rate is set up more than a condition in default frequency of bowing or multiple conditions, judge that the driving condition of driver is in spirit not
Collected state.
In the facial feature data of monitoring controller for driver state collection, include frequency of wink, eye-closing period, bow
The characteristics such as frequency.Certainly, not merely there was only example provided above in the facial feature data, other can be driven
Facial feature data detected by the person's of sailing state monitoring device is belonged in the middle of scope of patent protection of the invention.The blink
Frequency, refers to the number of times that driver blinks within the unit interval.The eye-closing period, refers to driver and is driving vehicle
During, close the duration that eyes are passed through every time, including eyes are closed in blink action to being passed through during opening eyes
The duration and driver crossed close eyes to the duration passed through during opening eyes when non-blink is acted.It is described low
Head frequency, refers to the number of times that driver bows within the unit interval.During blinking in driver, close one's eyes, bowing, vehicle
Still advance, in driving states, and these actions can virtually influence or reflect that driver drives the driving of vehicle
State.The frequency of wink of the driver collected when monitoring controller for driver state is excessively frequently, eye-closing period is long or bows
When frequency is frequent, then prove that the eyes of driver are likely to be at fatigue state, eye-closing period is long, show that driver may essence
God is dimmed or even is dozing off, and frequency of bowing then means that driver is not absorbed in vehicle and is expert at more than default frequency of bowing
The situation of road ahead in car state, situation above all will seriously threaten driver and vehicle traffic safety in itself.Therefore,
Needs are provided with default frequency of wink, default eye-closing period and default frequency of bowing in monitoring controller for driver state, while
It is more than default frequency of wink, eye-closing period more than default eye-closing period, frequency of bowing more than pre- when the frequency of wink is detected
If wherein one or more conditions in frequency of bowing are set up, then meaning the driving safety of vehicle under present case will suffer
Threaten, driver cannot concentrate on driving vehicle with notice, i.e., cannot perform the operation for driving vehicle normal safe,
In distraction state.
Further, on the basis of driver status monitoring method first embodiment of the present invention, driver status are proposed
Monitoring method 3rd embodiment, with reference to Fig. 3, the difference between the 3rd embodiment and first embodiment is, the basis
The facial feature data, detects that the step of whether driving condition of driver is in distraction state also includes：
Step S21, detects whether the driving time of driver is more than predetermined threshold value；
Step S22, when the driving time for detecting driver is more than predetermined threshold value, then judges the driving condition of driver
In distraction state.
Another detection is also provided except the detection and analysis of the facial feature data to driver, in the embodiment of the present invention
Mode, i.e., detected by the length of the driving time of driver status monitor and detection driver.The driving time, refers to
Driver from the time point where starting to drive vehicle to it is current drive vehicle when where time point whole process in all from
The duration passed through in driving condition.Such as driver is the driving vehicle since seven o'clock of morning, until the same day
Nine o'clock of morning is all in driving condition, then whole process continue for a hour, it is assumed that current driver's condition monitoring
The default predetermined threshold value of device is one hour, then the driving time of driver is detected in monitoring controller for driver state more than pre-
If during threshold value, judging that the current driving condition of driver is in distraction state.
Further, on the basis of driver status monitoring method first embodiment of the present invention, driver status are proposed
Monitoring method fourth embodiment, the difference between the fourth embodiment and first embodiment is, described to detect driving
When the driving condition of member is in distraction state, the driving states of vehicle are controlled, also wrapped the step of to ensure driving safety
Include：
When the driving condition for detecting driver is in distraction state, then the driving speed of vehicle driving states is reduced
The Function for Automatic Pilot of degree and/or startup vehicle, to control the driving states of vehicle, ensures driving safety.
Once the driving condition for detecting driver is in distraction state, then prove the driving of now driver
Cannot ensure safely, may cause the generation of traffic accident not in time because of driver's reaction at any time.Therefore, except dependence is driven
Outside the person of sailing is controlled to vehicle, in addition it is also necessary to which monitoring controller for driver state makes preventive measure, auxiliary control vehicle
Driving states, to ensure driving safety.And ensure that the method for driving safety can be divided into two kinds, reduce vehicle in driving states
Under road speed, or start vehicle Function for Automatic Pilot, by intelligentized programming system control vehicle driving shape
State, eliminates the uncertain noncontrollable factors of driver's driving condition, completes automatic Pilot operation, farthest ensures driving
Driving safety in state.Wherein, monitoring controller for driver state can be based on CAN association to the control technology of vehicle
View, used as the serial communication protocol of International standardization, CAN agreement possesses security, comfortableness, convenience, low nuisanceless
With various advantages such as low cost, powerful technical support can be provided for the embodiment of the present invention.
The method of control vehicle driving states can all allow driver to perceive driver status in a short time and supervise above
Judgement of the control device to current driving safety, so as to improve the vigilance of driver, concentrates on the row of the current vehicle of concern
Car state and driving safety.
Further, on the basis of driver status monitoring method fourth embodiment of the present invention, driver status are proposed
The embodiment of monitoring method the 5th, the difference between the 5th embodiment and fourth embodiment is, described to detect driving
When the driving condition of member is in distraction state, the driving states of vehicle are controlled, also wrapped the step of to ensure driving safety
Include：
When the driving condition for detecting driver is in distraction state, send cue to carry to driver
Show that driver notes driving safety, and other vehicles to vehicle periphery where driver send early warning signal.
It is to perform in real time to the detection function and analytic function of driver's driving condition due to monitoring controller for driver state
, therefore the function of the driving states of its control vehicle is also to perform in real time, in this process, the state of mind of driver is not
Concentrate, its respond also declines therewith, therefore, monitoring controller for driver state needs to point out driver, Ke Yifa
Go out the cue that driver can discover, point out driver to note driving safety.To ensure that driver can be conveniently and efficiently
Receive the cue, cue can be voice message, light prompt etc., so as to driver can quickly adjust from
Oneself driving condition, enhances your vigilance, and notes driving safety.Meanwhile, monitoring controller for driver state can also be to where driver
Other vehicles of vehicle periphery send early warning signal, for example entered by light flash, voice reminder or vehicle external display screen
Compose a piece of writing this early warning, to point out other vehicles to keep certain spacing, the driving of further support vehicles with vehicle where driver
Safety.
The present invention also provides a kind of monitoring controller for driver state, in monitoring controller for driver state first embodiment,
With reference to Fig. 4, the monitoring controller for driver state includes：
Acquisition module 10, for when driver is detected in driving condition, gathering the facial feature data of driver；
Reference picture 1, Fig. 1 is a schematic diagram of a scenario of each embodiment of the invention, and A is monitoring controller for driver state, and B is
Driver, C is vehicle.Above-mentioned monitoring controller for driver state A can be the equipment such as vehicle mounted imaging apparatus, closed-circuit control device,
Monitoring controller for driver state A generally is equipped with camera and analyzing and processing element, and wherein camera is mainly used in detection
With collection facial feature datas of the driver B in driving procedure, and analyze and process element and be mainly used in analysis camera institute
The facial feature data for detecting and collecting, to obtain analysis knots of the monitoring controller for driver state A to driver's B state of mind
Really.In the present embodiment, the driving condition refers to the state that driver B controls vehicle C starts to exercise, and its agent object is
Driver B.The facial feature data is important reference data in technical solution of the present invention, including but not limited to following to be lifted
Example：Eye-closing period, frequency of wink, the frequency yawned etc..The citing of these facial characteristics is special with universal face
Levy and representative, the collection to driver's B facial feature datas enables to monitoring controller for driver state A more accurately to divide
The driving condition of analysis driver B, is the precondition performed to next step function.
Detection module 20, for according to the facial feature data, detecting the driving condition of driver whether in spirit
Not collected state；
According to the facial feature data of the driver for collecting, monitoring controller for driver state can detect that the face is special
Data are levied, to obtain the driving condition of driver, by the analysis to driver's driving condition, the driving condition of driver is known
Whether distraction state is in.The facial characteristics of driver is capable of the state of mind of actual response driver, actual life
In, if driver frequently yawns, it is meant that the state that driver drives vehicle has been in fatigue state；If driver is double
Eye is closed always, then prove that driver is not concerned with the front of vehicle traveling direction in driving procedure, now at driver
In the state of dangerous driving.Citing above is the explanation of actual life middle part branch scape, and above-mentioned scene is quantified
It is the detection function in monitoring controller for driver state, when the frequency yawned equivalent to detection driver and driver close one's eyes
Between, compare by with the reference threshold being pre-stored in monitoring controller for driver state, so that correspondence obtains driving for driver
Whether state is sailed in distraction state.
Control module 30, for when the driving condition for detecting driver is in distraction state, controlling vehicle
Driving states, to ensure driving safety.
If the driving condition that monitoring controller for driver state detects driver is in distraction state, then think
The driving safety for now driver is subject to certain threat.Now, because the driving condition of driver is quickly to carry out
Adjustment, and driver is probably unconscious to oneself driving condition in itself, i.e., driver not yet recognizes driving for vehicle
Sailing safety may just be threatened, therefore monitoring controller for driver state needs to make the driving states of vehicle certain tune
It is whole, to aid in controlling the driving states of vehicle, ensure the driving safety of driver and vehicle.
In technical solution of the present invention, first when driver is detected in driving condition, the face of collection driver is special
Levy data；Then according to the facial feature data, detect whether the driving condition of driver is in distraction state；Most
Afterwards when the driving condition for detecting driver is in distraction state, the driving states of vehicle are controlled, to ensure driving
Safety.Through the above way, the driving condition of driver can accurately be monitored during vehicle is driven, it is true anti-
The driving condition of driver is answered, and makes corresponding control to vehicle to the driving condition according to driver, ensure that driver exists
Driving safety in driving states.
Further, on the basis of monitoring controller for driver state first embodiment of the present invention, driver status are proposed
Supervising device second embodiment, the difference between the second embodiment and first embodiment is, the facial feature data
Including frequency of wink, eye-closing period, frequency of bowing, the detection module 20 is additionally operable to：
It is more than default frequency of wink, eye-closing period more than default eye-closing period, frequency of bowing when the frequency of wink is detected
When rate is set up more than a condition in default frequency of bowing or multiple conditions, judge that the driving condition of driver is in spirit not
Collected state.
In the facial feature data of monitoring controller for driver state collection, include frequency of wink, eye-closing period, bow
The characteristics such as frequency.Certainly, not merely there was only example provided above in the facial feature data, other can be driven
Facial feature data detected by the person's of sailing state monitoring device is belonged in the middle of scope of patent protection of the invention.The blink
Frequency, refers to the number of times that driver blinks within the unit interval.The eye-closing period, refers to driver and is driving vehicle
During, close the duration that eyes are passed through every time, including eyes are closed in blink action to being passed through during opening eyes
The duration and driver crossed close eyes to the duration passed through during opening eyes when non-blink is acted.It is described low
Head frequency, refers to the number of times that driver bows within the unit interval.During blinking in driver, close one's eyes, bowing, vehicle
Still advance, in driving states, and these actions can virtually influence or reflect that driver drives the driving of vehicle
State.The frequency of wink of the driver collected when monitoring controller for driver state is excessively frequently, eye-closing period is long or bows
When frequency is frequent, then prove that the eyes of driver are likely to be at fatigue state, eye-closing period is long, show that driver may essence
God is dimmed or even is dozing off, and frequency of bowing then means that driver is not absorbed in vehicle and is expert at more than default frequency of bowing
The situation of road ahead in car state, situation above all will seriously threaten driver and vehicle traffic safety in itself.Therefore,
Needs are provided with default frequency of wink, default eye-closing period and default frequency of bowing in monitoring controller for driver state, while
It is more than default frequency of wink, eye-closing period more than default eye-closing period, frequency of bowing more than pre- when the frequency of wink is detected
If wherein one or more conditions in frequency of bowing are set up, then meaning the driving safety of vehicle under present case will suffer
Threaten, driver cannot concentrate on driving vehicle with notice, i.e., cannot perform the operation for driving vehicle normal safe,
In distraction state.
Further, on the basis of monitoring controller for driver state first embodiment of the present invention, driver status are proposed
Supervising device 3rd embodiment, with reference to Fig. 5, the difference between the 3rd embodiment and first embodiment is, the detection
Module 20 includes：
Detection unit 21, for detecting the driving time of driver whether more than predetermined threshold value；
Judging unit 22, for when the driving time for detecting driver is more than predetermined threshold value, then judging driver's
Driving condition is in distraction state.
Another detection is also provided except the detection and analysis of the facial feature data to driver, in the embodiment of the present invention
Mode, i.e., detected by the length of the driving time of driver status monitor and detection driver.The driving time, refers to
Driver from the time point where starting to drive vehicle to it is current drive vehicle when where time point whole process in all from
The duration passed through in driving condition.Such as driver is the driving vehicle since seven o'clock of morning, until the same day
Nine o'clock of morning is all in driving condition, then whole process continue for a hour, it is assumed that current driver's condition monitoring
The default predetermined threshold value of device is one hour, then the driving time of driver is detected in monitoring controller for driver state more than pre-
If during threshold value, judging that the current driving condition of driver is in distraction state.
Further, on the basis of monitoring controller for driver state first embodiment of the present invention, driver status are proposed
Supervising device fourth embodiment, the difference between the fourth embodiment and first embodiment is that the control module 30 is also
For：
When the driving condition for detecting driver is in distraction state, then the driving speed of vehicle driving states is reduced
The Function for Automatic Pilot of degree and/or startup vehicle, to control the driving states of vehicle, ensures driving safety.
Once the driving condition for detecting driver is in distraction state, then prove the driving of now driver
Cannot ensure safely, may cause the generation of traffic accident not in time because of driver's reaction at any time.Therefore, except dependence is driven
Outside the person of sailing is controlled to vehicle, in addition it is also necessary to which monitoring controller for driver state makes preventive measure, auxiliary control vehicle
Driving states, to ensure driving safety.And ensure that the method for driving safety can be divided into two kinds, reduce vehicle in driving states
Under road speed, or start vehicle Function for Automatic Pilot, by intelligentized programming system control vehicle driving shape
State, eliminates the uncertain noncontrollable factors of driver's driving condition, completes automatic Pilot operation, farthest ensures driving
Driving safety in state.Wherein, monitoring controller for driver state can be based on CAN association to the control technology of vehicle
View, used as the serial communication protocol of International standardization, CAN agreement possesses security, comfortableness, convenience, low nuisanceless
With various advantages such as low cost, powerful technical support can be provided for the embodiment of the present invention.
The method of control vehicle driving states can all allow driver to perceive driver status in a short time and supervise above
Judgement of the control device to current driving safety, so as to improve the vigilance of driver, concentrates on the row of the current vehicle of concern
Car state and driving safety.
Further, on the basis of monitoring controller for driver state fourth embodiment of the present invention, driver status are proposed
The embodiment of supervising device the 5th, the difference between the 5th embodiment and fourth embodiment is that the control module 30 is also
For：
When the driving condition for detecting driver is in distraction state, send cue to carry to driver
Show that driver notes driving safety, and other vehicles to vehicle periphery where driver send early warning signal.
It is to perform in real time to the detection function and analytic function of driver's driving condition due to monitoring controller for driver state
, therefore the function of the driving states of its control vehicle is also to perform in real time, in this process, the state of mind of driver is not
Concentrate, its respond also declines therewith, therefore, monitoring controller for driver state needs to point out driver, Ke Yifa
Go out the cue that driver can discover, point out driver to note driving safety.To ensure that driver can be conveniently and efficiently
Receive the cue, cue can be voice message, light prompt etc., so as to driver can quickly adjust from
Oneself driving condition, enhances your vigilance, and notes driving safety.Meanwhile, monitoring controller for driver state can also be to where driver
Other vehicles of vehicle periphery send early warning signal, for example entered by light flash, voice reminder or vehicle external display screen
Compose a piece of writing this early warning, to point out other vehicles to keep certain spacing, the driving of further support vehicles with vehicle where driver
Safety.
It should be noted that herein, term " including ", "comprising" or its any other variant be intended to non-row
His property is included, so that process, method, article or device including a series of key elements not only include those key elements, and
And also include other key elements being not expressly set out, or also include for this process, method, article or device institute are intrinsic
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Also there is other identical element in the process of key element, method, article or device.
The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably implementation method.Based on such understanding, technical scheme is substantially done to prior art in other words
The part for going out contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are used to so that a station terminal equipment (can be mobile phone, computer, clothes
Business device, air-conditioner, or network equipment etc.) perform method described in each embodiment of the invention.
The preferred embodiments of the present invention are these are only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of driver status monitoring method, it is characterised in that the driver status monitoring method includes：
When driver is detected in driving condition, the facial feature data of driver is gathered；
According to the facial feature data, detect whether the driving condition of driver is in distraction state；
When the driving condition for detecting driver is in distraction state, the driving states of vehicle are controlled, driven with ensureing
Sail safety.
2. driver status monitoring method as claimed in claim 1, it is characterised in that the facial feature data includes blink
Frequency, eye-closing period, frequency of bowing,
It is described according to the facial feature data, the step of whether detect the driving condition of driver in distraction state
Also include：
It is big more than default eye-closing period, frequency of bowing more than default frequency of wink, eye-closing period when the frequency of wink is detected
When a condition or multiple conditions in default frequency of bowing are set up, judge that the driving condition of driver is in distraction
State.
3. driver status monitoring method as claimed in claim 1, it is characterised in that described according to the facial characteristics number
According to, detect driver driving condition whether in distraction state the step of also include：
Detect whether the driving time of driver is more than predetermined threshold value；
When the driving time for detecting driver is more than predetermined threshold value, then judge that the driving condition of driver is in spirit and does not collect
Middle state.
4. driver status monitoring method as claimed in claim 1, it is characterised in that described when the driving that detect driver
When state is in distraction state, the driving states of vehicle are controlled, also included the step of to ensure driving safety：
When the driving condition for detecting driver is in distraction state, then the road speed of vehicle driving states is reduced
And/or the Function for Automatic Pilot of startup vehicle, to control the driving states of vehicle, ensure driving safety.
5. the driver status monitoring method as described in Claims 1-4 any one, it is characterised in that described when detecting
When the driving condition of driver is in distraction state, the driving states of vehicle are controlled, the step of to ensure driving safety
Also include：
When the driving condition for detecting driver is in distraction state, send cue to driver to point out to drive
The person of sailing notes driving safety, and other vehicles to vehicle periphery where driver send early warning signal.
6. a kind of monitoring controller for driver state, it is characterised in that the monitoring controller for driver state includes：
Acquisition module, for when driver is detected in driving condition, gathering the facial feature data of driver；
Detection module, for according to the facial feature data, detecting whether the driving condition of driver is in distraction
State；
Control module, for when the driving condition for detecting driver is in distraction state, controlling the driving of vehicle
State, to ensure driving safety.
7. monitoring controller for driver state as claimed in claim 6, it is characterised in that the facial feature data includes blink
Frequency, eye-closing period, frequency of bowing, the detection module are additionally operable to：
It is big more than default eye-closing period, frequency of bowing more than default frequency of wink, eye-closing period when the frequency of wink is detected
When a condition or multiple conditions in default frequency of bowing are set up, judge that the driving condition of driver is in distraction
State.
8. monitoring controller for driver state as claimed in claim 6, it is characterised in that the detection module also includes：
Detection unit, for detecting the driving time of driver whether more than predetermined threshold value；
Judging unit, for when the driving time for detecting driver is more than predetermined threshold value, then judging the driving shape of driver
State is in distraction state.
9. monitoring controller for driver state as claimed in claim 6, it is characterised in that the control module is additionally operable to：
When the driving condition for detecting driver is in distraction state, then the road speed of vehicle driving states is reduced
And/or the Function for Automatic Pilot of startup vehicle, to control the driving states of vehicle, ensure driving safety.
10. the monitoring controller for driver state as described in claim 6 to 9 any one, it is characterised in that the control module
It is additionally operable to：
When the driving condition for detecting driver is in distraction state, send cue to driver to point out to drive
The person of sailing notes driving safety, and other vehicles to vehicle periphery where driver send early warning signal.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611076757.4A CN106740862A (en) | 2016-11-29 | 2016-11-29 | Driver status monitoring method and monitoring controller for driver state |
| PCT/CN2017/078423 WO2018098947A1 (en) | 2016-11-29 | 2017-03-28 | Method and device for monitoring state of driver |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611076757.4A CN106740862A (en) | 2016-11-29 | 2016-11-29 | Driver status monitoring method and monitoring controller for driver state |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106740862A true CN106740862A (en) | 2017-05-31 |
Family
ID=58897909
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611076757.4A Pending CN106740862A (en) | 2016-11-29 | 2016-11-29 | Driver status monitoring method and monitoring controller for driver state |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106740862A (en) |
| WO (1) | WO2018098947A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107351842A (en) * | 2017-06-05 | 2017-11-17 | 广西荣中科技有限责任公司 | A kind of safety driving system |
| CN108417021A (en) * | 2018-03-07 | 2018-08-17 | 京东方科技集团股份有限公司 | Automobile-used information sharing system and method |
| CN109291794A (en) * | 2018-09-28 | 2019-02-01 | 上汽通用五菱汽车股份有限公司 | Driver status monitoring method, automobile and storage medium |
| CN109334670A (en) * | 2018-12-04 | 2019-02-15 | 吉林大学 | A kind of vehicle drive people monitoring and early warning method, system, equipment and storage medium |
| WO2019056259A1 (en) * | 2017-09-21 | 2019-03-28 | 深圳传音制造有限公司 | Fatigue driving warning method and terminal |
| CN109606375A (en) * | 2018-12-26 | 2019-04-12 | 苏州智华汽车电子有限公司 | A method of improving safe driving |
| CN109760690A (en) * | 2019-01-18 | 2019-05-17 | 深圳市趣创科技有限公司 | Method for detecting fatigue driving, system and storage medium |
| CN110287838A (en) * | 2019-06-17 | 2019-09-27 | 韶关市启之信息技术有限公司 | A kind of monitoring method and system for driving to play mobile phone behavior |
| CN110576861A (en) * | 2019-08-11 | 2019-12-17 | 西藏宁算科技集团有限公司 | Vehicle control method and system based on visual recognition combined with tactile recognition |
| CN112092898A (en) * | 2019-06-17 | 2020-12-18 | 比亚迪股份有限公司 | Vehicle and control method and device thereof |
| CN112277955A (en) * | 2020-10-30 | 2021-01-29 | 安徽江淮汽车集团股份有限公司 | Driving assistance method, device, equipment and storage medium |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109733280B (en) * | 2018-12-05 | 2021-07-20 | 江苏大学 | Vehicle safety device based on facial features of driver and control method thereof |
| CN112438728A (en) * | 2019-08-28 | 2021-03-05 | 深圳市超捷通讯有限公司 | Safe driving detection device and detection method |
| CN112208544B (en) * | 2020-10-21 | 2022-10-14 | 合肥工业大学 | Driving capability judgment method for driver, safe driving method and system thereof |
| CN113591533A (en) * | 2021-04-27 | 2021-11-02 | 浙江工业大学之江学院 | Anti-fatigue driving method, device, equipment and storage medium based on road monitoring |
| CN113537135A (en) * | 2021-07-30 | 2021-10-22 | 三一重机有限公司 | Driving monitoring method, device and system and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060011399A1 (en) * | 2004-07-15 | 2006-01-19 | International Business Machines Corporation | System and method for controlling vehicle operation based on a user's facial expressions and physical state |
| CN104318714A (en) * | 2014-11-12 | 2015-01-28 | 沈阳美行科技有限公司 | Fatigue driving pre-warning method |
| CN105096528A (en) * | 2015-08-05 | 2015-11-25 | 广州云从信息科技有限公司 | Fatigue driving detection method and system |
| CN204801768U (en) * | 2015-05-25 | 2015-11-25 | 浙江商业职业技术学院 | Driver status monitoring device |
| CN105966404A (en) * | 2015-11-06 | 2016-09-28 | 乐卡汽车智能科技（北京）有限公司 | Method and device for evaluating driving behavior |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4841425B2 (en) * | 2003-06-06 | 2011-12-21 | ボルボ テクノロジー コーポレイション | Method and mechanism for controlling automobile subsystems based on driver behavior interpretation |
| US9308914B1 (en) * | 2015-01-23 | 2016-04-12 | Denso International America, Inc. | Advanced driver assistance system for vehicle |
-
2016
- 2016-11-29 CN CN201611076757.4A patent/CN106740862A/en active Pending
-
2017
- 2017-03-28 WO PCT/CN2017/078423 patent/WO2018098947A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060011399A1 (en) * | 2004-07-15 | 2006-01-19 | International Business Machines Corporation | System and method for controlling vehicle operation based on a user's facial expressions and physical state |
| CN104318714A (en) * | 2014-11-12 | 2015-01-28 | 沈阳美行科技有限公司 | Fatigue driving pre-warning method |
| CN204801768U (en) * | 2015-05-25 | 2015-11-25 | 浙江商业职业技术学院 | Driver status monitoring device |
| CN105096528A (en) * | 2015-08-05 | 2015-11-25 | 广州云从信息科技有限公司 | Fatigue driving detection method and system |
| CN105966404A (en) * | 2015-11-06 | 2016-09-28 | 乐卡汽车智能科技（北京）有限公司 | Method and device for evaluating driving behavior |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107351842A (en) * | 2017-06-05 | 2017-11-17 | 广西荣中科技有限责任公司 | A kind of safety driving system |
| WO2019056259A1 (en) * | 2017-09-21 | 2019-03-28 | 深圳传音制造有限公司 | Fatigue driving warning method and terminal |
| CN108417021A (en) * | 2018-03-07 | 2018-08-17 | 京东方科技集团股份有限公司 | Automobile-used information sharing system and method |
| CN108417021B (en) * | 2018-03-07 | 2021-08-17 | 京东方科技集团股份有限公司 | Vehicle information sharing system and method |
| CN109291794A (en) * | 2018-09-28 | 2019-02-01 | 上汽通用五菱汽车股份有限公司 | Driver status monitoring method, automobile and storage medium |
| CN109334670A (en) * | 2018-12-04 | 2019-02-15 | 吉林大学 | A kind of vehicle drive people monitoring and early warning method, system, equipment and storage medium |
| CN109606375A (en) * | 2018-12-26 | 2019-04-12 | 苏州智华汽车电子有限公司 | A method of improving safe driving |
| CN109760690A (en) * | 2019-01-18 | 2019-05-17 | 深圳市趣创科技有限公司 | Method for detecting fatigue driving, system and storage medium |
| CN110287838A (en) * | 2019-06-17 | 2019-09-27 | 韶关市启之信息技术有限公司 | A kind of monitoring method and system for driving to play mobile phone behavior |
| CN112092898A (en) * | 2019-06-17 | 2020-12-18 | 比亚迪股份有限公司 | Vehicle and control method and device thereof |
| CN110576861A (en) * | 2019-08-11 | 2019-12-17 | 西藏宁算科技集团有限公司 | Vehicle control method and system based on visual recognition combined with tactile recognition |
| CN112277955A (en) * | 2020-10-30 | 2021-01-29 | 安徽江淮汽车集团股份有限公司 | Driving assistance method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018098947A1 (en) | 2018-06-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106740862A (en) | Driver status monitoring method and monitoring controller for driver state | |
| CN106709420B (en) | Method for monitoring driving behavior of commercial vehicle driver | |
| US9988055B1 (en) | Vehicle occupant monitoring using infrared imaging | |
| CN104146722B (en) | Driving fatigue detecting and grading early warning method based on head signals | |
| JP4845886B2 (en) | Method and apparatus for generating personal alert level indications | |
| US10538259B2 (en) | Fit-for-duty detection and alerting system for rail and transit | |
| CN106781284A (en) | Trainman's driver fatigue monitor system based on Multi-information acquisition | |
| CN106585624A (en) | Driver state monitoring method and device | |
| CN112016457A (en) | Driver distraction and dangerous driving behavior recognition method, device and storage medium | |
| CN105292125B (en) | Driver state monitoring method | |
| CN110211335A (en) | The method and apparatus that the microsleep of driver used for vehicles is identified | |
| CN109801475A (en) | Method for detecting fatigue driving, device and computer readable storage medium | |
| KR20190134909A (en) | The apparatus and method for Driver Status Recognition based on Driving Status Decision Information | |
| KR102525413B1 (en) | Apparatus and method for estimating driver readiness and system and method for assisting driver | |
| CN114463940A (en) | Method and equipment for warning abnormal driving behavior of driver by lamplight | |
| CN104376685A (en) | Fatigue driving preventing vehicle control method | |
| CN107640160A (en) | Safe driving of vehicle accessory system and its control method | |
| CN112319483A (en) | Driving state improving device and driving state improving method | |
| WO2019239658A1 (en) | Cyber-attack notification device and notification method | |
| EP3000395A1 (en) | System and method for monitoring a subject's eye | |
| CN113312958B (en) | Method and device for adjusting dispatch priority based on driver state | |
| WO2021193711A1 (en) | Driving assistance device | |
| KR101807615B1 (en) | Drowsiness alert system and method for using the sleep time of the driver | |
| Raja et al. | Alcohol Detection and Emergency Alert System using IoT | |
| KR20190009008A (en) | Safety accident detection apparatus in vehicle and monitoring system comprising the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170531 |
|
| RJ01 | Rejection of invention patent application after publication |