CN110956780A - Fatigue driving reminding method and device and vehicle - Google Patents
Fatigue driving reminding method and device and vehicle Download PDFInfo
- Publication number
- CN110956780A CN110956780A CN201811127010.6A CN201811127010A CN110956780A CN 110956780 A CN110956780 A CN 110956780A CN 201811127010 A CN201811127010 A CN 201811127010A CN 110956780 A CN110956780 A CN 110956780A
- Authority
- CN
- China
- Prior art keywords
- fatigue driving
- vibration
- driver
- fatigue
- steering wheel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000001815 facial effect Effects 0.000 claims abstract description 28
- 206010016256 fatigue Diseases 0.000 claims description 308
- 230000004397 blinking Effects 0.000 claims description 16
- 230000000694 effects Effects 0.000 description 6
- 241001282135 Poromitra oscitans Species 0.000 description 3
- 206010048232 Yawning Diseases 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000004399 eye closure Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000007665 sagging Methods 0.000 description 1
- 230000007958 sleep Effects 0.000 description 1
- 230000036578 sleeping time Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Traffic Control Systems (AREA)
Abstract
The application relates to a fatigue driving reminding method, a fatigue driving reminding device and a vehicle, wherein the fatigue driving reminding method comprises the following steps: acquiring at least one face image of a driver; determining a fatigue driving level of the driver according to the at least one facial image; obtaining vibration parameters of a steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity; and controlling the steering wheel to vibrate according to the vibration parameters so as to remind fatigue driving. Through the mode, the method and the device can remind the driver in time when the driver is tired, so that the driving safety is ensured.
Description
Technical Field
The application relates to the technical field of vehicles, in particular to a fatigue driving reminding method and device and a vehicle.
Background
With the rapid development of automobile industry and the improvement of living standard of people in China, the quantity of automobiles owned by families of residents is rapidly increased, and the automobiles gradually become one of indispensable transportation means in the life of people.
Fatigue driving is a phenomenon in which a driver, during work or driving, repeatedly continues the operation of driving a vehicle many times, and then, physiologically and psychologically changes the operation to cause a lowering of the driving performance. When a driver sleeps for a long time with poor quality, short sleeping time or drives a vehicle for a long time, fatigue easily occurs, when the driver is in a fatigue driving state, the body feels like lassitude, heaviness and lassitude, the attention, feeling, perception, thinking, judgment, will, decision, movement and the like of the driver are influenced, road traffic accidents are easy to occur, and the driving safety is seriously influenced.
In response to the above problems, those skilled in the art have sought solutions.
Disclosure of Invention
The application aims to provide a fatigue driving reminding method, a fatigue driving reminding device and a vehicle, which can solve the technical problems and can remind a driver in time when the driver is fatigue driven, so that the driving safety is ensured.
In order to solve the technical problem, the present application provides a method for reminding fatigue driving, including:
acquiring at least one face image of a driver;
determining a fatigue driving level of the driver according to the at least one facial image;
obtaining vibration parameters of a steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity;
and controlling the steering wheel to vibrate according to the vibration parameters so as to remind fatigue driving.
Wherein said determining a fatigue driving level of the driver from the at least one facial image comprises:
respectively carrying out feature comparison on the obtained at least one face image and at least one preset fatigue driving face image, wherein each fatigue driving face image corresponds to a fatigue driving grade;
if the at least one facial image has a feature matched with one of the fatigue driving facial images, acquiring a fatigue score of the matched fatigue driving facial image;
and determining the fatigue driving grade of the driver according to the fatigue score.
Wherein said determining a fatigue driving level of the driver from the at least one facial image comprises:
extracting eye features of the at least one face image;
determining the blinking frequency and the viewing direction of the driver according to the eye features;
acquiring a fatigue score according to the blinking frequency and the viewing direction;
and determining the fatigue driving grade of the driver according to the fatigue score.
Wherein the determining a fatigue driving grade of the driver according to the fatigue score comprises:
if the fatigue score is larger than or equal to a first preset score, determining the fatigue driving grade of the driver as first-grade fatigue driving;
if the fatigue score is smaller than the first preset score and larger than a second preset score, determining that the fatigue driving grade of the driver is secondary fatigue driving;
and if the fatigue score is less than or equal to the second preset score, determining that the fatigue driving grade of the driver is third-level fatigue driving.
Wherein, the obtaining of the vibration parameter of the steering wheel according to the fatigue driving level comprises:
when the fatigue driving grade of the driver is first-grade fatigue driving, acquiring a first vibration parameter as a vibration parameter of a steering wheel, wherein the first vibration parameter is used for controlling the steering wheel to vibrate at a first vibration frequency and a first vibration strength;
when the fatigue driving grade of the driver is secondary fatigue driving, acquiring a second vibration parameter as a vibration parameter of the steering wheel, wherein the second vibration parameter is used for controlling the steering wheel to vibrate at a second vibration frequency and a second vibration intensity, the second vibration frequency is smaller than the first vibration frequency, and the second vibration intensity is smaller than or equal to the first vibration intensity;
and when the fatigue driving grade of the driver is three-level fatigue driving, acquiring a third vibration parameter as a vibration parameter of the steering wheel, wherein the third vibration parameter is used for controlling the steering wheel to vibrate at a third vibration frequency and a third vibration intensity, the third vibration frequency is smaller than the second vibration frequency, and the third vibration intensity is smaller than the second vibration intensity.
After controlling the steering wheel to vibrate according to the vibration parameters to remind fatigue driving, the method further comprises the following steps:
accumulating the vibration duration of the steering wheel;
when the fatigue driving grade of the driver is first-grade fatigue driving, controlling the steering wheel to stop vibrating according to the stop vibrating instruction of the driver;
when the fatigue driving grade of the driver is secondary fatigue driving, controlling the steering wheel to stop vibrating when the vibration duration reaches a first duration;
and when the fatigue driving grade of the driver is three-level fatigue driving, controlling the steering wheel to stop vibrating when the vibrating time length reaches a second time length, wherein the second time length is less than the first time length.
After controlling the steering wheel to vibrate according to the vibration parameters to remind fatigue driving, the method further comprises the following steps:
controlling the steering wheel to stop vibrating according to the vibration stopping instruction of the driver; or,
and acquiring the face image of the driver in real time, judging whether the driver is in fatigue driving according to the acquired face image, and controlling the steering wheel to stop vibrating if the driver is not in fatigue driving.
The application also provides a fatigue driving reminding device, which comprises a memory and a processor, wherein the memory is stored with at least one program instruction, and the processor loads and executes the at least one program instruction to realize the following method:
acquiring at least one face image of a driver;
determining a fatigue driving level of the driver according to the at least one facial image;
obtaining vibration parameters of a steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity;
and controlling the steering wheel to vibrate according to the vibration parameters so as to remind fatigue driving.
After executing the vibration of the steering wheel according to the vibration parameters to remind fatigue driving, the processor further executes the following steps:
controlling the steering wheel to stop vibrating according to the vibration stopping instruction of the driver; or,
and acquiring the face image of the driver in real time, judging whether the driver is in fatigue driving according to the acquired face image, and controlling the steering wheel to stop vibrating if the driver is not in fatigue driving.
The application also provides a vehicle, which comprises the fatigue driving reminding device.
The fatigue driving reminding method, the fatigue driving reminding device and the vehicle are used for obtaining at least one face image of a driver, determining the fatigue driving grade of the driver according to the at least one face image, then obtaining vibration parameters of a steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration strength, and controlling the steering wheel to vibrate according to the vibration parameters so as to carry out fatigue driving reminding. Through the mode, the method and the device can remind the driver in time when the driver is tired, so that the driving safety is ensured.
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical means of the present application more clearly understood, the present application may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present application more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
Fig. 1 is a flowchart illustrating a fatigue driving reminding method according to an exemplary embodiment.
Fig. 2 is a schematic block diagram of a fatigue driving warning device according to an exemplary embodiment.
Detailed Description
To further explain the technical means and effects of the present application for achieving the intended application, the following detailed description is provided with reference to the accompanying drawings and preferred embodiments for describing specific embodiments, methods, steps, structures, features and effects thereof according to the present application.
The foregoing and other technical matters, features and effects of the present application will be apparent from the following detailed description of preferred embodiments, which is to be read in connection with the accompanying drawings. While the present application is susceptible to embodiment and specific details, specific reference will now be made in detail to the present disclosure for the purpose of illustrating the general principles of the invention.
Fig. 1 is a flowchart illustrating a fatigue driving reminding method according to an exemplary embodiment. Referring to fig. 1, the fatigue driving reminding method of the present embodiment includes:
at step 110, at least one facial image of the driver is obtained.
The at least one camera device can be arranged in different directions in front of the driver to acquire facial images of the driver at different angles. The camera device can be controlled to collect the face image of the driver in real time when the vehicle is started, or the face image can be collected when a collection instruction is received, the face image collected by each camera device can be a plurality of continuously collected images, a plurality of images collected at intervals with set time length, a plurality of images collected at random intervals or only one image, and the adjustment can be specifically carried out according to the purpose of collecting the face image.
And step 120, determining the fatigue driving level of the driver according to the at least one facial image.
When a driver is in a fatigue driving state, the facial expression, the head angle, the blinking times, the eye size and the viewing direction of the driver are changed correspondingly, for example, typical characteristics such as yawning, head drooping, blinking times reduction, eye reduction and incapability of seeing the front directly appear, face image recognition is carried out on at least one collected face image to extract and analyze whether the characteristics appear on the driver, then the fatigue driving grade of the driver is determined according to the characteristics obtained by analysis, the fatigue driving grade is used for representing the fatigue degree of the driver, the driver is divided by first-level fatigue driving, second-level fatigue driving and third-level fatigue driving, the corresponding fatigue degrees are reduced sequentially, and it is understood that the grade number and the dividing mode of the fatigue driving are not limited by the above.
In one embodiment, determining a driver's fatigue driving level from at least one facial image comprises:
respectively carrying out feature comparison on the obtained at least one face image and at least one preset fatigue driving face image, wherein each fatigue driving face image corresponds to a fatigue driving grade;
if at least one face image has characteristics matched with one of the fatigue driving face images, acquiring a fatigue score of the matched fatigue driving face image;
and determining the fatigue driving grade of the driver according to the fatigue score.
Wherein, at least one preset fatigue driving face image is a face image which is collected in advance and has fatigue driving characteristics, as an implementation mode, an image which has the fatigue driving characteristics in the history collected face image of the driver of the vehicle is used as the fatigue driving face image, as another implementation mode, the face image of the driver of the vehicle can be collected and similar face images are matched, and then an image library in which the matched face images are located is used as an image library corresponding to the driver, the image library comprises other face images which have different fatigue characteristics and correspond to the matched face images, the fatigue driving characteristics are, for example, eye reduction, eye closure, yawning, head droop, head side inclination and the like, each fatigue driving face image has corresponding fatigue score according to the contained fatigue driving characteristics, the fatigue score is preset according to the characteristics contained in the images, for example, the fatigue score of the fatigue driving facial image containing the eye-narrowing and yawning features is lower than that of the fatigue driving facial image containing the eye-closing, head-sagging and head-side-tilting features, and the fatigue score of the fatigue driving facial image simultaneously showing two or more features is higher than that of the fatigue driving facial image singly showing one feature, and the fatigue scores are preset according to the features contained in the images, it is understood that the fatigue scores of different fatigue driving facial images can be the same or different, and the higher the fatigue score is, the higher the fatigue degree is.
In another embodiment, determining a driver's fatigue driving level from the at least one facial image comprises:
extracting eye features of at least one face image;
determining the blinking frequency and the viewing direction of the driver according to the eye characteristics;
acquiring a fatigue score according to the blinking frequency and the viewing direction;
and determining the fatigue driving grade of the driver according to the fatigue score.
After at least one face image is obtained, eye features in the face images are extracted, changes of the blinking frequency and the viewing direction of a driver are determined according to the eye features of the face images, and different blinking frequencies and changes of the viewing direction reflect different fatigue degrees of the driver, for example, the blinking frequency is lower than a preset frequency, the angle of the viewing direction continuously changes downwards/the fatigue degree of the up-down repeated change is larger than the blinking frequency and is lower than the preset frequency, the angle of the viewing direction keeps forward, so that corresponding fatigue scores can be obtained according to the blinking frequency and the viewing direction to represent different fatigue degrees, the fatigue scores have corresponding preset relations with the blinking frequency and the viewing direction, and the fatigue degrees are higher as the fatigue scores are higher.
In one embodiment, determining the driver's fatigue driving rating based on the fatigue score comprises:
if the fatigue score is greater than or equal to the first preset score, determining the fatigue driving grade of the driver as first-grade fatigue driving;
if the fatigue score is smaller than the first preset score and larger than the second preset score, determining the fatigue driving grade of the driver as secondary fatigue driving;
and if the fatigue score is less than or equal to the second preset score, determining the fatigue driving grade of the driver as three-grade fatigue driving.
After the fatigue scores are obtained according to the mode, if the fatigue scores are larger than or equal to the first preset scores, determining that the fatigue driving grade of the driver is first-grade fatigue driving, if the fatigue scores are smaller than the first preset scores and larger than the second preset scores, determining that the fatigue driving grade of the driver is second-grade fatigue driving, and if the fatigue scores are smaller than or equal to the second preset scores, determining that the fatigue driving grade of the driver is third-grade fatigue driving, wherein the fatigue degrees corresponding to the first-grade fatigue driving, the second-grade fatigue driving and the third-grade fatigue driving are reduced in sequence. Through grading the fatigue degree, corresponding reminding can be carried out aiming at different fatigue degrees, so that the reminding effect is better, and the normal driving of the vehicle by a driver is not influenced.
And step 130, acquiring vibration parameters of the steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity.
In one embodiment, acquiring vibration parameters of a steering wheel according to a fatigue driving level includes:
when the fatigue driving grade of a driver is first-grade fatigue driving, acquiring a first vibration parameter as a vibration parameter of a steering wheel, wherein the first vibration parameter is used for controlling the steering wheel to vibrate at a first vibration frequency and a first vibration strength;
when the fatigue driving grade of the driver is secondary fatigue driving, acquiring a second vibration parameter as a vibration parameter of the steering wheel, wherein the second vibration parameter is used for controlling the steering wheel to vibrate at a second vibration frequency and a second vibration strength, the second vibration frequency is smaller than the first vibration frequency, and the second vibration strength is smaller than or equal to the first vibration strength;
and when the fatigue driving grade of the driver is three-level fatigue driving, acquiring a third vibration parameter as a vibration parameter of the steering wheel, wherein the third vibration parameter is used for controlling the steering wheel to vibrate at a third vibration frequency and a third vibration strength, the third vibration frequency is smaller than the second vibration frequency, and the third vibration strength is smaller than the second vibration strength.
The vehicle controls the steering wheel to work with different parameters for fatigue driving reminding according to different fatigue driving grades, and the vibration parameters are not limited to include vibration frequency and/or vibration intensity, and may also be vibration time, for example. In practical implementation, when the fatigue driving level of the driver is first-level fatigue driving, a first vibration parameter is obtained as a vibration parameter of the steering wheel, the first vibration parameter is used for controlling the steering wheel to vibrate at a first vibration frequency and a first vibration intensity, when the fatigue driving level of the driver is second-level fatigue driving, a second vibration parameter is obtained as a vibration parameter of the steering wheel, the second vibration parameter is used for controlling the steering wheel to vibrate at a second vibration frequency and a second vibration intensity, when the fatigue driving level of the driver is third-level fatigue driving, a third vibration parameter is obtained as a vibration parameter of the steering wheel, and the third vibration parameter is used for controlling the steering wheel to vibrate at a third vibration frequency and a third vibration intensity. The second vibration frequency is smaller than the first vibration frequency, the second vibration intensity is smaller than or equal to the first vibration intensity, the third vibration frequency is smaller than the second vibration frequency, the third vibration intensity is smaller than the second vibration intensity, namely the higher the fatigue driving grade is, the higher the vibration frequency and the intensity of the steering wheel are, and the vibration frequencies or the intensities of the adjacent fatigue driving grades can be equal. So, according to fatigue degree's difference, the warning intensity that the driver obtained is also different, reminds the effect better and do not influence the driver and normally drive the vehicle, and simultaneously, the driver can learn the driving state of self according to the warning intensity of difference to effectively carry out state adjustment.
And 140, controlling the steering wheel to vibrate according to the vibration parameters so as to remind fatigue driving.
After the vibration parameters of the steering wheel are determined, the vehicle controls the steering wheel to vibrate according to the determined vibration parameters, and therefore fatigue driving reminding corresponding to the current fatigue degree is sent to the driver.
In one embodiment, after controlling the steering wheel to vibrate according to the vibration parameters to remind driver fatigue, the method of the present application further comprises the following steps:
accumulating the vibration duration of the steering wheel;
when the fatigue driving grade of the driver is first-grade fatigue driving, controlling the steering wheel to stop vibrating according to the stop vibration instruction of the driver;
when the fatigue driving grade of the driver is secondary fatigue driving, controlling the steering wheel to stop vibrating when the vibration duration reaches a first duration;
and when the fatigue driving grade of the driver is three-level fatigue driving, controlling the steering wheel to stop vibrating when the vibration duration reaches a second duration, wherein the second duration is less than the first duration.
Wherein, after the reminding, the vibration duration of the steering wheel is accumulated, the steering wheel is controlled to stop vibrating in different modes according to different fatigue driving grades, when the fatigue driving grade of the driver is first-grade fatigue driving, the driver is difficult to be ensured to be effectively waken up, therefore, the steering wheel can be controlled to stop vibrating according to the stop vibration instruction of the driver so as to ensure that the driver is wakened up, the stop vibration instruction can be triggered by the driver pressing a specific button on the steering wheel, when the driver triggers the stop vibration instruction, the current accumulated duration can be recorded as vibration duration reference data, when the fatigue driving grade of the driver is second-grade fatigue driving, the steering wheel is controlled to stop vibrating when the vibration duration reaches first duration, when the fatigue driving grade of the driver is third-grade fatigue driving, the steering wheel is controlled to stop vibrating when the vibration duration reaches second duration, the second duration is shorter than the first duration, namely, the vibration duration corresponding to the second-level fatigue driving is longer than the vibration duration corresponding to the third-level fatigue driving, so that the influence of the reminding process on the driving state of the driver can be avoided.
In one embodiment, after controlling the steering wheel to vibrate according to the vibration parameters to remind driver fatigue, the method of the present application further comprises the following steps:
controlling the steering wheel to stop vibrating according to the vibration stopping instruction of the driver; or,
the method comprises the steps of acquiring a face image of a driver in real time, judging whether the driver is in fatigue driving according to the acquired face image, and controlling a steering wheel to stop vibrating if the driver is not in fatigue driving.
In one embodiment, to ensure that the driver is effectively reminded, the steering wheel may be controlled to stop vibrating according to a stop vibration command of the driver, where the stop vibration command may be triggered by the driver pressing a specific button on the steering wheel. As another embodiment, after the reminding, the face image of the driver is continuously acquired, and whether the driver is tired to drive is judged according to the acquired face image, so that whether the driver is awakened or not is actively confirmed, if the driver is not tired to drive, the steering wheel is controlled to stop vibrating, otherwise, the steering wheel is continuously controlled to vibrate, and at this time, the frequency and the intensity of vibration can be further improved.
The fatigue driving reminding method comprises the steps of obtaining at least one face image of a driver, determining the fatigue driving grade of the driver according to the at least one face image, obtaining vibration parameters of a steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity, and controlling the steering wheel to vibrate according to the vibration parameters so as to carry out fatigue driving reminding. Through the mode, the method and the device can remind the driver in time when the driver is tired, so that the driving safety is ensured. In addition, according to the difference of fatigue degree, the intensity of reminding that the driver obtained is also different, reminds the effect better and does not influence the driver and normally drive the vehicle, and simultaneously, the driver can learn the driving state of self according to the warning intensity of difference to effectively carry out state adjustment.
Fig. 2 is a schematic block diagram of a fatigue driving warning device according to an exemplary embodiment. As shown in fig. 2, the fatigue driving reminding apparatus of the present embodiment includes a memory 210 and a processor 220, the memory 210 stores at least one program instruction, and the processor 220 implements the following method by loading and executing the at least one program instruction:
acquiring at least one face image of a driver;
determining a fatigue driving level of the driver according to the at least one facial image;
obtaining vibration parameters of a steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity;
and controlling the steering wheel to vibrate according to the vibration parameters so as to remind fatigue driving.
In one embodiment, processor 220 performs determining a driver's fatigue driving level based on at least one facial image, comprising:
respectively carrying out feature comparison on the obtained at least one face image and at least one preset fatigue driving face image, wherein each fatigue driving face image corresponds to a fatigue driving grade;
if at least one face image has characteristics matched with one of the fatigue driving face images, acquiring a fatigue score of the matched fatigue driving face image;
and determining the fatigue driving grade of the driver according to the fatigue score.
In one embodiment, processor 220 performs determining a driver's fatigue driving level based on at least one facial image, comprising:
extracting eye features of at least one face image;
determining the blinking frequency and the viewing direction of the driver according to the eye characteristics;
acquiring a fatigue score according to the blinking frequency and the viewing direction;
and determining the fatigue driving grade of the driver according to the fatigue score.
In one embodiment, processor 220 performs determining a driver's fatigue driving rating based on the fatigue score, comprising:
if the fatigue score is greater than or equal to the first preset score, determining the fatigue driving grade of the driver as first-grade fatigue driving;
if the fatigue score is smaller than the first preset score and larger than the second preset score, determining the fatigue driving grade of the driver as secondary fatigue driving;
and if the fatigue score is less than or equal to the second preset score, determining the fatigue driving grade of the driver as three-grade fatigue driving.
In one embodiment, processor 220 performs the obtaining of the vibration parameter of the steering wheel according to the fatigue driving level, including:
when the fatigue driving grade of a driver is first-grade fatigue driving, acquiring a first vibration parameter as a vibration parameter of a steering wheel, wherein the first vibration parameter is used for controlling the steering wheel to vibrate at a first vibration frequency and a first vibration strength;
when the fatigue driving grade of the driver is secondary fatigue driving, acquiring a second vibration parameter as a vibration parameter of the steering wheel, wherein the second vibration parameter is used for controlling the steering wheel to vibrate at a second vibration frequency and a second vibration strength, the second vibration frequency is smaller than the first vibration frequency, and the second vibration strength is smaller than or equal to the first vibration strength;
and when the fatigue driving grade of the driver is three-level fatigue driving, acquiring a third vibration parameter as a vibration parameter of the steering wheel, wherein the third vibration parameter is used for controlling the steering wheel to vibrate at a third vibration frequency and a third vibration strength, the third vibration frequency is smaller than the second vibration frequency, and the third vibration strength is smaller than the second vibration strength.
In one embodiment, after the processor 220 executes the following steps after controlling the steering wheel to vibrate according to the vibration parameters for performing the fatigue driving reminding:
accumulating the vibration duration of the steering wheel;
when the fatigue driving grade of the driver is first-grade fatigue driving, controlling the steering wheel to stop vibrating according to the stop vibration instruction of the driver;
when the fatigue driving grade of the driver is secondary fatigue driving, controlling the steering wheel to stop vibrating when the vibration duration reaches a first duration;
and when the fatigue driving grade of the driver is three-level fatigue driving, controlling the steering wheel to stop vibrating when the vibration duration reaches a second duration, wherein the second duration is less than the first duration.
In one embodiment, after the processor 220 executes the following steps after controlling the steering wheel to vibrate according to the vibration parameters for performing the fatigue driving reminding:
controlling the steering wheel to stop vibrating according to the vibration stopping instruction of the driver; or,
the method comprises the steps of acquiring a face image of a driver in real time, judging whether the driver is in fatigue driving according to the acquired face image, and controlling a steering wheel to stop vibrating if the driver is not in fatigue driving.
For the detailed working process and steps of the fatigue driving reminding device of the present embodiment, please refer to the description of the embodiment shown in fig. 1, which is not repeated herein.
The application also provides a vehicle, and the vehicle comprises the fatigue driving reminding device.
The fatigue driving reminding device and the vehicle obtain at least one face image of a driver, determine the fatigue driving grade of the driver according to the at least one face image, then obtain the vibration parameters of the steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity, and control the steering wheel to vibrate according to the vibration parameters so as to carry out fatigue driving reminding. Through the mode, the method and the device can remind the driver in time when the driver is tired, so that the driving safety is ensured.
Although the present application has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the application, and all changes, substitutions and alterations that fall within the spirit and scope of the application are to be understood as being included within the following description of the preferred embodiment.
Claims (10)
1. A fatigue driving reminding method is characterized by comprising the following steps:
acquiring at least one face image of a driver;
determining a fatigue driving level of the driver according to the at least one facial image;
obtaining vibration parameters of a steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity;
and controlling the steering wheel to vibrate according to the vibration parameters so as to remind fatigue driving.
2. The fatigue driving reminding method according to claim 1, wherein the determining the fatigue driving level of the driver according to the at least one facial image comprises:
respectively carrying out feature comparison on the obtained at least one face image and at least one preset fatigue driving face image, wherein each fatigue driving face image corresponds to a fatigue driving grade;
if the at least one facial image has a feature matched with one of the fatigue driving facial images, acquiring a fatigue score of the matched fatigue driving facial image;
and determining the fatigue driving grade of the driver according to the fatigue score.
3. The fatigue driving reminding method according to claim 1, wherein the determining the fatigue driving level of the driver according to the at least one facial image comprises:
extracting eye features of the at least one face image;
determining the blinking frequency and the viewing direction of the driver according to the eye features;
acquiring a fatigue score according to the blinking frequency and the viewing direction;
and determining the fatigue driving grade of the driver according to the fatigue score.
4. The fatigue driving reminding method according to claim 2 or 3, wherein the determining the fatigue driving level of the driver according to the fatigue score comprises:
if the fatigue score is larger than or equal to a first preset score, determining the fatigue driving grade of the driver as first-grade fatigue driving;
if the fatigue score is smaller than the first preset score and larger than a second preset score, determining that the fatigue driving grade of the driver is secondary fatigue driving;
and if the fatigue score is less than or equal to the second preset score, determining that the fatigue driving grade of the driver is third-level fatigue driving.
5. The fatigue driving reminding method according to claim 4, wherein the obtaining of the vibration parameter of the steering wheel according to the fatigue driving level comprises:
when the fatigue driving grade of the driver is first-grade fatigue driving, acquiring a first vibration parameter as a vibration parameter of a steering wheel, wherein the first vibration parameter is used for controlling the steering wheel to vibrate at a first vibration frequency and a first vibration strength;
when the fatigue driving grade of the driver is secondary fatigue driving, acquiring a second vibration parameter as a vibration parameter of the steering wheel, wherein the second vibration parameter is used for controlling the steering wheel to vibrate at a second vibration frequency and a second vibration intensity, the second vibration frequency is smaller than the first vibration frequency, and the second vibration intensity is smaller than or equal to the first vibration intensity;
and when the fatigue driving grade of the driver is three-level fatigue driving, acquiring a third vibration parameter as a vibration parameter of the steering wheel, wherein the third vibration parameter is used for controlling the steering wheel to vibrate at a third vibration frequency and a third vibration intensity, the third vibration frequency is smaller than the second vibration frequency, and the third vibration intensity is smaller than the second vibration intensity.
6. The fatigue driving reminding method according to claim 4, wherein after controlling the steering wheel to vibrate according to the vibration parameter to remind fatigue driving, the method further comprises:
accumulating the vibration duration of the steering wheel;
when the fatigue driving grade of the driver is first-grade fatigue driving, controlling the steering wheel to stop vibrating according to the stop vibrating instruction of the driver;
when the fatigue driving grade of the driver is secondary fatigue driving, controlling the steering wheel to stop vibrating when the vibration duration reaches a first duration;
and when the fatigue driving grade of the driver is three-level fatigue driving, controlling the steering wheel to stop vibrating when the vibrating time length reaches a second time length, wherein the second time length is less than the first time length.
7. The fatigue driving reminding method according to claim 1, wherein after controlling the steering wheel to vibrate according to the vibration parameter to remind fatigue driving, the method further comprises:
controlling the steering wheel to stop vibrating according to the vibration stopping instruction of the driver; or,
and acquiring the face image of the driver in real time, judging whether the driver is in fatigue driving according to the acquired face image, and controlling the steering wheel to stop vibrating if the driver is not in fatigue driving.
8. A fatigue driving reminding device, comprising a memory and a processor, wherein the memory stores at least one program instruction, and the processor loads and executes the at least one program instruction to realize the following method:
acquiring at least one face image of a driver;
determining a fatigue driving level of the driver according to the at least one facial image;
obtaining vibration parameters of a steering wheel according to the fatigue driving grade, wherein the vibration parameters comprise vibration frequency and/or vibration intensity;
and controlling the steering wheel to vibrate according to the vibration parameters so as to remind fatigue driving.
9. The fatigue driving reminding device according to claim 8, wherein the processor further performs the following steps after executing the controlling of the steering wheel to vibrate according to the vibration parameter for reminding fatigue driving:
controlling the steering wheel to stop vibrating according to the vibration stopping instruction of the driver; or,
and acquiring the face image of the driver in real time, judging whether the driver is in fatigue driving according to the acquired face image, and controlling the steering wheel to stop vibrating if the driver is not in fatigue driving.
10. A vehicle characterized in that the vehicle comprises the fatigue driving warning apparatus according to claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811127010.6A CN110956780A (en) | 2018-09-26 | 2018-09-26 | Fatigue driving reminding method and device and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811127010.6A CN110956780A (en) | 2018-09-26 | 2018-09-26 | Fatigue driving reminding method and device and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110956780A true CN110956780A (en) | 2020-04-03 |
Family
ID=69967674
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811127010.6A Pending CN110956780A (en) | 2018-09-26 | 2018-09-26 | Fatigue driving reminding method and device and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110956780A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112193157A (en) * | 2020-10-21 | 2021-01-08 | 恒大恒驰新能源汽车研究院(上海)有限公司 | Footrest information reminding device, control method thereof and vehicle-mounted control terminal |
| CN112201009A (en) * | 2020-09-30 | 2021-01-08 | 宝能(西安)汽车研究院有限公司 | Fatigue driving reminding method and system |
| CN112721947A (en) * | 2021-01-27 | 2021-04-30 | 东风商用车有限公司 | Reminding method, device and system for improving attention of driver and vehicle |
| CN117912192A (en) * | 2024-01-31 | 2024-04-19 | 无锡车联天下信息技术有限公司 | Vehicle driving reminding method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09240269A (en) * | 1996-03-04 | 1997-09-16 | Nippon Soken Inc | Fatigue driving preventing device |
| CN105956548A (en) * | 2016-04-29 | 2016-09-21 | 奇瑞汽车股份有限公司 | Driver fatigue state detection method and device |
| CN106097657A (en) * | 2016-08-09 | 2016-11-09 | 乐视控股（北京）有限公司 | A kind of based reminding method, device and vehicle |
| CN106952451A (en) * | 2017-05-19 | 2017-07-14 | 武泽人 | On-vehicle safety prior-warning device and method |
| CN107506698A (en) * | 2017-08-01 | 2017-12-22 | 无锡南理工科技发展有限公司 | The method of public transportation vehicle anti-fatigue-driving management based on Internet of Things |
| CN108372785A (en) * | 2018-04-25 | 2018-08-07 | 吉林大学 | A kind of non-security driving detection device of the automobile based on image recognition and detection method |
-
2018
- 2018-09-26 CN CN201811127010.6A patent/CN110956780A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09240269A (en) * | 1996-03-04 | 1997-09-16 | Nippon Soken Inc | Fatigue driving preventing device |
| CN105956548A (en) * | 2016-04-29 | 2016-09-21 | 奇瑞汽车股份有限公司 | Driver fatigue state detection method and device |
| CN106097657A (en) * | 2016-08-09 | 2016-11-09 | 乐视控股（北京）有限公司 | A kind of based reminding method, device and vehicle |
| CN106952451A (en) * | 2017-05-19 | 2017-07-14 | 武泽人 | On-vehicle safety prior-warning device and method |
| CN107506698A (en) * | 2017-08-01 | 2017-12-22 | 无锡南理工科技发展有限公司 | The method of public transportation vehicle anti-fatigue-driving management based on Internet of Things |
| CN108372785A (en) * | 2018-04-25 | 2018-08-07 | 吉林大学 | A kind of non-security driving detection device of the automobile based on image recognition and detection method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112201009A (en) * | 2020-09-30 | 2021-01-08 | 宝能(西安)汽车研究院有限公司 | Fatigue driving reminding method and system |
| CN112193157A (en) * | 2020-10-21 | 2021-01-08 | 恒大恒驰新能源汽车研究院(上海)有限公司 | Footrest information reminding device, control method thereof and vehicle-mounted control terminal |
| CN112721947A (en) * | 2021-01-27 | 2021-04-30 | 东风商用车有限公司 | Reminding method, device and system for improving attention of driver and vehicle |
| CN117912192A (en) * | 2024-01-31 | 2024-04-19 | 无锡车联天下信息技术有限公司 | Vehicle driving reminding method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110956780A (en) | Fatigue driving reminding method and device and vehicle | |
| CN110766912B (en) | Driving early warning method, device and computer readable storage medium | |
| CN101030316B (en) | Safety driving monitoring system and method for vehicle | |
| CN103871200B (en) | Safety prompting system and method for car steering | |
| CN104183091A (en) | System for adjusting sensitivity of fatigue driving early warning system in self-adaptive mode | |
| CN110395260B (en) | Vehicle, safe driving method and device | |
| CN110143202A (en) | A kind of dangerous driving identification and method for early warning and system | |
| CN110547807A (en) | driving behavior analysis method, device, equipment and computer readable storage medium | |
| CN112172830A (en) | Driver state monitoring method and system, readable storage medium and vehicle-mounted terminal | |
| CN107977607A (en) | A kind of fatigue driving monitoring method based on machine vision | |
| CN110654394A (en) | Driving control system and method and vehicle | |
| WO2020058006A1 (en) | Method for classifying a non-driving activity of a driver in respect of an interruptibility of the non-driving activity in the event of a prompt to take over the driving function, and method for re-releasing a non-driving activity following an interruption of said non-driving activity as a result of a prompt to takeover the driving function | |
| CN106904169A (en) | Traffic safety method for early warning and device | |
| CN107331121A (en) | A kind of intelligent automobile for detecting fatigue state | |
| CN105701972A (en) | System for detecting fatigue driving by using driving behavior variability characteristics | |
| CN116279513A (en) | Mining vehicle auxiliary driving method and device | |
| CN111027393A (en) | Information recommendation method and system and vehicle | |
| CN113312958B (en) | Method and device for adjusting dispatch priority based on driver state | |
| CN117333853A (en) | Driver fatigue monitoring method and device based on image processing and storage medium | |
| CN116834749A (en) | Fatigue driving early warning method, device, equipment and storage medium | |
| CN112277940B (en) | Driver state control system based on image information | |
| CN212569985U (en) | Fatigue driving early warning system | |
| JPH0793700A (en) | Driver state monitoring device | |
| CN111382631B (en) | Identification method, identification device, terminal, server and storage medium | |
| CN112193250A (en) | Method for monitoring vehicle running state, vehicle and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200403 |
|
| WD01 | Invention patent application deemed withdrawn after publication |