CN114435372A - Fatigue driving warning method and device - Google Patents

Fatigue driving warning method and device Download PDF

Info

Publication number
CN114435372A
CN114435372A CN202111665869.4A CN202111665869A CN114435372A CN 114435372 A CN114435372 A CN 114435372A CN 202111665869 A CN202111665869 A CN 202111665869A CN 114435372 A CN114435372 A CN 114435372A
Authority
CN
China
Prior art keywords
driver
fatigue
module
brain wave
motor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111665869.4A
Other languages
Chinese (zh)
Inventor
骆成
汪邵文
米俊
彭寿星
田子敬
边少君
陶青
黄思远
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South Sagittarius Integration Co Ltd
Original Assignee
South Sagittarius Integration Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South Sagittarius Integration Co Ltd filed Critical South Sagittarius Integration Co Ltd
Priority to CN202111665869.4A priority Critical patent/CN114435372A/en
Publication of CN114435372A publication Critical patent/CN114435372A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818Inactivity or incapacity of driver
    • B60W2040/0827Inactivity or incapacity of driver due to sleepiness
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/221Physiology, e.g. weight, heartbeat, health or special needs
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/229Attention level, e.g. attentive to driving, reading or sleeping
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/26Incapacity

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Traffic Control Systems (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

A method and apparatus for fatigue driving warning, the method comprising: step 1, acquiring brain wave signals of a driver in real time through a brain wave sensor, and acquiring facial features of the driver in real time through an image sensor; step 2, judging and detecting whether the driver is in a fatigue driving state based on the collected brain wave signals of the driver and the face characteristics; and 3, if the driver is in the fatigue driving state, uploading the state of the driver to a service desk, informing the driver to stop for rest by the service desk through a telephone, and giving out an alarm sound through an audio module to warn the fatigue driver. The fatigue state of the driver is collected and judged through the image sensor and the brain wave sensor, the fatigue driver is interfered and alerted through the alarm sound emitted by the audio module, the motor vibrates and the fan blows, meanwhile, the state of the driver is uploaded to the service desk, and the driver is prompted to have a rest or be warned that the driving safety risk exists at present through the telephone of the service desk.

Description

Fatigue driving warning method and device
Technical Field
The invention relates to the field of fatigue detection, in particular to a method and a device for warning fatigue driving.
Background
Fatigue driving is a main factor influencing driving safety, and means that after a driver drives a vehicle continuously for a long time, the physiological function and the mental function are disordered, so that the driving skill is reduced. The reasons for fatigue are manifold, for example, drivers have poor or insufficient sleeping quality, the road conditions are better, the road condition is single, the drivers continue to drive vehicles after fatigue, the drivers feel sleepy, weak limbs, lack of concentration, decline in judgment, unsafe factors such as slow or early movements, operation pause and the like occur, and road traffic accidents are easy to occur.
Most of the existing fatigue driving reminding modes are voice reminding or light alarming, and the existing fatigue driving modes cannot effectively stimulate a driver to be awake and excited and drive safely to a place where a person can have a rest.
Disclosure of Invention
In view of the technical defects and technical disadvantages in the prior art, embodiments of the present invention provide a method and an apparatus for fatigue driving warning, which overcome or at least partially solve the above problems, and the specific solutions are as follows:
as a first aspect of the present invention, there is provided a method of fatigue driving warning, the method comprising:
step 1, acquiring brain wave signals of a driver in real time through a brain wave sensor, and acquiring facial features of the driver in real time through an image sensor;
step 2, judging and detecting whether the driver is in a fatigue driving state based on the collected brain wave signals of the driver and the face characteristics;
and 3, if the driver is judged to be in the fatigue driving state, uploading the state of the driver to a service desk, and giving out an alarm sound through an audio module to warn the fatigue driver.
Further, the method further comprises: and if the driver is in the fatigue driving state, intervening and warning the fatigue driver through motor vibration and fan blowing.
Further, the method further comprises:
in the driving process of a driver, an interphone connected with a motorcade system is started, so that the purpose that the vehicle fleet member talks in multiple ways is achieved, fatigue is eliminated through talkback and chatting, and the condition among the vehicle fleet members is obtained.
As a second aspect of the present invention, there is provided a device for warning fatigue driving, the device including a main control chip module, an audio module, a brain wave sensor and an image sensor; the audio module, the brain wave sensor, the image sensor and the audio module are all electrically connected with the main control chip module;
the brain wave sensor is used for collecting brain wave signals of a driver in real time;
the image sensor is used for acquiring facial features of a driver in real time;
the main control chip module is used for judging and detecting whether the driver is in a fatigue driving state or not based on the collected brain wave signals and the collected facial features of the driver, uploading the state of the driver to the service desk when the driver is judged to be in the fatigue driving state, and giving out alarm sound through the audio module so as to warn the fatigue driver.
Further, the device still includes motor module and fan, motor module and fan all with the main control chip module electricity is connected, the main control chip module still is used for when judging that the driver is in the fatigue driving state, and control motor vibrations and fan are bloied, and it intervenes and warns fatigue driver to blow through motor vibrations and fan.
Further, the motor module comprises a motor driving chip and a motor, and the motor is electrically connected with the main control chip module through the motor driving chip.
Furthermore, the device also comprises an intercom module, wherein the intercom module is electrically connected with the main control chip module, and the intercom module is used for starting and connecting a motorcade system in the driving process of a driver, so that the purpose that the adults in the motorcade speak in multiple ways is achieved, the fatigue is eliminated through intercommunication and chat, and the conditions among the members of the motorcade are obtained.
Furthermore, the talkback module is a 2G/3G/4G card full-duplex digital talkback module, the 2G/3G/4G card full-duplex digital talkback module communicates with the main control chip module through an I2S serial port, and the 2G/3G/4G card full-duplex digital talkback module is connected with a microphone and an antenna.
Furthermore, the audio module is a headset, the fan is a mini fan, and the main control chip module, the fan, the brain wave sensor, the image sensor, the talkback module, the motor and the mini fan are all mounted on the headset.
The invention has the following beneficial effects:
1. the fatigue state of a driver is collected and judged through an image sensor and a brain wave sensor, an alarm sound is sent out through an audio module, a motor vibrates, a fan blows to intervene and warn the fatigue driver, meanwhile, a 2G/3G/4G card full-duplex digital intercom module is triggered to upload the state of the driver to a service desk, and the service desk is used for notifying the driver to stop for rest through a telephone.
2. The multi-party intercommunication of motorcade can be realized, the limitation of regional distance is broken, one-key opening is realized, the work management is convenient, the perfect combination of efficient and intelligent communication and management is realized, and the fatigue state of long-distance transportation is relieved.
Drawings
Fig. 1 is a flowchart of a method for warning fatigue driving according to an embodiment of the present invention;
fig. 2 is a structural diagram of a fatigue driving warning device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As a first embodiment of the present invention, as shown in fig. 1, there is provided a method of warning of fatigue driving, the method including:
step 1, acquiring brain wave signals of a driver in real time through a brain wave sensor, and acquiring facial features of the driver in real time through an image sensor;
step 2, judging and detecting whether the driver is in a fatigue driving state based on the collected brain wave signals of the driver and the face characteristics;
and 3, if the driver is in the fatigue driving state, uploading the state of the driver to a service desk, informing the driver to stop for rest by the service desk through a telephone, and giving out an alarm sound through an audio module to warn the fatigue driver.
Preferably, the method further comprises: and if the driver is in the fatigue driving state, intervening and warning the fatigue driver through motor vibration and fan blowing.
Preferably, the method further comprises:
in the driving process of a driver, an interphone connected with a motorcade system is started, so that the purpose that the vehicle fleet member talks in multiple ways is achieved, fatigue is eliminated through talkback and chatting, and the condition among the vehicle fleet members is obtained.
The method specifically comprises the following steps of judging and detecting whether a driver is in a fatigue driving state based on the collected brain wave signals of the driver and the facial features: the fatigue state of the driver is detected through two forms of brain wave signals and facial features of the driver, and if the fatigue state of the driver is detected in any one form, the fatigue state of the driver is judged.
According to the invention, on one hand, the fatigue state of the driver is collected and judged through the image sensor and the brain wave sensor, the alarm sound is sent out through the audio module, the motor vibrates, the fan blows to intervene and warn the fatigue driver, meanwhile, the state of the driver is uploaded to the service desk, and the service desk informs the driver to stop for a rest through a telephone, on the other hand, the motorcade multi-party intercommunication can be realized, the limitation of the regional distance is broken, one-key opening is realized, the work management is convenient, the high-efficiency and intelligent communication and management are perfectly combined, and the fatigue state of long-distance transportation is relieved
As a second aspect of the present invention, there is provided a device for warning fatigue driving, the device including a main control chip module, an audio module, a brain wave sensor and an image sensor; the audio module, the brain wave sensor, the image sensor and the audio module are all electrically connected with the main control chip module;
the brain wave sensor is used for collecting brain wave signals of a driver in real time;
the image sensor is used for acquiring facial features of a driver in real time;
the main control chip module is used for judging and detecting whether the driver is in a fatigue driving state or not based on the collected brain wave signals and the collected facial features of the driver, uploading the state of the driver to the service desk when the driver is judged to be in the fatigue driving state, and giving out alarm sound through the audio module so as to warn the fatigue driver.
Preferably, the device further comprises a motor module and a fan, wherein the motor module and the fan are both electrically connected with the main control chip module, and the main control chip module is further used for controlling the motor to vibrate and the fan to blow when judging that the driver is in a fatigue driving state, and intervening and warning the fatigue driver through the motor vibration and the fan blowing; the motor module comprises a motor driving chip and a motor, and the motor is electrically connected with the main control chip module through the motor driving chip.
Preferably, the device further comprises an intercom module, the intercom module is electrically connected with the main control chip module, and the intercom module is used for starting and connecting a motorcade system in the driving process of a driver, so that the purpose that the adults in the motorcade speak in multiple ways is achieved, fatigue is eliminated through intercommunication and chatting, and the conditions among the members of the motorcade are obtained; the intercom module is a 2G/3G/4G card full-duplex digital intercom module, the 2G/3G/4G card full-duplex digital intercom module is communicated with the main control chip module through an I2S serial port, the 2G/3G/4G card full-duplex digital intercom module is connected with a microphone and an antenna, and the main control chip module is wirelessly connected with a service desk through the 2G/3G/4G card full-duplex digital intercom module.
Preferably, the audio module is a headset, the fan is a mini fan, and the main control chip module, the fan, the brain wave sensor, the image sensor, the intercom module, the motor and the mini fan are all mounted on the headset.
The fatigue state is collected and judged through the image sensor module and the brain wave sensor and is transmitted to the main control chip module through the data interface such as DVP/MIPI/LVDS, and the main control chip module triggers an alarm sound to output after receiving a corresponding signal; and controlling a motor driving chip to form a current driving motor through an I2C or PWM signal; the power management chip is used for controlling the opening of the fan; and the fatigue state of the driver is uploaded to the service desk through the talkback module, and the service desk telephone prompts the driver to have a rest or warns that the driving safety risk exists at present.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (9)

1. A method of fatigue driving warning, the method comprising:
step 1, acquiring brain wave signals of a driver in real time through a brain wave sensor, and acquiring facial features of the driver in real time through an image sensor;
step 2, judging and detecting whether the driver is in a fatigue driving state based on the collected brain wave signals of the driver and the face characteristics;
and 3, if the driver is judged to be in the fatigue driving state, uploading the state of the driver to a service desk, and giving out an alarm sound through an audio module to warn the fatigue driver.
2. The method of driver fatigue warning of claim 1, further comprising: and if the driver is in the fatigue driving state, intervening and warning the fatigue driver through motor vibration and fan blowing.
3. The method of driver fatigue warning of claim 1, further comprising:
in the driving process of a driver, an interphone connected with a motorcade system is started, so that the purpose that the vehicle fleet member talks in multiple ways is achieved, fatigue is eliminated through talkback and chatting, and the condition among the vehicle fleet members is obtained.
4. The device for warning fatigue driving is characterized by comprising a main control chip module, an audio module, a brain wave sensor and an image sensor; the audio module, the brain wave sensor, the image sensor and the audio module are all electrically connected with the main control chip module;
the brain wave sensor is used for collecting brain wave signals of a driver in real time;
the image sensor is used for acquiring facial features of a driver in real time;
the main control chip module is used for judging and detecting whether the driver is in a fatigue driving state or not based on the collected brain wave signals and the collected facial features of the driver, uploading the state of the driver to the service desk when the driver is judged to be in the fatigue driving state, and giving out alarm sound through the audio module so as to warn the fatigue driver.
5. The device for warning fatigue driving according to claim 4, further comprising a motor module and a fan, wherein the motor module and the fan are both electrically connected to the main control chip module, and the main control chip module is further configured to control the motor to vibrate and the fan to blow when the driver is determined to be in the fatigue driving state, and intervene and warn the fatigue driver through the motor vibration and the fan to blow.
6. The device for warning fatigue driving according to claim 5, wherein the motor module comprises a motor driving chip and a motor, and the motor is electrically connected with the main control chip module through the motor driving chip.
7. The device for warning fatigue driving according to claim 5, further comprising an intercom module electrically connected with the main control chip module, wherein the intercom module is used for starting and connecting a motorcade system in the driving process of a driver, so that the inter-party intercommunication of the members in the motorcade is realized, the fatigue is eliminated through inter-speaking chatting, and the conditions among the members in the motorcade are obtained.
8. The apparatus for warning fatigue driving according to claim 7, wherein the intercom module is a 2G/3G/4G card full-duplex digital intercom module, the 2G/3G/4G card full-duplex digital intercom module communicates with the main control chip module through an I2S serial port, and a microphone and an antenna are connected to the 2G/3G/4G card full-duplex digital intercom module.
9. The apparatus for warning of fatigue driving of claim 5, wherein the audio module is a headset, the fan is a mini-fan, and the main control chip module, the fan, the brain wave sensor, the image sensor, the intercom module, the motor and the mini-fan are all mounted on the headset.
CN202111665869.4A 2021-12-31 2021-12-31 Fatigue driving warning method and device Pending CN114435372A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111665869.4A CN114435372A (en) 2021-12-31 2021-12-31 Fatigue driving warning method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111665869.4A CN114435372A (en) 2021-12-31 2021-12-31 Fatigue driving warning method and device

Publications (1)

Publication Number Publication Date
CN114435372A true CN114435372A (en) 2022-05-06

Family

ID=81364898

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111665869.4A Pending CN114435372A (en) 2021-12-31 2021-12-31 Fatigue driving warning method and device

Country Status (1)

Country Link
CN (1) CN114435372A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220369978A1 (en) * 2021-05-18 2022-11-24 Hyundai Mobis Co., Ltd. System and method for determining driver's fatigue

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01305967A (en) * 1988-06-02 1989-12-11 Fumio Fukushima Device for preventing driver from becoming fatigued
CN105069977A (en) * 2015-07-28 2015-11-18 宋婉毓 Reminding device and reminding method for preventing fatigue driving
CN211391102U (en) * 2019-08-22 2020-09-01 上海颖派汽车科技有限公司 Sleepiness prevention and early warning system for fatigue driving of driver
CN113192292A (en) * 2021-04-29 2021-07-30 深圳供电局有限公司 Fatigue driving recognition device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01305967A (en) * 1988-06-02 1989-12-11 Fumio Fukushima Device for preventing driver from becoming fatigued
CN105069977A (en) * 2015-07-28 2015-11-18 宋婉毓 Reminding device and reminding method for preventing fatigue driving
CN211391102U (en) * 2019-08-22 2020-09-01 上海颖派汽车科技有限公司 Sleepiness prevention and early warning system for fatigue driving of driver
CN113192292A (en) * 2021-04-29 2021-07-30 深圳供电局有限公司 Fatigue driving recognition device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220369978A1 (en) * 2021-05-18 2022-11-24 Hyundai Mobis Co., Ltd. System and method for determining driver's fatigue

Similar Documents

Publication Publication Date Title
CN105678961B (en) The automobile safety alarm system and alarming method for power of a kind of anti-fatigue-driving
CN110758235B (en) Pedestrian warning device system and pedestrian warning method
US20100102988A1 (en) Driving conditions monitoring device and method thereof
CN107901828B (en) Method and device for reminding overtaking through intelligent equipment cooperation
JP5880740B1 (en) Collision avoidance system and collision avoidance method
CN209795467U (en) Fatigue driving detection system and vehicle
JP2017218032A (en) On-board device
CN114435372A (en) Fatigue driving warning method and device
JP2021096696A (en) Condition notification device for vehicle and condition notification method for vehicle
CN103832380A (en) Dead zone automobile detection and warning system and method based on machine vision
CN205264009U (en) Vehicle safety precaution device
CN215552866U (en) Vehicle alarm system and car
CN105761431A (en) Behavior monitor early-warning method and system
CN112712043A (en) Intelligent cabin image processing system
CN105015341A (en) Device of preventing dangerous driving caused by using mobile phone during driving and method of preventing dangerous driving caused by using mobile phone during driving
JP2006254055A (en) Onboard telephone system
CN207311271U (en) Vehicle-mounted monitoring system
CN115862288A (en) Method and device for monitoring and reminding fatigue driving of automobile
CN112849151A (en) Reminding device for preventing fatigue driving
CN203318280U (en) Machine vision based blind-zone vehicle detection and warning system
CN217259809U (en) Multifunctional voice warning indicator for new energy city bus
CN206551948U (en) It is a kind of that lamp control device is alerted based on the vehicle risk that the Big Dipper is positioned
CN212275972U (en) Ultrasonic radar detection system
CN220518136U (en) Monitoring and early warning system based on vehicle state
CN217213903U (en) DSM monitoring and ADAS driving assistance system with vibration alarm

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination