CN209795467U - Fatigue driving detection system and vehicle - Google Patents

Fatigue driving detection system and vehicle Download PDF

Info

Publication number
CN209795467U
CN209795467U CN201822211242.1U CN201822211242U CN209795467U CN 209795467 U CN209795467 U CN 209795467U CN 201822211242 U CN201822211242 U CN 201822211242U CN 209795467 U CN209795467 U CN 209795467U
Authority
CN
China
Prior art keywords
processor
fatigue driving
vehicle
driver
fatigue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201822211242.1U
Other languages
Chinese (zh)
Inventor
张长隆
王苗苗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changsha Intelligent Driving Research Institute Co Ltd
Original Assignee
Changsha Intelligent Driving Research Institute Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changsha Intelligent Driving Research Institute Co Ltd filed Critical Changsha Intelligent Driving Research Institute Co Ltd
Priority to CN201822211242.1U priority Critical patent/CN209795467U/en
Application granted granted Critical
Publication of CN209795467U publication Critical patent/CN209795467U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The embodiment of the utility model discloses driver fatigue detecting system and vehicle, the system includes: the system comprises a vehicle-mounted device, an image acquisition device and a reminding device connected with the vehicle-mounted device; the vehicle-mounted device comprises a sensor and a processor; the reminding device, the image acquisition device and the sensor are respectively connected with the processor; the image acquisition device is used for acquiring facial image information of a driver and sending the facial image information to the processor; the sensor is arranged on the steering wheel and used for acquiring the rotation state information of the steering wheel and sending the rotation state information to the processor; the processor is used for determining the fatigue detection result of the driver according to the facial image information, determining the current correction frequency and the current rotation amplitude of the steering wheel according to the current rotation state information of the steering wheel, and determining the fatigue driving state of the driver based on the fatigue detection result and the current correction frequency and the current rotation amplitude of the steering wheel; and the reminding device is used for sending corresponding reminding information according to the fatigue driving state.

Description

Fatigue driving detection system and vehicle
Technical Field
the embodiment of the utility model provides a relate to the driving field, especially relate to a fatigue driving detecting system and vehicle.
Background
With the development of social economy, motor vehicles are increasing day by day, and fatigue driving is always one of important factors influencing driving safety. According to investigation, the traffic accidents related to fatigue in China account for about 20 percent of the total number of accidents, and account for more than 40 percent of the serious traffic accidents. Therefore, in order to reduce traffic accidents caused by fatigue driving and ensure the personal safety of people, it is necessary and significant to research an effective method for detecting the fatigue state of a driver in real time.
At present, the research focus for detecting the fatigue state of a driver is to integrate multi-source information such as a breathing signal, a heartbeat signal, a pressure signal of a hand-held steering wheel, a pulse signal and a vehicle speed for comprehensive judgment. However, in the above implementation, on one hand, since the physiological signals of the human body are collected, the requirements on the signal collecting device are high, which results in high cost, and the collecting device mostly needs to be in direct contact with the human body, which is not popular with drivers. On the other hand, the vehicle speed is indistinguishable from the driving environment, such as country roads, expressway roads, urban smooth road conditions, traffic jam road conditions and the like, and the vehicle speed is adjusted according to the road conditions, so that the integration of the vehicle speed information cannot better check whether the driver is tired, and on the contrary, related interference information is brought.
Disclosure of Invention
For solving the technical problem that exists now, the embodiment of the utility model provides a driver fatigue detecting system and vehicle.
In order to achieve the above object, the embodiment of the present invention provides a technical solution that:
an embodiment of the utility model provides a driver fatigue detecting system, include: the system comprises a vehicle-mounted device, an image acquisition device and a reminding device connected with the vehicle-mounted device; the vehicle-mounted device comprises a sensor and a processor; the reminding device, the image acquisition device and the sensor are respectively connected with the processor;
The image acquisition device is used for acquiring facial image information of a driver and sending the facial image information to the processor;
The sensor is arranged on a steering wheel and used for acquiring the rotation state information of the steering wheel and sending the rotation state information to the processor;
The processor is used for determining a fatigue detection result of a driver according to the facial image information, determining the current correction frequency and the current rotation amplitude of the steering wheel according to the current rotation state information of the steering wheel, and determining the fatigue driving state of the driver based on the fatigue detection result and the current correction frequency and the current rotation amplitude of the steering wheel;
And the reminding device is used for sending corresponding reminding information according to the fatigue driving state.
The processor controls the display device to display the text information corresponding to the fatigue driving state, and the audio output device outputs the voice information corresponding to the fatigue driving state.
The display device is a lens of intelligent glasses, the processor is in communication connection with the intelligent glasses through a wireless communication device, and the lens displays the text information corresponding to the fatigue driving state.
Wherein, the audio output device is an earphone.
The vehicle-mounted device further comprises a memory connected with the processor, and the memory is used for storing the facial image information, the rotation state information of the steering wheel and the corresponding fatigue driving state information.
The system further comprises a monitoring device, wherein the monitoring device is in communication connection with the vehicle-mounted device, and the vehicle-mounted device is used for sending the fatigue driving state of the driver to the monitoring device.
The monitoring device is used for sending a control instruction to the processor according to the fatigue driving state of the driver, and the processor controls the maximum throttle output of the throttle control device.
The processor is connected with a control system of the vehicle through a bus, and the processor controls the vehicle to be switched off or controls the vehicle to enter an automatic driving mode through the control system.
The system further comprises a vibration device arranged on a driver seat, the vibration device is connected with the processor, and the processor controls the vibration device to vibrate according to the determination result of the fatigue driving state.
The embodiment of the utility model provides a still provide a vehicle, include any embodiment of this application driver fatigue detecting system.
The embodiment of the utility model provides an among the fatigue driving detecting system, including car-mounted device, image acquisition device and with the reminding device that the car-mounted device is connected; the vehicle-mounted device comprises a sensor and a processor; the reminding device, the image acquisition device and the sensor are respectively connected with the processor; the image acquisition device is used for acquiring facial image information of the driver and sending the facial image information to the processor, so that the fatigue condition of the driver can be determined based on the facial image information; the sensor is arranged on the steering wheel and used for acquiring the rotation state information of the steering wheel and sending the rotation state information to the processor, so that the rotation state information of the steering wheel is directly acquired by the sensor, the sensor does not need to directly contact with the body of a driver, and good experience can be brought to the driver; the processor is used for determining a fatigue detection result of the driver according to the facial image information, determining the current correction frequency and the current rotation amplitude of the steering wheel according to the current rotation state information of the steering wheel, and determining the fatigue driving state of the driver based on the fatigue detection result, the current correction frequency and the current rotation amplitude of the steering wheel, so that the judgment result is more accurate and reliable because the judgment of the fatigue driving state of the driver integrates the human body information and the steering wheel information; the reminding device is used for sending corresponding reminding information according to the fatigue driving state, so that a driver can be timely reminded, and safety accidents are avoided.
Drawings
Fig. 1 is a schematic structural diagram of a fatigue driving detection system according to an embodiment of the present invention;
Fig. 2 is a schematic structural diagram of a reminder device according to an embodiment of the present application;
Fig. 3 is a schematic structural diagram of a display device according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of another fatigue driving detection system provided in the embodiments of the present application;
Fig. 5 is a schematic structural diagram of another fatigue driving detection system according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative work belong to the protection scope of the present invention.
Please refer to fig. 1, which is a schematic structural diagram of a fatigue driving detection system according to an embodiment of the present invention, the system includes: the system comprises an on-board device 12, an image acquisition device 11 and a reminding device 13 connected with the on-board device 12; the on-board device 12 includes a sensor 14 and a processor 15; the reminding device 13, the image acquisition device 11 and the sensor 14 are respectively connected with the processor 15;
Here, the connection between the devices or the connection between the devices may employ a wired or wireless connection.
the image acquisition device 11 is used for acquiring facial image information of a driver and sending the facial image information to the processor 15;
Here, image acquisition device 11 can be infrared dot matrix camera, infrared dot matrix camera is farther than ordinary infrared camera's irradiation distance, and the image quality is more exquisite clear, and life is longer moreover, simultaneously, because the infrared ray is direct to be sent by the human body, can carry out clear facial image information collection under the not good condition of light.
Here, the face image information includes information of at least one of: the number of blinks, the size of the slit between the upper and lower eyelids, the size aspect ratio of the eyes, the number of times of opening and closing the mouth, and the size aspect ratio of the mouth. The face image information may be information obtained by fusing the above information. For example, the eye and mouth features are subjected to data fusion in a weighting mode.
Here, the image capturing device 11 may further include an image preprocessing device, and the image preprocessing device is configured to perform gray processing, smoothing processing, deblurring processing, and dithering processing on the captured image data to prevent interference that the image quality is not clear due to camera shake caused by bumping during the driving of the vehicle.
The sensor 14 is disposed on the steering wheel, and is configured to collect rotation state information of the steering wheel and send the rotation state information to the processor 15.
Here, a preprocessing device is further connected between the sensor 14 and the processor 15, and the preprocessing device is configured to extract and buffer the rotation state information, remove noise from the rotation state information by using a fast fourier transform and a wavelet transform, and perform a smoothing process.
Here, the sensor 14 may be an angle sensor 14, and the sensor 14 may be mounted on a rotation shaft of a steering wheel.
here, the sensor 14 may be an on-board unit OBD sensor 14 provided in the vehicle.
the processor 15 is configured to determine a fatigue detection result of the driver according to the facial image information, determine a current correction frequency and a current rotation amplitude of the steering wheel according to the current rotation state information of the steering wheel, and determine a fatigue driving state of the driver based on the fatigue detection result and the current correction frequency and the current rotation amplitude of the steering wheel;
Here, a Fisher linear algorithm may be adopted to perform data fusion processing on the fatigue detection result, the current correction frequency of the steering wheel, and the current rotation amplitude, and then determine the fatigue driving state of the driver.
The fatigue driving state may include: a first result indicative of the driver being in an awake state, a second result indicative of the driver being in a fatigue state, and a third result indicative of the driver being in a severe fatigue state.
And the reminding device 13 is used for sending out corresponding reminding information according to the fatigue driving state.
in the embodiment of the present invention, the image capturing device 11 is used for capturing facial image information of a driver and sending the facial image information to the processor 15, so that fatigue of the driver can be determined based on the facial image information; the sensor 14 is arranged on the steering wheel and used for acquiring the rotation state information of the steering wheel and sending the rotation state information to the processor 15, so that the rotation state information of the steering wheel is directly acquired by the sensor 14, the sensor does not need to directly contact with the body of a driver, and good experience can be brought to the driver; the processor 15 is configured to determine a fatigue detection result of the driver according to the facial image information, determine a current correction frequency and a current rotation amplitude of the steering wheel according to current rotation state information of the steering wheel, and determine a fatigue driving state of the driver based on the fatigue detection result and the current correction frequency and the current rotation amplitude of the steering wheel, so that a determination result is more accurate and reliable because the determination of the fatigue driving state of the driver integrates human body information and steering wheel information; the reminding device 13 is used for sending corresponding reminding information according to the fatigue driving state, so that reminding can be timely sent to a driver, and safety accidents are avoided.
Referring to fig. 2, a schematic structural diagram of a reminding device 13 provided in the embodiment of the present application is shown, where the reminding device 13 includes a display device 16 and an audio output device 17, the processor 15 controls the display device 16 to display text information corresponding to the fatigue driving state, and the audio output device 17 outputs voice information corresponding to the fatigue driving state.
Here, when the fatigue driving state is a waking state, the text information may be displayed in green; when the fatigue state is a fatigue state, the text information can be displayed in light red; when the fatigue driving state is a severe fatigue state, the text message may be displayed in a deep red color. To alert the driver to the attention by different colors.
Here, the text message may be dynamically displayed to warn the driver.
Here, when the fatigue driving state is fatigue and severe fatigue, the voice message may be a sound with a high frequency to warn the driver's attention.
Please refer to fig. 3, which is a schematic structural diagram of a display device 16 according to an embodiment of the present invention, the display device 16 is a lens 18 of a pair of smart glasses, the processor 15 is in communication connection with the pair of smart glasses through a wireless communication device, and the lens 18 displays the text information corresponding to the fatigue driving state.
wherein the audio output device 17 is a headphone. Here, the headset may be a wireless headset.
referring to fig. 4, for another structural schematic diagram of a fatigue driving detection system provided in the embodiment of the present application, the vehicle-mounted device 12 further includes a memory 19 connected to the processor 15, where the memory 19 is configured to store the facial image information, the rotation state information of the steering wheel, and the corresponding fatigue driving state information.
here, storing the process information of the fatigue driving detection system can facilitate the query of the subsequent information.
Referring to fig. 5, a schematic structural diagram of another fatigue driving detection system provided in the embodiment of the present application is shown, where the system further includes a monitoring device 20, the monitoring device 20 is connected to the vehicle-mounted device 12 in a communication manner, and the vehicle-mounted device 12 is configured to send the fatigue driving state of the driver to the monitoring device 20.
here, the process information of the fatigue driving detection system is sent to the monitoring device 20, so that the driving state of the driver can be conveniently monitored by the background, a prompt is sent in time, and the driving safety of the driver is guaranteed.
The processor 15 is connected to a throttle control device of the vehicle, and the monitoring device 20 is configured to send a control instruction to the processor 15 according to the fatigue driving state of the driver, and control the maximum throttle output of the throttle control device through the processor 15.
Here, when it is detected that the driver is in a fatigue driving state, the output of the accelerator can be reduced, and the risk of an accident that may be caused by fatigue driving can be reduced.
the processor 15 is connected to a control system of the vehicle through a bus, and the processor 15 controls the vehicle to shut down or to enter an automatic driving mode through the control system.
Here, when the driver is in a fatigue state, the vehicle can be controlled to automatically shut down or enter an automatic driving state, thereby avoiding an accident.
the fatigue driving device further comprises a vibration device arranged on a driver seat, the vibration device is connected with the processor 15, and the processor 15 controls the vibration device to vibrate according to the determination result of the fatigue driving state.
Here, the vibrations of vibrating device can be felt by the driver, when the driver drives fatigue, can even warn the driver to pay attention to, avoids fatigue driving to lead to the accident.
The embodiment of the utility model provides a still provide a vehicle, include any embodiment of this application driver fatigue detecting system.
the above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, and improvement made within the spirit and scope of the present invention are all included within the protection scope of the present invention.

Claims (10)

1. A fatigue driving detection system, comprising: the system comprises a vehicle-mounted device, an image acquisition device and a reminding device connected with the vehicle-mounted device; the vehicle-mounted device comprises a sensor and a processor; the reminding device, the image acquisition device and the sensor are respectively connected with the processor;
The image acquisition device is used for acquiring facial image information of a driver and sending the facial image information to the processor;
The sensor is arranged on a steering wheel and used for acquiring the rotation state information of the steering wheel and sending the rotation state information to the processor;
The processor is used for determining a fatigue detection result of a driver according to the facial image information, determining the current correction frequency and the current rotation amplitude of the steering wheel according to the current rotation state information of the steering wheel, and determining the fatigue driving state of the driver based on the fatigue detection result and the current correction frequency and the current rotation amplitude of the steering wheel;
And the reminding device is used for sending corresponding reminding information according to the fatigue driving state.
2. The fatigue driving detection system of claim 1, wherein the prompting device comprises a display device and an audio output device, the processor controls the display device to display text information corresponding to the fatigue driving state, and the audio output device outputs voice information corresponding to the fatigue driving state.
3. The fatigue driving detection system of claim 2, wherein the display device is a lens of a pair of smart glasses, the processor is in communication connection with the pair of smart glasses through a wireless communication device, and the lens displays text information corresponding to the fatigue driving state.
4. The fatigue driving detection system of claim 2, wherein the audio output device is an earphone.
5. The fatigue driving detection system of claim 1, wherein the in-vehicle device further comprises a memory connected to the processor, the memory configured to store the facial image information, the steering wheel rotation state information, and the corresponding fatigue driving state information.
6. the fatigue driving detection system of claim 1, further comprising a monitoring device communicatively coupled to the in-vehicle device, the in-vehicle device configured to transmit the fatigue driving status of the driver to the monitoring device.
7. the fatigue driving detection system of claim 6, wherein the processor is connected to a throttle control device of the vehicle, and the monitoring device is configured to send a control command to the processor according to the fatigue driving state of the driver, and the processor controls the maximum throttle output of the throttle control device.
8. The fatigue driving detection system of claim 1, wherein the processor is connected to a control system of the vehicle via a bus, and the processor controls the vehicle to shut off or to enter an autonomous driving mode via the control system.
9. the fatigue driving detection system of claim 1, further comprising a vibration device disposed on a driver seat, the vibration device being connected to the processor, the processor controlling the vibration device to vibrate according to the determination of the fatigue driving state.
10. A vehicle characterized by comprising a fatigue driving detection system according to any one of claims 1 to 9.
CN201822211242.1U 2018-12-26 2018-12-26 Fatigue driving detection system and vehicle Active CN209795467U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201822211242.1U CN209795467U (en) 2018-12-26 2018-12-26 Fatigue driving detection system and vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201822211242.1U CN209795467U (en) 2018-12-26 2018-12-26 Fatigue driving detection system and vehicle

Publications (1)

Publication Number Publication Date
CN209795467U true CN209795467U (en) 2019-12-17

Family

ID=68818742

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201822211242.1U Active CN209795467U (en) 2018-12-26 2018-12-26 Fatigue driving detection system and vehicle

Country Status (1)

Country Link
CN (1) CN209795467U (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111634287A (en) * 2020-04-30 2020-09-08 长城汽车股份有限公司 Fatigue monitoring method, device and system and vehicle-mounted multimedia system
CN112185066A (en) * 2020-09-17 2021-01-05 北京汽车集团越野车有限公司 Fatigue driving prevention device and method and vehicle
CN113460073A (en) * 2021-06-30 2021-10-01 恒大新能源汽车投资控股集团有限公司 Fatigue driving reminding method, device and system
CN113879314A (en) * 2020-07-01 2022-01-04 罗敏 Vehicle-mounted system and method for monitoring human physiological data
CN114506335A (en) * 2022-01-13 2022-05-17 四川豪智融科技有限公司 Driver fatigue and health monitoring system for automatic driving

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111634287A (en) * 2020-04-30 2020-09-08 长城汽车股份有限公司 Fatigue monitoring method, device and system and vehicle-mounted multimedia system
CN113879314A (en) * 2020-07-01 2022-01-04 罗敏 Vehicle-mounted system and method for monitoring human physiological data
CN112185066A (en) * 2020-09-17 2021-01-05 北京汽车集团越野车有限公司 Fatigue driving prevention device and method and vehicle
CN113460073A (en) * 2021-06-30 2021-10-01 恒大新能源汽车投资控股集团有限公司 Fatigue driving reminding method, device and system
CN114506335A (en) * 2022-01-13 2022-05-17 四川豪智融科技有限公司 Driver fatigue and health monitoring system for automatic driving

Similar Documents

Publication Publication Date Title
CN209795467U (en) Fatigue driving detection system and vehicle
CN105336105B (en) A kind of method of preventing fatigue driving, smart machine and system
JP7060031B2 (en) Driver monitoring system
US20180229654A1 (en) Sensing application use while driving
CN205158585U (en) Prevention driver fatigue's smart machine and system
CN106515742A (en) Lane departure early warning method and system
US10666901B1 (en) System for soothing an occupant in a vehicle
CN108312964A (en) A kind of fatigue driving state identification early warning system and method
CN111179880A (en) Brightness adjusting method and device of display screen, electronic equipment and system
CN109190600A (en) A kind of driver's monitoring system of view-based access control model sensor
CN109801475A (en) Method for detecting fatigue driving, device and computer readable storage medium
CN106157537A (en) Anti-fatigue-driving system
CN104376684A (en) Monitoring system capable of preventing fatigue driving
CN211427470U (en) Fatigue driving reminding device
KR102494530B1 (en) Camera Apparatus Installing at a Car for Detecting Drowsy Driving and Careless Driving and Method thereof
CN209785217U (en) Fatigue driving prevention system based on convolutional neural network and matrix photography
CN209560688U (en) Driver fatigue based on Streaming Media rear-view mirror system monitors system
CN111243235A (en) Driving assistance method and device
CN110077417A (en) A kind of method and system of automobile guideboard acquisition of information prompt
CN115299948A (en) Driver fatigue detection method and detection system
CN212569985U (en) Fatigue driving early warning system
CN210416545U (en) Automobile safe driving detection device
CN114419841A (en) Driver fatigue driving early warning system and method
CN107499126A (en) A kind of intelligent automobile management system
CN203427710U (en) Automobile anti-fatigue driving device

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant