CN115880675A - Fatigue driving behavior real-time monitoring analysis method and system and electronic equipment - Google Patents
Fatigue driving behavior real-time monitoring analysis method and system and electronic equipment Download PDFInfo
- Publication number
- CN115880675A CN115880675A CN202211671340.8A CN202211671340A CN115880675A CN 115880675 A CN115880675 A CN 115880675A CN 202211671340 A CN202211671340 A CN 202211671340A CN 115880675 A CN115880675 A CN 115880675A
- Authority
- CN
- China
- Prior art keywords
- driver
- fatigue driving
- real
- fatigue
- time monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The application discloses a real-time monitoring fatigue driving behavior analysis method, including: collecting image information of the head of a driver; processing a feature model of the image information of the head of the driver, extracting a face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver; judging whether the driver is in a fatigue driving state or not based on the opening degree of the eyes and a set contour threshold value; and if the fatigue state of the driver is judged and the fatigue state exceeds the preset threshold value, a fatigue driving alarm signal is sent out. In the technical scheme, the method can improve the face recognition accuracy of the driver and reduce the misjudgment rate of the state of the driver by means of image acquisition data processing, behavior analysis and the like, and has the technical effects of high fatigue driving recognition rate, good specification of driving behaviors and reduction of social traffic safety accidents compared with the prior art. The invention also relates to an analysis system for monitoring the fatigue driving behavior in real time and an electronic device, and the system and the electronic device also have the beneficial effects.
Description
Technical Field
The application relates to the technical field of unmanned driving, in particular to a method and a system for analyzing fatigue driving behaviors through real-time monitoring and electronic equipment.
Background
In the rapid development of intelligent product technology, sanitation vehicles are gradually developed towards intellectualization and security. At present, some driver fatigue driving recognition monitoring method devices are available in the market, for example, facial feature forms of a human face and head steering and blinking frequencies are extracted through a camera, data are calculated and analyzed through an artificial intelligence mathematical model, and states of a driver are judged. .
Therefore, how to provide a real-time monitoring fatigue driving behavior analysis method, which can overcome the above technical problems, improve the face recognition accuracy, and reduce the misjudgment rate of the driver state, has become a technical problem to be solved by those skilled in the art.
Disclosure of Invention
In order to solve the technical problems, the application provides an analysis method for monitoring fatigue driving behaviors in real time, which can obviously improve the accuracy of facial recognition compared with the prior art, so that the misjudgment rate of the state of a driver is reduced. The application also provides a real-time monitoring fatigue driving behavior analysis system and electronic equipment, and the system and the electronic equipment also have the technical effects.
The technical scheme provided by the application is as follows:
the application provides a method for analyzing fatigue driving behaviors through real-time monitoring, which comprises the following steps: collecting image information of the head of a driver; processing a feature model of the image information of the head of the driver, extracting a face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver; judging whether the driver is in a fatigue driving state or not based on the opening degree of the eyes and a set contour threshold value; and if the fatigue state of the driver is judged and the fatigue state exceeds the preset threshold value, a fatigue driving alarm signal is sent out.
Further, in a preferred mode of the present invention, the step of "acquiring driver head image information" includes: the method comprises the steps of collecting information of the eye closing frequency, yawning, smoking, calling and the like of a driver, and filtering sunglasses and a mask on the head of the driver.
Further, in a preferred mode of the present invention, the method further includes the steps of: the driver is alerted by receiving a fatigue driving warning signal and providing a voice prompt to the driver.
Further, in a preferred mode of the present invention, the method further includes the steps of: and limiting the running speed of the vehicle after receiving the fatigue driving alarm signal.
Further, in a preferred mode of the present invention, the method further includes the steps of: and after receiving the fatigue driving alarm signal, judging whether to control the vehicle to suddenly stop or not by combining the surrounding environment of the vehicle.
In addition, the invention also provides an analysis system for monitoring fatigue driving behaviors in real time, which comprises: the image acquisition module is used for acquiring image information of the head of the driver; the image processing module is used for processing a feature model of the image information of the head of the driver, extracting the face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver; the data processing module is used for judging whether the driver is in a fatigue driving state or not based on the opening degree of eyes and a set contour threshold value; if the fatigue state of the driver is judged and the fatigue state exceeds a preset threshold value, a fatigue driving alarm signal is sent out; and the voice prompt module is used for receiving the fatigue driving alarm signal and providing voice prompt for the driver so as to arouse the driver alertness.
Further, in a preferred aspect of the present invention, the method further includes: and the speed limiting module is in communication connection with the data processing module and is used for limiting the driving speed of the vehicle after receiving the fatigue driving alarm signal.
Further, in a preferred aspect of the present invention, the method further includes: and the emergency stop module is used for receiving the fatigue driving alarm signal and then judging whether to control the vehicle to carry out emergency stop or not by combining the surrounding environment of the vehicle.
Further, in a preferred aspect of the present invention, the method further includes: and if an alarm event occurs, the real-time monitoring fatigue driving behavior analysis system of the 4G/5G remote terminal uploads the alarm event to the cloud end in real time through the 4G/5G network, so that the remote supervision of a terminal monitoring center and a driver is realized, and the driver is prompted to run safely.
Furthermore, the invention relates to an electronic device comprising: a computer program for executing the real-time monitoring fatigue driving behavior analysis method as described above; a memory for storing the computer program; a processor for executing the computer program.
The invention provides an analysis method for monitoring fatigue driving behaviors in real time, which comprises the following steps: collecting image information of the head of a driver; processing a feature model of the image information of the head of the driver, extracting a face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver; judging whether the driver is in a fatigue driving state or not based on the opening degree of the eyes and a set contour threshold value; and if the fatigue state of the driver is judged and the fatigue state exceeds the preset threshold value, a fatigue driving alarm signal is sent out. In the technical scheme, the method can improve the face recognition accuracy of the driver by means of image acquisition data processing, behavior analysis and the like, so that the misjudgment rate of the state of the driver is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of an analysis method for monitoring fatigue driving behaviors in real time according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a real-time monitoring fatigue driving behavior analysis system according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It will be understood that when an element is referred to as being "fixed" or "disposed" on another element, it can be directly on the other element or be indirectly disposed on the other element; when an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element.
It will be understood that the terms "length," "width," "upper," "lower," "front," "rear," "first," "second," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like, as used herein, refer to an orientation or positional relationship indicated in the drawings that is solely for the purpose of facilitating the description and simplifying the description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus should not be construed as limiting the application.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present application, "plurality" or "a plurality" means two or more unless specifically limited otherwise.
It should be understood that the structures, ratios, sizes, and the like shown in the drawings are only used for matching the disclosure of the specification, so as to be understood and read by those skilled in the art, and are not used to limit the practical limit conditions of the present application, so that the modifications of the structures, the changes of the ratio relationships, or the adjustment of the sizes, do not have the technical essence, and the modifications, the changes of the ratio relationships, or the adjustment of the sizes, are all within the scope of the technical contents disclosed in the present application without affecting the efficacy and the achievable purpose of the present application.
As shown in fig. 1 to fig. 2, the method for analyzing fatigue driving behavior through real-time monitoring provided by the embodiment of the application includes the following steps: collecting image information of the head of a driver; processing a feature model of the image information of the head of the driver, extracting a face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver; judging whether the driver is in a fatigue driving state or not based on the opening degree of the eyes and a set contour threshold value; and if the fatigue state of the driver is judged and the fatigue state exceeds the preset threshold value, a fatigue driving alarm signal is sent out. In the technical scheme, the method can improve the face recognition accuracy of the driver by means of image acquisition data processing, behavior analysis and the like, so that the misjudgment rate of the state of the driver is reduced.
The invention provides a method for analyzing fatigue driving behaviors through real-time monitoring, which specifically comprises the following steps: collecting image information of the head of a driver; processing a feature model of the image information of the head of the driver, extracting a face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver; judging whether the driver is in a fatigue driving state or not based on the opening degree of the eyes and a set contour threshold value; and if the fatigue state of the driver is judged and the fatigue state exceeds the preset threshold value, a fatigue driving alarm signal is sent out.
Specifically, in the embodiment of the present invention, the step of "acquiring driver head image information" includes: the method comprises the steps of collecting information such as eye closing frequency, yawning, smoking, calling and the like of a driver, and filtering sunglasses and a mask on the head of the driver.
Specifically, in the embodiment of the present invention, the method further includes the steps of: the driver is alerted by receiving a fatigue driving warning signal and providing a voice prompt to the driver.
Specifically, in the embodiment of the present invention, the method further includes the steps of: and limiting the running speed of the vehicle after receiving the fatigue driving alarm signal.
Specifically, in the embodiment of the present invention, the method further includes the steps of: and after receiving the fatigue driving alarm signal, judging whether to control the vehicle to suddenly stop or not by combining the surrounding environment of the vehicle.
In addition, the invention also provides an analysis system for monitoring fatigue driving behaviors in real time, which comprises: the image acquisition module is used for acquiring image information of the head of the driver; the image processing module is used for processing a feature model of the image information of the head of the driver, extracting the face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver; the data processing module is used for judging whether the driver is in a fatigue driving state or not based on the opening degree of eyes and a set contour threshold value; if the fatigue state of the driver is judged and the fatigue state exceeds a preset threshold value, a fatigue driving alarm signal is sent out; and the voice prompt module is used for receiving the fatigue driving alarm signal and providing voice prompt for the driver so as to arouse the driver alertness.
Specifically, in an embodiment of the present invention, the method further includes: and the speed limiting module is in communication connection with the data processing module and is used for limiting the driving speed of the vehicle after receiving the fatigue driving alarm signal.
Specifically, in an embodiment of the present invention, the method further includes: and the emergency stop module is used for receiving the fatigue driving alarm signal and then judging whether to control the vehicle to carry out emergency stop or not by combining the surrounding environment of the vehicle.
Specifically, in an embodiment of the present invention, the method further includes: 4G/5G remote terminal, the fatigue driving behavior analytic system of real-time supervision can pass through if the alarm incident takes place 4G/5G network uploads to the high in the clouds in real time, realizes the remote supervision of terminal monitoring center and driver, suggestion driver safety traffic.
In addition, an embodiment of the present invention further provides an electronic device, including: a computer program for executing the real-time monitoring fatigue driving behavior analysis method as described above; a memory for storing the computer program; a processor for executing the computer program.
More specifically, the technical scheme related to the embodiment of the invention is that the five sense organs of the driver are detected according to the time and the face recognition technology of the driver, the face orientation and the eye closure are analyzed to judge fatigue driving, the fatigue degree of the driver is analyzed, corresponding early warning is carried out on the driver working for fatigue driving for a long time, the driver is reminded to have reasonable rest, and therefore the occurrence of personal safety traffic accidents is reduced. In the rapid development of the intelligent product technology, the traditional sanitation vehicle industry also creates intellectualization and safety for drivers. Along with the intelligent and safe technological innovation and development of the sanitation vehicle, the driving operation habit problem of a driver is greatly solved, and particularly, the driver feels physical fatigue easily when driving for long-time continuous operation. Meanwhile, the design of the traditional sanitation vehicle for deploying the real-time fatigue driving monitoring device has a certain leading position in practical application, and the personal safety problem of a driver can be effectively reduced.
At present, some driver fatigue driving recognition monitoring method devices are available in the market, for example, facial feature forms of human faces and head turning and blinking frequencies are extracted through a monocular camera, data are calculated and analyzed through an artificial intelligence mathematical model, and states of drivers are judged. The monitoring method has complex mathematical model and large calculation data quantity, and is inaccurate in extracting database images of the face of the driver; the accuracy of face recognition is low; erroneous judgment of the state of the driver may occur. The existing technological innovation technology is too complex in a method for identifying fatigue of a driver, high in false detection rate and incapable of effectively solving the personal safety problem.
The implementation scheme of the invention comprises the following technical characteristics: the binocular camera module mainly collects head images of a driver, eye closing frequency, yawning, smoking, making a call, sunglasses filtering, mask wearing filtering and night detection, and transmits the collected face images to the processor through analog signals; the processor unit is mainly used for processing a head image feature model of the driver, extracting a face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver; judging whether the driver is in a fatigue driving state or not according to the opening degree of the eyes and a set contour threshold value; if the fatigue state of the driver is judged, a fatigue driving signal is sent to the alarm unit and the emergency stop unit when the fatigue state of the driver exceeds a preset threshold value; the voice interaction unit is used for providing corresponding voice prompt for the driver after the fatigue signal is received by the alarm unit so as to arouse the alertness of the driver; the 4G/5G remote terminal uploads the alarm event to the cloud end in real time through a 4G/5G network, so that remote supervision of a terminal monitoring center and a driver is realized, and the driver is prompted to run safely; the speed limiting unit or the emergency stop unit is mainly used for limiting the running speed of the vehicle after receiving the fatigue signal or carrying out emergency stop according to the surrounding environment of the vehicle.
In conclusion, the technical scheme of the embodiment of the invention has the advantages of simple image data acquisition model calculation, high behavior analysis and fatigue driving recognition rate and low hardware cost, and combines the characteristics of human-computer voice interaction to improve the safety awareness of a driver during driving and standardize the driving behavior, thereby reducing social traffic safety accidents and improving the precaution level of public transport drivers.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A real-time monitoring fatigue driving behavior analysis method is characterized by comprising the following steps:
collecting image information of the head of a driver;
processing a feature model of the image information of the head of the driver, extracting a face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver;
judging whether the driver is in a fatigue driving state or not based on the opening degree of the eyes and a set contour threshold value;
and if the fatigue state of the driver is judged and the fatigue state exceeds the preset threshold value, a fatigue driving alarm signal is sent out.
2. The real-time monitoring fatigue driving behavior analysis method according to claim 1, wherein the step of "collecting image information of the driver's head" comprises: the method comprises the steps of collecting information of the eye closing frequency, yawning, smoking, calling and the like of a driver, and filtering sunglasses and a mask on the head of the driver.
3. The real-time monitoring fatigue driving behavior analysis method according to claim 1, further comprising the steps of: the driver is alerted by receiving a fatigue driving warning signal and providing a voice prompt to the driver.
4. The real-time monitoring fatigue driving behavior analysis method according to claim 3, further comprising the steps of: and limiting the driving speed of the vehicle after receiving the fatigue driving alarm signal.
5. The real-time monitoring fatigue driving behavior analysis method according to claim 1, further comprising the steps of: and after receiving the fatigue driving alarm signal, judging whether to control the vehicle to suddenly stop or not by combining the surrounding environment of the vehicle.
6. A real-time monitoring fatigue driving behavior analysis system, comprising:
the image acquisition module is used for acquiring image information of the head of the driver;
the image processing module is used for processing a feature model of the image information of the head of the driver, extracting the face state through an artificial intelligence algorithm, and calculating the opening degree of eyes by combining the outline and the eye height of the eye area of the driver;
the data processing module is used for judging whether the driver is in a fatigue driving state or not based on the opening degree of the eyes and the set contour threshold value; if the driver is judged to be in a fatigue state and exceeds a preset threshold value, a fatigue driving alarm signal is sent out;
and the voice prompt module is used for receiving the fatigue driving alarm signal and providing voice prompt for the driver so as to arouse the driver alertness.
7. The real-time monitoring fatigue driving behavior analysis system of claim 6, further comprising: and the speed limiting module is in communication connection with the data processing module and is used for limiting the driving speed of the vehicle after receiving the fatigue driving alarm signal.
8. The real-time monitoring fatigue driving behavior analysis system of claim 7, further comprising: and the emergency stop module is used for receiving the fatigue driving alarm signal and then judging whether to control the vehicle to carry out emergency stop or not by combining the surrounding environment of the vehicle.
9. The real-time monitoring fatigue driving behavior analysis system of claim 8, further comprising: 4G/5G remote terminal, the fatigue driving behavior analytic system of real-time supervision can pass through if the alarm incident takes place 4G/5G network uploads to the high in the clouds in real time, realizes the remote supervision of terminal monitoring center and driver, suggestion driver safety traffic.
10. An electronic device, comprising:
a computer program for executing the real-time monitoring fatigue driving behavior analysis method of any one of claims 1 to 5;
a memory for storing the computer program;
a processor for executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211671340.8A CN115880675A (en) | 2022-12-26 | 2022-12-26 | Fatigue driving behavior real-time monitoring analysis method and system and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211671340.8A CN115880675A (en) | 2022-12-26 | 2022-12-26 | Fatigue driving behavior real-time monitoring analysis method and system and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115880675A true CN115880675A (en) | 2023-03-31 |
Family
ID=85755528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211671340.8A Pending CN115880675A (en) | 2022-12-26 | 2022-12-26 | Fatigue driving behavior real-time monitoring analysis method and system and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115880675A (en) |
-
2022
- 2022-12-26 CN CN202211671340.8A patent/CN115880675A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11783601B2 (en) | Driver fatigue detection method and system based on combining a pseudo-3D convolutional neural network and an attention mechanism | |
| CN102263937B (en) | Driver's driving behavior monitoring device and monitoring method based on video detection | |
| CN107697069A (en) | Fatigue of automobile driver driving intelligent control method | |
| CN106571015A (en) | Driving behavior data collection method based on Internet | |
| US20220175287A1 (en) | Method and device for detecting driver distraction | |
| CN101673464A (en) | Intelligent management system of fatigue driving | |
| CN110588512A (en) | Dangerous driving identification and early warning device, method and system | |
| CN110901385B (en) | Active speed limiting method based on fatigue state of driver | |
| CN107563346A (en) | One kind realizes that driver fatigue sentences method for distinguishing based on eye image processing | |
| CN109740477A (en) | Study in Driver Fatigue State Surveillance System and its fatigue detection method | |
| CN111179551A (en) | Real-time monitoring method for dangerous chemical transport driver | |
| Lashkov et al. | Driver dangerous state detection based on OpenCV & dlib libraries using mobile video processing | |
| CN212624073U (en) | Safe driving early warning system | |
| CN110992709A (en) | Active speed limiting system based on fatigue state of driver | |
| CN111860210A (en) | Method and device for detecting separation of hands from steering wheel, electronic equipment and storage medium | |
| CN103247150A (en) | Fatigue driving preventing system | |
| CN110781872A (en) | Driver fatigue grade recognition system with bimodal feature fusion | |
| Mašanović et al. | Driver monitoring using the in-vehicle camera | |
| Rani et al. | Development of an Automated Tool for Driver Drowsiness Detection | |
| CN109383516A (en) | A kind of anomaly analysis behavioral value system based on user behavior analysis | |
| Kolpe et al. | Drowsiness detection and warning system using python | |
| CN115880675A (en) | Fatigue driving behavior real-time monitoring analysis method and system and electronic equipment | |
| Reddy et al. | Soft Computing Techniques for Driver Alertness | |
| CN210639724U (en) | Fatigue detection and driving behavior recognition early warning system | |
| CN113420656A (en) | Fatigue driving detection method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |