CN112966664A - Fatigue driving detection method, system and device and readable storage medium - Google Patents

Fatigue driving detection method, system and device and readable storage medium Download PDF

Info

Publication number
CN112966664A
CN112966664A CN202110356417.1A CN202110356417A CN112966664A CN 112966664 A CN112966664 A CN 112966664A CN 202110356417 A CN202110356417 A CN 202110356417A CN 112966664 A CN112966664 A CN 112966664A
Authority
CN
China
Prior art keywords
fatigue driving
face
driver
posture
human eye
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110356417.1A
Other languages
Chinese (zh)
Inventor
王超
钟正迪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Kostal Huayang Automotive Electric Co Ltd
Kostal Shanghai Mechatronic Co Ltd
Original Assignee
Shanghai Kostal Huayang Automotive Electric Co Ltd
Kostal Shanghai Mechatronic Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Kostal Huayang Automotive Electric Co Ltd, Kostal Shanghai Mechatronic Co Ltd filed Critical Shanghai Kostal Huayang Automotive Electric Co Ltd
Priority to CN202110356417.1A priority Critical patent/CN112966664A/en
Publication of CN112966664A publication Critical patent/CN112966664A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris

Abstract

The application discloses a fatigue driving detection method, a system, a device and a computer readable storage medium, comprising: acquiring an infrared image of a preset area; analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light; and judging whether the driver is fatigue driving or not by using the position of the face. The method and the device have the advantages that the absorption rate of water to near infrared light is different, the facial infrared image of the driver is accurately analyzed, the face position and the face state of the driver can be effectively judged, the accuracy of judging whether the driver is in fatigue driving according to the face position is improved subsequently, and the fatigue driving detection efficiency is improved.

Description

Fatigue driving detection method, system and device and readable storage medium
Technical Field
The invention relates to the field of automobiles, in particular to a method, a system and a device for detecting fatigue driving and a computer readable storage medium.
Background
With the development of technology, in order to improve driving safety, various high-technology products aiming at driving safety are gradually popularized.
At present, in traffic accidents, accidents caused by fatigue driving account for a large part, and the harmfulness of fatigue driving is promoted and popularized by traffic departments.
In order to further prevent fatigue driving, an efficient fatigue driving detection method is needed, which can detect fatigue driving of a driver in time so as to give an alarm in the following.
Disclosure of Invention
In view of the above, the present invention provides a method, a system, a device and a computer readable storage medium for detecting fatigue driving, which can efficiently detect fatigue driving of a driver. The specific scheme is as follows:
a method of detecting fatigue driving, comprising:
acquiring an infrared image of a preset area;
analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light;
and judging whether the driver is in fatigue driving or not by using the position of the face.
Optionally, the process of analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light includes:
the human face contour and the human eye position in the infrared image are identified by the absorption rate of water to the near infrared light of 1.94 um.
Optionally, after the position of the face is used to determine whether the driver is tired, the method further includes:
and if the driver is judged to be in fatigue driving, a prompt tone is given to warn the driver.
Optionally, the process of determining whether the driver is tired of driving by using the position of the face includes:
judging whether the face pose is in a preset face pose range or not by using the face contour;
judging whether the human eye posture is in a preset human eye posture range by using the human eye position;
and if the human face posture and the human eye posture are not in a preset range, judging that the driver is in fatigue driving.
The invention also discloses a fatigue driving detection system, which comprises:
the infrared image acquisition module is used for acquiring an infrared image of a preset area;
the human face position analysis module is used for analyzing the position of the human face of the driver in the infrared image by utilizing the absorptivity of water to near infrared light;
and the fatigue driving judging module is used for judging whether the driver is in fatigue driving by utilizing the position of the face.
Optionally, the face position analysis module is specifically configured to identify a face contour and a position of a human eye in the infrared image by using an absorption rate of water to 1.94um near-infrared light.
Optionally, the method further includes:
and the warning module is used for sending out a warning sound to warn the driver if the fatigue driving judgment module judges that the driver is in fatigue driving.
Optionally, the fatigue driving determination module includes:
the human face posture judging unit is used for judging whether the human face posture is in a preset human face posture range by utilizing the human face contour;
the human eye posture judging unit is used for judging whether the human eye posture is in a preset human eye posture range by utilizing the human eye position;
and the fatigue driving judging unit is used for judging the fatigue driving of the driver if the human face posture and the human eye posture are not in a preset range.
The invention also discloses a fatigue driving detection device, which comprises:
a memory for storing a computer program;
a processor for executing the computer program to implement the fatigue driving detection method as described above.
The invention also discloses a computer readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a fatigue driving detection method as described above.
The fatigue driving detection method comprises the following steps: acquiring an infrared image of a preset area; analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light; and judging whether the driver is fatigue driving or not by using the position of the face.
According to the method, the infrared image of the face of the driver is accurately analyzed by utilizing different absorption rates of water to near infrared light, the face position and the face state of the driver can be effectively judged, the accuracy of judging whether the driver is in fatigue driving according to the face position subsequently is improved, and the fatigue driving detection efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for detecting fatigue driving according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of another fatigue driving detection method disclosed in the embodiment of the present invention;
fig. 3 is a schematic structural diagram of a fatigue driving detection system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses a fatigue driving detection method, which is shown in figure 1 and comprises the following steps:
s11: and acquiring an infrared image of the preset area.
Specifically, whether the driver is in fatigue driving is judged according to changes of facial details and facial positions of the driver during normal driving and fatigue driving, and therefore an infrared image of a preset area is obtained to obtain a facial image of the driver.
Specifically, the preset region may be a region where the head is located when the driver drives normally, which is summarized according to historical experience.
S12: and analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to the near infrared light.
Specifically, the absorption rate of the near infrared light by water is different, areas with different moisture on the infrared image have chromaticity differences, processing such as binaryzation can be utilized, areas with much moisture and areas with little moisture are distinguished, for the human face, human eyes moisture is more, therefore, the position of the human eyes can be judged by analyzing the infrared image, the human face has more moisture content relative to the background in the vehicle, the outline of the human face in the vehicle can be judged, therefore, through analyzing the infrared image, the position of the human face of the driver can be obtained.
S13: and judging whether the driver is fatigue driving or not by using the position of the face.
Specifically, according to the historical summary rule, it is determined whether the position of the face is fatigue driving, for example, whether the face is too low, too far forward, or even whether the face is in the image, and whether the eyes are open, whether the opening degree is in a normal state, or not.
Therefore, the embodiment of the invention accurately analyzes the face infrared image of the driver by utilizing the different absorption rates of water to near infrared light, can effectively judge the face position and the face state of the driver, further improves the accuracy of judging whether the driver is in fatigue driving according to the face position subsequently, and improves the fatigue driving detection efficiency.
The embodiment of the invention discloses a specific method, and compared with the previous embodiment, the embodiment further explains and optimizes the technical scheme. Referring to fig. 2, specifically:
s21: acquiring an infrared image of a preset area;
s22: the human face contour and the human eye position in the infrared image are identified by the absorption rate of water to the near infrared light of 1.94 um.
Specifically, can utilize the high absorptivity of water to 1.94um near-infrared light, use 1.94 um's near-infrared light to shoot infrared image, and then improve infrared image's definition, in addition, also can consider to utilize 1.4um near-infrared light and 3um near-infrared light to carry out infrared image acquisition.
S23: and judging whether the face pose is in a preset face pose range or not by using the face contour.
Specifically, the preset human face posture is the position of the human face when the driver drives normally, and whether the position of the human face changes due to dozing caused by fatigue driving can be judged by judging whether the human face is low or not and judging whether the human face posture is different from the preset human face posture.
S24: and judging whether the human eye posture is in a preset human eye posture range by using the human eye position.
Specifically, the preset human eye posture range may be a size of opening of a person when the driver drives normally, and whether the driver drives due to fatigue can be determined by determining the size of opening of the person, for example, closing of human eyes due to squinting due to fatigue driving can be detected.
S25: and if the human face posture and the human eye posture are not in the preset range, judging that the driver is in fatigue driving.
Specifically, in order to ensure the accuracy of the detection results, it can be ensured that both the detection results are not in the preset range and then determined as fatigue driving, and when the determination mode is determined according to the actual application requirements, the person can change the determination mode, for example, fatigue driving is performed when any one of the detection results meets the requirement.
S26: if the driver is judged to be fatigue driving, a warning sound is given to warn the driver.
Specifically, after fatigue driving is judged, a prompt tone is played through corresponding playing equipment to warn a driver of current fatigue driving, and the driver is guided to pay attention to the state of the driver to carry out corresponding precautionary measures.
Correspondingly, the embodiment of the invention also discloses a fatigue driving detection system, which is shown in fig. 3 and comprises:
the infrared image acquisition module 11 is used for acquiring an infrared image of a preset area;
the human face position analysis module 12 is used for analyzing the position of the human face of the driver in the infrared image by utilizing the absorption rate of water to near infrared light;
and the fatigue driving judging module 13 is used for judging whether the driver is in fatigue driving according to the position of the face.
Therefore, the embodiment of the invention accurately analyzes the face infrared image of the driver by utilizing the different absorption rates of water to near infrared light, can effectively judge the face position and the face state of the driver, further improves the accuracy of judging whether the driver is in fatigue driving according to the face position subsequently, and improves the fatigue driving detection efficiency.
Specifically, the face position analysis module 12 is specifically configured to identify a face contour and a human eye position in the infrared image by using an absorption rate of water to near-infrared light of 1.94 um.
Specifically, the system can also comprise an alarm module; wherein the content of the first and second substances,
and the warning module is used for giving out a prompt sound to warn the driver if the fatigue driving judging module 13 judges that the driver is in fatigue driving.
Specifically, the fatigue driving determination module 13 may include a human face posture determination unit, a human eye posture determination unit, and a fatigue driving determination unit; wherein the content of the first and second substances,
the human face posture judging unit is used for judging whether the human face posture is in a preset human face posture range by using the human face contour;
the human eye posture judging unit is used for judging whether the human eye posture is in a preset human eye posture range by utilizing the human eye position;
and the fatigue driving judging unit is used for judging the fatigue driving of the driver if the human face posture and the human eye posture are not in the preset range.
In addition, the embodiment of the invention also discloses a fatigue driving detection device, which comprises:
a memory for storing a computer program;
a processor for executing a computer program to implement the fatigue driving detection method as described above.
In addition, the embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when being executed by a processor, the computer program realizes the fatigue driving detection method.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The technical content provided by the present invention is described in detail above, and the principle and the implementation of the present invention are explained in this document by applying specific examples, and the above description of the examples is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A fatigue driving detection method, characterized by comprising:
acquiring an infrared image of a preset area;
analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near infrared light;
and judging whether the driver is in fatigue driving or not by using the position of the face.
2. The fatigue driving detection method according to claim 1, wherein the process of analyzing the position of the face of the driver in the infrared image by using the absorption rate of water to near-infrared light includes:
the human face contour and the human eye position in the infrared image are identified by the absorption rate of water to the near infrared light of 1.94 um.
3. The fatigue driving detection method according to claim 2, wherein after determining whether the driver is fatigued by using the position of the face, the method further comprises:
and if the driver is judged to be in fatigue driving, a prompt tone is given to warn the driver.
4. The fatigue driving detection method according to any one of claims 1 to 3, wherein the process of determining whether the driver is fatigue driving by using the position of the face includes:
judging whether the face pose is in a preset face pose range or not by using the face contour;
judging whether the human eye posture is in a preset human eye posture range by using the human eye position;
and if the human face posture and the human eye posture are not in a preset range, judging that the driver is in fatigue driving.
5. A fatigue driving detection system, comprising:
the infrared image acquisition module is used for acquiring an infrared image of a preset area;
the human face position analysis module is used for analyzing the position of the human face of the driver in the infrared image by utilizing the absorptivity of water to near infrared light;
and the fatigue driving judging module is used for judging whether the driver is in fatigue driving by utilizing the position of the face.
6. The fatigue driving detection system of claim 5, wherein the face position analysis module is specifically configured to identify a face contour and a human eye position in the infrared image by using an absorption rate of water to near infrared light of 1.94 um.
7. The fatigue driving detection system of claim 6, further comprising:
and the warning module is used for sending out a warning sound to warn the driver if the fatigue driving judgment module judges that the driver is in fatigue driving.
8. The fatigue driving detection system according to any one of claims 5 to 7, wherein the fatigue driving determination module includes:
the human face posture judging unit is used for judging whether the human face posture is in a preset human face posture range by utilizing the human face contour;
the human eye posture judging unit is used for judging whether the human eye posture is in a preset human eye posture range by utilizing the human eye position;
and the fatigue driving judging unit is used for judging the fatigue driving of the driver if the human face posture and the human eye posture are not in a preset range.
9. A fatigue driving detecting device, characterized by comprising:
a memory for storing a computer program;
a processor for executing the computer program to implement the fatigue driving detection method according to any one of claims 1 to 6.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the fatigue driving detection method according to any one of claims 1 to 6.
CN202110356417.1A 2021-04-01 2021-04-01 Fatigue driving detection method, system and device and readable storage medium Pending CN112966664A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110356417.1A CN112966664A (en) 2021-04-01 2021-04-01 Fatigue driving detection method, system and device and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110356417.1A CN112966664A (en) 2021-04-01 2021-04-01 Fatigue driving detection method, system and device and readable storage medium

Publications (1)

Publication Number Publication Date
CN112966664A true CN112966664A (en) 2021-06-15

Family

ID=76280823

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110356417.1A Pending CN112966664A (en) 2021-04-01 2021-04-01 Fatigue driving detection method, system and device and readable storage medium

Country Status (1)

Country Link
CN (1) CN112966664A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104881956A (en) * 2015-06-17 2015-09-02 上海大学 Fatigue driving early warning system
CN105069448A (en) * 2015-09-29 2015-11-18 厦门中控生物识别信息技术有限公司 True and false face identification method and device
CN105769120A (en) * 2016-01-27 2016-07-20 深圳地平线机器人科技有限公司 Fatigue driving detection method and device
CN106530623A (en) * 2016-12-30 2017-03-22 南京理工大学 Fatigue driving detection device and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104881956A (en) * 2015-06-17 2015-09-02 上海大学 Fatigue driving early warning system
CN105069448A (en) * 2015-09-29 2015-11-18 厦门中控生物识别信息技术有限公司 True and false face identification method and device
CN105769120A (en) * 2016-01-27 2016-07-20 深圳地平线机器人科技有限公司 Fatigue driving detection method and device
CN106530623A (en) * 2016-12-30 2017-03-22 南京理工大学 Fatigue driving detection device and method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
丁晓雯等: "《食品分析》", 31 August 2016 *
丁轶峰等: "《掌纹掌脉融合识别技术及其在范地铁环境中的应用》", 31 January 2017 *

Similar Documents

Publication Publication Date Title
JP5942761B2 (en) Driving support device and driving support method
CN109937152B (en) Driving state monitoring method and device, driver monitoring system and vehicle
CN107697069B (en) Intelligent control method for fatigue driving of automobile driver
CN107554528B (en) Fatigue grade detection method and device for driver and passenger, storage medium and terminal
CN110194174B (en) Fatigue driving monitoring system
CN105286802B (en) Driver Fatigue Detection based on video information
US7868771B2 (en) Doze-off warning apparatus for vehicle
CN109664891A (en) Auxiliary driving method, device, equipment and storage medium
JP5712968B2 (en) Human detection device
JP6754368B2 (en) A method performed by a device for determining fatigue and / or sleep of a vehicle driver
JP4529394B2 (en) Driver's vehicle driving characteristic estimation device
CN110879973A (en) Driver fatigue state facial feature recognition and detection method
WO2013186984A1 (en) Person detection device
Lashkov et al. Driver dangerous state detection based on OpenCV & dlib libraries using mobile video processing
KR102479049B1 (en) The apparatus and method for Driver Status Recognition based on Driving Status Decision Information
CN109664889A (en) A kind of control method for vehicle, device and system and storage medium
KR102433668B1 (en) Driver Monitoring System and method thereof
JP5349350B2 (en) Eye opening degree determination device and eye opening degree determination method
JP4760113B2 (en) Driver state estimation device
CN112966664A (en) Fatigue driving detection method, system and device and readable storage medium
KR20190056520A (en) Analysis Method for Forward Concentration using a Facial Expression Recognition Technology
JP6565305B2 (en) Vehicle safe driving promotion method and vehicle safe driving promotion device
JP2018194961A (en) Driver monitoring device, driver monitoring method, and driver monitoring program
KR101710007B1 (en) Methods for linguistically modeling of driver's behavior and recognizing of driver's behavior, and systems for performing the same
JP2011086186A (en) Sleepiness determination apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210615