CN110969808B - Fatigue driving monitoring method and system based on acceleration sensor - Google Patents

Fatigue driving monitoring method and system based on acceleration sensor Download PDF

Info

Publication number
CN110969808B
CN110969808B CN201911198813.5A CN201911198813A CN110969808B CN 110969808 B CN110969808 B CN 110969808B CN 201911198813 A CN201911198813 A CN 201911198813A CN 110969808 B CN110969808 B CN 110969808B
Authority
CN
China
Prior art keywords
automobile
information
driver
state
acceleration sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911198813.5A
Other languages
Chinese (zh)
Other versions
CN110969808A (en
Inventor
杨维美
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHENZHEN SHUNHE ELECTRIC TECHNOLOGY CO LTD
Original Assignee
SHENZHEN SHUNHE ELECTRIC TECHNOLOGY CO LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN SHUNHE ELECTRIC TECHNOLOGY CO LTD filed Critical SHENZHEN SHUNHE ELECTRIC TECHNOLOGY CO LTD
Priority to CN201911198813.5A priority Critical patent/CN110969808B/en
Publication of CN110969808A publication Critical patent/CN110969808A/en
Application granted granted Critical
Publication of CN110969808B publication Critical patent/CN110969808B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

The invention discloses a fatigue driving monitoring method based on an acceleration sensor, which comprises the following steps: step S1, acquiring acceleration information of the automobile through an acceleration sensor; step S2, generating the driving state information of the automobile according to the acceleration information; step S3, controlling the working mode of the monitoring module according to the running state information of the automobile; and step S4, judging whether the driver is in a fatigue state according to the monitored information. The invention not only overcomes the specific requirements of the CAN bus on the communication protocol; and the defect that the GPS can not continuously and stably work due to weak signals in a specific area (such as a tunnel) is overcome. Meanwhile, the scheme has low cost; products made using this scheme have a better competitive advantage.

Description

Fatigue driving monitoring method and system based on acceleration sensor
Technical Field
The invention belongs to the technical field of intelligent driving, and particularly relates to a fatigue driving monitoring method and system based on an acceleration sensor.
Background
A Fatigue Driving Monitoring system (DFM) is an electronic Monitoring device that uses sensors such as a camera to acquire facial features such as eyes and mouth of a driver, and determines whether the driver is Fatigue Driving by matching with a specific computer vision algorithm.
The equipment can work normally in the normal advancing process of the vehicle; however, when the vehicle turns, the driver may turn around to observe the situation outside the vehicle, and at the moment, the DFM considers that the driver does not concentrate on driving and gives an alarm; or when meeting the traffic light, the driver may stop and speak with the people nearby or turn around to observe the surrounding environment, and the DFM also considers that the driver does not pay attention to driving and gives an alarm.
In order to solve the problem of false alarm during turning and parking, the current industry generally has 2 methods: 1. acquiring automobile state information through a CAN bus; 2. the vehicle status is acquired using a GPS positioning system. Because CAN bus protocols are different for different vehicle types, if the vehicle state is acquired by using a CAN bus mode, the method is only suitable for the specific vehicle type of the front loading; and cannot be made into a universal product suitable for all vehicle types. The method for acquiring the automobile state by using the GPS positioning method has higher cost and is greatly influenced by the environment (for example, the positioning is invalid due to weak GPS signals in a tunnel).
Disclosure of Invention
The invention aims to provide a fatigue driving monitoring method and system based on an acceleration sensor.
In order to solve the technical problems, the technical scheme provided by the invention is as follows:
a fatigue driving monitoring method based on an acceleration sensor comprises the following steps:
step S1, acquiring acceleration information of the automobile through an acceleration sensor;
step S2, generating the driving state information of the automobile according to the acceleration information;
step S3, controlling the working mode of the monitoring module according to the running state information of the automobile;
and step S4, judging whether the driver is in a fatigue state according to the monitored information.
In the fatigue driving monitoring method based on the acceleration sensor provided by the invention, in the step S3,
when the automobile is in a stop state, controlling the monitoring module to be in a standby mode;
when the automobile is in a turning state, the control monitoring module monitors the eye information of a driver;
when the automobile is in a normal driving state, the control monitoring module simultaneously monitors eyes, a mouth, facial expressions and head movements of a driver.
The fatigue driving monitoring method based on the acceleration sensor further comprises the following steps:
and when the driver is monitored to be in a fatigue state, generating alarm information.
According to another aspect of the present invention, there is also provided:
an acceleration sensor-based driver fatigue monitoring system, comprising:
the acceleration sensor is used for acquiring the acceleration information of the automobile;
the driving state information generating module is used for generating driving state information of the automobile according to the acceleration information;
the control module is used for controlling the working mode of the monitoring module according to the running state information of the automobile;
the monitoring module is used for monitoring the driving state of the driver;
and the judging module is used for judging whether the driver is in a fatigue state according to the monitored driving state of the driver.
In the fatigue driving monitoring system based on the acceleration sensor, when an automobile is in a stop state, the control module controls the monitoring module to be in a standby mode; when the automobile is in a turning state, the control module controls the monitoring module to monitor the eye information of the driver; when the automobile is in a normal driving state, the control module controls the monitoring module to simultaneously monitor eyes, mouth, facial expressions and head movements of a driver.
The fatigue driving monitoring system based on the acceleration sensor provided by the invention further comprises:
and the alarm module is used for generating alarm information when monitoring that the driver is in a fatigue state.
In the fatigue driving monitoring system based on the acceleration sensor, the alarm module comprises a sound alarm unit and a flash alarm unit.
According to another aspect of the present invention, there is also provided a vehicle characterized by comprising: one or more processors; and
one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform one or more methods as described above.
According to another aspect of the invention, there is also provided one or more machine-readable media having instructions stored thereon which, when executed by one or more processors, cause the processors to perform one or more methods as described above.
The invention has the beneficial effects that:
the invention provides a fatigue driving monitoring system and a method based on an acceleration sensor, which can sense X, Y, Z acceleration in three directions through the acceleration sensor so as to judge the driving state (advancing, turning, stopping and the like) of an automobile. According to different working conditions of the automobile, the working mode of the DFM fatigue driving monitoring system is controlled, so that the accuracy of DFM and the comfort of user experience are improved. Not only overcomes the specific requirements of the CAN bus on the communication protocol; and the defect that the GPS can not continuously and stably work due to weak signals in a specific area (such as a tunnel) is overcome. Meanwhile, the scheme has low cost; products made using this scheme have a better competitive advantage.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts:
FIG. 1 is a flow chart of a fatigue driving monitoring method based on an acceleration sensor according to the present invention;
fig. 2 is a schematic diagram of a fatigue driving monitoring system based on an acceleration sensor according to the present invention.
Detailed Description
To facilitate an understanding of the invention, the invention will now be described more fully with reference to the accompanying drawings. Exemplary embodiments of the invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.
In order to better understand the technical solutions, the technical solutions will be described in detail below with reference to the drawings and the specific embodiments of the specification, and it should be understood that the embodiments and specific features of the embodiments of the present invention are detailed descriptions of the technical solutions of the present application, and are not limited to the technical solutions of the present application, and the technical features of the embodiments and examples of the present invention may be combined with each other without conflict.
Example one
Fig. 1 is a flowchart of a fatigue driving monitoring method based on an acceleration sensor according to the present invention, and as shown in fig. 1, fig. 1 is a flowchart of a fatigue driving monitoring method based on an acceleration sensor according to the present invention, which includes the following steps:
step S1, acquiring acceleration information of the automobile through an acceleration sensor;
specifically, in an embodiment of the present invention, the acceleration sensor employs an MMA8491Q chip manufactured by NXP corporation. The chip is provided with an X, Y, Z three-way sensor and a 14-bit AD analog-to-digital converter. X, Y, Z three-way sensor respectively senses the acceleration change in 3 directions of transverse direction, longitudinal direction and vertical direction; converting the acceleration change result into digital information through an ADC (analog-to-digital converter); and outputting the data to an external MCU from the IIC interface.
Step S2, generating the driving state information of the automobile according to the acceleration information;
specifically, in an embodiment of the present invention, it is determined that the vehicle is currently in a stopped state, a turning state, or a normal driving state, through the three-axis acceleration information obtained by the acceleration sensor. The determination of the driving state of the vehicle based on the acceleration information is known to those skilled in the art, and is not described herein again.
Step S3, controlling the working mode of the monitoring module according to the running state information of the automobile;
specifically, in an embodiment of the present invention, the monitoring module adopts different operation modes according to different driving states. When the automobile is in a stop state, controlling the monitoring module to be in a standby mode; when the automobile is in a turning state, the control monitoring module monitors the eye information of a driver; when the automobile is in a normal driving state, the control monitoring module simultaneously monitors eyes, a mouth, facial expressions and head movements of a driver. Therefore, the working mode of the DFM fatigue driving monitoring system is controlled according to different working conditions of the automobile, and therefore accuracy of DFM and comfort of user experience are improved.
And step S4, judging whether the driver is in a fatigue state according to the monitored information.
Specifically, in an embodiment of the present invention, whether the driver is tired can be determined according to the monitored user information in different operating modes. Wherein, whether the driver is in the fatigue state is judged according to the eye information of the driver or according to the eyes, mouth, facial expression and head action of the driver, a computer vision algorithm or any prior art known in the art can be adopted, and the invention is not limited herein.
Further, in one embodiment of the invention, after the fatigue state of the driver is monitored, the sound and light alarm is performed through the LED lamp and the buzzer.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Example two
Based on the same inventive concept, the invention also provides a fatigue driving monitoring system based on the acceleration sensor, which comprises:
the acceleration sensor 10 is used for acquiring acceleration information of the automobile;
specifically, in an embodiment of the present invention, the acceleration sensor employs an MMA8491Q chip manufactured by NXP corporation. The chip is provided with an X, Y, Z three-way sensor and a 14-bit AD analog-to-digital converter. X, Y, Z three-way sensor respectively senses the acceleration change in 3 directions of transverse direction, longitudinal direction and vertical direction; converting the acceleration change result into digital information through an ADC (analog-to-digital converter); and outputting the data to an external MCU from the IIC interface.
A driving state information generating module 20, configured to generate driving state information of the vehicle according to the acceleration information;
specifically, in an embodiment of the present invention, the driving state information generating module determines whether the vehicle is currently in a stopped state, a turning state, or a normal driving state according to the three-axis acceleration information acquired by the acceleration sensor. The driving state information generating module determines the driving state of the vehicle according to the acceleration information, which is known to those skilled in the art, and the present invention is not described herein again.
The control module 30 is used for controlling the working mode of the monitoring module according to the running state information of the automobile;
the monitoring module 40 is used for monitoring the driving state of the driver;
specifically, in an embodiment of the present invention, the monitoring module adopts different operation modes according to different driving states. When the automobile is in a stop state, controlling the monitoring module to be in a standby mode; when the automobile is in a turning state, the control monitoring module monitors the eye information of a driver; when the automobile is in a normal driving state, the control monitoring module simultaneously monitors eyes, a mouth, facial expressions and head movements of a driver. Therefore, the working mode of the DFM fatigue driving monitoring system is controlled according to different working conditions of the automobile, and therefore accuracy of DFM and comfort of user experience are improved.
And the judging module 50 is used for judging whether the driver is in a fatigue state according to the monitored driving state of the driver.
Specifically, in an embodiment of the present invention, whether the driver is tired can be determined according to the monitored user information in different operating modes. Wherein, whether the driver is in the fatigue state is judged according to the eye information of the driver or according to the eyes, mouth, facial expression and head action of the driver, a computer vision algorithm or any prior art known in the art can be adopted, and the invention is not limited herein.
And the alarm module 60 is used for generating alarm information when the fatigue state of the driver is monitored. The alarm module comprises a sound alarm unit and a flash alarm unit.
The invention provides a fatigue driving monitoring system and a method based on an acceleration sensor, which can sense X, Y, Z acceleration in three directions through the acceleration sensor so as to judge the driving state (advancing, turning, stopping and the like) of an automobile. According to different working conditions of the automobile, the working mode of the DFM fatigue driving monitoring system is controlled, so that the accuracy of DFM and the comfort of user experience are improved. Not only overcomes the specific requirements of the CAN bus on the communication protocol; and the defect that the GPS can not continuously and stably work due to weak signals in a specific area (such as a tunnel) is overcome. Meanwhile, the scheme has low cost; products made using this scheme have a better competitive advantage.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
An embodiment of the present invention further provides a vehicle, including:
one or more processors; and
one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform a method as described in embodiments of the invention.
Embodiments of the invention also provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the methods described in embodiments of the invention.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, EEPROM, Flash, eMMC, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
The fatigue driving monitoring system and method based on the acceleration sensor provided by the invention are described in detail, and the principle and the implementation mode of the invention are explained by applying specific examples, and the description of the examples is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (7)

1. A fatigue driving monitoring method based on an acceleration sensor is characterized by comprising the following steps:
step S1, acquiring acceleration information of the automobile through an acceleration sensor;
step S2, generating the driving state information of the automobile according to the acceleration information;
step S3, controlling the working mode of the monitoring module according to the running state information of the automobile;
step S4, judging whether the driver is in fatigue state according to the monitored information;
when the automobile is in a stop state, controlling the monitoring module to be in a standby mode;
when the automobile is in a turning state, the control monitoring module monitors the eye information of a driver;
when the automobile is in a normal driving state, the control monitoring module simultaneously monitors eyes, a mouth, facial expressions and head movements of a driver.
2. The acceleration sensor-based fatigue driving monitoring method of claim 1, further comprising:
and when the driver is monitored to be in a fatigue state, generating alarm information.
3. An acceleration sensor-based fatigue driving monitoring system, comprising:
the acceleration sensor is used for acquiring the acceleration information of the automobile;
the driving state information generating module is used for generating driving state information of the automobile according to the acceleration information;
the control module is used for controlling the working mode of the monitoring module according to the running state information of the automobile;
the monitoring module is used for monitoring the driving state of the driver;
the judging module is used for judging whether the driver is in a fatigue state or not according to the monitored driving state of the driver;
when the automobile is in a stop state, the control module controls the monitoring module to be in a standby mode; when the automobile is in a turning state, the control module controls the monitoring module to monitor the eye information of the driver; when the automobile is in a normal driving state, the control module controls the monitoring module to simultaneously monitor eyes, mouth, facial expressions and head movements of a driver.
4. The acceleration sensor-based fatigue driving monitoring system of claim 3, further comprising:
and the alarm module is used for generating alarm information when monitoring that the driver is in a fatigue state.
5. The acceleration sensor-based fatigue driving monitoring system of claim 4, wherein the alarm module comprises an audible alarm unit and a flashing alarm unit.
6. A vehicle, characterized by comprising: one or more processors; and
one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform any of the methods of claims 1-2.
7. A machine-readable medium having stored thereon instructions, which when executed by one or more processors, cause the processors to perform the method of any one of claims 1-2.
CN201911198813.5A 2019-11-29 2019-11-29 Fatigue driving monitoring method and system based on acceleration sensor Active CN110969808B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911198813.5A CN110969808B (en) 2019-11-29 2019-11-29 Fatigue driving monitoring method and system based on acceleration sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911198813.5A CN110969808B (en) 2019-11-29 2019-11-29 Fatigue driving monitoring method and system based on acceleration sensor

Publications (2)

Publication Number Publication Date
CN110969808A CN110969808A (en) 2020-04-07
CN110969808B true CN110969808B (en) 2021-07-09

Family

ID=70032173

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911198813.5A Active CN110969808B (en) 2019-11-29 2019-11-29 Fatigue driving monitoring method and system based on acceleration sensor

Country Status (1)

Country Link
CN (1) CN110969808B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112858827A (en) * 2021-03-12 2021-05-28 广州市诚臻电子科技有限公司 Whole-vehicle electromagnetic compatibility testing method for automatic driving vehicle

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004034748B4 (en) * 2004-07-17 2018-03-22 Conti Temic Microelectronic Gmbh Driver assistance system for fatigue detection and / or attention evaluation of a driver
KR20140072524A (en) * 2012-12-05 2014-06-13 현대자동차주식회사 Apparatus for measuring fatigue degree of driver's eye
CN104183091B (en) * 2014-08-14 2017-02-08 苏州清研微视电子科技有限公司 System for adjusting sensitivity of fatigue driving early warning system in self-adaptive mode
CN106293032B (en) * 2015-06-08 2021-09-24 北京三星通信技术研究有限公司 Portable terminal device, and control method and apparatus thereof
CN105303830A (en) * 2015-09-15 2016-02-03 成都通甲优博科技有限责任公司 Driving behavior analysis system and analysis method
CN105701972A (en) * 2016-04-14 2016-06-22 苏州清研微视电子科技有限公司 System for detecting fatigue driving by using driving behavior variability characteristics

Also Published As

Publication number Publication date
CN110969808A (en) 2020-04-07

Similar Documents

Publication Publication Date Title
CN109050397B (en) Device and method for warning driver of releasing hands
CN111824173B (en) Grading processing method and device suitable for faults of intelligent driving system
CN106965673B (en) Shutoff control unit
US20180345980A1 (en) Driver monitoring system
WO2015072069A1 (en) Driver monitoring device
CN110103908B (en) Reliability control method and system for remote control parking
US9892613B2 (en) Method and apparatus for maintaining alertness of an operator of a manually-operated system
US9868422B2 (en) Control apparatus of brake system and method of controlling the same
CN104859559B (en) The control method and device of interior environment
CN106476805A (en) A kind of control method of safe driving of vehicle and terminal
CN110291570A (en) Driving mode transition controller, methods and procedures
CN107585155B (en) Auxiliary driving control system
CN106652356B (en) Driver fatigue judgment method and device
US20170341512A1 (en) Method for the automatic execution of at least one driving function of a motor vehicle
CN110969808B (en) Fatigue driving monitoring method and system based on acceleration sensor
CN113655788B (en) Vehicle remote control parking method, system, terminal equipment and readable storage medium
CN113093591A (en) High-integration-level auxiliary driving control method, multi-core microprocessor and system
CN112298208B (en) Automatic driving transverse auxiliary control method and transverse auxiliary system
US9918205B2 (en) Communication system
SE1450179A1 (en) Infrastructure system for a vehicle
US9886034B2 (en) Vehicle control based on connectivity of a portable device
JP2011203967A (en) Electronic control apparatus
JPWO2020079755A1 (en) Information providing device and information providing method
CN114115207A (en) Remote driving control method, equipment and system
WO2019008745A1 (en) Automatic parking assistance device and automatic parking assistance method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant