CN112455453A - Driver state detection method, driver state detection device and computer-readable storage medium - Google Patents
Driver state detection method, driver state detection device and computer-readable storage medium Download PDFInfo
- Publication number
- CN112455453A CN112455453A CN202011426386.4A CN202011426386A CN112455453A CN 112455453 A CN112455453 A CN 112455453A CN 202011426386 A CN202011426386 A CN 202011426386A CN 112455453 A CN112455453 A CN 112455453A
- Authority
- CN
- China
- Prior art keywords
- driver
- vehicle
- state
- driving
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims description 39
- 230000002159 abnormal effect Effects 0.000 claims abstract description 39
- 238000004458 analytical method Methods 0.000 claims abstract description 22
- 230000005856 abnormality Effects 0.000 claims abstract description 13
- 230000035790 physiological processes and functions Effects 0.000 claims description 24
- 230000001133 acceleration Effects 0.000 claims description 15
- 238000012544 monitoring process Methods 0.000 claims description 9
- 230000001121 heart beat frequency Effects 0.000 claims description 8
- 230000009471 action Effects 0.000 claims description 6
- 230000006399 behavior Effects 0.000 claims description 5
- 230000036391 respiratory frequency Effects 0.000 claims description 3
- 238000000034 method Methods 0.000 abstract description 21
- 206010039203 Road traffic accident Diseases 0.000 abstract description 10
- 238000004891 communication Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000035565 breathing frequency Effects 0.000 description 4
- 241001282135 Poromitra oscitans Species 0.000 description 2
- 206010048232 Yawning Diseases 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000029058 respiratory gaseous exchange Effects 0.000 description 2
- 230000004397 blinking Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W2420/408—Radar; Laser, e.g. lidar
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/10—Longitudinal speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/12—Lateral speed
- B60W2520/125—Lateral acceleration
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/221—Physiology, e.g. weight, heartbeat, health or special needs
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a method and a device for detecting a driver state and a computer readable storage medium, wherein the method comprises the following steps: acquiring state information of a driver and driving information of a vehicle through a plurality of sensors respectively; determining the physical state of the driver according to the state information, and generating a driving capability analysis result according to the physical state of the driver and the driving information of the vehicle; and sending out a corresponding alarm prompt according to the driving capability analysis result, and controlling the vehicle to stop at the roadside through the auxiliary driving module. The invention can send out warning in time when the body state of the driver is determined to be abnormal, and help the driver to park at the roadside according to the actual driving capability of the driver after the abnormality occurs, thereby avoiding traffic accidents caused by the driver continuously driving the automobile.
Description
Technical Field
The invention relates to the field of safe driving, in particular to a method and a device for detecting a driver state and a computer readable storage medium.
Background
At present, in traffic accidents, long-time fatigue driving of a driver or sudden illness of the driver are main factors of the traffic accidents. The traffic accident not only can cause personal harm to drivers and passengers in the automobile, but also can affect other vehicles and pedestrians on the road.
In order to avoid a traffic accident caused by factors such as fatigue of a driver or sudden illness, a driver state detection device is generally installed in a vehicle. The detection means may generally include contact and non-contact, wherein the contact detection means may include a watch, a heart rate monitor, or the like; and the non-contact detection device comprises a camera, a sensor and the like. The detection device can detect the state of the driver. However, when the abnormality of the driver's state is detected, the driver and other surrounding vehicles and pedestrians in the vehicle cannot be further protected.
Disclosure of Invention
The invention mainly aims to provide a driver state detection method, a driver state detection device and a computer readable storage medium, and aims to solve the problem that the prior art can only detect the state of a driver and cannot further process abnormal situations.
In order to achieve the above object, the present invention provides a driver state detection method, comprising the steps of:
acquiring state information of a driver and driving information of a vehicle through a plurality of sensors respectively;
determining the physical state of the driver according to the state information, and generating a driving capability analysis result according to the physical state of the driver and the driving information of the vehicle;
and sending out a corresponding alarm prompt according to the driving capability analysis result, and controlling the vehicle to stop at the roadside through the auxiliary driving module.
Optionally, the plurality of sensors include a physiological state sensor and a driving state sensor, and the step of acquiring the state information of the driver and the driving information of the vehicle by the plurality of sensors includes:
the physiological state information of the driver is acquired through the physiological state sensor, and the driving information of the vehicle is acquired through the driving state sensor.
Optionally, the step of acquiring the physiological state information of the driver through the physiological state sensor includes:
monitoring the respiratory frequency and the heartbeat frequency of a driver through a millimeter wave radar;
monitoring the head posture and the face information of a driver through a camera;
the grip strength of the steering wheel, the gear position sensor and the pedal pressure sensor are used for respectively acquiring the grip strength of the steering wheel, the gear shifting operation behavior and the pedal treading action.
Optionally, the step of determining the physical state of the driver according to the state information comprises:
judging whether the physical state of the driver is abnormal according to the physiological state information of the driver, and determining the abnormal category of the physical state, wherein the abnormal category comprises fatigue and physical abnormality.
Optionally, the step of acquiring the driving information of the vehicle through the driving state sensor includes:
acquiring a current vehicle speed through a vehicle speed sensor;
the current yaw rate and the current lateral acceleration of the vehicle are acquired through a yaw rate sensor and a lateral acceleration sensor.
Optionally, the step of generating the driving ability analysis result according to the physical state of the driver and the driving information of the vehicle includes:
and determining the driving capability level of the driver according to the abnormal type of the physical state of the driver and the running information of the vehicle.
Optionally, the step of sending a corresponding warning prompt according to the driving ability analysis result includes:
when the driving ability level of the driver is a first level, sending an alarm prompt to the driver through an in-vehicle warning module;
when the driving ability level of the driver is a second level, alarm prompts are respectively sent to the driver and surrounding vehicles and pedestrians through the in-vehicle warning module and the out-vehicle warning module;
when the driving ability grade of the driver is the third grade, the warning prompt is respectively sent to the driver and surrounding vehicles and pedestrians through the in-vehicle warning module and the out-vehicle warning module, and the warning and the help are called through the warning device.
Optionally, the step of controlling the vehicle to stop at the roadside by the driving assistance module includes:
when the driving ability grade of the driver is a second grade, the auxiliary driving module is used for assisting the driver to stop at the roadside;
and when the driving ability grade of the driver is a third grade, taking over the vehicle through the auxiliary driving module and carrying out roadside parking.
Further, to achieve the above object, the present invention provides a driver state detection device including a memory, a processor, and a driver state detection program stored on the memory and executable on the processor, wherein: the driver state detection program, when executed by the processor, implements the steps of the driver state detection method as described above.
Further, to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a driver state detection program which, when executed by a processor, implements the steps of the driver state detection method as described above.
According to the method, the device and the computer-readable storage medium for detecting the state of the driver, provided by the embodiment of the invention, the state information of the driver and the driving information of the vehicle can be respectively detected through a plurality of sensors arranged on the vehicle. The current physical state of the driver can be determined according to the detected state information, and whether the physical state is abnormal or not can be determined. If the body state of the driver is abnormal, the driving ability of the driver is determined according to the driving information of the vehicle, a corresponding alarm prompt is sent according to the actual driving ability of the driver, and the auxiliary driving module is used for helping the driver to stop the vehicle at the roadside. When the body state of the driver is determined to be abnormal, a warning can be sent out in time, the driver is helped to park on the roadside according to the actual driving capacity of the driver after the abnormality occurs, and traffic accidents caused by the fact that the driver continues to drive the automobile are avoided.
Drawings
FIG. 1 is a schematic diagram of an apparatus in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a first exemplary embodiment of a method for detecting a driver state according to the present invention;
FIG. 3 is a flowchart illustrating a second exemplary embodiment of a method for detecting a driver state according to the present invention;
fig. 4 is a flowchart illustrating a third embodiment of the method for detecting a driver's state according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a schematic device structure diagram of a hardware operating environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be a driver state detection device which is arranged in an automobile.
As shown in fig. 1, the driver state detection device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the driver state detection device may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display screen based on the ambient light level and a proximity sensor that turns off the display screen and/or backlight when the hardware device is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the motion sensor is stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for recognizing the attitude of hardware equipment, and related functions (such as pedometer and tapping) for vibration recognition; of course, the hardware device may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, and so on, which are not described herein again.
Those skilled in the art will appreciate that the configuration of the driver state detection device shown in fig. 1 does not constitute a limitation of the driver state detection device, and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a driver state detection program.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke the driver state detection program stored in the memory 1005 and perform the following operations:
acquiring state information of a driver and driving information of a vehicle through a plurality of sensors respectively;
determining the physical state of the driver according to the state information, and generating a driving capability analysis result according to the physical state of the driver and the driving information of the vehicle;
and sending out a corresponding alarm prompt according to the driving capability analysis result, and controlling the vehicle to stop at the roadside through the auxiliary driving module.
Further, the processor 1001 may call the driver state detection program stored in the memory 1005, and also perform the following operations:
the physiological state information of the driver is acquired through the physiological state sensor, and the driving information of the vehicle is acquired through the driving state sensor.
Further, the processor 1001 may call the driver state detection program stored in the memory 1005, and also perform the following operations:
monitoring the respiratory frequency and the heartbeat frequency of a driver through a millimeter wave radar;
monitoring the head posture and the face information of a driver through a camera;
the grip strength of the steering wheel, the gear position sensor and the pedal pressure sensor are used for respectively acquiring the grip strength of the steering wheel, the gear shifting operation behavior and the pedal treading action.
Further, the processor 1001 may call the driver state detection program stored in the memory 1005, and also perform the following operations:
judging whether the physical state of the driver is abnormal according to the physiological state information of the driver, and determining the abnormal category of the physical state, wherein the abnormal category comprises fatigue and physical abnormality.
Further, the processor 1001 may call the driver state detection program stored in the memory 1005, and also perform the following operations:
acquiring a current vehicle speed through a vehicle speed sensor;
the current yaw rate and the current lateral acceleration of the vehicle are acquired through a yaw rate sensor and a lateral acceleration sensor.
Further, the processor 1001 may call the driver state detection program stored in the memory 1005, and also perform the following operations:
and determining the driving capability level of the driver according to the abnormal type of the physical state of the driver and the running information of the vehicle.
Further, the processor 1001 may call the driver state detection program stored in the memory 1005, and also perform the following operations:
when the driving ability level of the driver is a first level, sending an alarm prompt to the driver through an in-vehicle warning module;
when the driving ability level of the driver is a second level, alarm prompts are respectively sent to the driver and surrounding vehicles and pedestrians through the in-vehicle warning module and the out-vehicle warning module;
when the driving ability grade of the driver is the third grade, the warning prompt is respectively sent to the driver and surrounding vehicles and pedestrians through the in-vehicle warning module and the out-vehicle warning module, and the warning and the help are called through the warning device.
Further, the processor 1001 may call the driver state detection program stored in the memory 1005, and also perform the following operations:
when the driving ability grade of the driver is a second grade, the auxiliary driving module is used for assisting the driver to stop at the roadside;
and when the driving ability grade of the driver is a third grade, taking over the vehicle through the auxiliary driving module and carrying out roadside parking.
The specific embodiment of the present invention applied to the driver state detection apparatus is substantially the same as the following embodiments of the driver state detection method, and is not described herein again.
Referring to fig. 2, fig. 2 is a flowchart illustrating a driver state detection method according to a first embodiment of the present invention, wherein the driver state detection method includes the following steps:
step S10, acquiring state information of the driver and traveling information of the vehicle by a plurality of sensors, respectively;
a plurality of sensors are provided in the automobile, and the state information of the driver and the travel information of the vehicle can be acquired by different sensors. The state information of the driver may include breathing, heartbeat frequency, head posture, face information, and the like of the driver during the control of the driving of the automobile. The driving information of the vehicle may include the current vehicle speed, yaw rate, lateral acceleration, and the like.
Step S20, determining the body state of the driver according to the state information, and generating the driving ability analysis result according to the body state of the driver and the driving information of the vehicle;
after the state information of the driver is acquired, the current body state of the driver can be determined according to the acquired state information of the driver, and whether the body state of the driver is abnormal or not is judged. For example, when it is detected that the heartbeat and the breathing frequency of the driver are abnormal, or the head of the driver is drooping and the side is tilted, it can be determined that the physical state of the driver is abnormal.
When it is determined that the driver is abnormal, in order to ensure driving safety, the current driving ability of the driver can be analyzed according to the driving information of the current vehicle, and a corresponding driving ability analysis result is generated. The driving ability analysis result can be whether the driver has the ability of effectively controlling the vehicle to run currently.
And step S30, sending out corresponding alarm prompts according to the driving ability analysis results, and controlling the vehicle to stop at the roadside through the auxiliary driving module.
After the result of the analysis of the driving ability of the driver is obtained, it is possible to determine whether the driver has the driving manipulation ability based on the result of the analysis of the driving ability. If the driver still has certain driving control ability, then can be through the warning module suggestion driver in the car stop the car at the roadside, avoid taking place the traffic accident. If the driver can not effectively control the automobile to continue driving, the warning module can give an alarm to surrounding vehicles, pedestrians and other people in the automobile, and the auxiliary driving module in the automobile takes over the control authority of the automobile so as to safely stop the automobile at the roadside and avoid traffic accidents caused by the fact that the automobile continues driving.
In the present embodiment, the state information of the driver and the travel information of the vehicle can be detected by a plurality of sensors provided on the automobile, respectively. The current physical state of the driver can be determined according to the detected state information, and whether the physical state is abnormal or not can be determined. If the body state of the driver is abnormal, the driving ability of the driver is determined according to the driving information of the vehicle, a corresponding alarm prompt is sent according to the actual driving ability of the driver, and the auxiliary driving module is used for helping the driver to stop the vehicle at the roadside. The method has the advantages that the sensors are used for detecting the driving related data of the driver, the state of the driver is judged, when the body state of the driver is determined to be abnormal, the driver can be timely warned, the driver is helped to park on the roadside of the vehicle according to the actual driving capacity of the driver after the abnormality occurs, traffic accidents caused by the fact that the driver continues to drive the vehicle are avoided, and the safety of the vehicle and personnel is ensured.
Further, referring to fig. 3, fig. 3 is a flowchart illustrating a second embodiment of the method for detecting a driver' S state according to the present invention, based on the embodiment illustrated in fig. 2, where the plurality of sensors include a physiological state sensor and a driving state sensor, and the step S10 of obtaining the state information of the driver and the driving information of the vehicle through the plurality of sensors includes:
in step S11, the physiological state information of the driver is acquired by the physiological state sensor, and the driving information of the vehicle is acquired by the driving state sensor.
In the present embodiment, the plurality of sensors may be classified into a physiological state sensor and a travel state sensor. The physiological state sensor is used for acquiring physiological state information of a driver, and the driving state sensor is used for acquiring driving information of a vehicle.
Further, according to the embodiment shown in fig. 3, the step S11 of acquiring the physiological status information of the driver by the physiological status sensor and acquiring the driving information of the vehicle by the driving status sensor includes:
step S111, monitoring the breathing frequency and the heartbeat frequency of a driver through a millimeter wave radar;
step S112, monitoring the head posture and the face information of the driver through a camera;
step S113, respectively acquiring the grip strength of a steering wheel, the gear shift operation behavior and the pedal trampling action through a grip strength sensor of the steering wheel, a gear sensor and a pedal pressure sensor;
step S114, acquiring the driving information of the vehicle by the driving state sensor.
In the present embodiment, the physiological state sensor may include a millimeter wave radar, a camera, a steering wheel grip sensor, a gear sensor, a pedal pressure sensor, and the like. The millimeter wave radar can be arranged on the backrest of a driving seat in an automobile or in front of a driver to monitor the breathing frequency and the heartbeat frequency of the driver. The camera may be disposed in front of or laterally in front of the driver's seat to monitor the head pose and facial information of the driver. The head posture can be head front, head drop or head side facial information, and the information can include the blinking frequency and the yawning frequency of the driver.
The steering wheel grip strength sensor, the gear sensor and the pedal pressure sensor can be respectively arranged on a steering wheel, a clutch and a pedal of an automobile so as to respectively acquire the steering wheel grip strength, the gear shifting operation behavior and the pedal treading action. When the fact that the driver executes gear shifting operation is monitored, the holding force of the steering wheel and the treading force of the pedal can be monitored at the same time, and therefore the physical state of the driver can be determined according to various actions of the driver for controlling the vehicle to run.
Further, referring to fig. 4, fig. 4 is a flowchart illustrating a third embodiment of the method for detecting a driver' S state according to the present invention, and based on the embodiment illustrated in fig. 3, the step S20 of determining the physical state of the driver according to the state information, and generating a driving ability analysis result according to the physical state of the driver and the driving information of the vehicle includes:
step S21, judging whether the body state of the driver is abnormal according to the physiological state information of the driver, and determining the abnormal type of the body state, wherein the abnormal type comprises fatigue and body abnormality;
in step S22, a driving ability analysis result is generated based on the physical state of the driver and the travel information of the vehicle.
In this embodiment, whether the body state of the driver is abnormal or not can be judged according to the monitored physiological state information of the driver, and the abnormal category can be further determined. The abnormality categories may include fatigue and physical abnormalities, among others. In a fatigue state, a driver needs to stop driving the vehicle and take a rest, and physical abnormality needs to stop driving the vehicle and then perform further inspection.
It can be understood that when the breathing and heartbeat frequency of the driver are normal, the head is not looking forward, and the blink frequency or yawning frequency of the driver exceeds the normal range, the driver can be determined to be in a fatigue state and is not suitable for continuously operating the vehicle to run. When the breathing, the heartbeat frequency and the head of the driver are abnormal, and the holding power of the steering wheel or the treading force of the pedal suddenly changes when the gear shifting operation is executed, the driver can be determined to be not fatigue driving but abnormal in body.
Further, in step S114, the step of acquiring the driving information of the vehicle by the driving state sensor includes:
step S1141, acquiring the current vehicle speed through a vehicle speed sensor;
in step S1142, the current yaw rate and the current lateral acceleration of the vehicle are obtained through the yaw rate sensor and the lateral acceleration sensor.
In the present embodiment, the running state sensors provided to the vehicle may include a vehicle speed sensor, a yaw rate sensor, and a lateral acceleration sensor to detect a current vehicle speed, a yaw rate, and a lateral acceleration, respectively, while the vehicle is running. In the real-time detection process, when the current vehicle speed, the yaw rate or the lateral acceleration is detected, the current driver still has the capability of normally controlling the vehicle to run. If the current vehicle speed, the yaw rate or the lateral acceleration is detected to be abnormal, the actual driving capability of the driver can be determined according to the abnormal deviation degree of the driving monitoring data. For example, when the vehicle running angle is slightly shifted, it can be determined that the driver is conscious but the vehicle running cannot be effectively controlled; when the vehicle has large-angle deviation, the driver can be determined to lose consciousness and no longer have any driving capability.
Further, in a fourth embodiment of the driver state detection method according to the present invention, based on the embodiment shown in fig. 4, in step S22, the step of generating the driving ability analysis result according to the physical state of the driver and the traveling information of the vehicle includes:
in step S221, the driving ability level of the driver is determined based on the abnormality type of the physical state of the driver and the traveling information of the vehicle.
In the present embodiment, the current driving ability level of the driver can also be determined according to the abnormality category of the physical state of the driver and the traveling information of the vehicle. When the driving ability level of the driver is determined to be high, the driver can be determined to be aware of consciousness at present, and the vehicle can be effectively controlled to normally run. When the driving ability grade of the driver is determined to be general, the driver can be determined to be conscious, but the vehicle cannot be effectively controlled to normally run, and the vehicle needs to be parked to the roadside in time. When the driving ability grade of the driver is determined to be low, the driver can be determined to be sick suddenly and faint or lose consciousness, the vehicle can not be controlled any more, and at the moment, an auxiliary driving module in the automobile is required to take over the vehicle control authority, and the automobile is parked on the roadside.
It can be understood that when it is determined that the driver still has conscious awareness and can effectively control the vehicle to normally run, the in-vehicle warning module can be used for sending an abnormal prompt to the driver, so that the driver can stop at the side in time when the body state is abnormal but the vehicle manipulation capability is still provided, and traffic accidents caused by deterioration of the abnormal state are avoided.
Further, based on the fourth embodiment, in step S30, the step of sending a corresponding warning prompt according to the driving ability analysis result, and controlling the vehicle to stop at the roadside through the driving assistance module includes:
step S31, when the driving ability level of the driver is a first level, sending an alarm prompt to the driver through the in-vehicle warning module;
step S32, when the driving ability grade of the driver is a second grade, the in-vehicle warning module and the out-vehicle warning module respectively send warning prompts to the driver and surrounding vehicles and pedestrians, and the auxiliary driving module assists the driver to park on the roadside;
and step S33, when the driving ability grade of the driver is a third grade, the in-vehicle warning module and the out-vehicle warning module respectively send warning prompts to the driver and surrounding vehicles and pedestrians, the warning device gives a warning to call for help, and the auxiliary driving module takes over the vehicle and stops at the roadside.
In the present embodiment, the driving ability level of the driver may be determined from the traveling information of the vehicle. Among them, the driving ability level may be divided into a first level, a second level, and a third level. When the driving ability grade of the driver is a first grade, the current driver has the ability of effectively controlling the automobile to run although the driver is abnormal in body or fatigue driving is shown, and at the moment, an alarm prompt can be sent to the driver through the in-automobile warning module, so that the driver can stop the automobile to the roadside actively.
When the driving ability of the driver is at the second level, the driving ability indicates that the current driver is abnormal in body or fatigued to drive, and although the driver still has awareness, the driving ability of the vehicle cannot be effectively controlled, so that the driving ability cannot be normally used for various situations during driving. At the moment, alarm prompts can be sent to drivers and surrounding vehicles and pedestrians through the in-vehicle warning module and the out-vehicle warning module respectively so as to prompt the surrounding vehicles and pedestrians to notice avoiding, and the auxiliary driving module helps the drivers to park the vehicles on the roadside safely.
When the driving ability of the driver is at the third level, the current situation that the driver is abnormal in body or fatigue driving is shown, and the driver loses consciousness and can not control the automobile to run. At the moment, the warning prompt can be respectively sent to the driver and surrounding vehicles and pedestrians through the in-vehicle warning module and the out-vehicle warning module, the vehicles and the pedestrians around the driver are prompted to pay attention to avoidance, meanwhile, the vehicle control authority can be actively taken over through the auxiliary driving module, and the vehicles are controlled to stop on the roadside.
Furthermore, the present invention also proposes a computer-readable storage medium having a driver state detection program stored thereon. The computer-readable storage medium may be the Memory 20 in the terminal of fig. 1, and may also be at least one of a ROM (Read-Only Memory)/RAM (Random Access Memory), a magnetic disk, and an optical disk, and the computer-readable storage medium includes instructions for causing a driver status detection apparatus having a processor to execute the driver status detection method according to the embodiments of the present invention.
It is to be understood that throughout the description of the present specification, reference to the term "one embodiment", "another embodiment", "other embodiments", or "first through nth embodiments", etc., is intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A driver state detection method characterized by comprising the steps of:
acquiring state information of a driver and driving information of a vehicle through a plurality of sensors respectively;
determining the physical state of the driver according to the state information, and generating a driving capability analysis result according to the physical state of the driver and the driving information of the vehicle;
and sending out a corresponding alarm prompt according to the driving capability analysis result, and controlling the vehicle to stop at the roadside through the auxiliary driving module.
2. The driver state detection method according to claim 1, wherein the plurality of sensors include a physiological state sensor and a travel state sensor, and the step of acquiring the state information of the driver and the travel information of the vehicle by the plurality of sensors, respectively, includes:
the physiological state information of the driver is acquired through the physiological state sensor, and the driving information of the vehicle is acquired through the driving state sensor.
3. The driver state detection method according to claim 2, wherein the step of acquiring the physiological state information of the driver by the physiological state sensor includes:
monitoring the respiratory frequency and the heartbeat frequency of a driver through a millimeter wave radar;
monitoring the head posture and the face information of a driver through a camera;
the grip strength of the steering wheel, the gear position sensor and the pedal pressure sensor are used for respectively acquiring the grip strength of the steering wheel, the gear shifting operation behavior and the pedal treading action.
4. The driver state detection method according to claim 3, wherein the step of determining the physical state of the driver from the state information includes:
judging whether the physical state of the driver is abnormal according to the physiological state information of the driver, and determining the abnormal category of the physical state, wherein the abnormal category comprises fatigue and physical abnormality.
5. The driver state detection method according to claim 4, wherein the step of acquiring the travel information of the vehicle by the travel state sensor includes:
acquiring a current vehicle speed through a vehicle speed sensor;
the current yaw rate and the current lateral acceleration of the vehicle are acquired through a yaw rate sensor and a lateral acceleration sensor.
6. The driver state detection method according to claim 5, wherein the step of generating the driving ability analysis result based on the physical state of the driver and the travel information of the vehicle includes:
and determining the driving capability level of the driver according to the abnormal type of the physical state of the driver and the running information of the vehicle.
7. The driver state detection method according to claim 6, wherein the step of issuing a corresponding warning prompt in accordance with the result of the drivability analysis includes:
when the driving ability level of the driver is a first level, sending an alarm prompt to the driver through an in-vehicle warning module;
when the driving ability level of the driver is a second level, alarm prompts are respectively sent to the driver and surrounding vehicles and pedestrians through the in-vehicle warning module and the out-vehicle warning module;
when the driving ability grade of the driver is the third grade, the warning prompt is respectively sent to the driver and surrounding vehicles and pedestrians through the in-vehicle warning module and the out-vehicle warning module, and the warning and the help are called through the warning device.
8. The driver state detection method according to claim 7, wherein the step of controlling the vehicle to make a roadside stop by the driver assistance module includes:
when the driving ability grade of the driver is a second grade, the auxiliary driving module is used for assisting the driver to stop at the roadside;
and when the driving ability grade of the driver is a third grade, taking over the vehicle through the auxiliary driving module and carrying out roadside parking.
9. A driver state detection apparatus, characterized in that the driver state detection apparatus includes a memory, a processor, and a driver state detection program stored on the memory and executable on the processor, wherein: the driver state detection program, when executed by the processor, implements the steps of the driver state detection method according to any one of claims 1 to 8.
10. A computer-readable storage medium, characterized in that a driver state detection program is stored on the computer-readable storage medium, which when executed by a processor implements the steps of the driver state detection method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011426386.4A CN112455453A (en) | 2020-12-08 | 2020-12-08 | Driver state detection method, driver state detection device and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011426386.4A CN112455453A (en) | 2020-12-08 | 2020-12-08 | Driver state detection method, driver state detection device and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112455453A true CN112455453A (en) | 2021-03-09 |
Family
ID=74801677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011426386.4A Pending CN112455453A (en) | 2020-12-08 | 2020-12-08 | Driver state detection method, driver state detection device and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112455453A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113192292A (en) * | 2021-04-29 | 2021-07-30 | 深圳供电局有限公司 | Fatigue driving recognition device |
| CN113436414A (en) * | 2021-07-01 | 2021-09-24 | 北京汽车集团越野车有限公司 | Vehicle driving state early warning method and device and electronic equipment |
| CN113561982A (en) * | 2021-08-06 | 2021-10-29 | 上汽通用五菱汽车股份有限公司 | Driver coma processing method and device and readable storage medium |
| CN113734173A (en) * | 2021-09-09 | 2021-12-03 | 东风汽车集团股份有限公司 | Intelligent vehicle monitoring method and device and storage medium |
| CN113734178A (en) * | 2021-09-08 | 2021-12-03 | 一汽奔腾轿车有限公司 | System and method with safe driving assistance function |
| CN113829989A (en) * | 2021-09-24 | 2021-12-24 | 岚图汽车科技有限公司 | Driving information prompting method and device, storage medium and electronic equipment |
| CN114030475A (en) * | 2021-12-22 | 2022-02-11 | 清华大学苏州汽车研究院（吴江） | Vehicle driving assisting method and device, vehicle and storage medium |
| CN114454891A (en) * | 2022-02-28 | 2022-05-10 | 奇瑞汽车股份有限公司 | Automobile control method and device and computer storage medium |
| CN115027488A (en) * | 2022-07-08 | 2022-09-09 | 质子汽车科技有限公司 | Vehicle control method and device and intelligent vehicle |
| WO2024140326A1 (en) * | 2022-12-28 | 2024-07-04 | 华为技术有限公司 | Monitoring method and apparatus, and vehicle |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108725448A (en) * | 2018-03-30 | 2018-11-02 | 东风商用车有限公司 | Active vehicle control method and system based on driver state monitoring |
| CN109291794A (en) * | 2018-09-28 | 2019-02-01 | 上汽通用五菱汽车股份有限公司 | Driver status monitoring method, automobile and storage medium |
| CN110648502A (en) * | 2019-09-26 | 2020-01-03 | 中国第一汽车股份有限公司 | Method, system, device and storage medium for preventing fatigue driving |
| CN111634288A (en) * | 2020-04-30 | 2020-09-08 | 长城汽车股份有限公司 | Fatigue driving monitoring method and system and intelligent recognition system |
| CN111923929A (en) * | 2020-06-16 | 2020-11-13 | 浙江联控技术有限公司 | Vehicle control method and device based on driving risk |
-
2020
- 2020-12-08 CN CN202011426386.4A patent/CN112455453A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108725448A (en) * | 2018-03-30 | 2018-11-02 | 东风商用车有限公司 | Active vehicle control method and system based on driver state monitoring |
| CN109291794A (en) * | 2018-09-28 | 2019-02-01 | 上汽通用五菱汽车股份有限公司 | Driver status monitoring method, automobile and storage medium |
| CN110648502A (en) * | 2019-09-26 | 2020-01-03 | 中国第一汽车股份有限公司 | Method, system, device and storage medium for preventing fatigue driving |
| CN111634288A (en) * | 2020-04-30 | 2020-09-08 | 长城汽车股份有限公司 | Fatigue driving monitoring method and system and intelligent recognition system |
| CN111923929A (en) * | 2020-06-16 | 2020-11-13 | 浙江联控技术有限公司 | Vehicle control method and device based on driving risk |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113192292A (en) * | 2021-04-29 | 2021-07-30 | 深圳供电局有限公司 | Fatigue driving recognition device |
| CN113436414A (en) * | 2021-07-01 | 2021-09-24 | 北京汽车集团越野车有限公司 | Vehicle driving state early warning method and device and electronic equipment |
| CN113561982A (en) * | 2021-08-06 | 2021-10-29 | 上汽通用五菱汽车股份有限公司 | Driver coma processing method and device and readable storage medium |
| CN113734178A (en) * | 2021-09-08 | 2021-12-03 | 一汽奔腾轿车有限公司 | System and method with safe driving assistance function |
| CN113734173A (en) * | 2021-09-09 | 2021-12-03 | 东风汽车集团股份有限公司 | Intelligent vehicle monitoring method and device and storage medium |
| CN113829989A (en) * | 2021-09-24 | 2021-12-24 | 岚图汽车科技有限公司 | Driving information prompting method and device, storage medium and electronic equipment |
| CN114030475A (en) * | 2021-12-22 | 2022-02-11 | 清华大学苏州汽车研究院（吴江） | Vehicle driving assisting method and device, vehicle and storage medium |
| CN114454891A (en) * | 2022-02-28 | 2022-05-10 | 奇瑞汽车股份有限公司 | Automobile control method and device and computer storage medium |
| CN114454891B (en) * | 2022-02-28 | 2023-09-26 | 奇瑞汽车股份有限公司 | Control method and device for automobile and computer storage medium |
| CN115027488A (en) * | 2022-07-08 | 2022-09-09 | 质子汽车科技有限公司 | Vehicle control method and device and intelligent vehicle |
| WO2024140326A1 (en) * | 2022-12-28 | 2024-07-04 | 华为技术有限公司 | Monitoring method and apparatus, and vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112455453A (en) | Driver state detection method, driver state detection device and computer-readable storage medium | |
| CN108205731B (en) | Situation assessment vehicle system | |
| CN108032860B (en) | Emergency evacuation using autonomous driving | |
| US9925832B2 (en) | Alerting device | |
| JP5288045B2 (en) | Emergency vehicle evacuation device | |
| JP6341055B2 (en) | In-vehicle control device | |
| WO2016027412A1 (en) | In-vehicle control apparatus | |
| JP2014019301A (en) | Emergency evacuation device | |
| US20120101689A1 (en) | Method for operating a motor vehicle and motor vehicle | |
| CN109552042B (en) | Drive cycle sampling and monitoring for damage detection system | |
| KR20150061943A (en) | Device for detecting the status of the driver and method thereof | |
| CN113291302A (en) | Vehicle longitudinal safety control method, device, equipment and storage medium | |
| CN113487912B (en) | Traffic accident early warning and protecting method, automobile and readable storage medium | |
| JP2010179783A (en) | Vehicle information reporting device | |
| Caber et al. | Intelligent driver profiling system for cars–a basic concept | |
| JP2014109989A (en) | Driving support apparatus | |
| US20230141439A1 (en) | Driver controlling system for a vehicle | |
| CN103204161A (en) | Automatic brake system and method for automobile in unmanned state | |
| CN113370990A (en) | Driving assistance method and driving assistance device | |
| CN112406886B (en) | Vehicle control device and control method, vehicle, and storage medium | |
| CN111619561B (en) | Escape lifesaving method, device, equipment and storage medium for automatic driving automobile | |
| CN108556824B (en) | Automobile braking method, braking device, braking equipment and automobile | |
| JP7043726B2 (en) | Appropriate state judgment method and proper state judgment device | |
| US20230271633A1 (en) | Safety Control Method and Apparatus for Autonomous Driving Assistance System | |
| JP2018151941A (en) | State-of-actuation notification system, vehicle, state-of-actuation notification method, and state-of-actuation notification program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210309 |
|
| RJ01 | Rejection of invention patent application after publication |