CN110696834B - Driver state monitoring method, device and system and controller - Google Patents
Driver state monitoring method, device and system and controller Download PDFInfo
- Publication number
- CN110696834B CN110696834B CN201911144068.6A CN201911144068A CN110696834B CN 110696834 B CN110696834 B CN 110696834B CN 201911144068 A CN201911144068 A CN 201911144068A CN 110696834 B CN110696834 B CN 110696834B
- Authority
- CN
- China
- Prior art keywords
- driver
- information
- danger level
- driving
- physiological
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W40/09—Driving style or behaviour
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
The application relates to a method, a device, a system and a controller for monitoring a driver state. The method comprises the following steps: when the vehicle is in a driving state, acquiring video information, physiological information and driving information of a driver; obtaining the behavior danger level of the driver according to the video information; obtaining the physiological danger level of the driver according to the physiological information; obtaining the driving danger level of the driver according to the driving information; selecting the dangerous grade with the highest danger from the behavior dangerous grade, the physiological dangerous grade and the driving dangerous grade as the current dangerous grade of the driver; and executing the operation corresponding to the current danger level according to the current danger level. The method can comprehensively and accurately monitor the state of the driver.
Description
Technical Field
The application relates to the technical field of automobiles, in particular to a method, a device, a system and a controller for monitoring a driver state.
Background
With the improvement of living standard, the keeping quantity of automobiles increases year by year, and becomes one of the transportation means for people to go out daily. However, in recent years, motor vehicle accidents caused by situations such as physical fatigue, diseases, tension or inattention of drivers frequently occur, and great loss is brought to lives and properties of people. Although some current automobiles can monitor whether the driver is in fatigue, inattention and other states through the camera arranged in front of the driver, and therefore the driver can be reminded when the state is poor. However, the camera can only judge the state of the driver through the acquired monitoring video, and cannot detect diseases or other dangerous situations of the driver, so that the accuracy is insufficient.
Disclosure of Invention
In view of the above, it is necessary to provide a driver state monitoring method, device, system and controller capable of comprehensively and accurately monitoring the driver state.
A driver condition monitoring method, the method comprising:
when the vehicle is in a driving state, acquiring video information, physiological information and driving information of a driver;
obtaining the behavior danger level of the driver according to the video information;
obtaining the physiological risk level of the driver according to the physiological information;
obtaining the driving danger level of the driver according to the driving information;
selecting the dangerous grade with the highest danger from the behavior dangerous grade, the physiological dangerous grade and the driving dangerous grade as the current dangerous grade of the driver;
and executing the operation corresponding to the current danger level according to the current danger level.
In one embodiment, according to the current danger level, performing an operation corresponding to the current danger level includes:
and controlling the vehicle body controller and/or the alarm module to work according to the current danger level, wherein the current danger level comprises at least two danger levels.
In one embodiment, the current danger level is a first danger level, a second danger level or a third danger level, and the vehicle body controller and/or the alarm module is controlled to operate according to the current danger level, including:
when the current danger level is a first danger level, controlling the vehicle body controller to adjust the environment in the vehicle and/or play music, and controlling the alarm module to send a rest prompt;
when the current danger level is a second danger level, controlling an alarm module to send out a parking prompt;
when the current danger level is a third danger level, controlling the vehicle body controller to reduce the speed of the vehicle to a safe vehicle speed value, giving an external alarm through an alarm module, and sending alarm information to a preset mobile terminal or initiating an alarm call; the safe vehicle speed value is greater than zero and does not exceed a preset vehicle speed threshold value, or the safe vehicle speed value is zero.
In one embodiment, obtaining the behavior risk level of the driver according to the video information comprises:
acquiring behavior parameters of a driver within preset time from the video information, and comparing the behavior parameters with a preset behavior parameter evaluation threshold group to obtain a behavior danger level; preferably, the behavior parameters comprise one or more of the times of opening the breath and the lack of breath of the driver, the times of opening the breath and the lack of breath, the times of closing the eyes and the times of abnormal shaking of the body within the preset time;
obtaining the physiological risk level of the driver according to the physiological information, comprising the following steps:
comparing the physiological information with a preset physiological parameter evaluation threshold group to obtain a physiological risk level; preferably, the physiological information comprises one or more of blood pressure value and heart rate variation information of the driver.
In one embodiment, obtaining the driving risk level of the driver according to the driving information comprises:
comparing the driving information with a preset driving parameter evaluation threshold group to obtain a driving danger level; preferably, the driving information includes one or more of a number of lane departures and a number of steering wheel hands-off of the driver within a preset time.
In one embodiment, the method further comprises:
receiving driver state information input through an input device;
adjusting the intelligent seat according to the state information of the driver;
preferably, the input device is a control screen of the automobile, and the driver state information comprises driving age, sex, weight, height and health information of the driver.
In one embodiment, the method further comprises:
receiving and storing seat setting information of a driver input through an input device;
sending an encrypted signal to a mobile terminal corresponding to a driver, and establishing a binding protocol with the mobile terminal;
when an automobile starting signal is received, sending an identification request to the mobile terminal, and acquiring an identification code fed back by the mobile terminal;
determining seat setting information corresponding to the driver according to the identification code;
adjusting the intelligent seat according to the seat setting information;
preferably, the mobile terminal is a wearable device, such as a smart band, or other mobile devices, such as a smart phone, a tablet computer, and the like.
A driver condition monitoring device, the device comprising:
the information acquisition module is used for acquiring video information, physiological information and driving information of a driver when the vehicle is in a running state;
the behavior danger level module is used for obtaining the behavior danger level of the driver according to the video information;
the physiological risk grade module is used for obtaining the physiological risk grade of the driver according to the physiological information;
the driving danger level module is used for obtaining the driving danger level of the driver according to the driving information;
the current danger level module is used for selecting the danger level with the highest danger from the behavior danger level, the physiological danger level and the driving danger level as the current danger level of the driver;
and the execution module is used for executing the operation corresponding to the current danger level according to the current danger level.
A driver state monitoring system comprises a controller, an information acquisition module, a vehicle body controller, a communication module and an alarm module;
the controller is used for controlling the information acquisition device to detect the state of a driver when the vehicle is in a running state, and the information acquisition device comprises a video acquisition device, a physiological information acquisition device and a driving information acquisition device;
the video acquisition device is used for acquiring video information of a driver;
the physiological information acquisition device is used for acquiring the physiological information of the driver;
the driving information acquisition device is used for acquiring driving information of a driver;
the information acquisition module is used for obtaining behavior danger levels according to the video information, obtaining physiological danger levels according to the physiological information, obtaining driving danger levels according to the driving information, selecting the dangerous level with the highest danger from the behavior danger levels, the physiological danger levels and the driving danger levels as the current danger level of the driver, and sending the current danger level to the controller;
the controller is also used for controlling the vehicle body controller, the communication module and the alarm module to work according to the current danger level.
A controller comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
when the vehicle is in a driving state, acquiring video information, physiological information and driving information of a driver;
obtaining the behavior danger level of the driver according to the video information;
obtaining the physiological risk level of the driver according to the physiological information;
obtaining the driving danger level of the driver according to the driving information;
selecting the dangerous grade with the highest danger from the behavior dangerous grade, the physiological dangerous grade and the driving dangerous grade as the current dangerous grade of the driver;
and executing the operation corresponding to the current danger level according to the current danger level.
According to the driver state monitoring method, the device, the system and the controller, the behavior danger level, the physiological danger level and the driving danger level of the driver can be obtained by acquiring the video information, the physiological information and the driving information of the driver when the vehicle is in a running state, namely the driver state can be monitored and evaluated from the three aspects of the behavior information, the physiological information and the driving information of the driver, the fatigue behavior of the driver can be judged through the video information, the body state of the driver can be known through the physiological information, other driving danger conditions which are not easy to detect by a video device and wearable equipment can be known through the driving information, and the monitoring is more comprehensive; and then the danger grade with the highest danger is selected as the current danger grade of the driver, and the operation corresponding to the current danger grade is executed, so that the condition of misjudgment or missed judgment during monitoring by a single means can be effectively avoided, the accuracy is high, the safety is good, the state of the driver can be monitored more comprehensively and accurately, and the probability of traffic accidents is reduced.
Drawings
FIG. 1 is a schematic flow chart diagram of a driver condition monitoring method in one embodiment;
FIG. 2 is a schematic flow chart of a driver condition monitoring method in another embodiment;
FIG. 3 is a schematic flow chart of steps for presetting the smart seat in one embodiment;
FIG. 4 is a block diagram showing the structure of a driver state monitoring device according to an embodiment;
FIG. 5 is a block diagram of a driver condition monitoring system in one embodiment;
FIG. 6 is an internal block diagram of a controller in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
In one embodiment, as shown in FIG. 1, a driver condition monitoring method is provided, comprising the steps of:
the video information can be monitoring videos acquired by the video acquisition device on the face and the upper body of the driver; the physiological information can be physical state parameters of the driver monitored by the wearable device, such as blood pressure value and heart rate information of the driver; the driving information may be driving state information of the driver, such as the number of lane departures and the number of hand-off of the steering wheel of the driver within a preset time.
Specifically, the controller acquires the current vehicle speed, and if the vehicle speed is not zero, the vehicle is judged to be in a driving state, at the moment, the controller can control an information acquisition device to detect the state of a driver, and the information acquisition device comprises a video acquisition device, a physiological information acquisition device and a driving information acquisition device; the video acquisition device is a camera used for detecting video information of a driver, the physiological information acquisition device is wearable equipment used for detecting physiological information of the driver, and the driving information acquisition device is used for detecting driving state information of the driver.
104, obtaining the behavior danger level of the driver according to the video information; obtaining the physiological risk level of the driver according to the physiological information; obtaining the driving danger level of the driver according to the driving information;
here, the behavioral risk level, the physiological risk level, and the driving risk level may include the same number of risk levels; for example, whether the driver is in a state of fatigue, inattention and the like is detected according to the video information, and the behavior danger levels can be divided into S1, S2 and S3 according to information such as yawning, eye closing times, abnormal body shaking and the like; dividing physiological danger grades into S1, S2 and S3 according to physiological information such as blood pressure values, heart rate change characteristics and the like of a driver; the driving risk levels are classified into S1, S2, and S3 according to driving information such as the number of times the driver abnormally deviates from a lane, the number of times the steering wheel drags the hand, etc., wherein the risk levels are S3 > S2 > S1.
for example, if the behavioral risk level, the physiological risk level, and the driving risk level are S1, S2, and S3, respectively, the controller selects the highest result S3 as the current risk level of the driver.
And 108, executing operation corresponding to the current danger level according to the current danger level.
Specifically, the controller controls the vehicle body controller and/or the alarm module to work according to different current danger levels, and the current danger levels comprise at least two danger levels.
In the driver state monitoring method, the behavior danger level, the physiological danger level and the driving danger level of the driver can be obtained by acquiring the video information, the physiological information and the driving information of the driver when the vehicle is in a running state, namely the technical scheme provided by the application can monitor and evaluate the state of the driver from the three aspects of the behavior information, the physiological information and the driving information of the driver, not only can judge the fatigue behavior of the driver through the video information, but also can know the body state of the driver through the physiological information, and can know other driving danger conditions which are difficult to detect by a video device and wearable equipment through the driving information, so that the monitoring is more comprehensive; and then the danger grade with the highest danger is selected as the current danger grade of the driver, and the operation corresponding to the current danger grade is executed, so that the condition of misjudgment or missed judgment during monitoring by a single means can be effectively avoided, the accuracy is high, the safety is good, the state of the driver can be monitored more comprehensively and accurately, and the probability of traffic accidents is reduced.
In one embodiment, as shown in FIG. 2, the method includes the steps of:
the current danger level is first danger level, second danger level or third danger level, according to current danger level, controls automobile body controller and/or alarm module work, includes:
in step 208 and step 210, the warning module may be a voice warning device for warning the driver by playing a rest reminding voice or a parking reminding voice.
Here, the controller gives a deceleration command to the body controller, and the body controller controls the vehicle to gradually decelerate to a preset vehicle speed threshold value, which may be 5km/h, or the controller gives a parking command to the body controller, and the body controller controls the vehicle to park.
In the embodiment, when the driving danger possibly caused by the factors of diseases, fatigue, inattention and the like of the driver is detected, the warning is performed, when the danger level is continuously improved, the warning is performed, meanwhile, measures such as reducing the speed of the vehicle or stopping the vehicle can be taken to reduce the danger, and the probability of traffic accidents is reduced.
In one embodiment, obtaining the behavior risk level of the driver according to the video information comprises:
acquiring behavior parameters of a driver within preset time from the video information, and comparing the behavior parameters with a preset behavior parameter evaluation threshold group to obtain a behavior danger level; preferably, the behavior parameters comprise one or more of the times of opening the breath and the lack of breath of the driver, the times of opening the breath and the lack of breath, the times of closing the eyes and the times of abnormal shaking of the body within the preset time;
obtaining the physiological risk level of the driver according to the physiological information, comprising the following steps:
comparing the physiological information with a preset physiological parameter evaluation threshold group to obtain a physiological risk level; preferably, the physiological information comprises one or more of blood pressure value and heart rate variation information of the driver.
Obtaining the driving danger level of the driver according to the driving information, comprising the following steps:
comparing the driving information with a preset driving parameter evaluation threshold group to obtain a driving danger level; preferably, the driving information includes one or more of a number of lane departures and a number of steering wheel hands-off of the driver within a preset time.
In one embodiment, the method further comprises:
receiving driver state information input through an input device;
adjusting the intelligent seat according to the state information of the driver;
in the specific implementation process, the input device can be a control screen in an automobile, and the driver state information comprises the driving age, sex, weight, height and health information of the driver.
In this embodiment, a driver state monitoring method is provided, which further has an intelligent seat function, and can adjust the intelligent seat according to the health condition and the driving state condition of the driver, so as to help improve the state of the driver and further reduce the driving risk caused by poor state of the driver.
In one embodiment, as shown in fig. 3, the method further comprises the steps of:
in specific implementation, the mobile terminal is a wearable device, such as a smart band, or other mobile devices, such as a smart phone and a tablet computer.
In this embodiment, the driver can input seat setting information to the controller according to the demand of oneself, the controller binds this driver's seat setting information and the mobile terminal that the driver corresponds, when the driver starts the car, the controller carries out identification through mobile terminal, confirm driver's identity, the seat setting information that this driver corresponds is transferred, according to this seat setting information, adjust intelligent seat to this driver's state that sets up in advance, make intelligent seat adjust according to different drivers, guarantee the travelling comfort of seat.
It should be understood that although the various steps in the flow charts of fig. 1-3 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1-3 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 4, a driver condition monitoring device is provided, the device comprising an information acquisition module 402, a behavioral risk level module 404, a physiological risk level module 406, a driving risk level module 408, a current risk level module 410, and an execution module 412, wherein:
an information acquisition module 402, configured to acquire video information, physiological information, and driving information of a driver when a vehicle is in a driving state;
a behavior risk level module 404, configured to obtain a behavior risk level of the driver according to the video information;
a physiological risk level module 406, configured to obtain a physiological risk level of the driver according to the physiological information;
a driving risk level module 408, configured to obtain a driving risk level of the driver according to the driving information;
a current risk level module 410, configured to select a risk level with the highest risk from among the behavior risk level, the physiological risk level, and the driving risk level as a current risk level of the driver;
and the executing module 412 is configured to execute an operation corresponding to the current danger level according to the current danger level.
In one embodiment, the execution module 412 is configured to control the vehicle body controller and/or the alarm module to operate according to a current risk level, where the current risk level includes at least two risk levels.
In an embodiment, the current risk level is a first risk level, a second risk level, or a third risk level, and the executing module 412 is configured to:
when the current danger level is a first danger level, controlling the vehicle body controller to adjust the environment in the vehicle and/or play music, and controlling the alarm module to send a rest prompt;
when the current danger level is a second danger level, controlling an alarm module to send out a parking prompt;
when the current danger level is a third danger level, controlling the vehicle body controller to reduce the speed of the vehicle to a safe vehicle speed value, giving an external alarm through an alarm module, and sending alarm information to a preset mobile terminal or initiating an alarm call; the safe vehicle speed value is greater than zero and does not exceed a preset vehicle speed threshold value, or the safe vehicle speed value is zero.
In one embodiment, the behavior risk level module 404 is configured to obtain a behavior parameter of the driver within a preset time from the video information, and compare the behavior parameter with a preset behavior parameter evaluation threshold set to obtain a behavior risk level; in specific implementation, the behavior parameters may include one or more of the times of opening the breath and the lack of breath, the times of closing the eyes and the times of abnormal shaking of the body of the driver within a preset time;
a physiological risk level module 406, configured to compare the physiological information with a preset physiological parameter evaluation threshold set to obtain a physiological risk level; in particular implementations, the physiological information may include one or more of blood pressure values and heart rate variability information of the driver.
In one embodiment, the driving risk level module 408 is configured to compare the driving information to a set of preset driving parameter evaluation thresholds to obtain a driving risk level; in particular implementation, the driving information may include one or more of the number of lane departures and the number of steering wheel hands-off of the driver within a preset time.
In one embodiment, the apparatus further comprises:
the driver state input module is used for receiving the driver state information input by the input device;
the intelligent seat control module is used for adjusting the intelligent seat according to the state information of the driver;
in specific implementation, the input device can be a control screen in an automobile, and the driver state information comprises driving age, sex, weight, height and health information of the driver.
In one embodiment, the apparatus further comprises:
the receiving and storing module is used for receiving and storing the seat setting information of the driver input through the input device;
the binding module is used for sending the encrypted signal to a mobile terminal corresponding to the driver and establishing a binding protocol with the mobile terminal;
the identification module is used for sending an identification request to the mobile terminal when receiving an automobile starting signal, acquiring an identification code fed back by the mobile terminal, and determining seat setting information corresponding to a driver according to the identification code;
and the intelligent seat control module is used for adjusting the intelligent seat according to the seat setting information.
In particular, the mobile terminal may be a bracelet.
For specific limitations of the driver state monitoring device, reference may be made to the above limitations of the driver state monitoring method, which are not described herein again. The various modules in the driver state monitoring device described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, as shown in FIG. 5, a driver condition monitoring system is provided, the system comprising a controller 502, an information collection module 504, a body controller 506, a communication module 508, and an alarm module 510;
the controller is used for controlling the information acquisition device to detect the state of the driver when the vehicle is in a running state, and the information acquisition device comprises a video acquisition device 5041, a physiological information acquisition device 5042 and a driving information acquisition device 5043;
the video acquisition device 5041 is used for acquiring video information of the driver, and the video acquisition device can adopt an image acquisition device facing the front of the body of the driver, such as a camera arranged at a meter;
the physiological information collecting device 5042 is used for collecting physiological information of the driver, and here, the physiological information collecting device may adopt wearable equipment, such as a smart bracelet;
the driving information acquisition device 5043 is used for acquiring driving information of a driver;
the information acquisition module is used for obtaining behavior danger levels according to the video information, obtaining physiological danger levels according to the physiological information, obtaining driving danger levels according to the driving information, selecting the dangerous level with the highest danger from the behavior danger levels, the physiological danger levels and the driving danger levels as the current danger level of the driver, and sending the current danger level to the controller;
further, in a specific implementation, the controller 502 is further connected to an input device 512 and a smart seat 514, wherein the input device 512 is used for a user to input seat setting information or driver status information of the driver, and the smart seat 514 can be adjusted under the control of the controller 502 to meet the requirements of the driver.
The controller is also used for controlling the vehicle body controller, the communication module and the alarm module to work according to the current danger level.
In the embodiment, the driver state monitoring system is provided, the system acquires the video information of a driver, the physiological information and the driving information through the information acquisition module, the driver state can be monitored and evaluated in three aspects of the behavior information, the physiological information and the driving information of the driver, the fatigue behavior of the driver can be judged through the video information, the body state of the driver can be known through the physiological information, other driving dangerous conditions which are difficult to detect by a video device and wearable equipment can be known through the driving information, the monitoring is more comprehensive, the condition of misjudgment or missed judgment during monitoring by a single means can be effectively avoided, the accuracy is high, the safety is good, the driver state can be monitored more comprehensively and accurately, and the probability of traffic accidents is reduced.
In one embodiment, a controller is provided, which may be a terminal installed in a vehicle interior, and the internal structure thereof may be as shown in fig. 6. The controller includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the controller is configured to provide computational and control capabilities. The memory of the controller comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the controller is used for communicating with an external terminal through network connection. The computer program is executed by a processor to implement a driver condition monitoring method. The display screen of the controller can be a liquid crystal display screen or an electronic ink display screen, and the input device of the controller can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on a shell of the controller, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the configuration shown in fig. 6 is a block diagram of only a portion of the configuration associated with the present application and does not constitute a limitation on the controller to which the present application is applied, and that a particular controller may include more or less components than those shown, or combine certain components, or have a different arrangement of components.
In one embodiment, a controller is provided, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
when the vehicle is in a driving state, acquiring video information, physiological information and driving information of a driver; obtaining the behavior danger level of the driver according to the video information; obtaining the physiological risk level of the driver according to the physiological information; obtaining the driving danger level of the driver according to the driving information; selecting the dangerous grade with the highest danger from the behavior dangerous grade, the physiological dangerous grade and the driving dangerous grade as the current dangerous grade of the driver; and executing the operation corresponding to the current danger level according to the current danger level.
In one embodiment, the processor, when executing the computer program, further performs the steps of: according to the current danger level, executing the operation corresponding to the current danger level, wherein the operation comprises the following steps: and controlling the vehicle body controller and/or the alarm module to work according to the current danger level, wherein the current danger level comprises at least two danger levels.
In one embodiment, the current risk level is a first risk level, a second risk level, or a third risk level, and the processor when executing the computer program further performs the steps of: according to the current danger level, controlling the vehicle body controller and/or the alarm module to work, comprising the following steps: when the current danger level is a first danger level, controlling the vehicle body controller to adjust the environment in the vehicle and/or play music, and controlling the alarm module to send a rest prompt; when the current danger level is a second danger level, controlling an alarm module to send out a parking prompt; when the current danger level is a third danger level, controlling the vehicle body controller to reduce the speed of the vehicle to a safe vehicle speed value, giving an external alarm through an alarm module, and sending alarm information to a preset mobile terminal or initiating an alarm call; the safe vehicle speed value is greater than zero and does not exceed a preset vehicle speed threshold value, or the safe vehicle speed value is zero.
In one embodiment, the processor, when executing the computer program, further performs the steps of: obtaining the behavior danger level of the driver according to the video information, wherein the behavior danger level comprises the following steps: acquiring behavior parameters of a driver within preset time from the video information, and comparing the behavior parameters with a preset behavior parameter evaluation threshold group to obtain a behavior danger level; preferably, the behavior parameters comprise one or more of the times of opening the breath and the lack of breath of the driver, the times of opening the breath and the lack of breath, the times of closing the eyes and the times of abnormal shaking of the body within the preset time;
obtaining the physiological risk level of the driver according to the physiological information, comprising the following steps: comparing the physiological information with a preset physiological parameter evaluation threshold group to obtain a physiological risk level; in particular implementations, the physiological information includes one or more of blood pressure values and heart rate variability information of the driver.
In one embodiment, the processor, when executing the computer program, further performs the steps of: obtaining the driving danger level of the driver according to the driving information, comprising the following steps: comparing the driving information with a preset driving parameter evaluation threshold group to obtain a driving danger level; in specific implementation, the driving information comprises one or more of lane departure times and steering wheel hands-off times of the driver within preset time.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving driver state information input through an input device; adjusting the intelligent seat according to the state information of the driver; in specific implementation, the input device is a control screen in an automobile, and the driver state information comprises driving age, sex, weight, height and health information of the driver.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving and storing seat setting information of a driver input through an input device; sending an encrypted signal to a mobile terminal corresponding to a driver, and establishing a binding protocol with the mobile terminal; when an automobile starting signal is received, sending an identification request to the mobile terminal, and acquiring an identification code fed back by the mobile terminal; determining seat setting information corresponding to the driver according to the identification code; adjusting the intelligent seat according to the seat setting information; in particular, the mobile terminal may be a bracelet.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (9)
1. A driver condition monitoring method, the method comprising:
when a vehicle is in a driving state, acquiring video information and driving information of a driver, and acquiring physiological information of the driver through a wearable device, wherein the physiological information comprises one or more of blood pressure value and heart rate change information of the driver, and the driving information comprises one or more of lane departure times and steering wheel hand-off times of the driver in preset time;
obtaining the behavior danger level of the driver according to the video information;
obtaining the physiological risk level of the driver according to the physiological information;
obtaining the driving danger level of the driver according to the driving information;
selecting a risk grade with the highest risk from the behavior risk grade, the physiological risk grade and the driving risk grade as a current risk grade of the driver, wherein the current risk grade comprises at least two risk grades;
executing operation corresponding to the current danger level according to the current danger level;
the method further comprises the following steps:
receiving driver state information input through an input device;
adjusting the intelligent seat according to the state information of the driver;
the method further comprises the following steps:
receiving and storing the driver's seat setting information input through the input device;
sending an encrypted signal to wearable equipment corresponding to the driver, and establishing a binding protocol with the wearable equipment;
when an automobile starting signal is received, sending an identification request to the wearable equipment, acquiring an identification code fed back by the wearable equipment, and determining seat setting information corresponding to the driver according to the identification code;
and adjusting the intelligent seat according to the seat setting information.
2. The method of claim 1, wherein performing an operation corresponding to the current risk level according to the current risk level comprises:
and controlling the vehicle body controller and/or the alarm module to work according to the current danger level.
3. The method according to claim 2, wherein the current danger level is a first danger level, a second danger level or a third danger level, and the controlling of the vehicle body controller and/or the alarm module according to the current danger level comprises:
when the current danger level is a first danger level, controlling the vehicle body controller to adjust the environment in the vehicle and/or play music, and controlling the alarm module to send a rest prompt;
when the current danger level is a second danger level, controlling the alarm module to send out a parking prompt;
when the current danger level is a third danger level, controlling the vehicle body controller to reduce the speed of the vehicle to a safe vehicle speed value, giving an external alarm through an alarm module, and sending alarm information to a preset mobile terminal or initiating an alarm call; the safe vehicle speed value is larger than zero and does not exceed a preset vehicle speed threshold value, or the safe vehicle speed value is zero.
4. The method of claim 1, wherein said deriving a behavioral risk level of the driver from the video information comprises:
acquiring behavior parameters of the driver within preset time from the video information, and comparing the behavior parameters with a preset behavior parameter evaluation threshold group to obtain a behavior danger level; preferably, the behavior parameters comprise one or more of the times of the driver's breathing under, the times of each breathing under, the times of eye closure, the times of each eye closure and the times of abnormal body shaking within a preset time;
the obtaining of the physiological risk level of the driver according to the physiological information includes:
and comparing the physiological information with a preset physiological parameter evaluation threshold group to obtain a physiological risk grade.
5. The method of claim 4, wherein deriving the driving risk level of the driver from the driving information comprises:
and comparing the driving information with a preset driving parameter evaluation threshold group to obtain a driving danger level.
6. The method of claim 1, wherein the input device is a car center screen and the driver status information includes driving age, gender, weight, height, and health information of the driver.
7. A driver condition monitoring device, the device comprising:
the information acquisition module is used for acquiring video information and driving information of a driver when a vehicle is in a running state, and acquiring physiological information of the driver through a wearable device, wherein the physiological information comprises one or more of blood pressure value and heart rate variation information of the driver, and the driving information comprises one or more of lane departure times and steering wheel hand-off times of the driver within preset time;
the behavior danger level module is used for obtaining the behavior danger level of the driver according to the video information;
the physiological risk grade module is used for obtaining the physiological risk grade of the driver according to the physiological information;
the driving danger level module is used for obtaining the driving danger level of the driver according to the driving information;
the current danger level module is used for selecting a danger level with the highest danger from the behavior danger level, the physiological danger level and the driving danger level as a current danger level of the driver, and the current danger level comprises at least two danger levels;
the execution module is used for executing the operation corresponding to the current danger level according to the current danger level;
the device further comprises:
the driver state input module is used for receiving the driver state information input by the input device;
the intelligent seat control module is used for adjusting the intelligent seat according to the state information of the driver;
the device further comprises:
the receiving and storing module is used for receiving and storing the seat setting information of the driver input through the input device;
the binding module is used for sending an encrypted signal to wearable equipment corresponding to a driver and establishing a binding protocol with the wearable equipment;
the recognition module is used for sending a recognition request to the wearable equipment when receiving an automobile starting signal, acquiring a recognition code fed back by the wearable equipment, and determining seat setting information corresponding to a driver according to the recognition code;
and the intelligent seat control module is used for adjusting the intelligent seat according to the seat setting information.
8. A driver state monitoring system is characterized by comprising a controller, an information acquisition module, a vehicle body controller, a communication module and an alarm module;
the controller is used for controlling the information acquisition device to detect the state of a driver when the vehicle is in a running state, and the information acquisition device comprises a video acquisition device, a physiological information acquisition device and a driving information acquisition device;
the video acquisition device is used for acquiring video information of the driver;
the physiological information acquisition device is used for acquiring the physiological information of the driver, and the physiological information acquisition device is wearable equipment;
the driving information acquisition device is used for acquiring the driving information of the driver;
the information acquisition module is used for obtaining behavior danger levels according to the video information, obtaining physiological danger levels according to the physiological information, obtaining driving danger levels according to the driving information, selecting the dangerous level with the highest danger from the behavior danger levels, the physiological danger levels and the driving danger levels as the current danger level of the driver, and sending the current danger level to the controller, wherein the current danger level comprises at least two danger levels;
the controller is also used for controlling the vehicle body controller, the communication module and the alarm module to work according to the current danger level;
the controller is further connected with an input device and an intelligent seat, the input device is used for a user to input seat setting information or driver state information of a driver, and the intelligent seat is adjusted under the control of the controller to meet the requirements of the driver.
9. A controller comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 6 are implemented when the computer program is executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911144068.6A CN110696834B (en) | 2019-11-20 | 2019-11-20 | Driver state monitoring method, device and system and controller |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911144068.6A CN110696834B (en) | 2019-11-20 | 2019-11-20 | Driver state monitoring method, device and system and controller |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110696834A CN110696834A (en) | 2020-01-17 |
| CN110696834B true CN110696834B (en) | 2022-01-14 |
Family
ID=69206422
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911144068.6A Active CN110696834B (en) | 2019-11-20 | 2019-11-20 | Driver state monitoring method, device and system and controller |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110696834B (en) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111559370B (en) * | 2020-05-12 | 2021-07-09 | 大众汽车(安徽)有限公司 | Control method of intelligent health cabin |
| CN111549849A (en) * | 2020-05-19 | 2020-08-18 | 三一重机有限公司 | Control method and device of excavator |
| CN111923929A (en) * | 2020-06-16 | 2020-11-13 | 浙江联控技术有限公司 | Vehicle control method and device based on driving risk |
| CN113879314A (en) * | 2020-07-01 | 2022-01-04 | 罗敏 | Vehicle-mounted system and method for monitoring human physiological data |
| CN114162131A (en) * | 2020-09-10 | 2022-03-11 | 华为技术有限公司 | Driving behavior monitoring method and device |
| CN112208544B (en) * | 2020-10-21 | 2022-10-14 | 合肥工业大学 | Driving capability judgment method for driver, safe driving method and system thereof |
| CN112937576B (en) * | 2020-10-29 | 2022-05-20 | 北京理工大学 | Vehicle auxiliary control method based on relevance between driver state and vehicle state |
| CN112288286A (en) * | 2020-10-30 | 2021-01-29 | 上海仙塔智能科技有限公司 | Secure dispatching method, secure dispatching system and readable storage medium |
| CN112971755A (en) * | 2021-02-18 | 2021-06-18 | 上汽大众汽车有限公司 | Driver health monitoring method and monitoring equipment based on vehicle-mounted equipment |
| CN113011347B (en) * | 2021-03-23 | 2022-01-07 | 深圳信可通讯技术有限公司 | Intelligent driving method and device based on artificial intelligence and related products |
| CN113436414A (en) * | 2021-07-01 | 2021-09-24 | 北京汽车集团越野车有限公司 | Vehicle driving state early warning method and device and electronic equipment |
| CN113353086A (en) * | 2021-07-16 | 2021-09-07 | 恒大恒驰新能源汽车研究院(上海)有限公司 | Vehicle control method and device and electronic equipment |
| CN113386786B (en) * | 2021-07-29 | 2023-05-02 | 阿波罗智联(北京)科技有限公司 | Information prompting method, device, equipment, medium, cloud control platform and vehicle |
| CN113624514A (en) * | 2021-08-17 | 2021-11-09 | 中国汽车技术研究中心有限公司 | Test method, system, electronic device and medium for driver state monitoring product |
| CN113650624B (en) * | 2021-08-30 | 2024-01-19 | 东风柳州汽车有限公司 | Driving reminding method, device, storage medium and apparatus |
| CN113576436A (en) * | 2021-09-27 | 2021-11-02 | 北京小米移动软件有限公司 | Driver health monitoring method and device, vehicle and storage medium |
| CN113911128A (en) * | 2021-11-05 | 2022-01-11 | 深圳依时货拉拉科技有限公司 | Monitoring and alarming method for truck driving state, computer equipment and storage medium |
| CN113844456B (en) * | 2021-11-29 | 2022-03-29 | 宁波均联智行科技股份有限公司 | ADAS automatic opening method and device |
| CN114379566A (en) * | 2022-01-07 | 2022-04-22 | 广东乐心医疗电子股份有限公司 | Vehicle control method and device and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106585624A (en) * | 2016-12-07 | 2017-04-26 | 深圳市元征科技股份有限公司 | Driver state monitoring method and device |
| CN107697069A (en) * | 2017-10-31 | 2018-02-16 | 上海汽车集团股份有限公司 | Fatigue of automobile driver driving intelligent control method |
| CN108839658A (en) * | 2018-05-07 | 2018-11-20 | 威马智慧出行科技（上海）有限公司 | A kind of real-time driving fatigue monitoring system and method |
| CN109747656A (en) * | 2017-11-02 | 2019-05-14 | 罗曦明 | Artificial intelligence vehicle assistant drive method, apparatus, equipment and storage medium |
| CN109849660A (en) * | 2019-01-29 | 2019-06-07 | 合肥革绿信息科技有限公司 | A kind of vehicle safety control system |
| CN109849925A (en) * | 2017-11-29 | 2019-06-07 | 财团法人金属工业研究发展中心 | In the method for physiology monitoring combination vehicle control |
| CN110151166A (en) * | 2019-05-07 | 2019-08-23 | 中国电子科技集团公司第二十八研究所 | A kind of fatigue strength assessment system and appraisal procedure based on bi-mode biology electric signal and physiological data |
| CN110286667A (en) * | 2019-07-03 | 2019-09-27 | 上运车物联网科技（深圳）有限公司 | Abnormal driving condition intelligent control method and Intelligent terminal for Internet of things |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108407813A (en) * | 2018-01-25 | 2018-08-17 | 惠州市德赛西威汽车电子股份有限公司 | A kind of antifatigue safe driving method of vehicle based on big data |
| CN108545080A (en) * | 2018-03-20 | 2018-09-18 | 北京理工大学 | Driver Fatigue Detection and system |
| CN109035718A (en) * | 2018-07-31 | 2018-12-18 | 苏州清研微视电子科技有限公司 | The dangerous driving behavior grading forewarning system method of multifactor fusion |
-
2019
- 2019-11-20 CN CN201911144068.6A patent/CN110696834B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106585624A (en) * | 2016-12-07 | 2017-04-26 | 深圳市元征科技股份有限公司 | Driver state monitoring method and device |
| CN107697069A (en) * | 2017-10-31 | 2018-02-16 | 上海汽车集团股份有限公司 | Fatigue of automobile driver driving intelligent control method |
| CN109747656A (en) * | 2017-11-02 | 2019-05-14 | 罗曦明 | Artificial intelligence vehicle assistant drive method, apparatus, equipment and storage medium |
| CN109849925A (en) * | 2017-11-29 | 2019-06-07 | 财团法人金属工业研究发展中心 | In the method for physiology monitoring combination vehicle control |
| CN108839658A (en) * | 2018-05-07 | 2018-11-20 | 威马智慧出行科技（上海）有限公司 | A kind of real-time driving fatigue monitoring system and method |
| CN109849660A (en) * | 2019-01-29 | 2019-06-07 | 合肥革绿信息科技有限公司 | A kind of vehicle safety control system |
| CN110151166A (en) * | 2019-05-07 | 2019-08-23 | 中国电子科技集团公司第二十八研究所 | A kind of fatigue strength assessment system and appraisal procedure based on bi-mode biology electric signal and physiological data |
| CN110286667A (en) * | 2019-07-03 | 2019-09-27 | 上运车物联网科技（深圳）有限公司 | Abnormal driving condition intelligent control method and Intelligent terminal for Internet of things |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110696834A (en) | 2020-01-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110696834B (en) | Driver state monitoring method, device and system and controller | |
| US20210268902A1 (en) | Driving assistance apparatus and driving assistance method | |
| US9558414B1 (en) | Method for calculating a response time | |
| US10864918B2 (en) | Vehicle and method for supporting driving safety thereof | |
| US20170108862A1 (en) | Method and system for operating a vehicle when an occupant experiences a potential medical condition | |
| US10160456B2 (en) | Apparatus and method for controlling vehicle based on degree of fatigue | |
| CN113345204B (en) | Vehicle-mounted remote fatigue awakening method and awakening system thereof | |
| CN112644514B (en) | Driving data processing method, device, equipment, storage medium and program product | |
| CN112041910A (en) | Information processing apparatus, mobile device, method, and program | |
| US20150307105A1 (en) | Personalized Driver Assistance | |
| DE102014209071A1 (en) | MOBILE PHONE CAMERA FOR DRIVER STATUS ESTIMATION | |
| CN110287916B (en) | Method and system for judging attention of driver | |
| CN112406882A (en) | Device for monitoring state of driver in man-machine co-driving process and method for evaluating pipe connection capability | |
| JP2019086813A (en) | Aimless driving control system | |
| KR20160116772A (en) | Health management system using bio information from steering wheel with bio sensor and method thereof | |
| US11027741B2 (en) | Apparatus and method for estimating driver readiness and method and system for assisting driver | |
| US10165429B1 (en) | Systems and methods for facilitating vehicle incident communications | |
| US10717443B2 (en) | Occupant awareness monitoring for autonomous vehicles | |
| US20210099849A1 (en) | Emergency system for a vehicle | |
| US9820687B2 (en) | Method for determining drowsiness | |
| CN109770922A (en) | Embedded fatigue detecting system and method | |
| CN115366881A (en) | Dangerous driving intervention method, equipment, storage medium and device | |
| CN114140986A (en) | Fatigue driving early warning method, system and storage medium | |
| CN111376831A (en) | Vehicle drunken driving warning method and device, driving assisting system and storage medium | |
| CN114162131A (en) | Driving behavior monitoring method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |