CN111559381A - Automatic driving control system based on driver state monitoring - Google Patents
Automatic driving control system based on driver state monitoring Download PDFInfo
- Publication number
- CN111559381A CN111559381A CN202010314366.1A CN202010314366A CN111559381A CN 111559381 A CN111559381 A CN 111559381A CN 202010314366 A CN202010314366 A CN 202010314366A CN 111559381 A CN111559381 A CN 111559381A
- Authority
- CN
- China
- Prior art keywords
- driver
- automatic driving
- vehicle
- state monitoring
- driver state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60T—VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL; ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
- B60T7/00—Brake-action initiating means
- B60T7/12—Brake-action initiating means for automatic initiation; for initiation not subject to will of driver or passenger
- B60T7/14—Brake-action initiating means for automatic initiation; for initiation not subject to will of driver or passenger operated upon collapse of driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/001—Planning or execution of driving tasks
- B60W60/0015—Planning or execution of driving tasks specially adapted for safety
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/005—Handover processes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/005—Handover processes
- B60W60/0059—Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
Landscapes
- Engineering & Computer Science (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Automation & Control Theory (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Traffic Control Systems (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses an automatic driving control system based on driver state monitoring, which comprises an in-vehicle camera, wearable equipment for detecting heart rate, a driver state monitoring system and an automatic driving system, wherein the in-vehicle camera is connected with the in-vehicle camera; the vehicle camera and the wearable device report the heart rate respectively report the fatigue and body state of the driver, and the reports are output to a driver state monitoring system for judgment; when a driver is in a fatigue driving state and does not respond to the early warning prompt, the automatic driving system performs a braking action firstly, and if the driver still does not respond, the automatic driving system takes over the vehicle, turns on a danger alarm lamp and stops and parks the vehicle in a safe section. The system can automatically activate the automatic driving system to take over the vehicle and take necessary rescue actions to ensure the safety of the driver and passengers under the condition of abnormal body or fatigue state of the driver.
Description
Technical Field
The invention relates to the field of automatic driving, in particular to an automatic driving control system based on driver state monitoring.
Background
At present, the technology for monitoring the state of a driver is mature, the facial expression and the action of the driver are mostly monitored through a camera in a vehicle, and the fatigue state of the driver is early warned through a certain algorithm strategy, but the technology is only used as an independent system for early warning the driver. When the driver is uncomfortable and cannot normally drive the vehicle, the early warning can play a small role in protection, or the driver does not respond to the early warning, and serious potential safety hazards can be brought to the driver and surrounding traffic participants. If the early warning system is combined with automatic driving control, when the abnormal condition occurs, the automatic driving system can manage the driving action of the vehicle, take measures such as emergency parking, automatic driving to a rescue place and the like, and guarantee the safety of a driver or surrounding traffic participants to a great extent.
Disclosure of Invention
The invention aims to provide an automatic driving control system based on driver state monitoring, which comprises an in-vehicle camera, wearable equipment for detecting heart rate, a driver state monitoring system and an automatic driving system;
the vehicle camera and the wearable device report the heart rate respectively report the fatigue and body state of the driver, and the reports are output to a driver state monitoring system for judgment;
the driver state monitoring system outputs the judgment result to an automatic driving system, and the automatic driving system respectively operates emergency parking and emergency rescue strategies according to different current states of a driver;
when a driver is in a fatigue driving state and does not respond to the early warning prompt, the automatic driving system performs a braking action firstly, and if the driver still does not respond, the automatic driving system takes over the vehicle, turns on a danger alarm lamp and stops and parks the vehicle in a safe section;
when the driver is in a state of body abnormality, such as heart rate abnormality, the system is automatically activated after the driver early warning system is triggered, a nearest hospital route is planned, and a danger warning lamp is turned on.
Preferably, after the vehicle is driven to the destination hospital, the voice module is automatically requested to make a rescue call, and the current vehicle position and the vehicle information are broadcasted.
Preferably, the emergency treatment center sends out a distress alarm and transmits the hospitalization route to the emergency treatment center while the danger alarm lamp is turned on during the planning of hospitalization.
Preferably, when the driver is in a fatigue driving state, the number of times of the unresponsive early warning prompt is set to be 3, and the automatic driving system performs the snubbing action firstly after the unresponsive early warning prompt is set for 3 times.
Preferably, after the vehicle is parked in a safe place, the driver state monitoring system can report information to a traffic police department so as to store evidence information.
Compared with the prior art, the invention has the beneficial effects that: the system can automatically activate the automatic driving system to take over the vehicle and take necessary rescue actions to ensure the safety of the driver and passengers under the condition of abnormal body or fatigue state of the driver.
Drawings
FIG. 1 is a block diagram of the overall system of the present invention;
FIG. 2 is a core policy flow diagram of the present invention;
fig. 3 is a flow chart of emergency rescue according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Example 1
An automatic driving control system based on driver state monitoring comprises an in-vehicle camera, wearable equipment for detecting heart rate, a driver state monitoring system and an automatic driving system;
the vehicle camera and the wearable device report the heart rate respectively report the fatigue and body state of the driver, and the reports are output to a driver state monitoring system for judgment;
the driver state monitoring system outputs the judgment result to an automatic driving system, and the automatic driving system respectively operates emergency parking and emergency rescue strategies according to different current states of a driver;
when a driver is in a fatigue driving state and does not respond to the early warning prompt, the automatic driving system performs a braking action firstly, and if the driver still does not respond, the automatic driving system takes over the vehicle, turns on a danger alarm lamp and stops and parks the vehicle in a safe section; after the vehicle is parked in a safe place, the driver state monitoring system can report information to a traffic police department so as to store evidence information. The information is sent to the traffic police department, so that the traffic police can conveniently check nearby, and meanwhile, the information can be stored for some possible violation accidents in the later period. When a driver is in a fatigue driving state, the number of times of the unresponsive early warning prompt is set to be 3, and the automatic driving system can perform the snubbing action firstly after the unresponsive early warning prompt is not responded for 3 times.
When the driver is in a state of body abnormality, such as heart rate abnormality, the system is automatically activated after the driver early warning system is triggered, a nearest hospital route is planned, and a danger warning lamp is turned on.
After the vehicle is driven to a destination hospital, the voice module is automatically requested to dial a rescue call, and the current vehicle position and the vehicle information are broadcasted. When the danger alarm lamp is turned on during planning the hospitalizing, the emergency center can send out a distress alarm, and the hospitalizing route is conducted to the emergency center.
The system can automatically activate the automatic driving system to take over the vehicle and take necessary rescue actions to ensure the safety of the driver and passengers under the condition of abnormal body or fatigue state of the driver.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (5)
1. An automatic driving control system based on driver state monitoring, characterized in that: the system comprises an in-vehicle camera, wearable equipment for detecting the heart rate, a driver state monitoring system and an automatic driving system;
the vehicle camera and the wearable device report the heart rate respectively report the fatigue and body state of the driver, and the reports are output to a driver state monitoring system for judgment;
the driver state monitoring system outputs the judgment result to an automatic driving system, and the automatic driving system respectively operates emergency parking and emergency rescue strategies according to different current states of a driver;
when a driver is in a fatigue driving state and does not respond to the early warning prompt, the automatic driving system performs a braking action firstly, and if the driver still does not respond, the automatic driving system takes over the vehicle, turns on a danger alarm lamp and stops and parks the vehicle in a safe section;
when the driver is in a state of body abnormality, such as heart rate abnormality, the system is automatically activated after the driver early warning system is triggered, a nearest hospital route is planned, and a danger warning lamp is turned on.
2. An automatic driving control system based on driver state monitoring according to claim 1, characterized in that: after the vehicle is driven to a destination hospital, the voice module is automatically requested to dial a rescue call, and the current vehicle position and the vehicle information are broadcasted.
3. An automatic driving control system based on driver state monitoring according to claim 1, characterized in that: when the danger alarm lamp is turned on during planning the hospitalizing, the emergency center can send out a distress alarm, and the hospitalizing route is conducted to the emergency center.
4. An automatic driving control system based on driver state monitoring according to claim 1, characterized in that: when a driver is in a fatigue driving state, the number of times of the unresponsive early warning prompt is set to be 3, and the automatic driving system can perform the snubbing action firstly after the unresponsive early warning prompt is not responded for 3 times.
5. An automatic driving control system based on driver state monitoring according to claim 1, characterized in that: after the vehicle is parked in a safe place, the driver state monitoring system can report information to a traffic police department so as to store evidence information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010314366.1A CN111559381A (en) | 2020-04-21 | 2020-04-21 | Automatic driving control system based on driver state monitoring |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010314366.1A CN111559381A (en) | 2020-04-21 | 2020-04-21 | Automatic driving control system based on driver state monitoring |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111559381A true CN111559381A (en) | 2020-08-21 |
Family
ID=72068958
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010314366.1A Pending CN111559381A (en) | 2020-04-21 | 2020-04-21 | Automatic driving control system based on driver state monitoring |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111559381A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112124320A (en) * | 2020-09-10 | 2020-12-25 | 恒大新能源汽车投资控股集团有限公司 | Vehicle control method and system and vehicle |
| CN112330920A (en) * | 2020-11-03 | 2021-02-05 | 山东建筑大学 | Control, monitoring and feedback terminal for long-distance driving |
| CN112606841A (en) * | 2020-12-28 | 2021-04-06 | 中亿达供应链管理(无锡)有限公司 | Special medical monitoring system and method for automobile driver |
| CN112829767A (en) * | 2021-02-22 | 2021-05-25 | 清华大学苏州汽车研究院（相城） | Automatic driving control system and method based on monitoring misoperation of driver |
| CN113576436A (en) * | 2021-09-27 | 2021-11-02 | 北京小米移动软件有限公司 | Driver health monitoring method and device, vehicle and storage medium |
| CN114419914A (en) * | 2022-01-30 | 2022-04-29 | 重庆长安汽车股份有限公司 | Driving system and method for early warning of traffic restriction and automatic avoidance of restricted number road section |
| CN114506332A (en) * | 2022-03-17 | 2022-05-17 | 上海安亭地平线智能交通技术有限公司 | Driving assistance method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104966382A (en) * | 2015-05-21 | 2015-10-07 | 浙江吉利汽车研究院有限公司 | Driver physiological status monitoring and responding system and method |
| CN106515706A (en) * | 2016-09-30 | 2017-03-22 | 广州汽车集团股份有限公司 | Vehicle safety driving control method and vehicle safety driving control system |
| CN107336711A (en) * | 2017-06-19 | 2017-11-10 | 北京汽车股份有限公司 | Vehicle and its automated driving system and method |
| JP2019067421A (en) * | 2018-11-12 | 2019-04-25 | みこらった株式会社 | Automatic driving vehicle |
| CN109693674A (en) * | 2018-12-17 | 2019-04-30 | 安徽酷哇机器人有限公司 | Automatic Pilot switching method based on driver's state recognition |
-
2020
- 2020-04-21 CN CN202010314366.1A patent/CN111559381A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104966382A (en) * | 2015-05-21 | 2015-10-07 | 浙江吉利汽车研究院有限公司 | Driver physiological status monitoring and responding system and method |
| CN106515706A (en) * | 2016-09-30 | 2017-03-22 | 广州汽车集团股份有限公司 | Vehicle safety driving control method and vehicle safety driving control system |
| CN107336711A (en) * | 2017-06-19 | 2017-11-10 | 北京汽车股份有限公司 | Vehicle and its automated driving system and method |
| JP2019067421A (en) * | 2018-11-12 | 2019-04-25 | みこらった株式会社 | Automatic driving vehicle |
| CN109693674A (en) * | 2018-12-17 | 2019-04-30 | 安徽酷哇机器人有限公司 | Automatic Pilot switching method based on driver's state recognition |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112124320A (en) * | 2020-09-10 | 2020-12-25 | 恒大新能源汽车投资控股集团有限公司 | Vehicle control method and system and vehicle |
| CN112330920A (en) * | 2020-11-03 | 2021-02-05 | 山东建筑大学 | Control, monitoring and feedback terminal for long-distance driving |
| CN112606841A (en) * | 2020-12-28 | 2021-04-06 | 中亿达供应链管理(无锡)有限公司 | Special medical monitoring system and method for automobile driver |
| CN112829767A (en) * | 2021-02-22 | 2021-05-25 | 清华大学苏州汽车研究院（相城） | Automatic driving control system and method based on monitoring misoperation of driver |
| CN112829767B (en) * | 2021-02-22 | 2024-05-17 | 清华大学苏州汽车研究院（相城） | Automatic driving control system and method based on monitoring of misoperation of driver |
| CN113576436A (en) * | 2021-09-27 | 2021-11-02 | 北京小米移动软件有限公司 | Driver health monitoring method and device, vehicle and storage medium |
| CN114419914A (en) * | 2022-01-30 | 2022-04-29 | 重庆长安汽车股份有限公司 | Driving system and method for early warning of traffic restriction and automatic avoidance of restricted number road section |
| CN114506332A (en) * | 2022-03-17 | 2022-05-17 | 上海安亭地平线智能交通技术有限公司 | Driving assistance method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111559381A (en) | Automatic driving control system based on driver state monitoring | |
| CN105452044B (en) | Emergency for vehicle guidance aids in | |
| CN203020082U (en) | Vehicle-mounted alcohol monitoring device | |
| CN107244290A (en) | Automobile driving without hands monitor, take over system and method | |
| CN105678961B (en) | The automobile safety alarm system and alarming method for power of a kind of anti-fatigue-driving | |
| BR102016017813A2 (en) | parking verification system, parked train monitoring system, motion detection system, parking verification method, parked train monitoring method and motion detection method for a train having at least one locomotive and at least one wagon rail | |
| CN103531029A (en) | Safety device for preventing vehicle from running red light and being overspeed | |
| CN108189709A (en) | The control method and electric vehicle of a kind of braking system of electric car | |
| JP2019099145A (en) | Method for incorporating vital sign monitoring to vehicle control | |
| CN206885022U (en) | Vehicle DAS (Driver Assistant System) and vehicle | |
| CN109823337A (en) | The autonomous avoiding system of vehicle and method under a kind of operating passenger car driver abnormal conditions | |
| CN108122371A (en) | Vehicle help-asking system, vehicle-mounted emergency device and vehicle | |
| CN109774684A (en) | A kind of automobile driver sudden death emergency braking system and method | |
| CN113515074A (en) | Remote monitoring device and method for logistics transportation | |
| CN115107758A (en) | Method and device for assisting driver to safely park, vehicle and storage medium | |
| CN107609830A (en) | Commercial car vehicle condition physical distribution monitoring system and method | |
| CN207060031U (en) | A kind of traffic safety guard system of vehicle | |
| CN110834588B (en) | Method for warning people to evacuate after automobile accident or fault parking | |
| CN113911128A (en) | Monitoring and alarming method for truck driving state, computer equipment and storage medium | |
| WO2023236437A1 (en) | Driver fatigue state monitoring system based on seat pressure-bearing analysis | |
| CN108091156A (en) | Travel safety ensuring system based on big data platform | |
| CN210181809U (en) | Secondary accident linkage early warning system | |
| CN111063140A (en) | Traffic accident detection early warning alarm system | |
| CN110503829A (en) | A kind of driving assistance system based on artificial intelligence | |
| CN214929564U (en) | Safety guarantee system for sudden serious illness of school bus driver |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200821 |