CN112793522A - Steering wheel hands-off monitoring and early warning method and system and automobile - Google Patents
Steering wheel hands-off monitoring and early warning method and system and automobile Download PDFInfo
- Publication number
- CN112793522A CN112793522A CN202110338409.4A CN202110338409A CN112793522A CN 112793522 A CN112793522 A CN 112793522A CN 202110338409 A CN202110338409 A CN 202110338409A CN 112793522 A CN112793522 A CN 112793522A
- Authority
- CN
- China
- Prior art keywords
- steering wheel
- hands
- monitoring
- hand
- early
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 40
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims description 19
- 230000036544 posture Effects 0.000 claims description 15
- 230000006870 function Effects 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 5
- 230000008569 process Effects 0.000 claims description 5
- 230000008447 perception Effects 0.000 claims description 4
- 230000004927 fusion Effects 0.000 abstract description 5
- 238000001514 detection method Methods 0.000 description 4
- 206010039203 Road traffic accident Diseases 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012502 risk assessment Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
Abstract
The invention discloses a method and a system for monitoring and early warning steering wheel hands off and an automobile, wherein the method comprises the following steps: shooting and recognizing hand posture images of a driver, judging that two hands are separated from a steering wheel if the two hands are separated from the steering wheel and the duration time exceeds a first preset time, and sending a primary hand-off early warning; and if the situation that the hand does not leave the steering wheel is identified and the duration time exceeds the first preset time, judging that the hand does not leave the steering wheel, detecting the pressure acting on the steering wheel, and if the situation that the pressure acting on the steering wheel is smaller than a preset pressure threshold value and the duration time exceeds the second preset time is detected, judging that two hands or one hand are frapped on the steering wheel in a virtual mode, and sending out a secondary hand-off early warning. By the method, the hands are not taken off, the virtual lap and the steering wheel is taken over by data fusion, and early warning is timely given to the hands which are not taken off and the virtual lap, so that the monitoring precision is greatly improved, and the driving safety performance is improved.
Description
Technical Field
The invention relates to the technical field of vehicle driving assistance, in particular to a steering wheel hands-off monitoring and early warning method and system and an automobile.
Background
In recent years, the automotive industry has seen widespread attention worldwide as it has prosperous and prosperous developments. The automatic driving technology aims to provide a solution for convenient and intelligent travel for human beings and simultaneously reduce the burden of drivers. At present, various large vehicle enterprises, internet vehicle manufacturing enterprises, intelligent driving innovation enterprises and the like at home and abroad are in deep research and related technical products are promoted. At present, the automobile is intelligentized into 0-5 levels, and intelligent driving experience of different levels can be provided for a driver.
Because the current intelligent driving has an auxiliary driving function and the driver is dominant, in the driving process, the driver needs to hold the steering wheel by hand to take over the vehicle all the time, and the system needs to remind when detecting that the driver drives without hands, so that the method for detecting the driver's hands is made to have great significance for safe driving. Chinese patent document CN101638072A discloses a device and method for monitoring and early warning of hands-off driving, which performs risk assessment according to the status signal of a steering wheel pressure sensor, determines whether to start an alarm and selects an alarm level according to the analysis result; but this method has the disadvantage that it does not always have the desired accuracy.
Disclosure of Invention
The invention aims to provide a method and a system for monitoring and early warning of steering wheel hand-off and an automobile.
In order to achieve the purpose, the invention provides a steering wheel hands-off monitoring and early warning method, which comprises the following steps:
(S1) shooting a hand posture image of the driver and detecting whether the hands of the driver leave the steering wheel or not, wherein the duration time exceeds a first preset time, if so, judging that the hands of the driver leave the steering wheel, sending a primary hand-off early warning, and repeatedly executing the step (S1); otherwise, judging that the two hands or one hand of the driver does not leave the steering wheel, and turning to the execution step (S2);
(S2) detecting whether the pressure acting on the steering wheel is smaller than a preset pressure threshold value and the duration time exceeds a second preset time, if so, judging that two hands or one hand of the driver are frapped on the steering wheel, sending out a secondary hands-off early warning, and returning to the execution step (S1); otherwise, it is determined that the driver grips the steering wheel with both hands or with one hand, and the process goes to the execution step (S1).
Further, before the step (S1) is performed, the following steps are also performed:
and starting the hands-off monitoring and early warning function manually or automatically.
Further, after the hands-off monitoring and early warning function is started, the following steps are also executed:
(S0) detecting whether the vehicle speed is greater than 0, if yes, turning to the step (S1); otherwise, go to execute step (S01);
(S01) detecting whether the vehicle is powered off, if not, repeating the step (S0).
Further, the strength of the first-stage hand-off early warning is greater than that of the second-stage hand-off early warning.
Further, in step (S3), the photographing of the driver' S hand posture image is performed by an infrared camera.
The invention also provides a monitoring and early warning system for steering wheel hands off, which comprises:
the environment sensing module is used for detecting target parameter information, and the target parameter information comprises hand postures and pressure acting on a steering wheel;
the data processing module is used for processing the target parameter information;
the decision-making module is used for processing the hand posture and the pressure signal and judging the hand-off condition of the driver and whether an alarm instruction needs to be sent;
the alarm module is used for receiving an alarm instruction and carrying out alarm reminding;
the environment perception module is connected with the data processing module, the data processing module and the alarm module are both connected with the decision module, and the steering wheel hands-off monitoring and early-warning system can execute the steps of the steering wheel hands-off monitoring and early-warning method.
Further, the alarm module is a human-computer interaction system.
Further, the environment perception module comprises a camera unit for shooting hand posture images of a driver and a pressure sensor for collecting pressure signals on a steering wheel.
Further, the camera shooting unit is an infrared camera.
The invention also provides an automobile which comprises the steering wheel hands-off monitoring and early warning system.
Compared with the prior art, the invention has the following advantages:
according to the steering wheel hands-off monitoring and early warning method, signal data fusion is adopted to judge the hands-off, the virtual lap and the take-over of the driver and make early warning on the hands-off and the virtual lap of the driver in time, so that the driving risk is reduced, the driving safety performance is improved, the traffic accident is reduced, and the method is more accurate compared with the traditional detection method.
Drawings
FIG. 1 is a flow chart of a steering wheel hands-off monitoring and early warning method according to the present invention;
fig. 2 is a schematic structural diagram of the steering wheel hands-off monitoring and early warning system of the present invention.
In the figure:
1-an environment awareness module; 2-a data processing module; 3-a decision-making module; 4-an alarm module.
Detailed Description
The following further describes embodiments of the present invention with reference to the drawings.
Referring to fig. 1, the embodiment discloses a steering wheel hands-off monitoring and early warning method, which includes the following steps:
(S1) shooting a hand posture image of the driver and detecting whether the hands of the driver leave the steering wheel or not, wherein the duration time exceeds a first preset time, if so, judging that the hands of the driver leave the steering wheel, sending a primary hand-off early warning, and repeatedly executing the step (S1); otherwise, judging that the two hands or one hand of the driver does not leave the steering wheel, and turning to the execution step (S2);
(S2) detecting whether the pressure acting on the steering wheel is smaller than a preset pressure threshold value and the duration time exceeds a second preset time, if so, judging that two hands or one hand of the driver are frapped on the steering wheel, sending out a secondary hands-off early warning, and returning to the execution step (S1); otherwise, it is determined that the driver grips the steering wheel with both hands or with one hand, and the process goes to the execution step (S1).
When the infrared camera detects that two hands or one Hand of a driver does not leave the steering wheel, the dynamic signal Hand Hold is continuously output, the grip strength steering wheel detects that the pressure is smaller than a set value through a pressure sensor on the steering wheel, the pressure signal Hand off is continuously output, data compensation is carried out on target information detected by the infrared camera and the pressure sensor, the grip strength steering wheel and the target detection and screening information of the infrared camera are output to a central control module through a CAN (controller area network) interface for data fusion, the fact that the two hands or one Hand of the driver are virtually lapped on the steering wheel is judged in real time, when the duration time exceeds the set value, the fact that the two hands or one Hand of the driver are virtually lapped on the steering wheel is judged, signals are sent to a bus, and secondary hands-off early warning is carried out on the driver after the instrument receives signals of the two hands or one Hand of the driver virtually.
When the infrared camera detects that both hands or one Hand of the driver do not leave the steering wheel, continuously output dynamic signal Hand Hold, the grip power steering wheel detects pressure through pressure sensor and is more than or equal to the preset threshold value, continuously output pressure signal Hand Hold, judge in real time that both hands or one Hand of the driver grip the steering wheel, after duration surpassed the second preset time, judge that both hands or one Hand of the driver grip on the steering wheel, directly send the signal to the bus through the gateway, the instrument does not report to the police after receiving this signal.
In the present embodiment, before the step (S1) is performed, the following steps are also performed: and starting the hands-off monitoring and early warning function manually or automatically.
In this embodiment, after the hands-off monitoring and early warning function is started, the following steps are further executed:
(S0) detecting whether the vehicle speed is greater than 0, if yes, turning to the step (S1); otherwise, go to execute step (S01);
(S01) detecting whether the vehicle is powered off, if so, closing the hands-off monitoring and early warning function; otherwise, the step (S0) is repeatedly performed.
In this embodiment, the strength of the first-level hands-off warning is greater than the strength of the second-level hands-off warning.
In the present embodiment, in step (S3), the photographing of the driver hand posture image is performed by an infrared camera.
Referring to fig. 2, this embodiment also discloses a steering wheel hands-off monitoring and early warning system, including:
the environment sensing module 1 is used for detecting target parameter information, and the target parameter information comprises hand gestures and pressure acting on a steering wheel. The target parameter information also includes vehicle speed and the power down signal.
The data processing module 2 is used for processing the target parameter information; the data processing module 2 further comprises a pressure signal processing unit and an infrared dynamic signal processing unit.
The decision module 3 is used for processing the hand posture and pressure signals and judging the hand-off condition of the driver and whether an alarm instruction needs to be sent; wherein, the decision module is a central controller.
The alarm module 4 is used for receiving an alarm instruction and carrying out alarm reminding;
the environment perception module 1 is connected with the data processing module 2, the data processing module 2 and the alarm module 4 are both connected with the decision module 3, and the steering wheel hands-off monitoring and early-warning system can execute the steps of the steering wheel hands-off monitoring and early-warning method.
In this embodiment, the alarm module 4 is a human-computer interaction system. The man-machine interaction system comprises an instrument and a vehicle-mounted entertainment audio-visual system.
In the present embodiment, the environmental sensing module 1 includes a camera unit for capturing an image of the hand posture of the driver and a pressure sensor for acquiring a pressure signal on the steering wheel.
In this embodiment, the camera unit is an infrared camera.
The embodiment also discloses an automobile which comprises the steering wheel hands-off monitoring and early warning system.
During the driving process of the vehicle, the infrared camera collects driving posture dynamic signals of a driver, the grip steering wheel collects dynamic grip strength information of hands of the driver, fusion processing is carried out through the central controller, whether the driver is out of hand or not is judged through detection results after data fusion, signals are sent to the gateway and then sent to the bus through the gateway or directly sent to the bus through the gateway, and corresponding prompt is carried out after the human-computer interaction system instrument receives relevant signals.
According to the steering wheel hands-off monitoring and early warning method, signal data fusion is adopted to judge the hands-off, the virtual lap and the take-over of the driver and make early warning on the hands-off and the virtual lap of the driver in time, so that the driving risk is reduced, the driving safety performance is improved, the traffic accident is reduced, and the method is more accurate compared with the traditional detection method.
The foregoing detailed description of the preferred embodiments of the invention has been presented. It should be understood that numerous modifications and variations could be devised by those skilled in the art in light of the present teachings without departing from the inventive concepts. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the prior art according to the concept of the present invention should be within the scope of protection defined by the claims.
Claims (10)
1. A steering wheel hands-off monitoring and early warning method is characterized by comprising the following steps:
(S1) shooting a hand posture image of the driver and detecting whether the hands of the driver leave the steering wheel or not, wherein the duration time exceeds a first preset time, if so, judging that the hands of the driver leave the steering wheel, sending a primary hand-off early warning, and repeatedly executing the step (S1); otherwise, judging that the two hands or one hand of the driver does not leave the steering wheel, and turning to the execution step (S2);
(S2) detecting whether the pressure acting on the steering wheel is smaller than a preset pressure threshold value and the duration time exceeds a second preset time, if so, judging that two hands or one hand of the driver are frapped on the steering wheel, sending out a secondary hands-off early warning, and returning to the execution step (S1); otherwise, it is determined that the driver grips the steering wheel with both hands or with one hand, and the process goes to the execution step (S1).
2. The steering wheel hands-off monitoring and early-warning method according to claim 1, wherein before the step (S1), the following steps are further performed:
and starting the hands-off monitoring and early warning function manually or automatically.
3. The steering wheel hands-off monitoring and early-warning method according to claim 2, characterized in that after the hands-off monitoring and early-warning function is started, the following steps are further executed:
(S0) detecting whether the vehicle speed is greater than 0, if yes, turning to the step (S1); otherwise, go to execute step (S01);
(S01) detecting whether the vehicle is powered off, if not, repeating the step (S0).
4. The steering wheel hands-off monitoring and early-warning method according to claim 1, 2 or 3, wherein the intensity of the primary hands-off early-warning is greater than the intensity of the secondary hands-off early-warning.
5. The steering wheel hands-off monitoring and early warning method according to claim 4, wherein in the step (S3), the capturing of the driver hand posture image is performed by an infrared camera.
6. The utility model provides a steering wheel takes off one's hand monitoring and early warning system which characterized in that includes:
the environment sensing module (1) is used for detecting target parameter information, and the target parameter information comprises hand postures and pressure acting on a steering wheel;
the data processing module (2) is used for processing the target parameter information;
the decision-making module (3) is used for processing the hand posture and the pressure signal and judging the hand-off condition of the driver and whether an alarm instruction needs to be sent;
the alarm module (4) is used for receiving an alarm instruction and carrying out alarm reminding;
the environment perception module (1) is connected with the data processing module (2), the data processing module (2) and the alarm module (4) are both connected with the decision module (3), and the steering wheel hands-off monitoring and early-warning system can execute the steps of the steering wheel hands-off monitoring and early-warning method as claimed in any one of claims 1 to 5.
7. The monitoring and early-warning system for steering wheel hands-off as claimed in claim 6, wherein the alarm module (4) is a human-computer interaction system.
8. The monitoring and early warning system for the hands-off of the steering wheel as claimed in claim 6 or 7, wherein the environment sensing module (1) comprises a camera unit for shooting a posture image of the hand of the driver and a pressure sensor for acquiring a pressure signal on the steering wheel.
9. The steering wheel hands-off monitoring and early warning system according to claim 8, wherein the camera unit is an infrared camera.
10. An automobile, characterized by comprising a steering wheel hands-off monitoring and warning system according to any one of claims 6 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110338409.4A CN112793522A (en) | 2021-03-30 | 2021-03-30 | Steering wheel hands-off monitoring and early warning method and system and automobile |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110338409.4A CN112793522A (en) | 2021-03-30 | 2021-03-30 | Steering wheel hands-off monitoring and early warning method and system and automobile |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112793522A true CN112793522A (en) | 2021-05-14 |
Family
ID=75815875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110338409.4A Pending CN112793522A (en) | 2021-03-30 | 2021-03-30 | Steering wheel hands-off monitoring and early warning method and system and automobile |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112793522A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113247092A (en) * | 2021-05-30 | 2021-08-13 | 重庆长安汽车股份有限公司 | Driver hands-off detection method and device, automobile and computer storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202294509U (en) * | 2011-10-09 | 2012-07-04 | 江苏大学 | Device for preventing driver from operating steering wheel by single hand for long time |
| CN105291977A (en) * | 2015-11-19 | 2016-02-03 | 南京信息工程大学 | Automobile safe driving pre-warning system and pre-warning method thereof |
| CN107054439A (en) * | 2015-12-10 | 2017-08-18 | Lg电子株式会社 | The steering input unit and vehicle of vehicle |
| US20190004514A1 (en) * | 2017-06-29 | 2019-01-03 | Denso Ten Limited | Driver assistance apparatus and driver assistance method |
| CN109823347A (en) * | 2019-03-12 | 2019-05-31 | 长安大学 | Intelligent network joins vehicle driving behavior supplementary security system and method |
| CN110371134A (en) * | 2019-07-26 | 2019-10-25 | 中国联合网络通信集团有限公司 | Safe driving method, safety driving system and automobile |
| CN111860210A (en) * | 2020-06-29 | 2020-10-30 | 杭州鸿泉物联网技术股份有限公司 | Method and device for detecting separation of hands from steering wheel, electronic equipment and storage medium |
-
2021
- 2021-03-30 CN CN202110338409.4A patent/CN112793522A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202294509U (en) * | 2011-10-09 | 2012-07-04 | 江苏大学 | Device for preventing driver from operating steering wheel by single hand for long time |
| CN105291977A (en) * | 2015-11-19 | 2016-02-03 | 南京信息工程大学 | Automobile safe driving pre-warning system and pre-warning method thereof |
| CN107054439A (en) * | 2015-12-10 | 2017-08-18 | Lg电子株式会社 | The steering input unit and vehicle of vehicle |
| US20190004514A1 (en) * | 2017-06-29 | 2019-01-03 | Denso Ten Limited | Driver assistance apparatus and driver assistance method |
| CN109823347A (en) * | 2019-03-12 | 2019-05-31 | 长安大学 | Intelligent network joins vehicle driving behavior supplementary security system and method |
| CN110371134A (en) * | 2019-07-26 | 2019-10-25 | 中国联合网络通信集团有限公司 | Safe driving method, safety driving system and automobile |
| CN111860210A (en) * | 2020-06-29 | 2020-10-30 | 杭州鸿泉物联网技术股份有限公司 | Method and device for detecting separation of hands from steering wheel, electronic equipment and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113247092A (en) * | 2021-05-30 | 2021-08-13 | 重庆长安汽车股份有限公司 | Driver hands-off detection method and device, automobile and computer storage medium |
| CN113247092B (en) * | 2021-05-30 | 2022-11-04 | 重庆长安汽车股份有限公司 | Driver hands-off detection method and device, automobile and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9771085B2 (en) | Robotic vehicle control | |
| CN110293969B (en) | Self-adaptive cruise driving system and method and automobile | |
| CN108189709B (en) | Control method of electric automobile brake system and electric automobile | |
| CN106585624A (en) | Driver state monitoring method and device | |
| CN107031553A (en) | A kind of tailgating-proof system and method for vehicle | |
| US20140121927A1 (en) | Vehicle emergency evacuation device | |
| CN111942404B (en) | Vehicle and driving method and device thereof | |
| CN106627589A (en) | Vehicle driving safety auxiliary method and system and vehicle | |
| CN202669799U (en) | Control device for preventing misoperation in emergency brake of vehicle | |
| CN202345670U (en) | Voice-assisted parking device | |
| CN105678961A (en) | Anti-fatigue driving automobile safety warning system and warning method | |
| CN109849925A (en) | In the method for physiology monitoring combination vehicle control | |
| CN110136464A (en) | A kind of method, device and equipment that auxiliary drives | |
| CN209257982U (en) | A kind of bad steering behavior monitoring device | |
| CN111942353B (en) | Emergency braking control method for pure electric vehicle, vehicle control unit and control device | |
| CN112793522A (en) | Steering wheel hands-off monitoring and early warning method and system and automobile | |
| CN115107758A (en) | Method and device for assisting driver to safely park, vehicle and storage medium | |
| CN110758387A (en) | Unmanned vehicle-based anti-collision device and method | |
| CN111169474A (en) | Autonomous emergency steering avoidance auxiliary device and method | |
| CN206336200U (en) | A kind of video enabling anti-collision prewarning apparatus | |
| CN110182211B (en) | Vehicle intelligent danger avoiding control method based on driver state monitoring system | |
| WO2018058265A1 (en) | Car control method and system | |
| CN201681468U (en) | Automobile fatigue driving prevention system | |
| CN113516015B (en) | Emotion recognition method, driving assisting device and application | |
| CN205022457U (en) | A controller and system for speed of a motor vehicle is reminded |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210514 |