CN102963298A - Abnormal behavior monitoring method based on sight detection - Google Patents
Abnormal behavior monitoring method based on sight detection Download PDFInfo
- Publication number
- CN102963298A CN102963298A CN2012103725704A CN201210372570A CN102963298A CN 102963298 A CN102963298 A CN 102963298A CN 2012103725704 A CN2012103725704 A CN 2012103725704A CN 201210372570 A CN201210372570 A CN 201210372570A CN 102963298 A CN102963298 A CN 102963298A
- Authority
- CN
- China
- Prior art keywords
- visibility
- treater
- chaufeur
- range
- desirable range
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Emergency Alarm Devices (AREA)
- Lighting Device Outwards From Vehicle And Optical Signal (AREA)
Abstract
The invention provides an abnormal behavior monitoring method based on sight range of a driver. The method comprises the following steps of predicting an ideal sight range of a driver under normal safe driving situation in the next period of time through vehicle steering and vehicle speed information, determining the actual sight range of the driver through an image identification algorithm, comparing the overlap ratio between the ideal sight range and the actual sight range to comprehensively identify whether the driving behavior of the driver is abnormal through effectively combining the traffic information and the driver information.
Description
Technical field
The invention belongs to the safe driving of vehicle technical field, be specifically related to the method for supervising of the abnormal behaviours such as pilot's line of vision departs from.
Background technology
In recent years, China's vehicle guaranteeding organic quantity increases sharply, traffic accident quantity is high, according to the statistics of traffic accidents result, the generation of rear-end collision be that the chaufeur dispersion attention causes, so driving behavior monitoring and early warning technology becomes one of research emphasis of intelligent transportation field, to the driving ability that improves chaufeur and reduce its driver workload, coordinate the relation between chaufeur and vehicle and the traffic environment, it is significant to improve the traffic accident situation.
Prior art mainly concentrates in the fatigue driving the chaufeur driving condition supervision, and for the corresponding monitoring means of shortage of chaufeur abnormal behaviours such as gazing around in the driving procedure except fatigue driving, absent minded.
Summary of the invention
The object of the invention is, provide a kind of to chaufeur abnormal behaviour method for supervising, predict the desirable pilot's line of vision scope of the corresponding requirement of conduct route, the judgement of information of vehicles matching in a period of time by the current sight line of chaufeur and vehicle, judge chaufeur and whether have the problems such as absent minded, fatigue driving, sight line abnormal deviation.
Based on the abnormal behaviour method for supervising of line-of-sight detection, by the collaborative following steps of finishing of treater, video collector, annunciator, steering wheel angle sensor and speed sensor:
1) obtain corner of vehicle steering wheel information and speed sensor implementations by steering wheel angle sensor and obtain car speed information and send signal to treater and determine roadway footpath in following a period of time scope, thus determine with following a period of time scope in the roadway desirable range of visibility in the corresponding driver safety driving situation directly;
2) video collector receives chaufeur head video information, and sends signal to actual range of visibility that treater is determined chaufeur in the driving process;
3) treater compares desirable range of visibility and the actual range of visibility of chaufeur in the safe driving situation of determining, if overlap ratio less than certain expected value, annunciator is accepted treater and is controlled, startup sight line deviation warning;
Further, step 1) also comprises: after the desirable range of visibility of determining in the normal safe driving situation of chaufeur, obtain the intention that turns to of chaufeur by turning to the indicator signal generating means, the process that aforementioned desirable range of visibility is revised.
Another kind of abnormal behaviour method for supervising based on line-of-sight detection may further comprise the steps:
1) obtain corner of vehicle steering wheel information and speed sensor implementations by steering wheel angle sensor and obtain car speed information and send signal to treater and determine roadway footpath in following a period of time scope, thus determine with following a period of time scope in the roadway desirable range of visibility in the corresponding driver safety driving situation directly;
2) receive chaufeur head, eye video information by video collector, and send signal to actual range of visibility that treater is determined chaufeur;
3) judge by treater whether the actual sight line variation range of chaufeur is too small in the certain hour,
That treater starts annunciator and carries out fatigue warning;
No, treater compares the desirable range of visibility in the normal safe driving situation and the actual range of visibility of chaufeur, if overlap ratio less than certain expected value, annunciator is accepted treater control, starts the sight line deviation warning.
Further, step 1) also comprises: after the desirable range of visibility of determining in the normal safe driving situation of chaufeur, obtain the intention that turns to of chaufeur by turning to the indicator signal generating means, the process that aforementioned desirable range of visibility is revised.
Useful technique effect of the present invention is: the invention provides a kind of abnormal driving behavior monitoring method based on the pilot's line of vision scope, by the desirable range of visibility in the normal safe driving situation of Vehicular turn, speed information predict future a period of time chaufeur, determine the actual range of visibility of chaufeur by image recognition algorithm, compare by desirable range of visibility and actual range of visibility overlap ratio, can effectively comprehensively judge chaufeur abnormal driving behavior judgement in conjunction with vehicle condition information and driver information.
Description of drawings
Fig. 1 is the block diagram of system of the present invention;
Fig. 2 is control logic figure of the present invention.
The specific embodiment
Fig. 1 is the block diagram of system of the present invention, among the present invention in the system, treater 1 receives the astern signal of the steering wheel angle signal from steering wheel corner sensor device 4, the speed signal of speed sensor implementations 5, the turn sign that turns to indicator signal generating means 6 and reversing indicator signal generating means 7, and can utilize above signal to judge current driving state and predict future a period of time running route of vehicle; Treater 1 receives the chaufeur head video information from video collector 2, and can determine the actual range of visibility of chaufeur; Treater 1 can be controlled annunciator 3 and report to the police.
As shown in Figure 2, system opens, abnormal behaviour monitoring in the beginning car, treater 1 is transferred signal from reversing indicator signal generating means 7, if confirm that vehicle is in the reversing state, then do not carry out the warning based on line-of-sight detection, if vehicle is non-reversing state, then system starts the abnormal behaviour method for supervising based on line-of-sight detection, and concrete steps are:
Obtain corner of vehicle steering wheel information and speed sensor implementations 5 by steering wheel angle sensor 4 and obtain car speed information and send signal to treater 1 and determine roadway footpath in following a period of time scope, thus determine with following a period of time scope in the roadway desirable range of visibility in the corresponding driver safety driving situation directly;
Simultaneously can or turn to 6 pairs of desirable range of visibility of indicator signal generating means to revise in conjunction with vehicle-mounted road ahead or pedestrian's recognition system; After desirable range of visibility is determined, because the situations such as sharply turning opposite with current line footpath route trend may appear in navigating mate, so need based on the turn sign that turns to indicator signal generating means 6 desirable range of visibility to be revised; Simultaneously and since desirable range of visibility only consider when the vehicle in front self-condition, also can revise desirable range of visibility such as with due regard to road, vehicle-mounted the place ahead, pedestrian factor in conjunction with vehicle natural environment of living in, thereby obtain more accurately desirable range of visibility;
Treater 1 receives chaufeur head video information, eye information by video collector 2, then determine the actual range of visibility of chaufeur by image recognition algorithm, if the sight line variation range is too small in the certain hour, then be judged as fatigue state, then fatigue warning is carried out in control warning 3; If the sight line variation range is normal in the certain hour, treater 1 compares the desirable range of visibility in the normal safe driving situation and the actual range of visibility of chaufeur, if overlap ratio is less than certain expected value, annunciator 3 is accepted treater 1 control, starts the sight line deviation warning.
Certainly, also can not carry out fatigue state and judge, after detecting actual range of visibility, directly compare judgement with desirable range of visibility, be confirmed whether the existence of the abnormal driving behaviors such as sight line departs from.
Claims (4)
1. based on the abnormal behaviour method for supervising of line-of-sight detection, by the collaborative following steps of finishing of treater (1), video collector (2), annunciator (3), steering wheel angle sensor (4) and speed sensor (5):
1) obtain corner of vehicle steering wheel information and speed sensor implementations (5) by steering wheel angle sensor (4) and obtain car speed information and send signal to treater (1) and determine roadway footpath in following a period of time scope, thus determine with following a period of time scope in the roadway desirable range of visibility in the corresponding driver safety driving situation directly;
2) video collector (2) receives chaufeur head, eye video information, and sends signal to actual range of visibility that treater (1) is determined chaufeur in the driving process;
3) treater (1) compares desirable range of visibility and the actual range of visibility of chaufeur in the safe driving situation of determining, if overlap ratio less than certain expected value, annunciator (3) is accepted treater (1) and is controlled, startup sight line deviation warning.
2. the abnormal behaviour method for supervising based on line-of-sight detection as claimed in claim 1, step 1) also comprises: after the desirable range of visibility of determining in the driver safety driving situation, by turning to indicator signal generating means (6) to obtain the intention that turns to of chaufeur, the process that aforementioned desirable range of visibility is revised.
3. based on the abnormal behaviour method for supervising of line-of-sight detection, may further comprise the steps:
1) obtain corner of vehicle steering wheel information and speed sensor implementations (5) by steering wheel angle sensor (4) and obtain car speed information and send signal to treater (1) and determine roadway footpath in following a period of time scope, thus determine with following a period of time scope in the roadway desirable range of visibility in the corresponding driver safety driving situation directly;
2) receive chaufeur head, eye video information by video collector (2), and send signal to actual range of visibility that treater (1) is determined chaufeur;
3) judge by treater (1) whether the actual sight line variation range of chaufeur is too small in the certain hour,
That treater (1) starts annunciator (3) and carries out fatigue warning;
No, treater (1) compares the desirable range of visibility in the normal safe driving situation and the actual range of visibility of chaufeur, if overlap ratio less than certain expected value, annunciator (3) is accepted treater (1) control, starts the sight line deviation warning.
4. the abnormal behaviour method for supervising based on line-of-sight detection as claimed in claim 3, step 1) also comprises: after the desirable range of visibility of determining in the driver safety driving situation, by turning to indicator signal generating means (6) to obtain the intention that turns to of chaufeur, the process that aforementioned desirable range of visibility is revised.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103725704A CN102963298A (en) | 2012-09-29 | 2012-09-29 | Abnormal behavior monitoring method based on sight detection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103725704A CN102963298A (en) | 2012-09-29 | 2012-09-29 | Abnormal behavior monitoring method based on sight detection |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102963298A true CN102963298A (en) | 2013-03-13 |
Family
ID=47793827
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012103725704A Pending CN102963298A (en) | 2012-09-29 | 2012-09-29 | Abnormal behavior monitoring method based on sight detection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102963298A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103770733A (en) * | 2014-01-15 | 2014-05-07 | 中国人民解放军国防科学技术大学 | Method and device for detecting safety driving states of driver |
| CN105835888A (en) * | 2016-04-07 | 2016-08-10 | 乐视控股（北京）有限公司 | Steering prompting method and device |
| CN106335512A (en) * | 2016-11-04 | 2017-01-18 | 大连文森特软件科技有限公司 | The driving assistance system based on AR-augmented reality and vehicle violation record query |
| CN106372568A (en) * | 2015-07-22 | 2017-02-01 | 罗伯特·博世有限公司 | Method and device for predicting a line of vision of a vehicle occupant |
| CN107273996A (en) * | 2016-04-05 | 2017-10-20 | 福特全球技术公司 | Method and apparatus for the driver assistance of prediction |
| CN107844734A (en) * | 2016-09-19 | 2018-03-27 | 杭州海康威视数字技术股份有限公司 | Monitoring objective determines method and device, video frequency monitoring method and device |
| CN108634926A (en) * | 2018-05-14 | 2018-10-12 | 杭州市余杭区第五人民医院 | Vision testing method, device, system based on VR technologies and storage medium |
| CN108777058A (en) * | 2018-05-18 | 2018-11-09 | Oppo广东移动通信有限公司 | Posture based reminding method, electronic device and computer readable storage medium |
| CN109344042A (en) * | 2018-08-22 | 2019-02-15 | 北京中测安华科技有限公司 | Recognition methods, device, equipment and the medium of abnormal operation behavior |
| CN109859438A (en) * | 2019-01-30 | 2019-06-07 | 北京津发科技股份有限公司 | Safe early warning method, system, vehicle and terminal device |
| CN110390285A (en) * | 2019-07-16 | 2019-10-29 | 广州小鹏汽车科技有限公司 | System for distraction of driver detection method, system and vehicle |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003327009A (en) * | 2002-05-14 | 2003-11-19 | Toyota Central Res & Dev Lab Inc | Attention attracting device |
| CN1458006A (en) * | 2003-07-02 | 2003-11-26 | 北京交通大学 | Method for detecting fatigue driving based on multiple characteristic fusion |
| US20070168128A1 (en) * | 2004-01-28 | 2007-07-19 | Setsuo Tokoro | Running support system for vehicle |
| CN101089906A (en) * | 2006-06-14 | 2007-12-19 | 吴玉沈 | Active vehicle driver fatigue driving alarm device and method |
| US20110169625A1 (en) * | 2010-01-14 | 2011-07-14 | Toyota Motor Engineering & Manufacturing North America, Inc. | Combining driver and environment sensing for vehicular safety systems |
-
2012
- 2012-09-29 CN CN2012103725704A patent/CN102963298A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003327009A (en) * | 2002-05-14 | 2003-11-19 | Toyota Central Res & Dev Lab Inc | Attention attracting device |
| CN1458006A (en) * | 2003-07-02 | 2003-11-26 | 北京交通大学 | Method for detecting fatigue driving based on multiple characteristic fusion |
| US20070168128A1 (en) * | 2004-01-28 | 2007-07-19 | Setsuo Tokoro | Running support system for vehicle |
| CN101089906A (en) * | 2006-06-14 | 2007-12-19 | 吴玉沈 | Active vehicle driver fatigue driving alarm device and method |
| US20110169625A1 (en) * | 2010-01-14 | 2011-07-14 | Toyota Motor Engineering & Manufacturing North America, Inc. | Combining driver and environment sensing for vehicular safety systems |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103770733B (en) * | 2014-01-15 | 2017-01-11 | 中国人民解放军国防科学技术大学 | Method and device for detecting safety driving states of driver |
| CN103770733A (en) * | 2014-01-15 | 2014-05-07 | 中国人民解放军国防科学技术大学 | Method and device for detecting safety driving states of driver |
| CN106372568A (en) * | 2015-07-22 | 2017-02-01 | 罗伯特·博世有限公司 | Method and device for predicting a line of vision of a vehicle occupant |
| CN106372568B (en) * | 2015-07-22 | 2021-06-29 | 罗伯特·博世有限公司 | Method and device for predicting the line of sight of a vehicle occupant |
| CN107273996A (en) * | 2016-04-05 | 2017-10-20 | 福特全球技术公司 | Method and apparatus for the driver assistance of prediction |
| CN105835888A (en) * | 2016-04-07 | 2016-08-10 | 乐视控股（北京）有限公司 | Steering prompting method and device |
| CN107844734B (en) * | 2016-09-19 | 2020-07-07 | 杭州海康威视数字技术股份有限公司 | Monitoring target determination method and device and video monitoring method and device |
| CN107844734A (en) * | 2016-09-19 | 2018-03-27 | 杭州海康威视数字技术股份有限公司 | Monitoring objective determines method and device, video frequency monitoring method and device |
| CN106335512A (en) * | 2016-11-04 | 2017-01-18 | 大连文森特软件科技有限公司 | The driving assistance system based on AR-augmented reality and vehicle violation record query |
| CN108634926A (en) * | 2018-05-14 | 2018-10-12 | 杭州市余杭区第五人民医院 | Vision testing method, device, system based on VR technologies and storage medium |
| CN108777058A (en) * | 2018-05-18 | 2018-11-09 | Oppo广东移动通信有限公司 | Posture based reminding method, electronic device and computer readable storage medium |
| CN109344042A (en) * | 2018-08-22 | 2019-02-15 | 北京中测安华科技有限公司 | Recognition methods, device, equipment and the medium of abnormal operation behavior |
| CN109344042B (en) * | 2018-08-22 | 2022-02-18 | 北京中测安华科技有限公司 | Abnormal operation behavior identification method, device, equipment and medium |
| CN109859438A (en) * | 2019-01-30 | 2019-06-07 | 北京津发科技股份有限公司 | Safe early warning method, system, vehicle and terminal device |
| CN110390285A (en) * | 2019-07-16 | 2019-10-29 | 广州小鹏汽车科技有限公司 | System for distraction of driver detection method, system and vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102963298A (en) | Abnormal behavior monitoring method based on sight detection | |
| US20220083056A1 (en) | Alerting predicted accidents between driverless cars | |
| US10296796B2 (en) | Video capturing device for predicting special driving situations | |
| CN107867283B (en) | Integrated FCW/ACC/AEB system based on prediction model and vehicle | |
| CN106652558B (en) | Vehicle-road cooperative intelligent traffic control system | |
| CN109308816B (en) | Method and device for determining road traffic risk and vehicle-mounted system | |
| US20170248949A1 (en) | Alerting predicted accidents between driverless cars | |
| US9315191B2 (en) | Driving assistance device | |
| WO2022007655A1 (en) | Automatic lane changing method and apparatus, and device and storage medium | |
| CN110155045A (en) | A kind of vehicle promptly accelerates Self-Protection Subsystem and its self-protection method | |
| US20120296539A1 (en) | Driver assistance system | |
| US20120303222A1 (en) | Driver assistance system | |
| CN103544844A (en) | Driver assistance method and system for avoiding violation of traffic lights | |
| CN103594002A (en) | Vehicle safety protection system | |
| CN104417561A (en) | Context-aware threat response arbitration | |
| US9323718B2 (en) | Method and device for operating a driver assistance system of a vehicle | |
| CN102991504A (en) | Device and method for determining and prewarning lane change safety of drivers | |
| CN108437988B (en) | Transverse control device and method for intelligent navigation system | |
| CN102910126A (en) | Method and system for safe lane change of auxiliary vehicle | |
| US9873429B1 (en) | Turned-wheel detection for yielding during low-speed lane changes | |
| CN106114502A (en) | A kind of intelligent automobile aid system | |
| CN106864437A (en) | A kind of emergency brake of vehicle system and its control method | |
| CN105644567A (en) | Driving assistant system based on advanced driver assistant system (ADAS) | |
| CN112026761A (en) | Automobile auxiliary driving method based on data sharing | |
| CN103192785A (en) | Whole monitoring system for three-dimensional space around vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C05 | Deemed withdrawal (patent law before 1993) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130313 |