CN208958147U - A kind of driving behavior monitor detection device - Google Patents
A kind of driving behavior monitor detection device Download PDFInfo
- Publication number
- CN208958147U CN208958147U CN201821097170.6U CN201821097170U CN208958147U CN 208958147 U CN208958147 U CN 208958147U CN 201821097170 U CN201821097170 U CN 201821097170U CN 208958147 U CN208958147 U CN 208958147U
- Authority
- CN
- China
- Prior art keywords
- module
- glasses
- pupil
- driving behavior
- carrier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
The utility model discloses a kind of driving behavior monitor detection devices, using the closed Glasses structure of integration, and black light-absorbing material is used in outer layer, effectively avoid light leakage and pupil of human due to the variation of pupil caused by vision attention itself, in glasses and face joint place using flexible silica gel material, it is bonded face with glasses, is equivalent to and directly fatigue is detected, improve fatigue detecting precision；Pupil is stimulated with rectangle area source, light source can be made to stimulate pupil uniform；Pupil is irradiated using infrared area source, the interference for overcoming infrared spotlight to acquire pupil image, keep pupil image more uniform, is not easy to be disturbed, convolution deep learning network analysis pupil movement video when long using three-dimensional, and objectively classification is carried out to driver task's suitability and is determined, deep understanding pupil movement state, realization detect end to end, improve Detection accuracy and driving behavior monitor detection efficiency, present apparatus structure is simple, convenient to use.
Description
Technical field
The utility model belongs to medical sanitary technology field, is related to a kind of driving behavior monitor detection device.
Background technique
With the fast development of transportation and the increase of vehicle population, how to reduce road traffic accident number, protects
Barrier traffic safety is one of the research hotspot of related scientific research personnel.According to statistics, the whole world is every year due to road traffic accident
Leading to death toll is more than 600,000, and causing direct economic loss is more than 1,000,000,000, and China is that road fatalities are higher
One of country.In all multiple depots of road traffic accident, Driver's Factors account for larger proportion, and fatigue driving is even more wherein most
Important reason." People's Republic of China Road Traffic Safety Law " Article 22 clear stipulaties: " vehicle driver ...
Over fatigue influences safe driving, must not operating motor vehicles." therefore, carry out driver fatigue inspection for fatigue driving problem
Survey technology correlative study, the driver fatigue detection device for researching and developing Portable practical have important theoretical value and positive reality
Meaning.
The U.S. and Australia are two countries that global driving fatigue research is earliest and research achievement is most, are proposed suitable
Three features that the fatigue detection method used for traffic administration department should have:
(1) testing result must have objectivity and reliability, i.e., do not influenced (the Xiang Weibi by measured's subjective desire
The characteristics of must having)；
(2) it operates and to carry simple and convenient, not examined environmental restrictions, detection time short；
(3) test method is easy to be received by subject, and any body wound directly or indirectly cannot be such as generated to subject
Evil is not contacted with subject to avoid the infection of possible disease.
Currently, being based on above 3 points, subjective detection and objective detection can be divided into the method that driver carries out fatigue detecting
Two major classes.Subjectivity detection is that the physiological reaction of third-party subjective assessment and driver is leaned on to detect, and the detection of evaluation property includes
Pearson came fatigue quantifies table, driver self record sheet, Stamford sleep scale table etc., and basic principle is by a certain related special
The measurement table of property parameter or driver judge oneself subjectivity；Detection method based on physiological driver's reaction includes splashette
Value detection, the detection of knee jerk function etc..Subjective detection method is easy to operate, but real-time is bad, the accuracy of measurement result
It is difficult to ensure, not energetic degree of fatigue relies primarily on objective measure so being rarely employed at this stage.
Objective measure is broadly divided into three categories: physiological driver's signal detection, Characteristics of drivers' behavior detection and vehicle
The detection of behavioural characteristic.Physiological driver's signal detection includes the detection of the signals such as electrocardio (ECG), brain electric (EEG), pulse, this
Method and tired degree of correlation highest, but mostly contact, carrying, inconvenient for operation, research real-time is poor；Driving behavior is special
Sign detection mainly has eye feature, head position, detection of mouth state etc., and typical method is PERCLOSE (percentage
Of eyelid closure over the pupil over time) method, such method and the tired degree of correlation are general, and pole
It is interfered vulnerable to eye illness (trachoma, xerophthalmia etc.)；Mainly the detection including Vehicle Speed, lane are inclined for the detection of vehicle behavior feature
From degree, steering wheel angle etc., the method is easy to operate, and real-time is good, but sensitivity is not high, and reaction that can not be objective and accurate is tired
Labor degree.
The outer research emphasis about fatigue driving detection of Current Domestic be concentrated mainly on based on Characteristics of drivers' behavior and
In the detection of vehicle behavior feature, development abroad is relatively fast.
In the 1970s, Walt doctor Wierwille University of Virginia begin one's study eye optical variable with it is tired
The relationship of labor, fatigue measurement (the physiological fatigue detection devices and being put forward for the first time
Measures) method is using PERCLOS as tired measurement index.In April, 1999, Highway Administration, the United States Federal, first
It proposes using PERCLOS as the feasible method of prediction automobile driver driving fatigue.By development, in American National in 2003
(NHTSA) the joint University of Pennsylvania, highway traffic safety management board and Ka Neijimeilong research institute develop including
PERCLOS eyelid is closed the driving fatigue detection of monitor, lane security tracking systems, sleep activity logger three subsystems
With alarm system.In addition, fatigue detecting system DDDS has also been developed, using Doppler radar and complicated signal processing method
The fatigue datas such as the dysphoric emotional activity of driver, frequency of wink and duration are obtained, judge whether driver is in
Knock the state of sleeping.Malaysian university research goes out a set of fatigue detecting system, and this system mainly loads onto sensor on the steering wheel,
The dynamics that driver holds steering wheel is detected, a computer is connected on sensor, record records and handles these information, utilizes
Driver holds the relationship between fatigue of dynamics and people of steering wheel, holds the dynamics of steering wheel and interior by detection driver
Portion supervision group likelihood ratio identifies the fatigue state of driver, and sounds an alarm.
The Driver Fatigue Detection in the 1960s, China begins one's study, although more late than external starting, just at present
Some achievements are still achieved for research level.2000, the stone heavily fortified point of Shanghai Communications University drove fatigue by objective method
The case where driving into and gone research, having studied using steering wheel is held when fatigue driving, the informations parameter such as pedal that foot is stepped on are studied
The relationship of fatigue and driving safety；Professor Wang Rongben of Jilin University is detected to judge by the mouth state to driver
The degree of fatigue of driver, using the opening size of mouth as the characteristic value for wanting to extract, composition characteristic vector, to design output
It shuts up, speak and yawns three kinds of different conditions；Research institute, Jiangsu University uses wave on the basis of studying PERCLOS algorithm
The infrared image instrument and difference image instrument of a length of 850/950mm is detected as image acquisition device, using infrared light supply at
Interference as eliminating environment light source, the accuracy of this measurement are improved；The Wu Qun of Zhejiang University using electrocardiogram and
Eye state carries out surveillant's fatigue detecting, and this method obtains electrocardiogram of the human body under different conditions by experiment, then passes through
Core pivot method carries out classification analysis to the sample of acquisition, then utilizes algorithm Support Vector data description method (Support
Vector Data Description, SVDD) electrocardiogram (ECG) data classifies, and finally PERCLOSE principle comprehensive descision is combined to drive
The fatigue state for the person of sailing is detected, but such method and the tired degree of correlation are general, dry vulnerable to eye illness (trachoma, xerophthalmia etc.)
It disturbs；There are also many for suchlike research.Existing detection device and detection method carry out fatigue detecting by tired presentation,
Vulnerable to interference, accuracy in detection is low.
Utility model content
The purpose of this utility model is to provide a kind of driving behavior monitor detection devices, with overcome the deficiencies in the prior art.
In order to achieve the above objectives, the utility model adopts the following technical solution:
A kind of driving behavior monitor detection device, including glasses carrier, the mirror position of glasses carrier are equipped with area source and red
Outer video camera, glasses carrier front end are equipped with extinction mask, and glasses carrier front end is equipped with the nose clip suitable for human eye portion, in use, energy
Human eye is enough set to be completely in dark state, two side stand of glasses carrier is hinged with glasses stress bracket, and glasses carrier two sides are also set
There is broadcast earphone, is used for voice prompting；It is equipped with battery module in glasses stress bracket, is additionally provided with main control processor in glasses carrier
And total power button and starting testing button for switch control；Glasses carrier is equipped with display module.
Further, thermal camera there are two being set on glasses carrier.
Further, main control processor includes processing module and SPI module, USB module, electricity in processing module connection
Source module and I/O interface module, wherein SPI module is used for data transmission and control to voice module；USB module for pair
The data transmission and control of thermal camera；Power module is used for the charge control of battery module and to entire main control processor
Power supply control；I/O interface module is connected to modular surface light source, button and display module, processing module be used for SPI module with
USB module receives information and carries out data processing and shown by display module.
Compared with prior art, the utility model has technical effect beneficial below:
A kind of driving behavior monitor detection device of the utility model using the closed Glasses structure of integration, and is adopted in outer layer
With black light-absorbing material, light leakage and pupil of human can be effectively avoided to change due to pupil caused by vision attention itself, in eye
Mirror and face joint place are bonded face with glasses, are equivalent to and directly detect to fatigue, improved using flexible silica gel material
Fatigue detecting precision；Pupil is stimulated using rectangle area source, light source can be made to stimulate pupil uniform；The inspection of this fatigue
It surveys glasses to be irradiated pupil using infrared area source, the interference for overcoming infrared spotlight to acquire pupil image makes pupil
It is imaged more uniform；It is not easy to be disturbed, accuracy in detection is high, and present apparatus structure is simple, convenient to use.
Further, thermal camera there are two setting on glasses carrier, keeps pupil image more uniform, adapts to double vision difference
Crowd.
Detailed description of the invention
FIG. 1 is a schematic structural view of the utility model.
Fig. 2 is the utility model axonometric drawing.
Fig. 3 is detection algorithm model structure schematic diagram.
Fig. 4 is master control processor structure schematic diagram.
Fig. 5 is space-time convolution kernel structural schematic diagram.
Specific embodiment
The utility model is described in further detail with reference to the accompanying drawing:
As shown in Figures 1 to 5, a kind of driving behavior monitor detection device, including glasses carrier 1, the mirror surface position of glasses carrier 1
Area source 2 and thermal camera 3 are installed, 1 front end of glasses carrier is equipped with extinction mask 11, and 1 front end of glasses carrier, which is equipped with, to be suitable for
The nose clip in human eye portion, in use, human eye can be made to be completely in dark state, in glasses and face joint place using flexible silica gel
Material is bonded face with glasses, and 1 liang of side stand of glasses carrier is hinged with glasses stress bracket 4, and 1 two sides of glasses carrier are also set
There is broadcast earphone 5, is used for voice prompting；It is equipped with battery module 8 in glasses stress bracket 4, is additionally provided at master control in glasses carrier 1
Manage device 9 and total power button 6 and starting testing button 7 for switch control；Glasses carrier 1 is equipped with display module 10；
Main control processor 9 include processing module and in processing module connection SPI module, USB module, power module and
I/O interface module, wherein SPI module is used for data transmission and control to voice module；USB module is used for infrared photography
The data transmission and control of machine；Power module is used for the charge control of battery module and to entire main control processor for automatically controlled
System；I/O interface module is connected to modular surface light source, button and display module, and processing module is used for SPI module and USB module
Information is received to carry out data processing and show by display module.
Specifically, setting on glasses carrier 1, there are two thermal cameras 3, keep pupil image more uniform, adapt to double vision difference
Crowd；
A kind of driving behavior monitor detection method, comprising the following steps:
Step 1), driver wear driving behavior monitor detection device, so that driver eye is completely in glasses load intracorporal
In the space of darkroom；
Through-hole aperture is acquired by thermal camera 3 under step 2), dark state and is sent to main control processor 9, then is led to
It crosses area source 2 and generates light stimulation, while through-hole aperture is acquired by thermal camera 3 and is sent to main control processor 9；
Step 3), main control processor 9 use the fatigue detecting model analysis pupil movement data based on space-time convolution, pass through
Display module 10 shows current driver's task suitability degree.
Specifically, driver wears driver task's driving aptitude test device in step 1), glasses stress bracket 4 is clasped
Hindbrain is easy to support, by under the opposite darkroom of pupil processing, opens system power supply by total power button 6, is played and grasped by broadcast earphone
Work and points for attention voice；
In step 2), infrared camera scan pupil image is controlled by main control processor 9, is starting test in the setting time
Afterwards, area source 2 is controlled by main control processor 9 and generates light stimulation；
Specifically, starting the test setting time in step 2) is 1s；
In step 3), using the fatigue detecting model analysis pupil movement data based on space-time convolution specific steps such as
Under:
Step 3.1), using the Brox light stream estimation technique, calculate the light stream amplitude of before and after frames, to keep former frame number constant, first
Frame uses the light stream estimated value of the second frame.
Step 3.2) uses sliding selecting video segment to entire video frame, and setting video totalframes is N, and sliding window is big
Small is D, and step-length is always S, then slides the video clip number n=N-S+D of selection；
Step 3.3) is inputted video clip number obtained in step 3.2) as different channels, then has n input
Channel；
Step 3.4) carries out space-time convolutional calculation to the n-channel video data in step 3.3).
Step 3.4) specifically calculates as follows:
Step 3.4.1), use space-time convolution kernel as shown in figure 5, spatial resolution is h × w, temporal resolution d；
Step 3.4.2), convolution when using filling mode carry out, guarantee output with input size it is identical；
Step 3.4.3), be repeated 5 times convolution, respectively conv1, conv2, conv3, conv4, conv5, each convolutional layer
Fn1, Fn2, Fn3, Fn4, Fn5 is respectively adopted, and (general value is Fn1=64, Fn2=128, Fn3=256, Fn4=256, Fn5
=256) a filter；It is connected using maximum pond layer with ReLU layers between each convolutional layer.Maximum pond filter size
For Pw × Ph × Pd, (under normal circumstances, first layer uses Pw=2, Ph=2, Pd=1, and remainder layer uses Pw=2, Ph=2, Pd
=2).
Step 3.5), to the finally obtained convolution results of step 3.4), be connected with three layers of full articulamentum (fc6, fc7, fc8)
It connects, wherein the number of nodes of fc6 is set as p6, and the number of nodes of fc7 is set as p7 (p6=p7=2048 under normal circumstances), fc node
Number is set as final classification number k；
To the driver under different driving task suitable degrees, using utility model device, under acquisition pupil is stimulated
The video image of movement (acquisition duration T seconds every time samples frame per second F frame/second, totalframes N=T × F frame).K driving suitability degree
The video data number for including in classification is greater than 2000, and total video data amount check is greater than 20000.
Embodiment
Suitability degree will be driven and be built into k degree, FkIt indicates to drive suitability degree, t indicates continuous driving time.To construct 8
The suitability degree of a degree, step-length are each suitability degree classification (F as follows for 0.5 hour0To F8Driving suitability degree successively
Reduce):
F0: t < 0.5 hour
F1: 0.5 hour≤t < 1 hour
F2: 1 hour≤t < 1.5 hour
F3: 1.5 hours≤t < 2 hour
F4: 2 hours≤t < 2.5 hour
F5: 2.5 hours≤t < 3 hour
F6: 3 hours≤t < 3.5 hour
F7: 3.5 hours≤t < 4 hour
F8: 4 hours≤t.
In order to avoid light leakage and pupil of human since pupil caused by vision attention itself changes, this fatigue detecting glasses are adopted
With the closed Glasses structure of integration, and black light-absorbing material is used in outer layer, uses flexible silicon in glasses and face joint place
Glue material is bonded face with glasses, is equivalent to and directly detects to fatigue, improves fatigue detecting precision；In order to overcome
Point light source stimulates non-uniform problem to pupil, this fatigue detecting glasses stimulate pupil using rectangle area source；In order to
The interference for overcoming infrared spotlight to acquire pupil image, this fatigue detecting glasses shine pupil using infrared area source
It penetrates, keeps pupil image more uniform；In order to adapt to double vision difference crowd, this fatigue detecting glasses are designed using dual camera；For
Make to detect more acurrate, this fatigue detecting glasses analyze pupil light stimulus movement using RNN neural network, improve
Detection accuracy.It uses glasses for carrier, using the closed Glasses structure of integration, and uses in glasses and face joint place soft
Property silica gel material, the method for being bonded face with glasses can make pupil be in darkroom and the environment measuring without lime light, be right
Pupil movement detection provides good detection environment；Pupil is stimulated using area source, pupil can be made to obtain sufficiently
Stimulation.
Claims (4)
1. a kind of driving behavior monitor detection device, which is characterized in that including glasses carrier (1), the mirror position of glasses carrier (1)
Equipped with area source (2) and thermal camera (3), glasses carrier (1) front end is equipped with extinction mask (11), glasses carrier (1) front end
Equipped with the nose clip for being suitable for human eye portion, (1) two side stand of glasses carrier is hinged with glasses stress bracket (4), glasses carrier (1) two sides
It is additionally provided with broadcast earphone (5), is used for voice prompting；Battery module (8) are equipped in glasses stress bracket (4), in glasses carrier (1)
It is additionally provided with main control processor (9) and total power button (6) and starting testing button (7) for switch control；Glasses carrier
(1) display module (10) are equipped with.
2. a kind of driving behavior monitor detection device according to claim 1, which is characterized in that glasses carrier (1) is equipped with
Two thermal cameras (3).
3. a kind of driving behavior monitor detection device according to claim 1, which is characterized in that main control processor (9) includes
Processing module and SPI module, USB module, power module and the I/O interface module connected in processing module, wherein SPI mould
Block is used for data transmission and control to voice module；USB module is used for data transmission and control to thermal camera；Power supply
Module is used for the charge control to battery module and the power supply control to entire main control processor；I/O interface module is connected to face
Light source module, button and display module, processing module, which is used to receive information to SPI module and USB module, carries out data processing simultaneously
It is shown by display module.
4. a kind of driving behavior monitor detection device according to claim 1, which is characterized in that main control processor (9) is used for
Control infrared camera scan pupil image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201821097170.6U CN208958147U (en) | 2018-07-11 | 2018-07-11 | A kind of driving behavior monitor detection device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201821097170.6U CN208958147U (en) | 2018-07-11 | 2018-07-11 | A kind of driving behavior monitor detection device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN208958147U true CN208958147U (en) | 2019-06-11 |
Family
ID=66748576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201821097170.6U Active CN208958147U (en) | 2018-07-11 | 2018-07-11 | A kind of driving behavior monitor detection device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN208958147U (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108814630A (en) * | 2018-07-11 | 2018-11-16 | 长安大学 | A kind of driving behavior monitor detection device and method |
| CN110275307A (en) * | 2019-06-25 | 2019-09-24 | 深圳市华臣云图科技有限公司 | A kind of VR glasses system with alleviation asthenopia function |
-
2018
- 2018-07-11 CN CN201821097170.6U patent/CN208958147U/en active Active
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108814630A (en) * | 2018-07-11 | 2018-11-16 | 长安大学 | A kind of driving behavior monitor detection device and method |
| CN110275307A (en) * | 2019-06-25 | 2019-09-24 | 深圳市华臣云图科技有限公司 | A kind of VR glasses system with alleviation asthenopia function |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113743471B (en) | Driving evaluation method and system | |
| WO2020029444A1 (en) | Method and system for detecting attention of driver while driving | |
| CN101593425B (en) | Machine vision based fatigue driving monitoring method and system | |
| CN103714660B (en) | System for achieving fatigue driving judgment on basis of image processing and fusion between heart rate characteristic and expression characteristic | |
| WO2005050156A3 (en) | Measurement system and method for use in determining the patient's condition | |
| CN108464839A (en) | A kind of vehicle-mounted fatigue monitoring and early warning of driving system based on machine learning | |
| CN103714659B (en) | Fatigue driving identification system based on double-spectrum fusion | |
| CN103824420A (en) | Fatigue driving identification system based on heart rate variability non-contact measuring | |
| CN208958147U (en) | A kind of driving behavior monitor detection device | |
| CN109770925A (en) | A kind of fatigue detection method based on depth time-space network | |
| CN202568277U (en) | Fatigue detection device | |
| CN205054771U (en) | Domestic medical detector of intelligence based on massage armchair | |
| Qi et al. | Non-contact driver cardiac physiological monitoring using video data | |
| CN204890010U (en) | Driver system of testing and assessing | |
| CN112631112A (en) | Multifunctional health monitoring smart watch and control method thereof | |
| CN111904441A (en) | Emotion analysis system and method based on multi-modal characteristics | |
| CN109624984A (en) | A kind of mobile Internet intelligent vehicle-mounted system | |
| CN202604845U (en) | Pupillometric lie detector based on platform TMS320DM642 | |
| Xu et al. | Ivrr-PPG: An illumination variation robust remote-PPG algorithm for monitoring heart rate of drivers | |
| CN109875583B (en) | Fatigue driving detection system and method based on AR technology | |
| CN107307870A (en) | A kind of driving condition brain monitoring system and method based near infrared spectrum | |
| CN108814630A (en) | A kind of driving behavior monitor detection device and method | |
| CN209391912U (en) | A kind of multispectral skin detection instrument | |
| CN202727986U (en) | Physiological signal acquisition based fatigue driving detection and control system | |
| CN107730834A (en) | A kind of antifatigue Intelligent worn device being combined based on attitude detection with image recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |