CN109549625A - Acquire the rearview mirror of driver eye movement data and the fatigue monitoring system using the rearview mirror - Google Patents
Acquire the rearview mirror of driver eye movement data and the fatigue monitoring system using the rearview mirror Download PDFInfo
- Publication number
- CN109549625A CN109549625A CN201811347398.0A CN201811347398A CN109549625A CN 109549625 A CN109549625 A CN 109549625A CN 201811347398 A CN201811347398 A CN 201811347398A CN 109549625 A CN109549625 A CN 109549625A
- Authority
- CN
- China
- Prior art keywords
- module
- driver
- mirror
- optical sensor
- inside rear
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004424 eye movement Effects 0.000 title claims abstract description 38
- 238000012544 monitoring process Methods 0.000 title claims abstract description 12
- 238000004891 communication Methods 0.000 claims abstract description 25
- 230000003287 optical effect Effects 0.000 claims abstract description 24
- 210000001508 eye Anatomy 0.000 claims abstract description 21
- 210000001747 pupil Anatomy 0.000 claims abstract description 17
- 239000004973 liquid crystal related substance Substances 0.000 claims abstract description 6
- 238000009434 installation Methods 0.000 claims abstract description 4
- 206010016256 fatigue Diseases 0.000 claims description 28
- 238000000034 method Methods 0.000 claims description 6
- 208000016255 tiredness Diseases 0.000 claims description 4
- 230000003867 tiredness Effects 0.000 claims description 4
- 239000000284 extract Substances 0.000 claims description 3
- 238000001514 detection method Methods 0.000 description 6
- 230000005611 electricity Effects 0.000 description 3
- 206010039203 Road traffic accident Diseases 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 235000019506 cigar Nutrition 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000000465 moulding Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/11—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils
- A61B3/112—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils for measuring diameter of pupils
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
- A61B5/1103—Detecting muscular movement of the eye, e.g. eyelid movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Physiology (AREA)
- Ophthalmology & Optometry (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Signal Processing (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Acquire the rearview mirror of driver eye movement data and the fatigue monitoring system using the rearview mirror, including integrated installation interior inside rear-view mirrors infrared optical sensor, electronic system and output module, the infrared optical sensor is mounted on inside rear-view mirror mirror surface behind, and the inside rear-view mirror mirror surface uses single-surface mirror；Infrared optical sensor is for acquiring driver's eyes number of winks, wink time, pupil diameter, the X axis coordinate of blinkpunkt and Y axis coordinate data；Electronic system includes eye movements system control module, electronic operation module, communication module and power module, can be extracted to driver's pupil of both eyes centre coordinate, acquires eye movement data and is recorded, calculated, exported；Output module includes liquid crystal display, buzzer, for reminding driver, is capable of the fatigue conditions of real-time monitoring driver and reminds, and it is convenient, practical to have the characteristics that.
Description
Technical field
The present invention relates to automobile rearview mirror field, in particular to a kind of rearview mirror for acquiring driver eye movement data and utilization
The fatigue monitoring system of the rearview mirror.
Background technique
In particularly serious traffic accident, 40% or more is accounted for as caused by fatigue driving, fatigue driving, which has become, makes
One of the main reason at particularly serious traffic accident.Existing rearview mirror is other than basic back vision function, other classes on the market
The rearview mirror of type is not directed to the function that driver fatigue state carries out detection judgement.Existing human body brainfag detection means has
The detection methods such as brain electricity, electrocardio, eye movement.Although these detection means have been relatively mature, but every kind of detection method is both needed to spy
Locking equipment and skilled addressee detect tested personnel, cannot achieve in driver in driver's cabin it is automatic, independently into
Row fatigue detecting.
Summary of the invention
In order to overcome the above-mentioned deficiencies of the prior art, it is an object of the invention to propose a kind of acquisition driver eye movement data
Rearview mirror and using the rearview mirror fatigue monitoring system, be capable of the fatigue conditions of real-time monitoring driver and remind,
It is convenient, practical to have the characteristics that.
To achieve the goals above, the technical solution adopted by the present invention is that:
The rearview mirror for acquiring driver eye movement data, the infrared optics including integrated installation in interior inside rear-view mirrors sense
Device, electronic system and output module, the infrared optical sensor are mounted on inside rear-view mirror mirror surface behind, the inside rear-view mirror mirror
Face uses single-surface mirror.
Using the fatigue monitoring system of the rearview mirror, including
Infrared optical sensor: for acquire driver's eyes number of winks, wink time, pupil diameter, blinkpunkt X
Axial coordinate and Y axis coordinate data；
Electronic system: including eye movements system control module, electronic operation module, communication module and power module；
Eye movements system control module: being connected with infrared optical sensor and electronic operation module respectively, eye movements system control
Molding block extracts driver's pupil of both eyes centre coordinate by infrared optical sensor, controls the acquisition of eye movement data
Journey；
Electronic operation module: collected eye movement data recorded, calculation processing, and according to Tiredness model to driver
Fatigue conditions determined；
Communication module: operation result is exported to output module；
Power module: power supply needed for infrared optical sensor, other each modules of electronic system and output module is carried out
Management, configuration；
Output module: including liquid crystal display, buzzer, for reminding driver, output module respectively with electronic system
Communication module be connected with power module.
The inside rear-view mirror further includes cell phone client, and cell phone client interacts communication with communication module and connect cloud
Server is held, system record, the driving fatigue situation determined are saved into local and cloud server.
The communication module includes that communication bluetooth module or WLAN module can be interacted with cell phone client.
Since eye movement data acquisition device is integrated in inside inside rear-view mirror by the present invention, so being examined without extras
It surveys；Using single-surface mirror as inside rear-view mirror mirror surface, so operating no shadow to the normal backsight of driver in eye movement detection process
It rings；Eye movement data acquisition device is integrated in inside inside rear-view mirror, so being detected without extras；Acquisition can be passed through
Driver's eye movements parameter such as the eye closing number of eyes, pupil diameter when driving, determines driver by system-computed
Fatigue conditions, driver in a state of fatigue is prompted by output module, is waken up, by the tired of entire driving conditions
Labor situation is recorded, and it is convenient, practical to have the characteristics that.
Further, the present invention includes cell phone client and cloud server, thus driving data can be managed and
Long-range monitoring.
Further, the communication module of electronic system of the invention uses bluetooth 4.0 technology, and data are uploaded to driver
Mobile phone in, with mobile phone carry out data communication.
Detailed description of the invention
Fig. 1 is the principle of the present invention block diagram.
Specific embodiment
The present invention is described in further detail below in conjunction with the accompanying drawings.
Referring to Fig. 1, the inside rear-view mirror of driver eye movement data is acquired, including infrared optical sensor 1, electronic system 2, defeated
Module 3 out, wherein infrared optical sensor 1, electronic system 2 and 3 integrated installation of output module are in interior inside rear-view mirrors, infrared light
After sensor 1 is mounted on inside rear-view mirror single-surface mirror, the capable of emitting infrared ray of infrared optical sensor 1 is through single-surface mirror to eyes spy
Reference breath is acquired, and eyes can only see the external image of single-surface mirror reflection, can not see the inside rear-view mirror inside single-surface mirror
Structure.Infrared optical sensor 1 is connected with the eye movements system control module 21 of electronic system 2.
Using the fatigue monitoring system of the inside rear-view mirror, including electronic system 2, electronic system 2 and infrared optical sensor
1, output module 3 is connected, and electronic system 2 includes eye movements system control module 21, electronic operation module 22, communication module 23 and electricity
Source module 24.Wherein eye movements system control module 21 is connected with infrared optical sensor 1 and electronic operation module 22 respectively, passes through
Infrared optical sensor 1 extracts driver's pupil of both eyes centre coordinate, and controls the collection process of eye movement data, and will
Acquisition information is sent to electronic operation module 22.
Eye movements system control module uses model Tobii Pro Nano equipment, the tracking of corneal reflection formula, and eyes are tracked,
Dark pupil and bright pupil combine, Method for Single Sensor System, sample rate 60Hz, 0.10 ° of RMS of accuracy, and head moves range: wide × high: 35cm ×
30cm (13.78 " × 11.81 ")@65cm, it can be ensured that at least one eye eyeball is tracked to.
(1) the pupil diameter coefficient of variation
In formula:
CV--- the pupil diameter coefficient of variation；
The standard deviation of σ --- pupil diameter；
--- pupil diameter mean value (mm).
(2) wink time mean value
In formula:
Tb--- wink time mean value (s)；
Ta--- total wink time (s)；
N --- number of winks.
(3) eye closing percentage
In formula:
ηb--- eye closing percentage；
Ta--- total closed-eye time (s)；
to--- time window (s).
Function mode: after eye movements system control module collects data, electronic operation module is calculated by formula is driven
The person's of sailing pupil diameter coefficient of variation, wink time mean value and eye closing percent values variation tendency are driven by variation tendency judgement
The person's of sailing fatigue conditions.
Electronic operation module 22 is connected with eye movements system control module 21 and communication module 23 respectively, electronic operation module 22
For being recorded, being handled by collected eyes characteristic information, the eye movements such as the pupil diameter coefficient of variation, eye closing percentage are obtained
Data calculate the fatigue conditions current to driver according to Tiredness model and determine, output determines result.
Communication module 23 is connected with output module 3, and fatigue is determined result to output module 3 and mobile phone visitor by communication module 23
Family end 4 is exported.
Power module 24 respectively with infrared optical sensor 1, eye movements system control module 21, electronic operation module 22, logical
News module 23 is connected with output module 3, and power module 24 is signal infrared optical sensor 1, eye movements system control module 21, electricity
Sub- computing module 22, communication module 23 and output module 3 provide electric energy, and power module 24 is powered using vehicle interior cigar lighter.
Output module 3 is connected with electronic system 2, is communicated with communication module 23.Output module 3 includes liquid crystal display
31 and buzzer 32.Liquid crystal display 31 to inside rear-view mirror for being operated and being shown that driver fatigue state determines knot
Fruit, buzzer 32 are used to carry out auditory tone cues and wake-up to driver in a state of fatigue.
Cell phone client 4 is communicated with communication module 23, and system record, the driving fatigue situation determined are saved to this
In ground and cloud server 5.
Referring to attached drawing, the working principle of the invention is:
Infrared optical sensor 1 by transmitting infrared ray, driver's eyes characteristic information is acquired, collection process by
Eye movements system control module 21 is controlled.Collected eyes characteristic information is recorded, is handled by electronic operation module 22
The eye movement datas such as the pupil diameter coefficient of variation, eye closing percentage are obtained, calculated according to Tiredness model and judge driver fatigue shape
State.Fatigue state is exported by communication module 23 to output module 3 and cell phone client 4.Output module 3 receives judgement result
Visual alerts are carried out by liquid crystal display 31 afterwards, audible prompts are carried out to driver by buzzer 32.Driver passes through hand
Machine client 4 checks that driving fatigue data, data can be reserved in terminal local and cloud server 5.
Claims (4)
1. acquiring the rearview mirror of driver eye movement data, which is characterized in that including integrated installation in the infrared of interior inside rear-view mirrors
Optical sensor (1), electronic system (2) and output module (3), the infrared optical sensor (1) are mounted on inside rear-view mirror mirror
Behind, the inside rear-view mirror mirror surface uses single-surface mirror in face.
2. utilizing the fatigue monitoring system of the rearview mirror, which is characterized in that including
Infrared optical sensor (1): for acquire driver's eyes number of winks, wink time, pupil diameter, blinkpunkt X
Axial coordinate and Y axis coordinate data；
Electronic system (2): including eye movements system control module (21), electronic operation module (22), communication module (23) and power supply
Module (24)；
Eye movements system control module (21): being connected with infrared optical sensor (1) and electronic operation module (22) respectively, eye movement
System control module (21) extracts driver's pupil of both eyes centre coordinate by infrared optical sensor (1), controls eye
The collection process of dynamic data；
Electronic operation module (22): collected eye movement data recorded, calculation processing, and according to Tiredness model to driver
Fatigue conditions determined；
Communication module (23): operation result is exported to output module (3)；
Power module (24): to needed for infrared optical sensor (1), other each modules of electronic system (2) and output module (3)
Power supply is managed, configures；
Output module (3): including liquid crystal display (31), buzzer (32), for reminding driver, output module (3) is respectively
It is connected with the communication module (23) of electronic system and power module (24).
3. the inside rear-view mirror of acquisition driver eye movement data according to claim 2 and the fatigue prison using the inside rear-view mirror
Examining system, which is characterized in that the inside rear-view mirror further includes cell phone client (4), cell phone client (4) and communication module (23)
It interacts communication and connects cloud server (5), system record, the driving fatigue situation determined are saved to local and cloud
In server (5).
4. the rearview mirror of acquisition driver eye movement data according to claim 2 and the fatigue monitoring using the inside rear-view mirror
System, which is characterized in that the communication module (23) include can be interacted with cell phone client (4) communication bluetooth module or
WLAN module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811347398.0A CN109549625A (en) | 2018-11-13 | 2018-11-13 | Acquire the rearview mirror of driver eye movement data and the fatigue monitoring system using the rearview mirror |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811347398.0A CN109549625A (en) | 2018-11-13 | 2018-11-13 | Acquire the rearview mirror of driver eye movement data and the fatigue monitoring system using the rearview mirror |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109549625A true CN109549625A (en) | 2019-04-02 |
Family
ID=65866108
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811347398.0A Pending CN109549625A (en) | 2018-11-13 | 2018-11-13 | Acquire the rearview mirror of driver eye movement data and the fatigue monitoring system using the rearview mirror |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109549625A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102510480A (en) * | 2011-11-04 | 2012-06-20 | 大连海事大学 | Automatic calibrating and tracking system of driver sight line |
| CN103318023A (en) * | 2013-06-21 | 2013-09-25 | 同济大学 | Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device |
| CN203651621U (en) * | 2013-12-31 | 2014-06-18 | 北京兴科迪科技有限公司 | Inner rearview mirror with fatigue driving prompting device and vehicle with the inner rearview mirror |
| CN104590130A (en) * | 2015-01-06 | 2015-05-06 | 上海交通大学 | Rearview mirror self-adaptive adjustment method based on image identification |
| CN104757981A (en) * | 2015-03-16 | 2015-07-08 | 于莹光 | Method and device for high-sensitively receiving and transmitting integrated infrared detection of driver's fatigue |
| CN205836672U (en) * | 2016-07-21 | 2016-12-28 | 上海仰笑信息科技有限公司 | A kind of automobile rearview mirror |
| CN106447828A (en) * | 2016-10-10 | 2017-02-22 | 深圳市驰勇科技有限公司 | Automobile data recorder with iris recognition function |
| CN106548600A (en) * | 2016-12-06 | 2017-03-29 | 张家港全智电子科技有限公司 | Real-time pupil tracing system and fatigue state monitoring method |
| CN107137097A (en) * | 2017-06-28 | 2017-09-08 | 李婷 | Packaged type fatigue driving monitor |
| CN207972581U (en) * | 2017-11-02 | 2018-10-16 | 山东科技大学 | A kind of room mirror with fatigue driving monitoring function |
-
2018
- 2018-11-13 CN CN201811347398.0A patent/CN109549625A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102510480A (en) * | 2011-11-04 | 2012-06-20 | 大连海事大学 | Automatic calibrating and tracking system of driver sight line |
| CN103318023A (en) * | 2013-06-21 | 2013-09-25 | 同济大学 | Vehicle-mounted real-time intelligent fatigue monitoring and auxiliary device |
| CN203651621U (en) * | 2013-12-31 | 2014-06-18 | 北京兴科迪科技有限公司 | Inner rearview mirror with fatigue driving prompting device and vehicle with the inner rearview mirror |
| CN104590130A (en) * | 2015-01-06 | 2015-05-06 | 上海交通大学 | Rearview mirror self-adaptive adjustment method based on image identification |
| CN104757981A (en) * | 2015-03-16 | 2015-07-08 | 于莹光 | Method and device for high-sensitively receiving and transmitting integrated infrared detection of driver's fatigue |
| CN205836672U (en) * | 2016-07-21 | 2016-12-28 | 上海仰笑信息科技有限公司 | A kind of automobile rearview mirror |
| CN106447828A (en) * | 2016-10-10 | 2017-02-22 | 深圳市驰勇科技有限公司 | Automobile data recorder with iris recognition function |
| CN106548600A (en) * | 2016-12-06 | 2017-03-29 | 张家港全智电子科技有限公司 | Real-time pupil tracing system and fatigue state monitoring method |
| CN107137097A (en) * | 2017-06-28 | 2017-09-08 | 李婷 | Packaged type fatigue driving monitor |
| CN207972581U (en) * | 2017-11-02 | 2018-10-16 | 山东科技大学 | A kind of room mirror with fatigue driving monitoring function |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101574260B (en) | Vehicle-mounted fatigue early warning device and method thereof | |
| CN205158585U (en) | Prevention driver fatigue's smart machine and system | |
| CN105336105A (en) | Method, intelligent device and system for preventing fatigue driving | |
| CN205836672U (en) | A kind of automobile rearview mirror | |
| CN100462046C (en) | Online early warning system and method of weariness working | |
| CN106781284A (en) | Trainman's driver fatigue monitor system based on Multi-information acquisition | |
| CN104146722A (en) | Driving fatigue detecting and grading early warning device and method based on head signals | |
| CN109717853A (en) | Vehicle carried driving person's fatigue detecting system based on raspberry pie | |
| CN109190600A (en) | A kind of driver's monitoring system of view-based access control model sensor | |
| CN103198618A (en) | Mobile phone capable of preventing fatigue driving and warning method | |
| CN105006105A (en) | Eye state identification device and eye state identification method based on infrared detection | |
| CN106205052A (en) | A kind of driving recording method for early warning | |
| CN104269027B (en) | The fatigue driving detection device combined based on video and sensing | |
| CN110322132A (en) | A kind of personnel's fatigue management-control method and system based on management platform | |
| CN109953763A (en) | A kind of vehicle carried driving behavioral value early warning system and method based on deep learning | |
| CN107404570A (en) | A kind of method and system for improving travel safety | |
| CN106157537A (en) | Anti-fatigue-driving system | |
| CN107648719A (en) | The eye wearable system stimulated based on fatigue detecting with awakening | |
| CN109866774A (en) | System and method is monitored based on Face datection and the driver fatigue state of authentication | |
| CN202624069U (en) | Automobile inner rear-view mirror with fatigue driving warning system | |
| CN107933461A (en) | In-car identification fusing device and method based on single camera | |
| CN107170190B (en) | A kind of dangerous driving warning system | |
| CN209454644U (en) | A kind of rearview mirror acquiring driver eye movement data and the fatigue monitoring system using the rearview mirror | |
| CN108492528A (en) | A kind of real-time driving fatigue monitoring system and vehicle | |
| CN109549625A (en) | Acquire the rearview mirror of driver eye movement data and the fatigue monitoring system using the rearview mirror |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190402 |