KR101681938B1 - Apparatus for preventing drowsy driving - Google Patents
Apparatus for preventing drowsy driving Download PDFInfo
- Publication number
- KR101681938B1 KR101681938B1 KR1020150156617A KR20150156617A KR101681938B1 KR 101681938 B1 KR101681938 B1 KR 101681938B1 KR 1020150156617 A KR1020150156617 A KR 1020150156617A KR 20150156617 A KR20150156617 A KR 20150156617A KR 101681938 B1 KR101681938 B1 KR 101681938B1
- Authority
- KR
- South Korea
- Prior art keywords
- image
- driver
- infrared
- region
- prism lens
- Prior art date
Links
- 238000005286 illumination Methods 0.000 claims abstract description 31
- 206010041349 Somnolence Diseases 0.000 claims abstract description 26
- 230000003287 optical effect Effects 0.000 claims abstract description 23
- 230000007935 neutral effect Effects 0.000 claims abstract description 15
- 230000003667 anti-reflective effect Effects 0.000 claims abstract description 6
- 230000000903 blocking effect Effects 0.000 claims abstract description 3
- 230000002265 prevention Effects 0.000 claims description 15
- 238000000034 method Methods 0.000 claims description 14
- 230000001815 facial effect Effects 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims 1
- 238000001514 detection method Methods 0.000 abstract description 12
- 230000035945 sensitivity Effects 0.000 abstract description 8
- 238000004364 calculation method Methods 0.000 abstract description 3
- 230000001678 irradiating effect Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000020169 heat generation Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/04—Prisms
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/20—Filters
- G02B5/208—Filters for use with infrared or ultraviolet radiation, e.g. for separating visible light from infrared and/or ultraviolet radiation
-
- H04N5/2257—
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Traffic Control Systems (AREA)
Abstract
The present invention relates to a drowsiness driving preventing device capable of accurately detecting the eyes of a driver without increasing the irradiating light or increasing the sensitivity of the camera unit and greatly reducing the amount of calculation for eye detection.
An apparatus for preventing drowsiness driving according to the present invention includes: an illumination unit that emits light in an infrared wavelength band; A prism lens for dispersing incident infrared rays in a first direction and a second direction; An infrared pass filter provided on one surface of the prism lens for blocking visible light and passing infrared light; A neutral density filter provided on the first direction optical path of the prism lens; An antireflective (AR) layer disposed on the second directional optical path of the prism lens; A first image pickup element for detecting light incident upon the neutral density filter and generating a first image; A second image pickup element for generating a second image by detecting light incident upon the non-reflective layer; And extracting the area including the eyes as a region of interest after recognizing the driver's face region from the first image generated by the first image pickup element, extracting from the region corresponding to the region of interest the eyes of the driver And a central processing unit for detecting the central processing unit.
Description
BACKGROUND OF THE
Generally, since a plurality of vehicles run at the same time in each lane when the vehicle is running on the road, the driver must pay attention to the brake operation and the steering wheel operation so that the driver can run safely without colliding with the vehicle in the next lane.
However, when the driver does not know that the vehicle ahead is stopped due to drowsy driving and can not properly operate the brakes, a collision accident may be caused. In the case of steering the steering wheel to the right and left unintentionally during drowsiness operation, The vehicle enters the side lane and collides with another vehicle in the lane of the lane, failing to guarantee safe driving.
In order to prevent such drowsy driving, various technologies have been proposed. In general, the drowsiness driving prevention device detects an eye image from a driver image input from a camera and determines whether the drowsiness operation is performed using the detected eye image.
In addition, when it is determined that the driver is sleepy driving, a predetermined event such as a warning sound is generated to alert the driver, thereby preventing traffic accidents caused by sleepy driving.
For example, in the
However, such a conventional drowsiness driving prevention apparatus or method has a problem in that when the general CCD or CMOS camera is used, the driving environment is dark, such as at night, or an image sufficient to discriminate the driver's eye condition when the driver wears sunglasses There is a problem that it is difficult to do.
In order to solve such a problem, there is a method of acquiring an image using an infrared camera (see prior patents 2 and 3). However, in this case, there is a limit in obtaining satisfactory images for various illuminance environments.
In order to solve the limitations of the
However, if the irradiated light is increased or the sensitivity of the camera unit is increased in order to acquire the image of the eye region through the sunglasses, another problem occurs as follows.
First, when the irradiation light of the illumination is increased, the size of the illumination, the current consumption, the heat generation, the price, and the like increase, and when the sensitivity of the camera unit is increased, the size and the price of the lens and the image sensor increase.
Next, when the irradiation light increase or the camera unit sensitivity increasing method is applied individually or simultaneously, it is possible to secure enough brightness to transmit the sunglasses to check the opening state of the eye, but image saturation occurs in the area other than the sunglasses generated at this time There is a problem.
In addition, when the sunlight is transmitted through the sunglasses to increase the irradiation light to detect the eye area, or when a problem occurs in the face recognition operation due to strong external light such as backlighting or spotlighting, the operation itself becomes impossible after a malfunction, It is not possible to determine the area of interest, which increases the amount of computation.
It is an object of the present invention to provide a drowsiness driving prevention device capable of accurately discriminating whether or not drowsy driving is performed even when a driver's sunglasses is worn as well as various illuminance environments.
In particular, it is a principal object of the present invention to provide a drowsiness driving prevention device capable of detecting a driver's eye without increasing the irradiated light or increasing the sensitivity of the camera unit, and capable of reducing a calculation amount for eye detection.
According to an aspect of the present invention, there is provided an apparatus for preventing drowsiness in an eye, comprising: an illumination unit that emits light of an infrared wavelength band toward a face of a driver; A prism lens for dispersing the infrared rays incident on the driver after projecting in a first direction and a second direction; An infrared ray pass filter provided on a surface of the prism lens on which the infrared rays are incident, the infrared rays passing through the prism lens while blocking visible rays and passing infrared rays; A neutral density filter provided on the first direction optical path of the prism lens; An antireflective (AR) layer disposed on the second directional optical path of the prism lens; A first image pickup element for detecting light incident upon the neutral density filter and generating a first image; A second image pickup element for generating a second image by detecting light incident upon the non-reflective layer; And extracting the area including the eyes as a region of interest after recognizing the driver's face region from the first image generated by the first image pickup element, extracting from the region corresponding to the region of interest the eyes of the driver And a central processing unit for detecting the central processing unit.
According to the drowsiness prevention device of the present invention, it is possible to acquire an image suitable for distinguishing drowsiness not only in various illuminance environments but also when wearing sunglasses of a driver, and in particular, It is possible to accurately detect the driver's eye without increasing the sensitivity and further improve the processing speed for eye detection by greatly reducing the image analysis workload or calculation amount for eye detection.
1 is a block diagram of a drowsiness driving prevention device according to the present invention;
2 is a view showing a detailed configuration of an optical system according to the present invention;
3 is a view showing a wavelength band of light emitted by the illumination unit according to the present invention.
FIG. 4 is a perspective view illustrating an example in which the drowsiness driving prevention device according to the present invention is installed inside a vehicle.
5 (a) and 5 (b) illustrate a first image, a region of interest, and a second image obtained by the first and second image pickup devices of the present invention.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.
Also, in the present specification, the term " above or above "means to be located above or below the object portion, and does not necessarily mean that the object is located on the upper side with respect to the gravitational direction. It will also be understood that when a section of an area, plate, or the like is referred to as being "above or above another section ", this applies not only to the case where the other section is " And the like.
Also, in this specification, when an element is referred to as being "connected" or "connected" with another element, the element may be directly connected or directly connected to the other element, It should be understood that, unless an opposite description is present, it may be connected or connected via another element in the middle.
Also, in this specification, the terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.
In the following, preferred embodiments, advantages and features of the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a block diagram of an apparatus for preventing drowsiness according to the present invention, FIG. 2 is a view showing a detailed configuration of an optical system according to the present invention, FIG. 3 is a graph showing the wavelength band of light emitted by the illumination unit according to the present invention FIG. 4 is an example of an installation example in which the drowsiness driving prevention device according to the present invention is installed inside a vehicle, and FIG. 5 is a view showing an example in which the drowsiness prevention device according to the present invention is acquired by the first and second
1 to 5, the drowsiness prevention device according to the present invention includes an
The
According to a preferred embodiment, the
According to a preferred embodiment, the
The
Meanwhile, the
The
The
The
The
The
The
The
According to a preferred embodiment, the
Here, the 'near infrared ray of a specific band' passed by the optical band pass filter (OBPF) may be any one of a plurality of bands classified in the near-infrared wavelength band. For example, the first band B1, The second band B2, or the third band B3.
The
Here, the bandwidth of the first band B1 can be configured to be at most 760 to 880 nm in the range of 840 to 880 nm at the minimum, and the bandwidth of the second band B2 can be set at 760 to 1550 nm at the minimum in the range of 840 to 1020 nm And the bandwidth of the third band B3 can be configured to a maximum of 880 to 1550 nm in a range of a minimum of 920 to 1020 nm.
Therefore, when the
The light I1 incident on the first surface side of the
The neutral density filter (NDF) 24 of the
The neutral density filter (NDF) 24 is provided on the optical path which is incident on the
(Near) infrared rays that are incident on the first surface side of the
The
For reference, the second image P2, which will be described later, is an image used to substantially detect an eye at a portion D2 corresponding to the region of interest D1 acquired in the first image P1, P2 are generated from (near) infrared rays traveling in the second direction K2. Therefore, the noise of the second image P2 is blocked as much as possible, and a clearer image is required than the first image P1.
Specifically, infrared rays (near infrared rays) which are diffracted in the third surface side (i.e., the second direction K2) after being incident on the first surface side of the
According to one embodiment, the
The infrared camera (30) of the present invention includes an image sensor capable of detecting an infrared ray projected on a face of a driver and generating an image. If the illuminating
The
In particular, the
Specifically, the first
The first image P1 obtained by the first
The second
The second image P2 obtained by the second
The process of detecting the eyes by analyzing the first image P1 and the second image P2 obtained by the first
Hereinafter, the
The
Here, the 'area including the eye' refers to the entire face or part of the driver's face, including the eye area including the pupil and the iris.
When the setting of the region of interest D1 is completed, the
In other words, the
Accordingly, it is possible to improve the eye detection accuracy of the
When the detection of the driver's eyes is completed by the above-described processing, the
Specifically, the
If it is determined that the driver is drowsy as a result of the determination, the warning event generator 50 is controlled to generate a warning to the driver. Here, the warning event generating unit 50 may employ at least one of a means such as a speaker, a vibration means, a cold air generator, or the like that can call a user's attention.
On the other hand, the
The
If the face recognition is successful, the second image P2 is acquired after extracting the region of interest D1 from the first image P1 and releasing the illumination output restriction. Then, the driver's eye is detected in an area D2 corresponding to the area of interest D1 among the second images P2.
At this time, if the eye detection fails, the illumination output is changed to acquire the second image P2 again and the eye is detected in the region D2 corresponding to the region of interest D1.
When the eye detection is successfully completed, it is possible to determine whether or not the driver is drowsy by analyzing the opening and closing of the eye (for example, whether or not the eye is open or the aperture ratio).
Thereafter, when it is determined that the user is drowsy, a warning event is generated, and then the process of acquiring the second image P2 is repeated and the process of detecting the eyes of the driver is continuously performed.
If the repetitive eye detection processing operation successively fails, the first image P1 acquisition and the interest area D1 setting operation after the illumination output limitation, and the second image P2 after the subsequent illumination output restriction release, To perform the eye detection performing operation of the camera.
As described above, when the first and second image acquiring processes according to the limitation and release of the illumination output are further included, there is an advantage that the eye can be detected more accurately.
While the preferred embodiments of the present invention have been described and illustrated above using specific terms, such terms are used only for the purpose of clarifying the invention, and it is to be understood that the embodiment It will be obvious that various changes and modifications can be made without departing from the spirit and scope of the invention. Such modified embodiments should not be understood individually from the spirit and scope of the present invention, but should be regarded as being within the scope of the claims of the present invention.
10: illumination part 20: optical system
21: prism lens 22: infrared pass filter
23: neutral density filter 24: non-reflecting layer
25: Objective lens 30: Infrared camera
31: First image pickup element
32: second image pickup element 40: central processing unit
50: Warning event generating unit P1: First video
P2: second image D1: region of interest
D2: region of interest matching
Claims (8)
A prism lens for dispersing the infrared rays incident on the driver side after projecting in a first direction and a second direction;
An infrared ray pass filter provided on a surface of the prism lens on which the infrared ray is incident, for blocking visible rays and passing infrared rays;
A neutral density filter provided on the first direction optical path of the prism lens;
An antireflective (AR) layer disposed on the second directional optical path of the prism lens;
A first image pickup element for detecting light incident upon the neutral density filter and generating a first image;
A second image pickup element for generating a second image by detecting light incident upon the non-reflective layer; And
Extracting a region including an eye as a region of interest after recognizing the face region of the driver from a first image generated by the first image pickup element, and extracting, from an area corresponding to the region of interest, And a central processing unit for detecting the drowsiness of the user.
The central processing unit,
Wherein when the extraction of the ROI is completed, the eye of the driver included in the second image is detected by performing an image control that focuses on an area corresponding to the ROI of the second image Drowsiness driving prevention device.
The central processing unit,
Acquiring the first image by limiting an illumination output of the illumination unit, extracting the ROI from the first image, recognizing the ROI,
And acquires the second image after releasing the illumination output limitation of the illuminating unit when the facial area recognition is successful and detects the eyes of the driver from an area corresponding to the area of interest of the second image A drowsiness driving prevention device.
The central processing unit,
Wherein when the face region recognition fails, the illumination output is changed to acquire the first image again, and then the face region recognition is performed.
Further comprising an objective lens provided on the infrared pass filter.
Wherein the infrared pass filter is a band-pass filter that passes only a near infrared ray of a specific band of light incident on the prism lens.
Wherein the infrared ray emitted from the illumination unit is light in a near-infrared wavelength range.
The central processing unit compares the detected eye image with a steady-state eye region image stored in the memory or analyzes the opening and closing of the eye to determine whether the driver is drowsy. If it is determined that the driver is drowsy And generates a predetermined warning event.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150156617A KR101681938B1 (en) | 2015-11-09 | 2015-11-09 | Apparatus for preventing drowsy driving |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150156617A KR101681938B1 (en) | 2015-11-09 | 2015-11-09 | Apparatus for preventing drowsy driving |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101681938B1 true KR101681938B1 (en) | 2016-12-02 |
Family
ID=57571618
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150156617A KR101681938B1 (en) | 2015-11-09 | 2015-11-09 | Apparatus for preventing drowsy driving |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101681938B1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR970036013A (en) | 1995-12-23 | 1997-07-22 | 전성원 | Drowsiness operation prevention device and drowsiness operation prevention device control method |
JPH10105898A (en) * | 1996-09-26 | 1998-04-24 | Niles Parts Co Ltd | Warning device for driven asleep |
KR19990086697A (en) * | 1998-05-29 | 1999-12-15 | 윤종용 | Laser blink detection system and method thereof |
KR100295849B1 (en) | 1997-12-17 | 2001-11-22 | 이계안 | Device and method for preventing sleep driving |
KR20060066807A (en) | 2004-12-14 | 2006-06-19 | 현대자동차주식회사 | Method and device for preventing sleepiness driving using filter for filtering near infrared ray |
KR20150061668A (en) * | 2013-11-27 | 2015-06-05 | 주식회사 디온테크 | An apparatus for warning drowsy driving and the method thereof |
-
2015
- 2015-11-09 KR KR1020150156617A patent/KR101681938B1/en active IP Right Grant
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR970036013A (en) | 1995-12-23 | 1997-07-22 | 전성원 | Drowsiness operation prevention device and drowsiness operation prevention device control method |
JPH10105898A (en) * | 1996-09-26 | 1998-04-24 | Niles Parts Co Ltd | Warning device for driven asleep |
KR100295849B1 (en) | 1997-12-17 | 2001-11-22 | 이계안 | Device and method for preventing sleep driving |
KR19990086697A (en) * | 1998-05-29 | 1999-12-15 | 윤종용 | Laser blink detection system and method thereof |
KR20060066807A (en) | 2004-12-14 | 2006-06-19 | 현대자동차주식회사 | Method and device for preventing sleepiness driving using filter for filtering near infrared ray |
KR20150061668A (en) * | 2013-11-27 | 2015-06-05 | 주식회사 디온테크 | An apparatus for warning drowsy driving and the method thereof |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4593942B2 (en) | Pupil detection apparatus and method | |
JP4853389B2 (en) | Face image capturing device | |
US8830324B2 (en) | Vehicle monitoring camera and vehicle monitoring camera system | |
EP1341119B1 (en) | Iris recognition system | |
JPH07134800A (en) | Device for photographing driver | |
JP2007522003A (en) | Device for measuring the driving ability of a driver in a car | |
CN111160081B (en) | Monitoring system | |
US7091867B2 (en) | Wavelength selectivity enabling subject monitoring outside the subject's field of view | |
JP2014158262A (en) | Vehicle illuminance environment recognition device and method therefor | |
US20090123031A1 (en) | Awareness detection system and method | |
JP2006248363A (en) | Driver lighting system, driver photographing device and driver monitoring device | |
JP7213466B2 (en) | Camera system, passenger monitoring system, mobile device, imaging method and program | |
KR20170135573A (en) | Apparatus for detecting of driver gaze direction | |
US20170353642A1 (en) | Driver state monitoring system | |
KR101681938B1 (en) | Apparatus for preventing drowsy driving | |
KR101694785B1 (en) | System for preventing drowsy driving | |
JP3296119B2 (en) | Gaze direction measuring device for vehicles | |
JP6572809B2 (en) | Image processing device | |
KR102320030B1 (en) | Camera system for internal monitoring of the vehicle | |
KR100546821B1 (en) | Lighting device of iris recognition device | |
JP4655751B2 (en) | Irradiation device and night vision device | |
KR101350861B1 (en) | System and method for controlling ir led of camera system using wavelength areness function of light | |
KR102288753B1 (en) | Apparatus for monitoring driver and method thereof | |
KR102038371B1 (en) | Driver eye detecting device and method thereof | |
KR102684524B1 (en) | Supersaturation removal method for Vehicle number plate and, vehicle number recognizer therewith |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant |