KR20130085097A - Earrings prevent drowsiness sensor - Google Patents

Abstract

PURPOSE: A sensor earring for preventing sleepiness is provided to determine the sleepiness of a driver. CONSTITUTION: A sensor earring for preventing sleepiness comprises a sensor unit (21), a signal processor (22), an alarm unit (24), and a power supply unit. The signal processor is connected to the output terminal of the sensor unit and determines the blinking state of an eye. The alarm unit receives output signals from the signal processor and generates a warning sound. The power supply unit supplies power to the sensor unit, the signal processor, and the alarm unit. The sensor unit comprises two IR detectors. One IR detector observes a pupil and the other IR detector observes the edge of an eye.

Description

Drowsiness sensor earrings {Earrings prevent drowsiness sensor}

The present invention relates to an anti-drowsiness earring for a driver. There are three types of drowsiness preventing devices introduced so far as products or industrial property rights: earring-type drowsiness preventing devices, drowsiness preventing devices using eye observation cameras, and drowsiness preventing devices for lane departure detection. However, they often sound alarms even when they are not sleepy. These disadvantages are based on the criteria for determining whether the driver is drowsy (cutting his head, closing his eyelids, changing lanes for sleep) or installing sensors to detect them. It appears that the location (walking on the wheel, the pupil camera is installed on the windshield of the driver's seat, the distance sensor between the lane and the vehicle is installed at the bottom of the vehicle) is not appropriate, and it is easy to see that it originates from the characteristics of the sensor. The present invention solves this problem completely, irrespective of the driver's head position and lane change, the earrings are equipped with an appropriate detection sensor that can accurately determine the driver's drowsiness and an alarm device that can wake the driver when dozing. Is characteristic. It has a drowsiness error rate of almost 0%, is compact and lightweight, and can be attached and detached.

As a drowsiness preventing device introduced so far as a product or industrial property, drowsiness preventing earrings (commercialized and on sale), drowsiness preventing devices using a pupil observation camera (registered patent 10-0762733, drowsiness driving prevention system and method; reflection image based Drowsiness prevention device and method) and lane departure detection device (ideas). However, they often generate alarms even when they are not sleepy due to sensor placement, configuration, and characteristics. Especially, the latter two use cameras, which is very complicated and expensive. Already commercialized earrings sound an alarm (or vibrate) when the driver leans down, so the alarm sounds even when the user is not dozing, but does not snooze (or shakes his head sideways or leans against the driver's seat pillow). In case of) alarm (or vibration) does not sound. The drowsiness prevention device using a pupil observation camera is an alarm sounds when the camera installed in front of the driver's seat observes the pupil and the eyelid is closed for a long time (patent 10-0762733) or the pupil disappears from the camera (registered patent 10-0766592). Such devices may malfunction even when strong scattered light enters or the driver bows or turns. Above all, they are complex and expensive to install, especially if the driver wears sunglasses when using a visible light camera. The concept of a sleepiness prevention device for lane departure detection using a lane detection camera is not drowsy while driving, but an alarm sounds even if the lane is changed. If the lane is not changed, the alarm does not sound and a collision with the front car may occur.

The problem to be solved has been introduced three types of existing drowsiness preventing device, when discussing the disadvantages of the existing invention in more detail as follows.

 The drowsy earrings are put on the ear after the power button is turned on. There is an angle adjustment button, and an alarm sounds when the user bows more than the set angle (usually 30 °). Even if you do not sleep, the alarm is activated when you lean your head, and also wears glasses because the glasses legs overlap with the earrings, so there is a disadvantage of wearing comfort.

 The anti-drowsiness device using a pupil observation camera has two types of this kind of device as industrial property rights. One (patent 10-0762733) installs a thumb-sized camera in the windshield frame of the vehicle, and the other device is attached to a suitable place inside the vehicle. You can see the eyes taken with a small monitor, and the camera attached to the monitor checks the position of the eyes with a blinking cycle, and the central processing unit calculates whether the eyes are opened and closed and whether they are drowsy. Make a decision and sound the alarm. The other (registered patent 10-0766592) irradiates near-infrared rays on the driver's face, searches for the image of the light source formed on the iris with high reflectance while photographing the face with a camera, and then determines the closure of the eye according to the deformation of the image. Based on the duration, it determines whether it is drowsy and sounds an alarm. The latter uses the near-infrared light to compensate for the weakness of the former (miscalculation caused by scattered visible light) (the camera phone can also be used). . In any case, the methods are not traceable to the camera, making eye monitoring difficult and portable. In particular, in the case of a visible light camera sensor, even if the driver wears sunglasses, even infrared rays are difficult to pass, so that they become useless.

 The lane departure detection device uses a camera to monitor the distance between the vehicle and the lane to determine the drowsiness of the driver.However, if the driver approaches the lane, moves away, or changes the lane without being drowsy during driving, there is a possibility of misjudgment. The biggest. As described above, in the normal operation state, the devices often generate alarms even if they are not sleepy. The causes are based on the characteristics of the sensor, the installation position, and the criteria for determining whether the driver is drowsy. Thus, in order to derive the problem to be solved by the present invention, it is necessary to first consider the external change mechanism of drowsiness. That is, when the driver sleeps, he first becomes confused, closes his eyes almost at the same time, then bows down, loses his hand (muscles), and eventually gets out of the lane. Looking at this sleepiness mechanism, it is the most direct that the eyes are closed, the bowing down is subsequent in time, and the departure from the lane is the last. Therefore, monitoring of eyelid closure is the most direct and accurate drowsiness criterion.

The problems to be solved by the present invention are summarized as follows. First, the method of determining whether the driver is drowsy must be direct and accurate. Use eyelid closure as a criterion for drowsiness. In this case, the eye blinking time and the eye closing time when sleepy are different from each other. Second, as can be seen from the second example (drowsiness prevention device using a pupil observation camera), even if the eyelid closure is set as a criterion for drowsiness determination, the camera is fixed inside the vehicle so that the driver's eyes cannot be tracked. Done. For this reason, the sensor must be in a position to constantly track the driver's eyes. Third, the present invention should be able to wear an examinee or sentry soldier who wants to chase drowsiness rather than using only while driving. In order to solve the above problems, the present invention provides a solution for each of the problems to be overcome in contrast to each problem as follows.

 [1] From the first condition, it is possible to observe the eyelid closure phenomenon as a direct and accurate way of judging drowsiness (this criterion is also used in the previously published industrial property rights (Patent 10-0762733, Patent 10-0766592). However, it was not effective because the camera couldn't track the driver's eyes.) People often blink their eyes, which is approximately 1/16 to 1/8 seconds, and blinking within a maximum of one second is the driver's mind. Judging by driving, if more than that, the driver is determined to be sleepy. I feel tired while driving and close my eyes for a long time (1 ~ 1.5 seconds) and open it up, so I think the driver is drowsy (when driving at 100km / h speed in the experiment, if you close your eyes for more than 1.5 seconds, Feels). Therefore, if the time to close the eyes is more than 1 second, an alarm (beep or vibration) is sounded to wake the driver.

[2] The sensor that monitors eye closure does not necessarily need to be a camera. In fact, camera systems are too expensive and too complex to install. The sensor qualification of the present invention is sufficient if it can be seen whether the eyes are closed or closed. That is, it is possible to distinguish between the pupil and the eyelid (when the eyes are closed) or the flesh near the eyes. Since you drive at night like clay, the sensor that distinguishes your eyes from your eyelids should be an infrared (IR) sensor. 8-12um) infrared sensor is suitable. In addition, even if the sensor composed of a single pixel detector is sufficient to achieve the above object, it can be seen that the infrared sensor of the present invention is preferably a single element long wave length IR sensor (SLIR sensor) having a single pixel.

[3] From the second condition, the sensor to be used in the present invention must be able to track the driver's eyes. In the existing examples (Patent 10-0762733, Patent 10-0766592), since the camera is fixed somewhere in the front windshield of the inside of the vehicle can not track the position of the eye when the driver turns his head. To improve this, you need to keep the sensor close to your face, but look for a way for the driver to follow the sensor as it turns.

[4] According to the third condition, the user of the present invention should be easy to install and detach so that the user of the present invention can be worn not only by the driver but also by a student or guard who wants to keep away from sleepiness, and is designed to be portable (small and lightweight).

 Combining the solutions mentioned above, the requirements for the present invention can be summarized as follows. According to the present invention, the eyelid blink is observed using the SLIR sensor, and when the eye blinking time is 1 second or more, there is an alarm unit (warning sound or vibration) that determines the sleepiness (signal processing unit) to wake up the driver. The SLIR sensor should be installed in a place where it can be monitored without missing an eye state and effectively wake up the driver's drowsiness. Therefore, the modules (SLIR sensor unit, call processing unit and alarm unit) are installed in glasses. In addition, the modules can be attached to or detached from the glasses so that not only the driver but also a sentry, examinee, or the like can be used.

The anti-drowsy earrings that are currently on sale are very innovative in terms of their low price, but the alarm (or vibration) will sound when you bow your head regardless of the driver's drowsiness. If you lean on the pillow, the alarm will not work. In addition, when wearing glasses, the pair of glasses and earrings of the 'drowsiness prevention earrings' overlap each other has a disadvantage in that the wearing feeling is not good. In addition, the 'drowsiness preventing device using a pupil observation camera' (registered patent 10-0762733, drowsiness driving prevention system and method; registered patent 10-0766592: iris reflection image-based drowsiness preventing device and method) introduced as industrial property is a driver's seat When the camera installed in front observes the eyes and the eyelid is closed for longer than a certain time, the alarm function is activated. Such devices can malfunction even when strong scattered light enters or the driver bows or turns, and the device is complex and expensive to install. In addition, even if near-infrared is used, the equipment is still complicated and the traceability is low, such as the addition of a near-infrared ray irradiation device. On the other hand, the lane monitoring drowsiness prevention device is a very indirect drowsiness monitoring method, even if an alarm sounds because it will sound in an accident state is not a recommended device.

 The present invention completely solves the problems indicated by the configuration, arrangement, and characteristics of the sensors, and provides an appropriate long-wave IR sensor, drowsiness determination function, and alarm function to accurately wake up by drowsiness (covering of eye caps). It is compactly installed on the glasses. Advantages of the present invention compared to the existing invention is as follows.

 First, the present invention monitors the state of the driver's eyes at all times, but because it monitors right next to the driver's eyes, there is no misjudgment (high accuracy of the constant monitoring and judgment).

 Second, since the long-range IR sensor is adopted as the drowsiness monitoring sensor, it can be judged accurately (~ 100%) at night as well as in the sun. As a result, a separate near-infrared light source is not required (simplification of the device).

 Third, since the monitoring sensor is a single pixel detector rather than an array type detector, the electronic part coupled to it is simple (that is, it is not necessary to detect geometric elements such as eyes and eyebrows like a camera, and a complex drowsiness determination algorithm to handle this). This is why the price is relatively cheap (economical price).

 Fourth, the present invention is a SLIR sensor capable of photographing the blinking of the eyes (two states, such as closed eyes, opened state), the signal processing unit for distinguishing the eye blink state and determining the persistence of the cycle and the output signal from the signal processor It is composed of an alarm unit that generates a switching pulse to sound a warning sound (or vibration), so it is small in size and light and easy to wear (small and light).

Fifth, the present invention can be made only for anti-drowsiness glasses, but may be installed in the existing glasses because it is small and light. In other words, by making it possible to attach and detach existing glasses such as sunglasses, dimming lenses, guardian glasses, myopia and primitive glasses, it is possible to use not only the driver but also the examinee and the sentry (universal use).

1 is the overall appearance of the earrings
Figure 2 is a configuration and function diagram for the drowsiness sensor module of the present invention
Figure 3 is an embodiment of the configuration H / W of the present invention installed on the ear hook
Figure 4 is an embodiment of a sensor unit consisting of a single pixel detector
5 is a relationship between eye closing time, frequency and sleep status for the general public

The present invention is to install the anti-drowsiness sensor module (IR sensor and signal processing unit and alarm unit) to the glasses, to increase the accuracy of drowsiness determination, simplify the configuration, and miniaturization and light weight. From the above problem solving means (four problems), the configuration, function and features of the present invention can be described as follows. 2 shows the configuration and the functional diagram for the drowsiness prevention sensor module of the present invention. As shown in FIG. 2, the sensor module for preventing drowsiness is connected to a sensor unit 21 that detects blinking of eyes (two states such as a closed state and an opened state) and an output terminal of the sensor unit 21. A signal processor 22 for distinguishing the blinking state and determining the persistence of eye closure, a switching unit 23 for receiving and switching a signal output from the signal processing unit 22, and a switching signal from the switching unit 23 It consists of an alarm unit (24) for sounding a warning sound (or vibration), and a power supply unit 25 for supplying power to the components (21 to 24). 3 shows an embodiment in which a drowsiness preventing sensor module (FIG. 2) is installed in a typical spectacle frame (FIG. 1). The sensor unit 21 may be installed beside the eye, which is an optimal position for monitoring the eye state (open or closed state). In the embodiment of FIG. 3, the sensor unit 21 is installed beside the ear. In addition, the signal processing unit 22 is installed next to the ear together with the center of the earring leg or the sensor unit 21. In addition, since the alarm unit 24 is preferably located near the ear, the alarm unit 24 is installed in the ear hook, and the power supply unit 25 is also installed in the leg of the ear hook or the leg of the ear hook which is easy to support its weight. Meanwhile, in FIG. 3, a conductive wire connecting the sensor unit 21, the signal processing unit 22, the alarm unit 24, and the power supply unit 25 to each other is provided inside the leg portion of the ear hook. In Figure 3, the sensor unit 21 is to observe the blinking of the eyelid, it is configured as an IR sensor, because it must accurately recognize the signal level of the closed state and the open state of the two detectors (eg, photo-diode or photo -transister, etc.) (26), one arranged to observe the pupil and the other to observe the eye periphery (Figure 3). Figure 4a shows an embodiment of the sensor unit 21 consisting of two detectors. The detectors 26 function to switch their line of sight (LOS), respectively (elevation control keys 31 and 32, azimuth adjustment keys 33 and 34), and zero level of the two detectors. And a reset key 35 to match. The elevation of the detector gaze can be adjusted within a predetermined angle range (about ± 15 °) by the elevation adjustment keys 31 and 32 of each detector, and the azimuth angle of the detector gaze is the azimuth adjustment keys 33 and 34 of each detector. Can be adjusted within a predetermined angle range (about ± 15 °). On the other hand, the two detectors are provided with a micro lens on each pixel, the micro lens field of view (FOV) 36 is designed to be about 4mm when converted to the diameter of the circle at a distance of 3cm. In FIG. 2 and FIG. 3, the signal processor 22 is a differential amplifier 221 for amplifying a difference between the output signals of the two detectors 26 constituting the sensor unit 21, and a signal intensity and width are equal to or less than a predetermined value. A pulse determination generator 222 for filtering pulses, and an inverting unit 223 for inverting the output signal level of the pulse determination generator 222 (FIG. 4A). In FIG. 2 and FIG. 3, the alarm unit 24 uses a switching unit 23 for receiving and switching a signal output from the inverting unit 223 of the signal processing unit 22 and a switching pulse signal from the switching unit 23. To sound a warning through the speaker (sp in Figure 2) or to generate vibration through a vibrator (vib. In Figure 2). The functions of each component module shown in [4a] are as follows. One of the two detectors looks at the flesh around the eye (the flesh directly above or below the eye) and the other points the eye. The temperature of the pupil is relatively lower than the temperature of the flesh (about 0.5 degrees or less), because the pupil is covered with tears and cools slightly in contact with the surrounding air. Therefore, when the eyes are opened, the output signal levels of the two detectors are different. However, when the eyes are closed, the two detectors observe all kinds of temperatures, so the temperature difference becomes almost zero, so the output signal levels of the two are the same within the error range. Let's say it's 1 if there's a level difference, or 0 if it's not). Therefore, when the output signals of the two detectors are input to the differential amplifier 221 to amplify the difference, and the result is inverted by the inverting unit 222, the signal is 1 in the closed state and the eyes are opened. Signal level is 0.

 Drowsy driving means that the driver does not actually sleep while driving, but the snow falls by itself due to the falling sleep, and this condition becomes worse, and the eyes are driven in a state where the time is a little longer, which leads to a big accident. To prevent this, you should wake up the driver with a warning alarm without delay when you start getting sleepy. 5 is a graph showing the relationship between the number of times the eyes closed and the number of times for the general public. From this, the state of waking, sleepy and sleeping are divided. As can be seen from the graph (FIG. 5), the number of blinks per minute is 35 to 50 times in the awake state, and the time to close the eyes is about 0.1 to 0.15 seconds, and the number of blinks per minute is 15 to the sleepy state. 25 times, with the eyes closed about 0.7-1.5 seconds, in sleep

The number of blinks per minute is 0 to 1, and the time to close the eyes is about 6 seconds or more (with the eyes closed, the driving time for psychological peace is about 1 second. After winding, alarm will sound if 1 second is exceeded). According to Fig. 5, since the drowsiness is not proportional to the number of eyes closed, it is closely related to the time to close the eyes, so if the pulse width ≥ 1 second, it is judged as drowsiness, and a switching pulse is generated to generate a switching pulse. ), An alarm (vibration or beep) should sound (Figure 2). On the other hand, in the case of using two detectors in the present invention, if necessary, the drowsiness determination reference time setting function is provided in the pulse determination generation unit 222 so that the reference pulse width (time) can be set. Since it is installed inside, the distance between the sensor and the eyes is short and there is no error during alarm operation because it is always observed. In addition, there is an advantage that can be attached to or detached from the existing glasses (sunglasses, primitives, myopia glasses, etc.) so that not only the driver but also guards, examinees, etc. can be used. The table below compares the advantages of the present invention over other inventions. As can be seen from the table, it can be seen that the present invention is excellent in most of the characteristics, including the reliability of sleepiness judgment.

21.Sensor part, 22.Signal processing part, 23.Switching part
221.Differential amplification part, 222.Pulse judgment generation part, 223.Inversion part,
24 alarm section, 25 power section. 26. Detector
31,32.Elevation adjustment key, 33,34.Azimuth adjustment key 35.Reset key

Claims (2)

A sensor unit 21 for detecting infrared rays, a signal processor 22 connected to an output terminal of the sensor unit 21 to determine a blink state of the eye, and receiving an output signal from the signal processor 22 to generate a warning In the conventional drowsiness preventing earrings having an alarm unit 24 and a power supply unit 25 for supplying power to the configuration modules 21, 22, and 24, the sensor unit 21 is installed next to the eyes. Observing the blink state of the eye, consisting of two IR detectors 26, one for observing the pupil and the other for observing the eye, the two detectors 26 to switch their eyes By having a function key (elevation adjustment keys 31 and 32 and azimuth adjustment keys 33 and 34), the elevation angle and azimuth angle of the detector line of sight can be adjusted within a predetermined angle range, and the two detectors 26 ) Put a micro lens on each pixel, The lens lens 36 is characterized in that it is made to be a circle having a predetermined diameter at a distance of 3cm, the signal processing unit 22 is installed next to the eye with a predetermined position or the sensor unit 21 of the leg portion of the earrings The differential amplifier 221 amplifies the difference between the output signals of the two detectors 26 constituting the sensor unit 21 and pulses having a signal intensity and width less than or equal to a predetermined value. And the inverting unit 223 for inverting the output signal level of the pulse determination generation unit 222 and the pulse determination generation unit 222, wherein the alarm unit 24 includes the ear hook 15. It is installed at the rear part to receive an output signal from the inverting unit 223 of the signal processing unit 22 and using a switching pulse signal from the switching unit 23 to sound a warning sound through the speaker or vibrator To generate vibrations through Drowsy earrings. The signal processor of claim 1, further comprising a signal processor (22) connected to the sensor unit (21), an output terminal of the sensor unit (21), and determining an eye blink state, and receiving an output signal from the signal processor (22). Drowsiness sensor earrings, characterized in that the alarm unit 24 for generating a warning can be removed or mounted from a normal eyeglass frame

Images