KR20160016149A - System and method for preventing drowsiness by wearable glass device - Google Patents

Abstract

The present invention relates to a system and a method for checking taxi riding information using a glasses type wearable device. The method comprises: a step (S100) for obtaining consecutive images of specific time intervals or images around eyes of a user by a second camera (122) of the glasses type wearable device; a step (S200) of measuring an eye exposure range and eye nonexposure time through the obtained images; a step (S300) for determining the state of the user based on the measured eye exposure range and eye nonexposure time; and a step (S400) for generating an alarm for the user when the user is determined that the user is drowsy. According to the present invention, it is possible to wake up the user with various ways of alarms by checking if the user is drowsy or not using the glasses type wearable device. In addition, the system can be used in various situations such as learning and driving by using the glasses type wearable device which the user is always able to wear. Anyone is able to use the system according to his or her eye sizes by setting standards of the eye exposure range and the eye nonexposure time by photographing a picture of eyes in the daily life of the user.

Description

TECHNICAL FIELD [0001] The present invention relates to a sleeping prevention system and a sleepiness prevention method using a wearable device of a glass type,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a sleeping prevention system and a sleeping prevention method using a glass-type wearable device, and more particularly, to a system and a method for awakening a user when a user is sleeping, .

Recently wearable devices are emerging. It has appeared in the form of glasses that are linked to smart phones, and some forms that can operate independently without a smartphone are also emerging.

On the other hand, Patent Document 1 (Japanese Patent Application Laid-Open No. 10-2010-0047429) discloses a drowsiness driving prevention device using a piezoelectric element. Patent Document 1 discloses a device in which a change in pressure of a user is measured from a piezoelectric element placed on a handle and a seat, and an alarm sounds when the change in pressure is abnormal. However, according to the prior art 1, there is a problem that the pressure information is uncertain depending on the position of the piezoelectric element, and the cost is high because the pressure information is required to be installed in the vehicle. Further, there is a problem that drowsiness can be prevented only at the time of operation.

In addition, a drowsiness-free earring that sounds an alarm when the user slumped his or her head while sleeping is commercially available. However, according to this, there is a problem of indirect measurement, and an alarm does not sound if the user does not bow his head even if he sleeps, and an alarm is generated when his / her head is leaned.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a wearable wearable device for a wearable wearable wearable device which is capable of detecting a pupil exposure range and a pupil exposure time of a wearer with a glass wearable device to determine whether the wearer is sleeping, And a method of preventing drowsiness.

According to another aspect of the present invention, there is provided a method of preventing drowsiness in a wearable wearable device using a glass wearable device, the method comprising: Acquiring an image; Measuring an eyeball exposure range and an eyeball exposure time through the acquired image or image; Determining a state of the user on the basis of the measured eye exposure range and the angular exposure time; And generating an alarm to the user when the user is determined to be in a sleeping state.

In addition, the step of determining the user's condition based on the measured ocular exposure range and the ocular exposure time may include comparing the measured ocular exposure reference time, the ocular exposure reference range, the stored ocular exposure reference time, and the ocular exposure reference range . ≪ / RTI >

When the user is determined to be in a sleepy state, the step of generating an alarm to the user may include an alarm method by vibration generation of the glass type wearable device, an alarm method by sound output of the glass type wearable device, Type wearable device transmits an electroencephalogram tuning signal to be stimulated by a brain, and an alarm method by an acoustic output of an external device.

The eyeball exposure reference range may be a range that is less than a predetermined ratio of the normal eyeball exposure range or a range designated by the user in a sleeping state of the eyeball exposure range measured during the process of collecting the normal eyeball exposure range of the user have.

According to another embodiment of the present invention, there is provided a sleepiness prevention system using a wearable device of a glass type, comprising: a second camera for acquiring a real-time image around a user's eye or a continuous image at a specific time interval; An eyeball exposure range measuring unit for measuring an eyeball exposure range in the image or the image, an eyeball exposure time measuring unit for measuring the eyeball exposure time by analyzing the image or the image, and the eyeball exposure range and the eyeball exposure time And an alarm control unit for determining whether or not an alarm is generated based on the alarm signal. And an alarm unit for providing an alarm for awakening the user ' s drowsiness.

The alarm unit may include at least one of a vibration alarm unit for generating vibration, an acoustic output unit for outputting an alarm sound, and an EEG tuning signal generator for providing a brain wave tuning signal to stimulate the brain.

The apparatus may further include an eyeball exposure learning unit for collecting and analyzing data on the eyeball exposure range or the eyeball exposure time of the user at normal times.

The control unit may further include an alarm criterion setting unit for setting a criterion of an eyeball exposure range or an eyeglass exposure time for providing an alarm to a user.

According to the present invention as described above, the following various effects are obtained.

First, it is possible to awaken the user by various alarm methods by checking whether the user is sleeping through the wearable device of the glass type.

Secondly, by using a wearable wearable device which can be worn by the user at all times, it can be used in various situations such as not only during driving but also during learning.

Third, the user can set the criteria of the eyeball exposure range and the eyeball exposure time by photographing the eyeball during daily life, so that anyone can use it according to his / her eye size standard.

1 is a flow chart of a drowsiness prevention method using a glass-type wearable device according to a preferred embodiment of the present invention
2 is an example of a maximum vertical length of an eye region measured by a glass-type wearable device
3A shows an eye region image or an image obtained by a glass-like wearable device when a user is opening his eyes.
FIG. 3B shows an eye region image or image obtained by a glass-like wearable device when the user is opening his eyes.
Fig. 4 is an internal configuration diagram of a drowsiness prevention system using a glass-type wearable device

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element.

FIG. 1 is a flowchart illustrating a method of preventing drowsiness using a wearable wearable device according to a preferred embodiment of the present invention, and FIG. 2 is a diagram illustrating a maximum length of an eye area measured by a wearable wearable device. FIG. 3A is an eye area image or an image exemplified by a wearable wearable device when the user is winking, FIG. 3B is an eye area image or image obtained by a wearable wearable device when the user is winking, Fig. 4 is an internal configuration diagram of a drowsiness prevention system using a glass-type wearable device.

1 to 4 show a system 100, a user input unit 110, an application 111, a keyboard 112, a voice input unit 113, a touch pad 114, a GPS signal unit 115, A camera 120, a first camera 121, a second camera 122, a third camera 123, a sensing unit 130, a gyro sensor 131, an acceleration sensor 132, a pressure sensor 133, an iris recognition sensor 134, a heartbeat detection sensor 135, an electromyogram sensor 136, an information processing unit 210, a voice recognition unit 220, a situation evaluation module 230, a voice- A wireless communication unit 250, a memory 260, an interface unit 270, an output unit 300, a display unit 310, an acoustic output unit 320, an alarm unit 330, and a haptic module 340 Respectively.

The system 100 of the present invention includes a camera unit 120, a voice input unit 113, a user input unit 110, a sensing unit 130, an output unit 300, a wireless communication unit 250, a memory 260, A controller 270, a controller 210, a power supply unit, and a voice recognition unit 220.

The camera unit 120 is for inputting video signals or image signals, and may be provided in accordance with a configuration of the device. The camera unit 120 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 310. [ The image frame processed by the camera unit 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250. [ When an image signal or a video signal is used as an input for information processing, the image signal and the video signal are transmitted to the control unit 210.

The voice input unit 113 is for inputting voice signals and may include a microphone and the like. The microphone receives an external acoustic signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication unit and output when the voice data is in the call mode. A variety of noise canceling algorithms may be used to remove the noise generated by the microphone in receiving an external acoustic signal.

The user input unit 110 generates key input data that the user inputs for controlling the operation of the device. The user input unit 110 may include a key pad, a keyboard, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 310 described later, it can be called a touch screen.

The sensing unit 130 senses the current state of the device such as the open / close state of the device, the position of the device, the presence or absence of the user, and generates a sensing signal for controlling the operation of the device. In addition, the sensing unit 130 may function as an input unit for receiving an input signal for information processing of a device, and may perform various sensing functions such as recognition of connection to an external device.

The sensing unit 130 may include a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heartbeat detection sensor 135, a skin temperature sensor, , A distance sensor, a Doppler radar, and the like.

The proximity sensor makes it possible to detect the presence of an object to be approached or nearby, without mechanical contact. The proximity sensor can detect a nearby object by using the change of the alternating magnetic field or the change of the static magnetic field, or by using the change rate of the capacitance. The proximity sensor may be equipped with two or more sensors according to the configuration.

The pressure sensor 133 can detect whether or not pressure is applied to the device, the magnitude of the pressure, and the like. The pressure sensor 133 may be installed in a part of the device where the pressure needs to be detected depending on the use environment. When the pressure sensor 133 is installed on the display unit 310, a touch input through the display unit 310 and a pressure applied by the touch input The pressure touch input can be identified. Also, according to the signal output from the pressure sensor 133, the magnitude of the pressure applied to the display unit 310 at the time of pressure touch input can be known.

The motion sensor includes at least one of an acceleration sensor 132, a gyro sensor 131, and a geomagnetic sensor, and detects the position and movement of the device using the sensor. The acceleration sensor 132, which can be used for a motion sensor, is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. The acceleration sensor 132 includes a gravity sensor that recognizes a change in gravitational acceleration. Further, the gyro sensor 131 is a sensor for measuring the angular velocity, and can sense the direction of rotation with respect to the reference direction.

The heartbeat detection sensor 135 measures changes in the optical blood flow due to changes in the thickness of the blood vessel caused by the heartbeat in order to collect emotion signals. The skin temperature sensor measures the skin temperature as the resistance value changes in response to the temperature change. The skin resistance sensor measures the skin's electrical resistance.

The iris recognition sensor 134 performs a function of recognizing a person using iris information of an eye having a characteristic unique to each person. The human iris is completed after 18 months of age, and the circular iris pattern, which is raised near the medial side of the iris, is almost unchanged once determined, and the shape of each person is different. Therefore, iris recognition is the application of information technology to security for information of different iris characteristics. That is, it is an authentication method developed to identify people by analyzing the shape and color of iris and the morphology of retinal capillaries.

The iris recognition sensor 134 encodes a pattern of iris and converts it into a video signal to compare and judge. The general operation principle is as follows. First, when the user's eye is aligned with the mirror located at the center of the iris recognizer at a certain distance, the infrared camera adjusts the focus through the zoom lens. After the iris camera images the user's iris as a photo, the iris recognition algorithm analyzes the iris pattern of the iris region to generate iris codes unique to the user. Finally, a comparison search is performed at the same time that the iris code is registered in the database.

Distance sensors include two-point distance measurement, triangulation (infrared, natural light) and ultrasonic. As in the conventional triangulation principle, when the object to be measured from two paths is reflected by a rectangular prism and incident on two image sensors, the distance between two points is displayed when the relative positions are matched. In this case, there is a method of making natural light (manual type) and a method of emitting infrared rays. The ultrasonic method is a method of transmitting ultrasonic waves having sharp direction to the object to be measured and measuring the time until the reflected wave from the object is received to find the distance. A piezoelectric element is used as the receiving sensor.

The Doppler radar is a radar that uses a Doppler effect of a wave, that is, a phase change of a reflected wave. The Doppler radar includes a continuous wave radar that transmits and receives a sinusoidal wave that is not pulse-modulated, and a pulse radar that uses a pulse-modulated wave to a square wave as an electromagnetic wave signal waveform.

In the continuous wave radar, the modulation frequency is relatively high in order to obtain the performance of the Doppler frequency filter. Therefore, it is inappropriate for the radar for the long distance, but the motion of the human body and the vehicle is reproduced as a stable sound by adopting the Doppler frequency as the audible frequency band. There is a feature that can be. The pulse radar measures the distance to the target by the time from the pulse transmission to the reflection echo reception. There is a method referred to as a pulse compression laser that performs frequency modulation or phase modulation within the transmission pulse width.

The output unit 300 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 300 may include a display unit 310, an audio output module, an alarm unit 330, a haptic module 340, and the like.

The display unit 310 displays and outputs information processed in the device. For example, when the device is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with the call is displayed. When the device is in the video communication mode or the photographing mode, the captured or received image can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 310 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 310 can be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like.

In addition, the display unit 310 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). There may be two or more display units 310 depending on the implementation type of the device. For example, the device may include an external display unit 310 and an internal display unit 310 at the same time.

The display unit 310 may be implemented as a head up display (HUD), a head mounted display (HMD), or the like. HMD (Head Mounted Display) is an image display device that allows you to enjoy large images on your head like glasses. A Head Up Display (HUD) is a video display device that projects a virtual image onto a glass in a visible region of a user.

The sound output module 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. Also, the sound output module 320 outputs sound signals related to functions performed in the device, for example, call signal reception tones, message reception tones, and the like. The sound output module 320 may include a speaker, a buzzer, and the like.

The alarm unit 330 outputs a signal for notifying the occurrence of an event of the device. Examples of events that occur in a device include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 330 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 330 may output a signal to notify when a call signal is received or a message is received. Also. When the key signal is input, the alarm unit 330 can output a signal as a feedback signal to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 330. A signal for notifying the occurrence of an event in the device may also be output through the display unit 310 or the sound output module.

The haptic module 340 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 340 is a vibration effect. When the haptic module 340 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 340 can be converted, and the different vibrations may be synthesized and output or sequentially output.

The wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, a short distance communication module, and a GPS module.

The broadcast receiving module receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module. Broadcast-related information can exist in various forms.

The broadcast receiving module receives a broadcast signal using various broadcast systems, and can receive a digital broadcast signal using a digital broadcast system. In addition, the broadcast receiving module may be configured to be suitable for all broadcasting systems that provide broadcast signals as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.

The mobile communication module transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be embedded in a device or externally. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution-Advanced) or the like can be used.

The short-range communication module 116 is a module for short-range communication. Beacon, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee and the like can be used as a short distance communication technology.

Beacon is a wireless communication device that transmits very small frequency signals around them using a protocol based on Bluetooth 4.0 (BLE-Bluetooth Low Energy). Bluetooth 4.0 allows devices to communicate with devices within approximately 5m to 70m, and is low power with minimal impact on battery life, so you can always turn on Bluetooth with minimal power wastage.

The GPS (Global Position System) module 115 receives position information from a plurality of GPS satellites.

The memory 260 may store a program for processing and controlling the control unit 210 and may perform a function for temporarily storing input or output data (e.g., a message, a still image, a moving image, etc.) It is possible.

The memory 260 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM , And a ROM. ≪ / RTI > The device may also operate a web storage that performs storage functions of the memory on the Internet.

The memory 260 may be represented by a storage unit 260 or an eye-opening-learning unit 260. [

The interface unit 270 serves as an interface with all external devices connected to the device. Examples of external devices connected to the device include a wired / wireless headset, an external charger, a wired / wireless data port, a memory 260 card, a Subscriber Identification Module (SIM) or a User Identity Module A card socket, an audio I / O (input / output) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 270 may receive data from the external device or supply power to the respective components in the device, and may transmit data in the device to the external device.

The control unit 210 typically controls the operation of each unit to control the overall operation of the device. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing data input from the input unit or the sensing unit 130.

The power supply unit receives external power and internal power under the control of the controller 210, and supplies power necessary for operation of the respective components.

The speech recognition unit 220 performs a function of recognizing verbally meaningful contents from the speech by automatic means. Specifically, a speech waveform is input to identify a word or a word sequence, and a meaning is extracted. The process is largely divided into voice analysis, phoneme recognition, word recognition, sentence analysis, and semantic extraction. The voice recognition unit 220 may further include a voice evaluation module that compares the stored voice with the input voice. The voice recognition unit 220 may further include a voice-to-text conversion module 240 that converts the input voice to text or converts the voice to voice.

The EEG signal generator generates an EEG synchronized signal having a frequency and a waveform for synchronizing human brain waves. That is, the EEG coherent signal generator performs the function of synchronizing the EEG by transmitting the vibration of the EEG frequency to the skull. Electroencephalogram (EEG) refers to the flow of electricity that occurs when a cranial nerve signal is transmitted. These brain waves are very slow when sleeping Delta wave EEG, when the action is a fast EEG betapa, meditation when the middle rate of the alpha waves are increased. Therefore, the EEG signal generation part can induce the alpha wave and the seta wave, so that the effect of learning assistance and mental concentration can be demonstrated.

Hereinafter, a drowsiness prevention system and method using a glass-type wearable device according to embodiments of the present invention will be described with reference to the drawings.

1 is a flowchart illustrating a method of preventing drowsiness using a wearable device of a glass type according to a preferred embodiment of the present invention.

Referring to FIG. 1, a method of preventing drowsiness using a wearable device of a glass type according to an embodiment of the present invention includes: Acquiring an image (SlOO); Measuring an ocular exposure range and an ocular exposure time through the obtained image or image (S200); Determining a state of the user on the basis of the measured eye exposure range and the eyelashes exposure time (S300); And generating an alarm to the user (S400) when it is determined that the user is in a sleeping state. A sleeping prevention method using a glass-type wearable device according to an embodiment of the present invention will be described in order.

The second camera 122 of the glass-like wearable device acquires images around the user's eyes or continuous images at specific time intervals (S100). The second camera 122 is attached to one side of the glass-like wearable device to acquire an image or an image of an eyeball region. The eye area can be defined as the area between the upper and lower eyelashes. If the second camera 122 acquires only one image, it can not measure the angular exposure time, and if the image is obtained when the user blinks the eye, an error may occur in the measurement of the eye exposure range. Accordingly, the second camera 122 acquires images or continuous images at regular intervals. The acquired image or image is subjected to image processing and converted into a monochrome image, thereby making it possible to more clearly detect the eyes and the pupil in the image or the image.

The eyeball exposure range and the anterior / posterior exposure time are measured through the acquired image or image (S200). The eyeball exposure range refers to the range in which the pupil of the user is visible. The eyeball exposure range measurement may be measured by the width of the eyeball region shown in the image or the image, or may be measured by the maximum height h of the user eye as shown in FIG. However, the method of measuring the range of eyeball exposure is not limited thereto, and various methods of measuring the degree of eye blinking can be applied.

The angular exposure time refers to the time during which the eyeball is maintained in the range of the eyeball exposure reference range in the image or the continuously acquired image. The angular exposure time measurement calculates the elapsed time from the time when the range of the eyeball exposure reference range falls below the eyeball exposure reference range to the time when the eyeball exposure reference range becomes equal to or greater than the eyeball exposure reference range. However, the method of measuring the exposure time is not limited to this, and various methods of measuring how long the user is eyes can be applied.

The state of the user is determined on the basis of the measured range of the eyeball exposure and the eyeball exposure time (S300). That is, if the measured eyeball exposure reference time, the eyeball exposure reference range, the stored eyeball exposure reference time, and the eyeball exposure reference range are compared with each other and the state in which the eye of the user is within the eyeball exposure reference range is maintained for more than the eyeball exposure reference time, It is determined that the user is sleeping. For example, when a person drowsy, his or her eyes naturally wind down. As shown in FIG. 3, the length of the eye is usually shorter than the vertical length (h) of the eye at that time. The controller 210 determines that the user is in a drowsy state if the user keeps the eye for a certain period of time longer than the vertical length h of the normal state.

In addition, by measuring the exposure range of the eyeball and the exposure time of the eyeball, it is possible to determine the frequency of eye blinking and the duty ratio of eye blinking, that is, You can decide. For example, in normal times, the ratio between the time of eye opening and the time of eye closing is significantly different. On the other hand, when fatigue is increased or in the drowsy state, the frequency of flickering of the eyes or the time of closing the eyes is increased, thereby increasing the duty ratio with respect to the time of closing the eyes. Accordingly, the controller 210 can recognize the drowsiness state of the user by using the frequency and / or the duty ratio of the eye flicker.

However, the method of determining whether the user is sleeping by using the measured time of eye exposure standard and the range of eye exposure standard is not limited to this, and various algorithms may be applied according to the type of the user.

The eyeball exposure reference range may be set to a range lower than a predetermined ratio of the normal eyeball exposure range. For example, the vertical length (h) of the user's eyes is measured, and the measured values are calculated and stored in the eye-on-eye learning unit 260. The measured average value is a steady state value, not a drowsy state. Since the eye size is different for each person, the vertical length (h) of each eye is measured for each user and used as a reference value for determining the drowsiness state do. In addition, the eyeball exposure reference range may be set to a range designated by the user as a sleeping state of the eyeball exposure range measured during the process of collecting the normal eyeball exposure range. For example, the eyeball region image of the user is acquired all day, stored in the eyeball exposure learning unit 260, and the eyeball region image of the drowsy state is extracted from the eyeball region image by selecting the point at which the user has slept. The maximum vertical height of the eye area or the width of the eye area of the extracted image is measured to set the eye exposure standard range.

The eyeball exposure reference time can be set as a reference and can be set based on a specific time by calculating a period of time during which the user blinks the eyes or a time taken for the user to wake up after the eyes are closed.

However, the setting of the eyeball exposure reference range and the eyeball exposure reference time is not limited to this, and may be set to various criteria for determining whether the user is sleeping.

If it is determined that the user is sleeping, an alarm is generated to the user (S400). The method of generating an alarm to the user may include an alarm system in which the vibration alarm unit of the glass wearable device generates vibration, an alarm system in which the sound output unit 320 of the glass wearable device outputs an alarm sound, The wearable device's brain wave tuning signal generator may provide an EEG tuning signal to stimulate the brain, and an alarm system based on the sound output of the external device.

6 is a configuration diagram of a drowsiness prevention system using a glass-type wearable device according to an embodiment of the present invention. In FIG. 6, a detailed description of the configuration described above will be omitted.

Referring to FIG. 6, a sleeping prevention system using a glass-type wearable device according to another embodiment of the present invention includes a second camera 122; A control unit 210; And an alarm unit 330.

The second camera 122 is provided on one side of the glass-type wearable device to acquire a real-time image around the user's eyes or a continuous image at a specific time interval.

The control unit 210 includes an eyeball exposure range measuring unit; Angumi Exposure Time Measurement Unit; And an alarm control unit.

The eyeball exposure range measuring unit performs a function of measuring an eyeball exposure range in the image or the image. The eyeball exposure range may be measured as the width of the eyeball region shown in the image or the image, or may be measured as the maximum height h of the user eye as shown in FIG.

The angular exposure time measuring unit measures the angular exposure time by analyzing the image or the image. The angular exposure time can be measured by the user's eye-blinking period or the time taken for the eye to re-rise after closing the eyes.

The alarm control unit determines whether or not an alarm is generated based on the measured eye exposure range and the angular exposure time. The alarm control unit compares the measured eyeball exposure reference time and eyeball exposure reference range with the stored eyeball exposure reference time and eyeball exposure reference range and maintains the state of the user's eye within the eyeball exposure reference range for at least the eyeball exposure reference time The user is determined to be in a state of being sleepy.

The alarm unit 330 provides an alarm for waking up the user. The alarm unit 330 may include a vibration alarm unit for generating vibration, an acoustic output unit 320 for outputting an alarm sound, and an EEG tuning signal generator for stimulating the brain by providing an EEG tuning signal.

In addition, the eyeball exposure learning unit 260 may be included. The eye-on-eye learning unit 260 performs a function of collecting and analyzing data on the eye-exposure range or the eye-gaze exposure time of the user. That is, the vertical length (h) of the user's eye is measured for a predetermined time, and the average value is calculated. The average time for the user to blink the eye or the time for the user to wake up after the eye is closed is calculated. This allows you to set the range of eye exposure thresholds or the time of eye exposure thresholds.

In addition, the control unit 210 may further include an alarm reference setting unit. The alarm criterion setting unit performs a function of setting a criterion of an eye exposure range or a fog exposure time for providing an alarm to a user.

According to the present invention as described above, the following various effects are obtained.

First, it is possible to awaken the user by various alarm methods by checking whether the user is sleeping through the wearable device of the glass type.

Secondly, by using a wearable wearable device which can be worn by the user at all times, it can be used in various situations such as not only during driving but also during learning.

Third, the user can set the criteria of the eyeball exposure range and the eyeball exposure time by photographing the eyeball during daily life, so that anyone can use it according to his / her eye size standard.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

100: system 110: user input
111: Application 112: Keyboard
113: voice input unit 114: touch pad
115: GPS signal unit 116: Local area communication
120: camera unit 121: first camera
122: second camera 123: third camera
130: sensing unit 131: gyro sensor
132: acceleration sensor 133: pressure sensor
134: iris recognition sensor 135: heart rate detection sensor
136: EMG sensor
210: information processing unit 220:
230: situation evaluation module 240: voice-to-text conversion module
250: wireless communication unit 260: memory
270:
300: output unit 310: display unit
320: Acoustic output unit 330:
340: Haptic module

Claims (8)

Acquiring an image around a user's eye or a continuous image at a specific time interval by a second camera of the glass-like wearable device;
Measuring an eyeball exposure range and an eyeball exposure time through the acquired image or image;
Determining a state of the user on the basis of the measured eye exposure range and the angular exposure time; And
And generating an alarm to the user when the user is determined to be in a sleeping state. The method according to claim 1,
Wherein the step of determining the user's condition based on the measured ocular exposure range and the ocular exposure time comprises:
And comparing the measured eyeball exposure reference time and eyeball exposure reference range with the stored eyeball exposure reference time and eyeball exposure reference range. The method according to claim 1,
Wherein when the user is determined to be in a sleeping state,
An alarm system by the vibration output of the glass wearable device, an alarm system by the sound output of the glass wearable device, an alarm system by the brain wearable device providing a brain wave tuning signal to stimulate the brain, The method of claim 1, wherein the at least one of the at least one of the at least one of the at least two of the at least one of the at least one of the at least one of the at least two of the at least two glasses. The method according to claim 1,
The eye-
Wherein the user is in a sleeping state of the eye exposure range measured in the process of collecting the normal eye exposure range or a range of the normal eye exposure range or less. A second camera for acquiring a real-time image around the user's eye or a continuous image at a specific time interval;
An eyeball exposure range measuring unit for measuring an eyeball exposure range in the image or the image, an eyeball exposure time measuring unit for measuring the eyeball exposure time by analyzing the image or the image, and the eyeball exposure range and the eyeball exposure time And an alarm control unit for determining whether or not an alarm is generated based on the alarm signal. And
And an alarm unit for providing an alarm for waking up the user's sleepiness. 6. The method of claim 5,
The alarm unit includes:
A wearable system using a glass wearable device comprising at least one of a vibration alarm unit for generating vibration, an acoustic output unit for outputting an alarm sound, and an EEG coherent signal generating unit for stimulating the brain by providing an EEG synchronization signal. 6. The method of claim 5,
And an eyeball exposure learning unit for collecting and analyzing data on the eyeball exposure range or the eyeball exposure time of the user at normal times. 6. The method of claim 5,
Wherein,
And an alarm reference setting unit for setting a reference of an eyeball exposure range or an eyeglass exposure time for providing an alarm to the user.

Images