KR20170026925A - Smart glasses using brain wave - Google Patents

Smart glasses using brain wave Download PDF

Info

Publication number
KR20170026925A
KR20170026925A KR1020150122908A KR20150122908A KR20170026925A KR 20170026925 A KR20170026925 A KR 20170026925A KR 1020150122908 A KR1020150122908 A KR 1020150122908A KR 20150122908 A KR20150122908 A KR 20150122908A KR 20170026925 A KR20170026925 A KR 20170026925A
Authority
KR
South Korea
Prior art keywords
module
display unit
target
unit
eeg
Prior art date
Application number
KR1020150122908A
Other languages
Korean (ko)
Other versions
KR101727155B1 (en
Inventor
송지성
박수조
박건우
이한울
고기훈
최혜원
Original Assignee
한양대학교 에리카산학협력단
송지성
최혜원
박건우
이한울
박수조
고기훈
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한양대학교 에리카산학협력단, 송지성, 최혜원, 박건우, 이한울, 박수조, 고기훈 filed Critical 한양대학교 에리카산학협력단
Priority to KR1020150122908A priority Critical patent/KR101727155B1/en
Publication of KR20170026925A publication Critical patent/KR20170026925A/en
Application granted granted Critical
Publication of KR101727155B1 publication Critical patent/KR101727155B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005—Input arrangements through a video camera

Abstract

The present invention provides a smart glass using brain waves capable of driving a smart glass using brain waves.
The smart glass using EEG according to an embodiment of the present invention includes an EEG measuring unit for measuring brain waves, an eye photographing unit for photographing the movement of the eyeball, a subject photographing unit for photographing an object, a display unit for displaying an image, An eye movement unit for displaying a target on the display unit and moving the target, and an information display unit for displaying information on the object photographed by the object photographing unit.

Description

{SMART GLASSES USING BRAIN WAVE}

The present invention relates to a smart glass, and more particularly, to a smart glass using an EEG.

Generally, brain waves are biological signals that directly or indirectly reflect human consciousness or unconscious state, and refers to a wavelength having a frequency of 30 Hz or less with a potential difference of tens of microvolts measured in all regions of human scalp.

These EEGs are classified into a delta wave, a theta wave, an alpha wave, a beta wave, and a gamma wave by frequency band. The delta wave is a brain wave with a frequency of less than 4Hz and typically appears in a normal sleep state. Theta wave is an EEG having a frequency of about 4 to 8 Hz, which is mainly observed when the state is disturbed or distracted. .

The alpha wave is an electroencephalogram with a frequency of about 8 to 12 Hz, which is generally stable when the mental state is stable, and the eye is closed and taking a relaxed psychological state. Alpha waves also occur when there is a high degree of concentration to separate from the surrounding situation, or when psychological stabilization has occurred due to meditation. Gamma wave is an EEG having a frequency of 30 to 50 Hz and appears in an excited state.

Beta waves refer to the EEG with a frequency of about 12 to 30 Hz, which is mainly observed when a little tension or attention is paid. Beta waves are widespread throughout the brain when exercising, learning, or performing tasks. The beta wave is divided into an SMR wave having a frequency of 12 to 15 Hz, an intermediate beta wave having a frequency of 15 to 18 Hz, and a high-beta wave having a frequency of 20 Hz or more. Beta waves are more stressful when exposed to stress such as anxiety or tension.

When attention is paid, SMR wave appears. When concentrated and normal activities are performed, middle beta waves with a frequency of 15 to 18 Hz appear in the left brain, and Kobe beat exceeding 20 Hz appears when tension and anxiety continue.

Although the convenience of providing information when gazing at objects using a smart glass, there is a problem that the eyeball easily becomes fatigued.

The present invention provides a smart glass using brain waves capable of driving a smart glass using brain waves.

The smart glass using EEG according to an embodiment of the present invention includes an EEG measuring unit for measuring brain waves, an eye photographing unit for photographing the movement of the eyeball, a subject photographing unit for photographing an object, a display unit for displaying an image, An eye movement unit for displaying a target on the display unit and moving the target, and an information display unit for displaying information on the object photographed by the object photographing unit.

In addition, the eye movement unit may include a visual determination module that determines the degree of eye fatigue based on the image captured by the eye capture unit.

In addition, the eye movement part may include an EEG judging module for judging the degree of eye fatigue through a change in EEG occurring according to the movement of the eyeball.

In addition, the EEG determining module can determine the degree of eye fatigue through the change of high beta and delta waves having a frequency of 20 Hz to 30 Hz.

In addition, the EEG judgment module can determine the degree of eye fatigue by measuring a change in P300 brain waves.

In addition, the eye movement part may include a target display module for displaying a target moving on a display part of the smart glass.

In addition, the target display module may move the target of the dot to a remote background on a nearby object, and gradually reduce the size of the target as the target moves to a remote background.

The information display unit may include a subject recognition module for recognizing a subject photographed by the subject photographing unit.

The information display unit may include an information selection module for displaying information on the selected object when the user selects an object displayed on the display unit using the brain waves.

The information display unit may include an information removal module for determining a change in brain waves and removing information on an object displayed on the display unit.

In addition, the smart glass may further include a mood adjusting unit for enlarging or reducing the image on the display unit.

The zoom controller may include a pupil measurement module that measures a size and a motion of the pupil in the image captured by the eyeball photographing unit.

The zoom adjusting unit may include a screen enlarging module for enlarging and displaying an image on the display unit when the size of the pupil is reduced and the intensity of the SMR wave is increased.

In addition, the zoom controller may include a screen reduction module for reducing and displaying an image on the display unit when the size of the pupil increases and the intensity of the SMR wave decreases.

The zoom controller may include a zoom stop module that stops the zoom function when the focus of the pupil moves sideways.

In addition, the smart glass may include a risk notification unit for analyzing a change in pupil size and changes in brain waves to determine a dangerous situation, and notifying a dangerous situation through wireless communication.

In addition, the danger notification unit may include a risk judgment module for generating a high-beta sound having a frequency of 20 Hz to 30 Hz and an alarm made of vibration or sound when the intensity of the gamma wave increases.

The risk notification unit may include a risk checking module for determining whether a signal for stopping the alarm is inputted.

In addition, the risk notification unit may include a notification transmission module for transmitting a structure request signal through wireless communication.

As described above, the smart glass using the EEG according to one aspect of the present invention includes the eye movement part, and when the eyes are fatigued, the eyes can be fatigued by using the eye movement part using the target.

In addition, information on the selected object is displayed using the EEG, so that the user can easily display desired information on the screen. It can also generate notifications and transmit rescue signals when a user is at risk.

1 is a perspective view illustrating a smart glass according to a first embodiment of the present invention.
FIG. 2 is a configuration diagram of a smart glass according to a first embodiment of the present invention.
3 is a view for explaining movement of a target in a smart glass according to the first embodiment of the present invention.
4 is a flowchart illustrating a method of driving a smart glass according to a first embodiment of the present invention.
FIG. 5 is a configuration diagram showing a smart glass according to a second embodiment of the present invention.
6 is a view for explaining movement of a target in a smart glass according to a second embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention can be variously modified and may have various embodiments, and specific embodiments will be described in detail with reference to the drawings. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, a smart glass according to a first embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG. FIG. 1 is a perspective view showing a smart glass according to a first embodiment of the present invention, and FIG. 2 is a view showing a smart glass according to a first embodiment of the present invention.

1 and 2, the smart glass 101 according to the first embodiment includes a frame 1 and a subject photographing unit 30 provided on the frame 1 and configured by a front camera for photographing an object, An eye photographing unit 20 which is installed in the subject 1 and is composed of a rear camera for photographing the eyeball, a display unit 80 fixed to the frame 1 to cover the eyes, a secondary display 4 for displaying information, (5) fixed to the earphone (1). An image is displayed on the display unit 80, and the display unit 80 may be made of a glass whose transparency can be adjusted.

The smart glass 101 includes a brain wave measuring unit 10, an eyeball photographing unit 20, a subject photographing unit 30, a display unit 80, an eyeball movement unit 40, an information display unit 60, (50).

The EEG measuring unit 10 comprises a device for receiving an EEG attached to a head of a user wearing a smart glass. The EEG measuring unit 10 may include a plurality of electrodes attached to the user's scalp. The EEG measuring unit 10 according to the present embodiment may be fixedly installed on the frame 1 via wires or the like, Or may be provided in the form of a pad on the frame 1 itself.

The eyeball photographing unit 20 is composed of a small camera fixedly mounted on the frame for photographing the movement of the eyeball and installed toward the eyes. The object photographing unit 30 is installed on the front surface of the smart glass 101 and is made of a camera for photographing an object.

The display unit 80 has a lens shape, and an image is displayed on the display unit 80. An image can be displayed on the display unit 80 by a projector method. The transparency of the display unit 80 is reduced when the image is displayed on the display unit 80 and the transparency is increased when the image is not displayed on the display unit 80 . The transparency of the display unit 80 can be controlled by adjusting the polarization state.

The eye movement unit 40 determines the eye fatigue of the user, displays the target on the display unit, and moves the target. The eye movement unit 40 includes a visual determination module 41, a brain wave determination module 42, and a target display module 43.

The visual determination module 41 analyzes the image captured by the eye-photographing unit 20 to determine the degree of eye fatigue. The visual determination module 41 determines the degree of eye fatigue by analyzing the congestion state of eyes, the focus change, the expansion speed of the cavity, and the reduction speed. That is, the visual determination module 41 determines that the eye fatigue is increased when the user looks at a nearby place for more than a predetermined time without changing the focus.

In addition, the eye movement unit 40 includes an EEG determining module 42 for determining the degree of eye fatigue through a change in EEG occurring according to the movement of the eyeball. The EEG judging module 42 can judge the degree of fatigue of the eye through the change of the high beta and the delta wave having the frequency of 20 Hz to 30 Hz. As the fatigue of the eye increases, the high beta increases and the motion of the eye decreases, and the delta wave decreases. Accordingly, the EEG judging module 42 can judge that the eye fatigue is high when the high beta is increased and the delta wave is decreased. In addition, the EEG judging module 42 can determine the degree of eye fatigue by measuring the change of P300 brain waves. P300 EEG refers to a positive peak of EEG appearing after 300 ms after a stimulus is given. As the fatigue of the eye increases, the perception of the object is delayed. Therefore, the P300 wave changes, and the EEG module 42 can judge the fatigue of the eye through these changes.

As shown in FIG. 3, the eye movement part 40 may include a target display module 43 for displaying a target 105 moving to the display part 80 of the smart glass. The target display module 43 displays the target 105 made of dots on the display portion 80 and moves the target 105. [ The target display module 43 moves the target 105 located on a nearby object to a distant background and gradually reduces the size of the target 105 as the target 105 moves to a remote background . The target display module 43 can also move the target to move repeatedly from near to far and from near to near at the target.

When the target 105 is displayed on the display unit 80, the focus of the pupil moves along the target. In this process, eye fatigue can be reduced by alternately observing the near distance and the far distance. Also, as the target 105 moves closer to the target, the size of the target 105 is increased, and when the target 105 is moved a long distance, the size of the target 105 is reduced, .

The information display unit 60 displays information on an object photographed by the object photographing unit 60. The information display unit 60 includes a object recognition module 61, an information selection module 62, and an information removal module 63 do.

The object recognizing module 61 recognizes an object photographed by the object photographing section. The object recognizing module 61 recognizes the object through the image processing program and connects the object to the object. Objects include objects or buildings, and information about objects can be retrieved using information stored in the GPS device, maps, and servers.

The information selection module 62 displays information about a selected object when the user selects an object displayed on the display unit 80 using an EEG. The user can select a desired object from the objects displayed on the display unit 80. In this case, since the focus of the pupil is directed toward the object, the user can specify the object selected. If information about the object is desired, And the SMR wave is increased, so that the user can judge that the user desires information about the object. Accordingly, the information selection module 62 can display the information by specifying the intention and object of the user through the focus of the pupil, whether the pupil is expanded, and the increase / decrease of the SMR wave.

After the information is displayed, if the user looks at another place or the SMR wave is decreased, the information removal module 63 deletes the information removal module from the information removal module 63, Removes information about objects from the display unit.

The zoom adjusting unit 50 enlarges or reduces the image on the display unit 80 and displays the pupil measurement module 51, the screen enlarging module 52, the screen reducing module 53, and the zoom stopping module 54 .

The pupil measurement module 51 measures the size and the motion of the pupil in the image photographed by the eyeball photographing unit 20. [ The screen magnification module 52 enlarges and displays the image on the display unit 80 when the pupil size is reduced and the intensity of the SMR wave is increased. When looking at a place where the user can not see clearly, the pupil is reduced to adjust the focal distance and the SMR wave is increased because the pupil gazes at the same place for at least 2 seconds. Accordingly, the screen magnification module 52 enlarges and displays the image on the display unit 80 when the pupil is reduced while the user gazes at the same place for 2 seconds or longer and the SMR wave increases.

The screen reduction module 53 reduces and displays the image on the display unit 80 when the size of the pupil increases and the intensity of the SMR wave decreases. The zoom stop module 54 stops the zoom function when the focus of the pupil moves sideways. The zoom stop module 54 determines that there is no intention to observe the same part any more when the user gazes at a place other than where the zoom is realized and stops the zoom function.

Hereinafter, a method of driving a smart glass according to a first embodiment of the present invention will be described with reference to FIG. 4 is a flowchart illustrating a method of driving a smart glass according to a first embodiment of the present invention.

Referring to FIG. 4, the driving method of the smart glass according to the first embodiment of the present invention includes steps E101, S102, S103, S104, (S105), a pupil measurement step (S106), a zoom adjustment step (S107), and a zoom stopping step (S108).

The EEG measurement step S101 measures the EEG of the user wearing the smart glass using the EEG measuring unit 10 attached to the user's head and receiving the EEG. In the eyeball imaging step (S102), the eyeball is photographed using a camera installed in a smart glass.

The fatigue determination step (S103) includes a visual determination step and a brain wave determination step to determine the eye fatigue of the user by analyzing the measured brain wave and the captured eye image.

The visual determination step determines the degree of fatigue of the eyeball by analyzing the image captured by the eyeball photographing unit 20. The visual judgment stage judges the eye fatigue by analyzing the congestion state of the eye, the focus change, the expansion speed of the cavity and the reduction speed.

The EEG judging step judges the degree of eye fatigue through the change of the EEG caused by the movement of the eyeball. The EEG decision stage can determine the degree of eye fatigue through the change of high beta and delta wave with frequency of 20Hz ~ 30Hz. As the fatigue of the eye increases, the high beta increases and the motion of the eye decreases, and the delta wave decreases. Therefore, it can be concluded that the eyeball is more fatigued when the high beta is increased and the delta wave is decreased. In addition, the EEG judging step can determine the degree of eye fatigue by measuring the change of P300 brain waves. P300 EEG refers to a positive peak of EEG appearing after 300 ms after a stimulus is given. As the fatigue of the eye increases, the perception of the object is delayed. Therefore, the change of the P300 wave occurs. In the step of determining the brain wave, these changes can determine the degree of fatigue of the eyeball.

The target display step (S104) displays a target made up of dots on the display unit. The target movement step S105 moves the displayed target on the display unit. The target moving step S105 moves the target 105 located on a nearby object to a distant background and gradually reduces the size of the target 105 as the target 105 moves to a remote background . In addition, the target movement step (S105) can move the target to move repeatedly from a near distance to a far distance and from a remote distance to a near distance.

The pupil measuring step (S106) measures the size and the motion of the pupil in the image taken in the eyeball shooting step.

The zoom adjustment step (S107) enlarges or reduces the image on the display unit for displaying an image according to changes in the pupil and the brain waves. The zoom adjusting step may include a screen enlarging step and a screen reducing step.

The screen enlarging step enlarges and displays the image on the display unit 80 when the size of the pupil decreases and the intensity of the SMR wave increases. When looking at a place where the user can not see clearly, the pupil is reduced to adjust the focal distance and the SMR wave is increased because the pupil gazes at the same place for at least 2 seconds. Accordingly, the user enlarges the image on the display unit 80 when the pupil is reduced while the user gazes at the same place for 2 seconds or more, and the SMR wave is increased.

The screen reduction step reduces and displays the image on the display unit 80 when the size of the pupil increases and the intensity of the SMR wave decreases. The zoom stop step stops the zoom function when the focus of the pupil moves sideways. In the zoom stopping step (S108), when the user gazes at a place other than where the zoom is realized, it is determined that there is no intention to observe the same part and the zoom function is stopped.

Hereinafter, a smart glass according to a second embodiment of the present invention will be described with reference to FIG. FIG. 5 is a configuration diagram showing a smart glass according to a second embodiment of the present invention.

5, the smart glass 102 according to the first embodiment includes a brain wave measuring unit 110, an eyeball photographing unit 120, a subject photographing unit 130, a display unit 180, an eyeball movement unit 140 An information display unit 160, a zoom control unit 150, and a danger notification unit 170. [

The EEG measuring unit 110 comprises a device for receiving an EEG attached to a head of a user wearing a smart glass. The EEG measuring unit 110 may include a plurality of electrodes attached to a scalp of a user. The EEG measuring unit 110 may be fixedly mounted on a frame via a wire or the like, It may be installed in a pad form.

The eyeball photographing unit 120 is composed of a small camera mounted on the frame for photographing the movement of the eyeball and installed toward the eyes. The object photographing unit 130 is installed on the front side of the smart glass 102 and includes a camera for photographing objects.

The display unit 180 has a lens shape, and an image is displayed on the display unit 180. An image can be displayed on the display unit 180 in a projector manner. When the image is displayed on the display unit 180, the transparency of the display unit 180 is decreased. When the image is not displayed on the display unit 180, the transparency of the display unit 180 is increased. . The transparency of the display unit 180 may be controlled by adjusting the polarization state.

The eye movement unit 140 determines the eye fatigue of the user, displays the target on the display unit, and moves the target. The eye movement unit 140 includes a visual determination module 141, an EEG determination module 142, and a target display module 143.

The visual determination module 141 analyzes the image captured by the eyeball capturing unit 120 to determine the degree of eye fatigue. The visual determination module 141 determines the degree of eye fatigue by analyzing the degree of congestion of the eyes, the focus change, the expansion speed of the cavity, and the reduction speed. That is, the visual determination module 141 determines that the degree of eye fatigue increases when the user looks at a nearby place for more than a predetermined time without changing the focus.

In addition, the eye movement unit 140 includes an EEG determining module 142 for determining the degree of eye fatigue through a change in EEG occurring according to the movement of the eyeball. The EEG judging module 142 can determine the degree of eye fatigue through the change of high beta and delta waves having a frequency of 20 Hz to 30 Hz. As the fatigue of the eye increases, the high beta increases and the motion of the eye decreases, and the delta wave decreases. Accordingly, the brain wave judgment module 142 can determine that the eye fatigue is high when the high beta is increased and the delta wave is decreased. In addition, the brain wave determination module 142 can determine the degree of eye fatigue by measuring the change of P300 brain waves. The P300 brain wave refers to a positive peak of the EEG occurring 300 ms after the stimulus is given. As the fatigue of the eye increases, the perception of the object is delayed, so that a change occurs in the P300 wave. The EEG module 142 can determine the degree of fatigue of the eye through such a change.

The eye movement part 140 may include a target display module 143 for displaying a target moving to the display part 180 of the smart glass. The target display module 143 displays a target made of dots on the display unit 180 and moves the target. The target display module 143 may move the target located on a nearby object to a remote background and gradually reduce the size of the target as the target moves to a remote background. The target display module 143 can also move the target to move repeatedly from near to far and from near to near at the target.

When the target is displayed on the display unit 180, the focus of the pupil moves along the target. In this process, it is possible to reduce the eye fatigue by alternately observing the near distance and the far distance. Also, if the target is moved to a close distance, the size of the target is increased, and if the target is moved to a longer distance, the size of the target is reduced, so that the user who views the target can easily perceive the perspective.

The information display unit 160 displays information about an object photographed by the object photographing unit 160. The information display unit 160 includes an object recognition module 161, an information selection module 162, and an information removal module 163 do.

The object recognizing module 161 recognizes an object photographed by the object photographing section. The object recognizing module 161 recognizes the object through the image processing program and connects the object to the object. Objects include objects or buildings, and information about objects can be retrieved using information stored in the GPS device, maps, and servers.

The information selection module 162 displays information on the selected object when the user selects an object displayed on the display unit 180 using an EEG. The user can select a desired object from the objects displayed on the display unit 180. In this case, since the focus of the pupil is directed toward the object, the user can specify the object selected. If information about the object is desired, And the SMR wave is increased, so that the user can judge that the user desires information about the object. Accordingly, the information selection module 162 can display the information by specifying the user's intention and object through the focus of the pupil, whether the pupil is expanded, and the increase / decrease of the SMR wave.

After the information is displayed, if the user looks at another place or the SMR wave is decreased, the information removing module 163 detects the change of the brain waves and removes the information about the object displayed on the display unit. Removes information about objects from the display unit.

The zoom adjusting unit 150 enlarges or reduces the image on the display unit 180 and displays the pupil measurement module 151, the screen enlarging module 152, the screen reducing module 153, and the zoom stopping module 154 .

The pupil measurement module 151 measures the size and the motion of the pupil in the image captured by the eyeball photographing unit 120. The screen magnification module 152 enlarges and displays the image on the display unit 180 when the pupil size is reduced and the intensity of the SMR wave is increased. When looking at a place where the user can not see clearly, the pupil is reduced to adjust the focal distance and the SMR wave is increased because the pupil gazes at the same place for at least 2 seconds. Accordingly, the screen magnification module 152 magnifies and displays the image on the display unit 180 when the pupil is reduced while the user gazes at the same place for 2 seconds or more and the SMR wave increases.

The screen reduction module 153 reduces and displays the image on the display unit 180 when the size of the pupil increases and the intensity of the SMR wave decreases. The zoom stop module 154 stops the zoom function when the focus of the pupil moves sideways. The zoom stop module 154 determines that there is no intention to observe the same portion any more when the user looks at a place other than where the zoom is realized and stops the zoom function.

The danger notification unit 170 analyzes a change in pupil size and changes in brain waves to determine a dangerous situation, and notifies a dangerous situation through wireless communication. The risk notification unit 170 includes a risk determination module 171, a risk identification module 172, and a notification transmission module 173.

The risk determination module 171 generates an alarm of vibration or sound when the size of the pupil increases and the intensity of the high beta and gamma waves having frequencies of 20 Hz to 30 Hz increases. When a risk occurs, the pupil expands due to the action of sympathetic nerves, and a stressful high beta appears. In addition, when an abnormality occurs in the body, the intensity of the gamma wave increases. The danger judgment module 171 generates sound or vibration when the pupil is expanded, the intensity of the Kobe beat increases, and the appearance of the gamma wave continues for 20 seconds or more.

The risk identification module 172 determines whether or not a signal for stopping the alarm is input. If an alarm interruption signal is input and the sound or vibration generated by the risk judgment module is removed by the user or by the operation of the surrounding persons, the user is judged that there is no abnormality in health or there is a person to help and no longer notifies the danger. However, if the alarm continues for more than the preset time, it is judged that it is a dangerous situation. The predetermined time may be from 1 minute to 5 minutes.

In the notification transmission module 173, the risk notification unit transmits a rescue request signal through wireless communication. The notification transmission module 173 transmits the rescue request signal to the contact registered by the user, and the rescue request signal includes a character or voice message and the location information of the user.

Hereinafter, a method of driving a smart glass according to a second embodiment of the present invention will be described with reference to FIG. 6 is a flowchart illustrating a method of driving a smart glass according to a second embodiment of the present invention.

Referring to FIG. 6, the driving method of the smart glass according to the second embodiment of the present invention includes steps of EEG measurement step S201, eyeball imaging step S202, fatigue determination step S203, target display step S204, (S205), and a risk notification step (S206).

The brain wave measuring step (S201) measures the brain waves of the user wearing the smart glass using the brain wave measuring unit 110 attached to the head of the user and receiving the brain waves. In the eyeball imaging step (S202), the eyeball is photographed using a camera installed in a smart glass.

In the fatigue determination step (S203), the eyeball fatigue of the user is analyzed by analyzing the measured brain waves and the captured eyeball image, and includes a visual determination step and an EEG determining step.

The visual determination step determines the degree of eye fatigue by analyzing the image captured by the eyeball photographing unit 120. The visual judgment stage judges the eye fatigue by analyzing the congestion state of the eye, the focus change, the expansion speed of the cavity and the reduction speed.

The EEG judging step judges the degree of eye fatigue through the change of the EEG caused by the movement of the eyeball. The EEG decision stage can determine the degree of eye fatigue through the change of high beta and delta wave with frequency of 20Hz ~ 30Hz. As the fatigue of the eye increases, the high beta increases and the motion of the eye decreases, and the delta wave decreases. Therefore, it can be concluded that the eyeball is more fatigued when the high beta is increased and the delta wave is decreased. In addition, the EEG judging step can determine the degree of eye fatigue by measuring the change of P300 brain waves. The P300 brain wave refers to a positive peak of the EEG occurring 300 ms after the stimulus is given. As the fatigue of the eye increases, the perception of the object is delayed. Therefore, the change of the P300 wave occurs. In the step of determining the brain wave, these changes can determine the degree of fatigue of the eyeball.

The target display step (S204) displays a target made of dots on the display unit. The target movement step (S205) moves the displayed target on the display unit. The target movement step (S205) may move the target located on a nearby object to a distant background, and gradually reduce the size of the target as the target moves to a remote background. In addition, the target movement step (S205) can move the target to move repeatedly from near to far, and from near to far.

The risk notification step (S206) analyzes a change in pupil size and changes in brain waves to determine a dangerous situation and notifies a dangerous situation through wireless communication. The risk notification step includes a risk determination step, a risk identification step, and a notification transmission step.

The risk determination step generates an alarm of vibration or sound when the size of the pupil increases and the intensity of the high-beta and gamma waves with a frequency of 20 Hz to 30 Hz increases. When a risk occurs, the pupil expands due to the action of sympathetic nerves, and a stressful high beta appears. In addition, when an abnormality occurs in the body, the intensity of the gamma wave increases. Thus, when the pupil expansion, the intensity of Kobe beat, and the appearance of gamma waves continue for more than 20 seconds, the danger judgment step generates sound or vibration.

The risk checking step determines whether or not a signal for stopping the alarm is input. If an alarm interruption signal is input and the sound or vibration generated by the risk judgment module is removed by the user or by the operation of the surrounding persons, the user is judged that there is no abnormality in health or there is a person to help and no longer notifies the danger. However, if the alarm continues for more than the preset time, it is judged that it is a dangerous situation. The predetermined time may be from 1 minute to 5 minutes.

In the notification transmission step, the risk notification unit transmits a rescue request signal through wireless communication. The alert transmission step transmits the rescue request signal to the contact registered by the user, and the rescue request signal includes the text or voice message and the location information of the user.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

101, 102: Smart glass
1: frame
4: Secondary display
5: earphone
105: Target
10, 110: EEG measurement unit
20, 120: eyeball shooting part
30, 130:
40, 140:
41, 141: visual judgment module
42, 142: EEG judgment module
43, 143: target display module
50, 150: zoom control unit
51, 151: Pupil measurement module
52, 152: Screen magnification module
53, 153: Screen Reduction Module
54, 154: zoom stop module
60, 160: information display section
61, 161: Object recognition module
62, 162: information selection module
63, 163: Information removal module
80, 180:
170: Hazard notification section
171: Risk Judgment Module
172: Hazard identification module
173: Notification transmission module

Claims (19)

An EEG measuring unit for measuring EEG;
An eyeball section for photographing movement of the eyeball;
A subject photographing section for photographing an object;
A display unit for displaying an image;
An eye movement unit for determining a user's eye fatigue and displaying a target on the display unit and moving the target; And
An information display unit for displaying information on an object photographed by the object photographing unit;
And a smart glass using the EEG.
The method according to claim 1,
Wherein the eye movement unit includes a visual determination module for determining the degree of eye fatigue based on the image captured by the eye image capture unit.
3. The method of claim 2,
Wherein the eye movement part includes an EEG judging module for judging the degree of eye fatigue through a change of EEG caused by the movement of the eyeball.
The method of claim 3,
Wherein the EEG judging module judges the degree of eye fatigue through a change of a high beta and a delta wave having a frequency of 20 Hz to 30 Hz.
The method of claim 3,
Wherein the EEG determining module determines a degree of eye fatigue by measuring a change in P300 brain waves.
The method of claim 3,
Wherein the eye movement part includes a target display module for displaying a target moving to a display part of the smart glass.
The method of claim 3,
Wherein the target display module moves a target made of dots to a remote background on a nearby object and gradually reduces the size of the target as the target moves to a remote background, .
The method of claim 3,
Wherein the information display unit includes a subject recognition module for recognizing a subject photographed by the subject photographing unit.
9. The method of claim 8,
Wherein the information display unit includes an information selection module for displaying information about a selected object when the user selects an object displayed on the display unit using an EEG.
10. The method of claim 9,
Wherein the information display unit includes an information removal module for determining a change in brain waves and removing information on an object displayed on the display unit.
10. The method of claim 9,
Wherein the smart glass further comprises a moxa control unit for enlarging or reducing the image on the display unit.
12. The method of claim 11,
Wherein the zoom controller comprises a pupil measurement module for measuring pupil size and motion in an image captured by the eyeball photographing unit.
13. The method of claim 12,
Wherein the zoom controller includes a screen magnification module for enlarging and displaying an image on the display unit when the size of the pupil is reduced and the intensity of the SMR wave is increased.
14. The method of claim 13,
Wherein the zoom adjusting unit includes a screen reducing module for reducing and displaying an image on the display unit when the size of the pupil increases and the intensity of the SMR wave decreases.
15. The method of claim 14,
Wherein the zoom controller includes a zoom stop module for stopping the zoom function when the focus of the pupil moves sideways.
The method according to claim 1,
Wherein the smart glass includes a risk notification unit for analyzing a change in pupil size and a change in brain waves to determine a dangerous situation and notifying a dangerous situation through wireless communication.
17. The method of claim 16,
Wherein the danger notification unit includes a risk determination module that generates an alarm consisting of vibration or sound when the size of the pupil increases and the intensity of the high beta and gamma waves increases with a frequency of 20 Hz to 30 Hz. Smart glass.
18. The method of claim 17,
Wherein the risk notification unit includes a risk identification module for determining whether or not a signal for stopping the upper limit alarm is input.
19. The method of claim 18,
Wherein the risk notification unit includes an alert transmission module for transmitting a rescue request signal through wireless communication.
KR1020150122908A 2015-08-31 2015-08-31 Smart glasses using brain wave KR101727155B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150122908A KR101727155B1 (en) 2015-08-31 2015-08-31 Smart glasses using brain wave

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150122908A KR101727155B1 (en) 2015-08-31 2015-08-31 Smart glasses using brain wave

Publications (2)

Publication Number Publication Date
KR20170026925A true KR20170026925A (en) 2017-03-09
KR101727155B1 KR101727155B1 (en) 2017-04-25

Family

ID=58402275

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150122908A KR101727155B1 (en) 2015-08-31 2015-08-31 Smart glasses using brain wave

Country Status (1)

Country Link
KR (1) KR101727155B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102118333B1 (en) * 2018-06-27 2020-06-04 연세대학교 원주산학협력단 Treadwheel for animal and control method thereof
KR102121548B1 (en) * 2018-07-17 2020-06-11 연세대학교 원주산학협력단 Training apparatus for animal and control method thereof

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101203921B1 (en) * 2011-09-21 2012-11-27 유제형 Information providing apparatus using an eye tracking and local based service

Also Published As

Publication number Publication date
KR101727155B1 (en) 2017-04-25

Similar Documents

Publication Publication Date Title
CN104252042B (en) The control method of head-mount formula display device and head-mount formula display device
US20240032788A1 (en) Monitoring neurological functional status
JP6184989B2 (en) Biosensor, communicator and controller for monitoring eye movement and methods for using them
CN106471419B (en) Management information is shown
US11602296B2 (en) Non-invasive systems and methods for detecting mental impairment
KR101536348B1 (en) method and apparatus for detecting drowsiness by physiological signal by using video
JP2008099834A (en) Display device and display method
JP2015177403A (en) Head-mounted display device and method of controlling head-mounted display device
US20180064335A1 (en) Retinal imager device and system with edge processing
JP2018187287A (en) Sensitivity estimation device, sensitivity estimation system, sensitivity estimation method and program
KR101769506B1 (en) Control mehthod for smart glasses using brain wave
EP3509475A1 (en) Retinal imager device and system with edge processing
KR101727155B1 (en) Smart glasses using brain wave
US20210389587A1 (en) Head-mount display and head-mount display system
WO2017016941A1 (en) Wearable device, method and computer program product
KR20160016149A (en) System and method for preventing drowsiness by wearable glass device
KR102422548B1 (en) Apparatus, method, computer-readable storage medium and computer program for assisting visual field
EP4197425A1 (en) Determining a visual performance of an eye of a person
TW200416581A (en) Vision-driving control system and control method thereof
US20240115831A1 (en) Enhanced meditation experience based on bio-feedback
JP2022051185A (en) Information provision device, information provision method, and program
JP2022051184A (en) Information provision device, information provision method, and program
JP2022051186A (en) Information provision device, information provision method, and program
JP2015012433A (en) Head-mounted display device and method of controlling head-mounted display device
KR20160100654A (en) method and apparatus for detecting drowsiness by physiological signal by using video

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right