KR101727155B1 - Smart glasses using brain wave - Google Patents
Smart glasses using brain wave Download PDFInfo
- Publication number
- KR101727155B1 KR101727155B1 KR1020150122908A KR20150122908A KR101727155B1 KR 101727155 B1 KR101727155 B1 KR 101727155B1 KR 1020150122908 A KR1020150122908 A KR 1020150122908A KR 20150122908 A KR20150122908 A KR 20150122908A KR 101727155 B1 KR101727155 B1 KR 101727155B1
- Authority
- KR
- South Korea
- Prior art keywords
- module
- display unit
- target
- unit
- eeg
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
- G06F3/005—Input arrangements through a video camera
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Dermatology (AREA)
- Neurosurgery (AREA)
- Neurology (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Multimedia (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The present invention provides a smart glass using brain waves capable of driving a smart glass using brain waves.
The smart glass using EEG according to an embodiment of the present invention includes an EEG measuring unit for measuring brain waves, an eye photographing unit for photographing the movement of the eyeball, a subject photographing unit for photographing an object, a display unit for displaying an image, An eye movement unit for displaying a target on the display unit and moving the target, and an information display unit for displaying information on the object photographed by the object photographing unit.
Description
The present invention relates to a smart glass, and more particularly, to a smart glass using an EEG.
Generally, brain waves are biological signals that directly or indirectly reflect human consciousness or unconscious state, and refers to a wavelength having a frequency of 30 Hz or less with a potential difference of tens of microvolts measured in all regions of human scalp.
These EEGs are classified into a delta wave, a theta wave, an alpha wave, a beta wave, and a gamma wave by frequency band. The delta wave is a brain wave with a frequency of less than 4Hz and typically appears in a normal sleep state. Theta wave is an EEG having a frequency of about 4 to 8 Hz, which is mainly observed when the state is disturbed or distracted. .
The alpha wave is an electroencephalogram with a frequency of about 8 to 12 Hz, which is generally stable when the mental state is stable, and the eye is closed and taking a relaxed psychological state. Alpha waves also occur when there is a high degree of concentration to separate from the surrounding situation, or when psychological stabilization has occurred due to meditation. Gamma wave is an EEG having a frequency of 30 to 50 Hz and appears in an excited state.
Beta waves refer to the EEG with a frequency of about 12 to 30 Hz, which is mainly observed when a little tension or attention is paid. Beta waves are widespread throughout the brain when exercising, learning, or performing tasks. The beta wave is divided into an SMR wave having a frequency of 12 to 15 Hz, an intermediate beta wave having a frequency of 15 to 18 Hz, and a high-beta wave having a frequency of 20 Hz or more. Beta waves are more stressful when exposed to stress such as anxiety or tension.
When attention is paid, SMR wave appears. When concentrated and normal activities are performed, middle beta waves with a frequency of 15 to 18 Hz appear in the left brain, and Kobe beat exceeding 20 Hz appears when tension and anxiety continue.
Although the convenience of providing information when gazing at objects using a smart glass, there is a problem that the eyeball easily becomes fatigued.
The present invention provides a smart glass using brain waves capable of driving a smart glass using brain waves.
The smart glass using EEG according to an embodiment of the present invention includes an EEG measuring unit for measuring brain waves, an eye photographing unit for photographing the movement of the eyeball, a subject photographing unit for photographing an object, a display unit for displaying an image, An eye movement unit for displaying a target on the display unit and moving the target, and an information display unit for displaying information on the object photographed by the object photographing unit.
In addition, the eye movement unit may include a visual determination module that determines the degree of eye fatigue based on the image captured by the eye capture unit.
In addition, the eye movement part may include an EEG judging module for judging the degree of eye fatigue through a change in EEG occurring according to the movement of the eyeball.
In addition, the EEG determining module can determine the degree of eye fatigue through the change of high beta and delta waves having a frequency of 20 Hz to 30 Hz.
In addition, the EEG judgment module can determine the degree of eye fatigue by measuring a change in P300 brain waves.
In addition, the eye movement part may include a target display module for displaying a target moving on a display part of the smart glass.
In addition, the target display module may move the target of the dot to a remote background on a nearby object, and gradually reduce the size of the target as the target moves to a remote background.
The information display unit may include a subject recognition module for recognizing a subject photographed by the subject photographing unit.
The information display unit may include an information selection module for displaying information on the selected object when the user selects an object displayed on the display unit using the brain waves.
The information display unit may include an information removal module for determining a change in brain waves and removing information on an object displayed on the display unit.
In addition, the smart glass may further include a mood adjusting unit for enlarging or reducing the image on the display unit.
The zoom controller may include a pupil measurement module that measures a size and a motion of the pupil in the image captured by the eyeball photographing unit.
The zoom adjusting unit may include a screen enlarging module for enlarging and displaying an image on the display unit when the size of the pupil is reduced and the intensity of the SMR wave is increased.
In addition, the zoom controller may include a screen reduction module for reducing and displaying an image on the display unit when the size of the pupil increases and the intensity of the SMR wave decreases.
The zoom controller may include a zoom stop module that stops the zoom function when the focus of the pupil moves sideways.
In addition, the smart glass may include a risk notification unit for analyzing a change in pupil size and changes in brain waves to determine a dangerous situation, and notifying a dangerous situation through wireless communication.
In addition, the danger notification unit may include a risk judgment module for generating a high-beta sound having a frequency of 20 Hz to 30 Hz and an alarm made of vibration or sound when the intensity of the gamma wave increases.
The risk notification unit may include a risk checking module for determining whether a signal for stopping the alarm is inputted.
In addition, the risk notification unit may include a notification transmission module for transmitting a structure request signal through wireless communication.
As described above, the smart glass using the EEG according to one aspect of the present invention includes the eye movement part, and when the eyes are fatigued, the eyes can be fatigued by using the eye movement part using the target.
In addition, information on the selected object is displayed using the EEG, so that the user can easily display desired information on the screen. It can also generate notifications and transmit rescue signals when a user is at risk.
1 is a perspective view illustrating a smart glass according to a first embodiment of the present invention.
FIG. 2 is a configuration diagram of a smart glass according to a first embodiment of the present invention.
3 is a view for explaining movement of a target in a smart glass according to the first embodiment of the present invention.
4 is a flowchart illustrating a method of driving a smart glass according to a first embodiment of the present invention.
FIG. 5 is a configuration diagram showing a smart glass according to a second embodiment of the present invention.
6 is a view for explaining movement of a target in a smart glass according to a second embodiment of the present invention.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention can be variously modified and may have various embodiments, and specific embodiments will be described in detail with reference to the drawings. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.
For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.
Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.
Hereinafter, a smart glass according to a first embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG. FIG. 1 is a perspective view showing a smart glass according to a first embodiment of the present invention, and FIG. 2 is a view showing a smart glass according to a first embodiment of the present invention.
1 and 2, the
The
The
The
The
The
The
In addition, the
As shown in FIG. 3, the
When the
The
The
The
After the information is displayed, if the user looks at another place or the SMR wave is decreased, the
The
The
The
Hereinafter, a method of driving a smart glass according to a first embodiment of the present invention will be described with reference to FIG. 4 is a flowchart illustrating a method of driving a smart glass according to a first embodiment of the present invention.
Referring to FIG. 4, the driving method of the smart glass according to the first embodiment of the present invention includes steps E101, S102, S103, S104, (S105), a pupil measurement step (S106), a zoom adjustment step (S107), and a zoom stopping step (S108).
The EEG measurement step S101 measures the EEG of the user wearing the smart glass using the
The fatigue determination step (S103) includes a visual determination step and a brain wave determination step to determine the eye fatigue of the user by analyzing the measured brain wave and the captured eye image.
The visual determination step determines the degree of fatigue of the eyeball by analyzing the image captured by the
The EEG judging step judges the degree of eye fatigue through the change of the EEG caused by the movement of the eyeball. The EEG decision stage can determine the degree of eye fatigue through the change of high beta and delta wave with frequency of 20Hz ~ 30Hz. As the fatigue of the eye increases, the high beta increases and the motion of the eye decreases, and the delta wave decreases. Therefore, it can be concluded that the eyeball is more fatigued when the high beta is increased and the delta wave is decreased. In addition, the EEG judging step can determine the degree of eye fatigue by measuring the change of P300 brain waves. P300 EEG refers to a positive peak of EEG appearing after 300 ms after a stimulus is given. As the fatigue of the eye increases, the perception of the object is delayed. Therefore, the change of the P300 wave occurs. In the step of determining the brain wave, these changes can determine the degree of fatigue of the eyeball.
The target display step (S104) displays a target made up of dots on the display unit. The target movement step S105 moves the displayed target on the display unit. The target moving step S105 moves the
The pupil measuring step (S106) measures the size and the motion of the pupil in the image taken in the eyeball shooting step.
The zoom adjustment step (S107) enlarges or reduces the image on the display unit for displaying an image according to changes in the pupil and the brain waves. The zoom adjusting step may include a screen enlarging step and a screen reducing step.
The screen enlarging step enlarges and displays the image on the
The screen reduction step reduces and displays the image on the
Hereinafter, a smart glass according to a second embodiment of the present invention will be described with reference to FIG. FIG. 5 is a configuration diagram showing a smart glass according to a second embodiment of the present invention.
5, the
The
The
The
The
The
In addition, the
The
When the target is displayed on the
The
The
The
After the information is displayed, if the user looks at another place or the SMR wave is decreased, the
The
The
The
The danger notification unit 170 analyzes a change in pupil size and changes in brain waves to determine a dangerous situation, and notifies a dangerous situation through wireless communication. The risk notification unit 170 includes a
The
The
In the
Hereinafter, a method of driving a smart glass according to a second embodiment of the present invention will be described with reference to FIG. 6 is a flowchart illustrating a method of driving a smart glass according to a second embodiment of the present invention.
Referring to FIG. 6, the driving method of the smart glass according to the second embodiment of the present invention includes steps of EEG measurement step S201, eyeball imaging step S202, fatigue determination step S203, target display step S204, (S205), and a risk notification step (S206).
The brain wave measuring step (S201) measures the brain waves of the user wearing the smart glass using the brain
In the fatigue determination step (S203), the eyeball fatigue of the user is analyzed by analyzing the measured brain waves and the captured eyeball image, and includes a visual determination step and an EEG determining step.
The visual determination step determines the degree of eye fatigue by analyzing the image captured by the
The EEG judging step judges the degree of eye fatigue through the change of the EEG caused by the movement of the eyeball. The EEG decision stage can determine the degree of eye fatigue through the change of high beta and delta wave with frequency of 20Hz ~ 30Hz. As the fatigue of the eye increases, the high beta increases and the motion of the eye decreases, and the delta wave decreases. Therefore, it can be concluded that the eyeball is more fatigued when the high beta is increased and the delta wave is decreased. In addition, the EEG judging step can determine the degree of eye fatigue by measuring the change of P300 brain waves. The P300 brain wave refers to a positive peak of the EEG occurring 300 ms after the stimulus is given. As the fatigue of the eye increases, the perception of the object is delayed. Therefore, the change of the P300 wave occurs. In the step of determining the brain wave, these changes can determine the degree of fatigue of the eyeball.
The target display step (S204) displays a target made of dots on the display unit. The target movement step (S205) moves the displayed target on the display unit. The target movement step (S205) may move the target located on a nearby object to a distant background, and gradually reduce the size of the target as the target moves to a remote background. In addition, the target movement step (S205) can move the target to move repeatedly from near to far, and from near to far.
The risk notification step (S206) analyzes a change in pupil size and changes in brain waves to determine a dangerous situation and notifies a dangerous situation through wireless communication. The risk notification step includes a risk determination step, a risk identification step, and a notification transmission step.
The risk determination step generates an alarm of vibration or sound when the size of the pupil increases and the intensity of the high-beta and gamma waves with a frequency of 20 Hz to 30 Hz increases. When a risk occurs, the pupil expands due to the action of sympathetic nerves, and a stressful high beta appears. In addition, when an abnormality occurs in the body, the intensity of the gamma wave increases. Thus, when the pupil expansion, the intensity of Kobe beat, and the appearance of gamma waves continue for more than 20 seconds, the danger judgment step generates sound or vibration.
The risk checking step determines whether or not a signal for stopping the alarm is input. If an alarm interruption signal is input and the sound or vibration generated by the risk judgment module is removed by the user or by the operation of the surrounding persons, the user is judged that there is no abnormality in health or there is a person to help and no longer notifies the danger. However, if the alarm continues for more than the preset time, it is judged that it is a dangerous situation. The predetermined time may be from 1 minute to 5 minutes.
In the notification transmission step, the risk notification unit transmits a rescue request signal through wireless communication. The alert transmission step transmits the rescue request signal to the contact registered by the user, and the rescue request signal includes the text or voice message and the location information of the user.
As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.
101, 102: Smart glass
1: frame
4: Secondary display
5: earphone
105: Target
10, 110: EEG measurement unit
20, 120: eyeball shooting part
30, 130:
40, 140:
41, 141: visual judgment module
42, 142: EEG judgment module
43, 143: target display module
50, 150: zoom control unit
51, 151: Pupil measurement module
52, 152: Screen magnification module
53, 153: Screen Reduction Module
54, 154: zoom stop module
60, 160: information display section
61, 161: Object recognition module
62, 162: information selection module
63, 163: Information removal module
80, 180:
170: Hazard notification section
171: Risk Judgment Module
172: Hazard identification module
173: Notification transmission module
Claims (19)
Wherein the eye movement part includes an EEG judging module for judging the degree of eye fatigue through a change of EEG caused by the movement of the eyeball.
Wherein the eye movement unit includes a visual determination module for determining the degree of eye fatigue based on the image captured by the eye image capture unit.
Wherein the EEG judging module judges the degree of eye fatigue through a change of a high beta and a delta wave having a frequency of 20 Hz to 30 Hz.
Wherein the EEG determining module determines a degree of eye fatigue by measuring a change in P300 brain waves.
Wherein the eye movement part includes a target display module for displaying a target moving to a display part of the smart glass.
Wherein the target display module moves a target made of dots to a remote background on a nearby object and gradually reduces the size of the target as the target moves to a remote background, .
Wherein the information display unit includes a subject recognition module for recognizing a subject photographed by the subject photographing unit.
Wherein the information display unit includes an information selection module for displaying information about a selected object when the user selects an object displayed on the display unit using an EEG.
Wherein the information display unit includes an information removal module for determining a change in brain waves and removing information on an object displayed on the display unit.
Wherein the smart glass further comprises a zoom adjusting unit for enlarging or reducing the image on the display unit.
Wherein the zoom controller comprises a pupil measurement module for measuring pupil size and motion in an image captured by the eyeball photographing unit.
Wherein the zoom controller includes a screen magnification module for enlarging and displaying an image on the display unit when the size of the pupil is reduced and the intensity of the SMR wave is increased.
Wherein the zoom adjusting unit includes a screen reducing module for reducing and displaying an image on the display unit when the size of the pupil increases and the intensity of the SMR wave decreases.
Wherein the zoom controller includes a zoom stop module for stopping the zoom function when the focus of the pupil moves sideways.
Wherein the smart glass includes a risk notification unit for analyzing a change in pupil size and a change in brain waves to determine a dangerous situation and notifying a dangerous situation through wireless communication.
Wherein the danger notification unit includes a risk determination module that generates an alarm consisting of vibration or sound when the size of the pupil increases and the intensity of the high beta and gamma waves increases with a frequency of 20 Hz to 30 Hz. Smart glass.
Wherein the risk notification unit includes a risk identification module for determining whether or not a signal for stopping the upper limit alarm is input.
Wherein the risk notification unit includes an alert transmission module for transmitting a rescue request signal through wireless communication.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150122908A KR101727155B1 (en) | 2015-08-31 | 2015-08-31 | Smart glasses using brain wave |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150122908A KR101727155B1 (en) | 2015-08-31 | 2015-08-31 | Smart glasses using brain wave |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20170026925A KR20170026925A (en) | 2017-03-09 |
KR101727155B1 true KR101727155B1 (en) | 2017-04-25 |
Family
ID=58402275
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150122908A KR101727155B1 (en) | 2015-08-31 | 2015-08-31 | Smart glasses using brain wave |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101727155B1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20200001172A (en) * | 2018-06-27 | 2020-01-06 | 연세대학교 원주산학협력단 | Treadwheel for animal and control method thereof |
KR20200008784A (en) * | 2018-07-17 | 2020-01-29 | 연세대학교 원주산학협력단 | Training apparatus for animal and control method thereof |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101203921B1 (en) * | 2011-09-21 | 2012-11-27 | 유제형 | Information providing apparatus using an eye tracking and local based service |
-
2015
- 2015-08-31 KR KR1020150122908A patent/KR101727155B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101203921B1 (en) * | 2011-09-21 | 2012-11-27 | 유제형 | Information providing apparatus using an eye tracking and local based service |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20200001172A (en) * | 2018-06-27 | 2020-01-06 | 연세대학교 원주산학협력단 | Treadwheel for animal and control method thereof |
KR102118333B1 (en) | 2018-06-27 | 2020-06-04 | 연세대학교 원주산학협력단 | Treadwheel for animal and control method thereof |
KR20200008784A (en) * | 2018-07-17 | 2020-01-29 | 연세대학교 원주산학협력단 | Training apparatus for animal and control method thereof |
KR102121548B1 (en) * | 2018-07-17 | 2020-06-11 | 연세대학교 원주산학협력단 | Training apparatus for animal and control method thereof |
Also Published As
Publication number | Publication date |
---|---|
KR20170026925A (en) | 2017-03-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104252042B (en) | The control method of head-mount formula display device and head-mount formula display device | |
US20240032788A1 (en) | Monitoring neurological functional status | |
CN106471419B (en) | Management information is shown | |
JP6184989B2 (en) | Biosensor, communicator and controller for monitoring eye movement and methods for using them | |
US9117124B2 (en) | Driving attention amount determination device, method, and computer program | |
US11602296B2 (en) | Non-invasive systems and methods for detecting mental impairment | |
KR101536348B1 (en) | method and apparatus for detecting drowsiness by physiological signal by using video | |
US20180064335A1 (en) | Retinal imager device and system with edge processing | |
JP2015177403A (en) | Head-mounted display device and method of controlling head-mounted display device | |
KR101769506B1 (en) | Control mehthod for smart glasses using brain wave | |
JP2018187287A (en) | Sensitivity estimation device, sensitivity estimation system, sensitivity estimation method and program | |
EP3509475A1 (en) | Retinal imager device and system with edge processing | |
KR101727155B1 (en) | Smart glasses using brain wave | |
WO2017016941A1 (en) | Wearable device, method and computer program product | |
KR20160016149A (en) | System and method for preventing drowsiness by wearable glass device | |
KR102422548B1 (en) | Apparatus, method, computer-readable storage medium and computer program for assisting visual field | |
WO2022059784A1 (en) | Information provision device, information provision method, and program | |
US20240268660A1 (en) | Determining a visual performance of an eye of a person | |
TW200416581A (en) | Vision-driving control system and control method thereof | |
JP2022051185A (en) | Information provision device, information provision method, and program | |
JP2022051184A (en) | Information provision device, information provision method, and program | |
JP2022051186A (en) | Information provision device, information provision method, and program | |
JP2024002120A (en) | Program and information processing device | |
JP2015012433A (en) | Head-mounted display device and method of controlling head-mounted display device | |
KR20160100654A (en) | method and apparatus for detecting drowsiness by physiological signal by using video |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right |