WO2018080149A2 - Biometric-linked virtual reality-cognitive rehabilitation system - Google Patents

Abstract

The present invention relates to a virtual reality-cognitive rehabilitation apparatus. More specifically, the present invention relates to a virtual reality-cognitive rehabilitation training apparatus which can perform cognitive impairment prevention training and cognitive rehabilitation therapy by displaying a virtual reality content on a smart glass device that is operated in connection with bio-signal sensors. A biometric-linked virtual reality-cognitive rehabilitation system according to an embodiment of the present invention may comprise: a head mounted display including an optical module for transmitting, to a user's eyes, image light emitted from at least one display; an electroencephalogram sensor for sensing at least one brain wave of the user; an electromyogram sensor for sensing an electromyogram which varies according to movements of the user; and a control unit for controlling the head mounted display such that, when information sensed through at least one of the electroencephalogram sensor and the electromyogram sensor satisfies a predetermined condition, the head mounted display outputs a different content.

Description

Bio-Signaling Virtual Reality Cognitive Rehabilitation System

The present invention relates to a virtual reality cognitive rehabilitation device. More specifically, the present invention relates to a virtual reality cognitive rehabilitation training device that can perform cognitive function prevention training and rehabilitation treatment by displaying virtual reality content on a smart glass device driven in conjunction with a biosignal sensor.

Virtual reality is a computer-to-human interface that creates a 3D content with a certain environment or situation through a computer, making the person using the 3D content as if they are interacting with the environment or environment around them. Generic interface and so on.

In general, the three-dimensional sense perceived by a person is the degree of change in the thickness of the lens according to the position of the object to be observed, the difference in angle between the two eyes and the object, the difference in the position and shape of the visible object in the left and right eyes, and the parallax caused by the movement of the object. In addition, the effects of various psychological and memory effects are combined.

Among them, the most important factor of the three-dimensional feeling is the binocular disparity that appears when the human eyes are about 6.5 cm apart in the horizontal direction. In other words, binocular parallax is used to look at the angle with respect to the object, and because of this difference, the images coming into each eye have different images. When these two images are transmitted to the brain through the retina, the brain receives these two pieces of information. You can feel the original 3D stereoscopic image by fusion of exactly each other.

Such three-dimensional 3D contents have been widely used in various media fields and have been well received by consumers. Examples are 3D movies, 3D games and experience displays.

As described above, along with the generalization of 3D contents of virtual reality technology, development of a technology capable of providing a more immersive virtual reality service is required in various ways.

In general, an image display device focuses an image light generated at a position very close to an eye so that a virtual large screen can be composed at a long distance by using a precise optical device so that a user can see an enlarged virtual image. Refers to an image display device.

In addition, the image display device is a see-close which can only see the image light emitted from the display element without seeing the surrounding environment, and simultaneously shows the image light emitted from the display element while viewing the surrounding environment through the window. It can be divided into visible see-throughs.

Head mounted display (HMD) refers to various digital devices that can be worn on the head like glasses to provide multimedia content. According to the trend of light weight and small size of digital devices, various wearable computers are being developed, and HMDs are also widely used. The HMD can be combined with augmented reality technology, N screen technology, and the like to provide a variety of convenience to the user beyond simple display functions.

For example, when the microphone and the speaker are mounted on the HMD, the user can perform a phone call while wearing the HMD. Also, for example, when the camera is mounted on the HMD, the user may capture an image in a direction desired by the user while wearing the HMD.

At present, the needs of using the above-described virtual reality technology for cognitive rehabilitation prevention and treatment training are increasing.

Computer-based computerized cognitive rehabilitation system has been commercialized and used as the existing cognitive rehabilitation method, but it requires a separate computer system, so it can be used only in specific places and only quantitative analysis based on cognitive training consisting of contents is possible.

Therefore, it is a simple system that can be worn and worn by individuals by combining bio-sensor technology such as EEG, EMG, ECG sensor, smart glass technology, and virtual reality content technology, which can prevent and treat cognitive rehabilitation regardless of location. There is a need to propose a system.

The present invention has been made to solve the above-mentioned conventional problems, to provide a virtual reality cognitive rehabilitation device.

Specifically, the present invention is to provide a user with a virtual reality cognitive rehabilitation training device that can perform cognitive function prevention training and rehabilitation treatment by displaying the virtual reality content on the smart glass device driven in conjunction with the bio-signal sensor.

The cognitive rehabilitation device proposed by the present invention is a structure that can display virtual reality contents on a smart glass worn like glasses or a helmet, and can be used without regard to a place, and can be used for a brain wave sensor or a human body embedded in the smart glass. Using the EMG sensor that can be attached, real-time and quantitative analysis of the user's cognitive function and exercise function is possible, and cognitive function training for each level according to the degree of cognitive function is possible.

In addition, the proposed talent rehabilitation device of the present invention can provide user motion and location-based content using a motion sensor, a camera, and an externally interlockable Kinect sensor embedded in a smart glass, so that it can be utilized as a physical rehabilitation system as well as cognitive rehabilitation. It aims to be possible, and aims to provide physical analysis data such as exercise state and stress index using an ECG sensor that can be attached to a human body.

On the other hand, the technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned are clearly to those skilled in the art from the following description. It can be understood.

According to an aspect of the present invention, there is provided a biosignal-linked virtual reality cognitive rehabilitation system, including: a head mounted display including an optical module configured to transmit an image light emitted from at least one display to an eye of a user; An EEG sensor sensing the at least one EEG of the user; An EMG sensor that senses EMG that changes according to the movement of the user; And a controller configured to control the head mounted display to output other content when the information sensed by at least one of the EEG sensor and the EMG sensor satisfies a predetermined condition.

The head mounted display may further include a first interface unit disposed at the front of the eyeball of the user and fixing the head of the user horizontally based on the position of the head mounted display; And a second interface unit which fixes the head of the user vertically based on the position of the head mounted display.

In addition, the headmount display may be in the form of goggles.

In addition, the at least one brain wave is a source of source data such as alpha wave (α), beta wave (β), theta wave (θ), gamma wave (γ), delta wave (δ), SMR wave and Mid-β wave. Time domain and frequency domain analysis index may be included.

In addition, the EMG sensor may be in the form of a wrist band fitted to the wrist of the user.

In addition, the predetermined condition may be a condition in which the analysis index calculated by processing the source data according to an algorithm designed for cognitive rehabilitation training among the brain waves sensed by the brain wave sensor is a predetermined value or more.

The predetermined condition may be a condition in which the movement of the user included in the information sensed by the EMG sensor corresponds to the guide information displayed through the headmount display.

The apparatus may further include a wireless communication unit configured to receive update information from the outside, and at least one of the head mounted display, the EEG sensor, the EMG sensor, and the ECG sensor may perform the update using the update information.

In addition, the bio-signal linked virtual reality cognitive rehabilitation system, may be targeted for users with attention deficit hyperactivity disorder (ADHD), mild cognitive impairment (MCI) and cognitive dysfunction.

On the other hand, in accordance with another embodiment of the present invention for realizing the above-described problem, the bio-signal linked virtual reality cognitive rehabilitation method, the head mounted display consisting of an optical module for transmitting the image light emitted from the at least one display to the eye of the user Outputting first content; Sensing, by the EEG sensor, at least one brain wave of the user, and by the EMG sensor, sensing the EMG that changes according to the movement of the user; Sensing information through at least one of the EEG sensor and the EMG sensor; And when the sensed information satisfies a predetermined condition, outputting another content by the head mounted display.

In addition, the at least one brain wave is a source of source data such as alpha wave (α), beta wave (β), theta wave (θ), gamma wave (γ), delta wave (δ), SMR wave and Mid-β wave. Time domain and frequency domain analysis index may be included.

In addition, the predetermined condition may be a condition in which the analysis index calculated by processing the source data according to an algorithm designed for cognitive rehabilitation training among the brain waves sensed by the brain wave sensor is a predetermined value or more.

The predetermined condition may be a condition in which the movement of the user included in the information sensed by the EMG sensor corresponds to the guide information displayed through the headmount display.

In addition, receiving update information from the outside through the wireless communication unit; And at least one of the head mounted display, the brain wave sensor, the electrocardiogram sensor, and the electrocardiogram sensor may be updated using the update information.

In addition, the bio-signal linked virtual reality cognitive rehabilitation method, may be targeted for users with attention deficit hyperactivity disorder (ADHD), users with cognitive dysfunction, such as mild cognitive impairment (MCI) and dementia.

The present invention has been made to solve the above-mentioned conventional problems, it can provide a virtual reality cognitive rehabilitation device.

Specifically, the present invention can provide a user with a virtual reality cognitive rehabilitation training device that can perform cognitive function prevention training and rehabilitation treatment by displaying virtual reality content on a smart glass device driven in conjunction with a biosignal sensor.

The cognitive rehabilitation device proposed by the present invention is a structure that can display virtual reality contents on a smart glass worn like glasses or a helmet, and can be used without regard to a place, and can be used for a brain wave sensor or a human body embedded in the smart glass. EMG sensors, ECG sensors, and the like can be attached to the user's cognitive and motor functions in real time, quantitative analysis is possible, and cognitive function training for each level can be possible.

In addition, the proposed talent rehabilitation device of the present invention can provide user motion and location-based content using a gyro sensor, a camera, an externally interlockable Kinect sensor, etc. embedded in a smart glass, so that it can be used not only for cognitive rehabilitation but also for exercise rehabilitation system. This is possible.

The present invention can be used for the prevention and treatment of attention deficit hyperactivity disorder (ADHD), the prevention and treatment of dementia, in the prevention and treatment of cognitive dysfunction.

The present invention can be used in relation to the prevention and treatment of brain dysfunction, cognitive rehabilitation and motor function rehabilitation, cognitive reinforcement training and memory, attention, concentration, execution ability, communication training and the like due to brain dysfunction.

In addition, the present invention may be used in the concentration game using a bio-signal in relation to the game market.

On the other hand, the effect obtained in the present invention is not limited to the above-mentioned effects, other effects that are not mentioned will be clearly understood by those skilled in the art from the following description. Could be.

The following drawings, which are attached to this specification, illustrate one preferred embodiment of the present invention, and together with the detailed description thereof, serve to further understand the technical spirit of the present invention. It should not be construed as limited.

1 illustrates an example of a block diagram of a biosignal virtual reality cognitive rehabilitation system proposed by the present invention.

Figure 2 shows an example of a block diagram of a smart glass applied to the present invention.

FIG. 3A illustrates a specific example of the biosignal virtual reality cognitive rehabilitation apparatus, and FIG. 3B illustrates an example of an EMG sensor used in the biosignal virtual reality cognitive rehabilitation apparatus.

FIG. 4 illustrates a detailed view of a user using the virtual reality cognitive rehabilitation apparatus described with reference to FIGS. 3A and 3B.

FIG. 5 illustrates a detailed embodiment of the present invention using the biosignal-linked virtual reality cognitive rehabilitation system for the prevention and treatment of attention deficit hyperactivity disorder (ADHD).

FIG. 6 is a flowchart illustrating specific steps of preventing and treating attention deficit hyperactivity disorder (ADHD) described in FIG. 5.

Figure 7 shows the specific appearance of using the bio-signaling virtual reality cognitive rehabilitation system proposed by the present invention for the prevention and treatment of cognitive dysfunction.

FIG. 8 is a flowchart illustrating specific steps of preventing and treating cognitive dysfunction described in FIG. 7.

Virtual Reality Technology In addition to the generalization of 3D contents, development of a technology capable of providing a more immersive virtual reality service is required in various ways.

Therefore, the present specification proposes a bio-signal linked virtual reality cognitive rehabilitation device.

Specifically, the present invention is a simple system that can be worn and worn by an individual as a fusion technology of bio sensor technology such as EEG sensor, EMG sensor, ECG sensor, smart glass technology, and virtual reality content technology. It is about a system for treatment training.

Prior to the detailed description of the present invention with reference to the drawings will be described the basic configuration of the present invention.

1 illustrates an example of a block diagram of a biosignal virtual reality cognitive rehabilitation system proposed by the present invention.

Referring to FIG. 1, the biosignal-linked virtual reality cognitive rehabilitation system 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, and an output unit. The unit 150, the memory 160, the interface unit 170, the controller 180, and the power supply unit 190 may be included.

However, since the components shown in FIG. 1 are not essential, a biosignal-linked virtual reality cognitive rehabilitation system having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the biosignal-linked virtual reality cognitive rehabilitation system and the wireless communication system or between the device and the network in which the device is located.

For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to a biosignal linked virtual reality cognitive rehabilitation system. Can be. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). Digital broadcast signals can be received using digital broadcasting systems such as Handheld and Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be configured to be suitable for not only the above-described digital broadcasting system but also other broadcasting systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external device, and a server on a mobile communication network.

It may include various types of data according to text and multimedia message transmission and reception.

The wireless internet module 113 refers to a module for wireless internet access, and may be embedded or external to a biosignal virtual reality cognitive rehabilitation system. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. Short range communication technologies include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Wireless Fidelity (Wi-Fi), Wi-Di (Wireless Display) or the like may be used.

The location information module 115 is a module for acquiring a location of a biosignal linked virtual reality cognitive rehabilitation system, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a recording mode or a voice recognition mode, and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the biological signal interlocked virtual reality cognitive rehabilitation system. The user input unit 130 may input a sensor signal generated from a sensor of the sensing unit 140 through a signal processing process. In addition, it may be configured as a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

Sensing unit 140 is the opening and closing state of the bio-signaling virtual reality cognitive rehabilitation system, the location of the bio-signaling virtual reality cognitive rehabilitation system, the presence or absence of user contact, the orientation of the bio-signaling virtual reality cognitive rehabilitation system, bio-signaled virtual reality recognition A sensing signal for controlling the operation of the biosignaling virtual reality cognitive rehabilitation system is generated by detecting the current state of the biosignaling virtual reality cognitive rehabilitation system such as the acceleration / deceleration of the rehabilitation system.

The sensing unit 140 may sense whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled to an external device.

The sensing unit 140 may include a proximity sensor 141.

The output unit 150 is used to generate an output related to visual, auditory or tactile senses, which includes a display unit 151, an audio output module 152, an alarm unit 153, a haptic module 154, and a projector module ( 155) may be included.

The display unit 151 displays (outputs) information processed in the biosignal linked virtual reality cognitive rehabilitation system.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) microdisplay, and an LCoS (LCoS) liquid crystal on Silicon) may include at least one of a micro display, a flexible display, a 3D display.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may be configured as a light transmissive structure. With this structure, the user can see the object located behind the body of the biosignaled virtual reality cognitive rehabilitation system through the area occupied by the display unit 151 of the body of the biosignaled virtual reality cognitive rehabilitation system.

Two or more display units 151 may exist according to the implementation form of the biosignal virtual reality cognitive rehabilitation system. For example, a plurality of display units may be spaced apart or integrally disposed on one surface of the biosignal virtual reality cognitive rehabilitation system, or may be disposed on different surfaces.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in the inner region of the bio-signal linked virtual reality cognitive rehabilitation system or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

In addition, the system 100 according to the present invention may include an EEG sensor 142.

Electro-encephalography (EEG) refers to the measurement of signals generated in the brain with electrodes, and is obtained by measuring the signals on the tiny brain surface where electrical signals generated from numerous nerves of the brain are synthesized.

The EEG signal changes in time and space according to the activity of the brain, the state at the time of measurement, and the brain function. Accordingly, the EEG signal has spatial characteristics related to the band-specific characteristics according to frequency, the characteristics in the time domain, and the brain functions.

EEG is divided into delta, theta, alpha, beta, and gamma waves according to the frequency and voltage range, and the wavelengths according to the EEG frequency band and the physical state are shown in Table 1 below.

Table 1 shows the wavelength according to the frequency band of the brain wave and the physical condition.

The EEG sensor 141 according to the present invention provides a function of detecting at least one of the plurality of EEG.

In addition, the system 100 according to the present invention may include a motion sensor 143.

The motion sensor 143 according to the present invention refers to a technology for digitally transferring a motion of an object or a person using a gyroscope sensor.

The motion sensor 143 may be classified into mechanical, magnetic, optical, etc. according to the motion capture method.

In addition, the system 100 according to the present invention may include an EMG sensor 144.

EMG is a record of the electrical activity of skeletal muscles detected by surface electrodes or precipitation electrodes.

 EMG generally has an excellent effect in identifying diseases of the peripheral nervous system.

Myasthenia gravis, progressive muscular dystrophy, multiple myositis, etc., each have distinctive patterns of electromyography.

The EMG sensor 144 according to the present invention may sense a change in EMG and provide a signal for a content interlocking control function such as left / right, front / rear steering, and selection.

In addition, the system 100 according to the present invention may include an ECG sensor 145.

An electrocardiogram is a record of the electrical activity of the heart detected by a surface electrode.

From the ECG signal measured by the ECG sensor, it is possible to measure heart rate during exercise, angina pectoris, coronary artery disease such as myocardial infarction, arrhythmia, and diagnosis of electrolyte abnormalities.

The ECG sensor according to the present invention may provide a signal for calculating an exercise index and a stress index by sensing the change of the ECG.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The sound output module 152 may also output sound signals related to functions performed in the biosignal virtual reality cognitive rehabilitation system. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the biosignal virtual reality cognitive rehabilitation system.

The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration.

The video signal or the audio signal may be output through the display unit 151 or the audio output module 152, so that they 151 and 152 may be classified as part of the alarm unit 153.

The haptic module 154 generates various haptic effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled.

For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through the jetting or suction port, grazing to the skin surface, contact of the electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also may implement the user to feel the haptic effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration of the bio-signal virtual reality cognitive rehabilitation system.

The projector module 155 is a component for performing an image project function using a biosignal linked virtual reality cognitive rehabilitation system, and is displayed on the display unit 151 according to a control signal of the controller 180. An image that is the same as or at least partially different from the image may be displayed on an external screen or wall.

In detail, the projector module 155 may include a light source (not shown) for generating light (for example, laser light) for outputting the image to the outside, and an image for output to the outside using the light generated by the light source. And an image generating means (not shown), and a lens (not shown) for expanding and outputting the image to the outside at a predetermined focal length. In addition, the projector module 155 may include an apparatus (not shown) which may mechanically move the lens or the entire module to adjust the image projection direction.

The projector module 155 may be divided into a cathode ray tube (CRT) module, a liquid crystal display (LCD) module, a digital light processing (DLP) module, and the like, according to the device type of the display means. In particular, the DLP module may be advantageous in miniaturization of the projector module 151 by expanding and projecting an image generated by reflecting light generated from a light source to a digital micromirror device (DMD) chip.

Preferably, the projector module 155 may be provided in the longitudinal direction on the side, front or back of the bio-signal virtual reality cognitive rehabilitation system. Of course, the projector module 155 may be provided at any position of the bio-signaling virtual reality cognitive rehabilitation system, if necessary.

In addition, the present invention may include a smart glass 156.

The smart glass 156 proposed by the present invention may be a head mounted display (HMD).

Figure 2 shows an example of a block diagram of a smart glass applied to the present invention.

Referring to FIG. 2, the HMD 156 according to an embodiment of the present invention may include a display unit 1110, a communication unit 1120, a sensing unit 1130, a camera unit 1140, and a processor 1150. Can be.

HMD 156 may include a first body and a second body. The first body corresponds to a main body of the HMD 156 and may include a display unit 1110, a first communication unit, a first motion sensing unit, a processor 1150, and the like. In addition, the second body may be a body detachable from the main body of the HMD 156, and may include a second motion sensing unit, a camera unit 1140, a second communication unit, and the like. As described above, the first body and the second body may be an embodiment, and according to the needs of those skilled in the art, some configuration units may be changed or new components may be added to the first body and the second body.

The display unit 1110 may display visual information. Here, the visual information may include content, an application, an image, a video, and the like. In addition, the display unit 1110 may output visual information to the screen based on a control command of the processor 1150. In the present specification, the display unit 1110 may be included in the first body of the HMD 156.

Meanwhile, in the present specification, the HMD 156 may output an image on the display screen in various ways. As an example, the HMD 156 may output an image in a see-through manner.

Here, the see-through method refers to a method in which the display screen is transparent and the content can be used while the user recognizes the surrounding environment while wearing the HMD 156. As another example, the HMD 156 may output the image in a front-light manner. Here, the forward scanning method is a method of displaying a reflected image through a reflector such as a mirror without light being directly projected to the eye.

As another example, the HMD 156 may output an image in a see-closed manner. Here, the black-and-white type represents a method of using the content through the display screen without viewing the external environment through the display screen. In this specification, the HMD 156 is assumed to display an image in a perspective or blackout manner.

The communication unit 1120 may communicate with an external device using various protocols and transmit / receive data. In addition, the communication unit 1120 may transmit / receive digital data such as content by connecting to a network by wire or wirelessly. For example, the communication unit may be connected to a wireless network, such as a wireless LAN (WLAN), Wi-Fi, Wi-Di, wireless broadband (WiBro), world interoperability for microwave access (Wimax), or high speed downlink packet (HSDPA). Access) Communication standard can be used.

In this specification, the communication unit 1120 may include a first communication unit and a second communication unit. As described above, the first communication unit may be provided in the first body, and the second communication unit may be provided in the second body. For example, the first communication unit and the second communication unit are included in the first body.

A signal may be transmitted / received from the processor 1150 and a signal may be transmitted / received from the camera unit 1140 included in the second body.

The sensing unit 1130 may sense the surrounding environment of the HMD 156 using at least one sensor mounted on the HMD 156, and transmit the sensed environment to the processor 1150 in the form of a signal.

The sensing unit 1130 may include at least one sensing means. In one embodiment, the at least one sensing means is a gravity sensor, a geomagnetic sensor, a motion sensor, a gyroscope sensor, an acceleration sensor, an infrared sensor, an inclination sensor, a brightness sensor, an altitude sensor, an olfactory sensor, a temperature. Sensing means such as a sensor, a depth sensor, a pressure sensor, a bending sensor, an audio sensor, a video sensor, a global positioning system (GPS) sensor, a touch sensor, and a grip sensor may be included.

In addition, the sensing unit 1130 collectively refers to the various sensing means described above. The sensing unit 1130 senses various inputs of the user and the environment of the HMD 156, and transmits a sensing result so that the processor 1150 may perform an operation accordingly. Can be. The above-described sensors may be included in the HMD 156 as a separate element or integrated in at least one element.

In the present specification, the sensing unit 1130 may include an angle sensing unit 131 and an input sensing unit 132. In addition, the angle sensing unit 131 and the input sensing unit 132 may be provided in the first body and the second body, respectively. For example, the angle sensing unit provided in the first body may sense the rotation angle of the first body, and the input sensing unit provided in the first body may detect a user's input signal with respect to the first body. have. Also, for example, the angle sensing unit provided in the second body may sense the rotation angle of the second body, and the input sensing unit provided in the second body detects a user's input signal for the second body. can do. In addition, the separation signal and the mounting signal between the first body and the second body may be detected through various sensing means provided in the first body and the second body. In addition, the image capturing signal may be detected through an input sensing unit included in the first body or the second body.

The camera unit 1140 may take an image. In more detail, the camera unit 1140 may photograph an image in the forward direction. Here, the front direction may correspond to the direction that the camera unit 1140 is facing. In addition, the camera unit 1140 may sense an image in the field of view area and provide it to the processor 1150. Here, the field of view area represents a range of horizontal and vertical viewing angles that can be included in a constant screen when sensing an image.

In the present specification, the camera unit 1140 may be included in the second body. Meanwhile, in the present specification, the camera unit 1140 may be provided not only in the second body but also in the first body. The camera unit 1140 included in the second body may be mounted on the first body to sense an image. In addition, the camera unit 1140 included in the second body may be separated from the first body to sense an image.

The processor 1150 may process data, control each unit of the HMD 156 described above, and control data transmission / reception between the units. In the present specification, the processor 1150 may be included in the first body. For example, the processor 1150 may include the display unit 1110 included in the first body, the first angle sensing unit, and the first communication unit, as well as the camera unit 1140 and the second communication unit included in the second body. The sensor unit 1130 and the second angle sensing unit may be controlled. The processor 1150 may be provided separately from the second body as well as the first body.

In the present specification, when the second body is separated from the first body, the processor 1150 may obtain the first rotation angle and the second rotation angle. In addition, the processor 1150 may display a separate image preview interface that displays the first image of the sensed rotation based on the second rotation angle. In addition, the processor 1150 may detect the first capturing signal. In addition, the processor 1150 may capture the sensed image and store the second rotated compensation image based on the first rotation angle and the second rotation angle.

As an embodiment of the present disclosure, operations performed by the HMD 156 may be controlled by the processor 1150. For convenience, the drawings and the following description will collectively describe these operations as being performed / controlled by the HMD 156.

Although not shown in FIG. 2, the HMD 156 may include a power unit, a storage unit, an audio unit, and the like.

The power unit is a power source connected to a battery or an external power source inside the HMD 156, and may supply power to the HMD 156. In addition, the storage unit may store various digital data such as audio, photos, videos, applications, and the like. The storage unit may represent various digital data storage spaces such as flash memory, random access memory (RAM), and solid state drive (SSD). In addition, the audio unit may receive or output audio data through a microphone and a speaker.

In addition, the HMD 156 proposed by the present invention may be manufactured in a goggle shape.

Meanwhile, the memory unit 160 may store a program for processing and controlling the controller 180 and may temporarily store input / output data (for example, a message, audio, still image, video, etc.). It can also perform a function. The memory unit 160 may also store the frequency of use of each of the data. In addition, the memory unit 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The biosignal virtual reality cognitive rehabilitation system may operate in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the biosignal virtual reality cognitive rehabilitation system. The interface unit 170 receives data from an external device, receives power, and transfers the power to each component in the biosignal virtual reality cognitive rehabilitation system, or the data in the biosignal virtual reality cognitive rehabilitation system is transferred to an external device. To be transmitted. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the use authority of the biosignal-linked virtual reality cognitive rehabilitation system, and includes a user identification module (UIM), a subscriber identification module (SIM), and a general user. It may include an authentication module (Universal Subscriber Identity Module, USIM). A device equipped with an identification module (hereinafter referred to as an 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the bio-signal linked virtual reality cognitive rehabilitation system.

The interface unit may be a passage for supplying power from the cradle to the biosignaled virtual reality cognitive rehabilitation system when the biosignaled virtual reality cognitive rehabilitation system is connected to an external cradle, or inputted from the cradle by a user. Various command signals may be a passage for transmitting to the mobile device. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile device is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the biosignal virtual reality cognitive rehabilitation system.

The controller 180 may transmit or store a control signal for operating hardware of the output unit by using signals input through the wireless communication unit, the A / V input unit, the user input unit, the sensing unit, and the interface unit. The controller may include a processor module that analyzes the sensor signal and calculates an analysis index such as a cognitive function index and an exercise function index. The control unit may receive a signal from the memory and control the output unit function.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code may be implemented in software applications written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180.

FIG. 3A illustrates a specific example of the biosignal virtual reality cognitive rehabilitation apparatus, and FIG. 3B illustrates an example of an EMG sensor used in the biosignal virtual reality cognitive rehabilitation apparatus.

Referring to FIG. 3A, the bio-signal linked virtual reality cognitive rehabilitation device 100 according to the present invention may include a band-shaped interface unit 170, an EEG sensor 142, and a smart glass 156.

In addition, as shown in Figure 3b, the bio-signal linked virtual reality cognitive rehabilitation device 100 proposed by the present invention may further comprise an EMG sensor 144.

Referring to FIG. 3A, the band-shaped interface unit 170 includes a first portion 170a coupled to the user's head vertically with respect to the forehead and a second portion 170b coupled to the user's head horizontally. do.

In addition, the EEG sensor 142 is disposed near the user's forehead or temple to provide a function for measuring the brain wave of the user.

As described above, the EEG sensor 142 may detect a delta, theta, alpha, beta, gamma wave, etc. classified according to a range of frequency and voltage, and thus may determine a user's state.

In addition, the smart glass 156 is a head mounted display (HMD), it may be provided in the form of goggles.

The user may be provided with the virtual reality content through the smart glasses 156.

In addition, referring to FIG. 3B, the EMG sensor 144 may include a plurality of sensors, and may have a bracelet shape that is filled in at least a portion of an arm of a user.

As described above, it is possible to detect the electrical activity of the skeletal muscle of the user through the EMG sensor 144.

FIG. 4 illustrates a detailed view of a user using the virtual reality cognitive rehabilitation apparatus described with reference to FIGS. 3A and 3B.

Referring to FIG. 4, the user has a band-shaped interface unit including a first portion 170a coupled to the user's head vertically with respect to the forehead and a second portion 170b coupled to the user's head horizontally. It may be connected to the bio-signal linked virtual reality cognitive rehabilitation device 100 through 170.

In addition, smart glasses 156 in the form of goggles are disposed in front of the eyeball of the user, and the EEG sensor 142 is disposed near the user's forehead or temple, and the EMG sensor 144 is filled in the arm of the user in the form of a bracelet. do.

The bio-signal linked virtual reality cognitive rehabilitation device 100 proposed by the present invention may be used for preventing and treating cognitive dysfunction such as attention deficit hyperactivity disorder (ADHD) and dementia.

That is, for the treatment of hyperactivity disorder (ADHD), the content of the virtual reality is displayed through the goggles-type smart glasses 156, and the EMG sensor 144 solves the problem presented by the content through the signal-based control. The degree of concentration of the user may be checked through the EEG sensor 142, and the content of the virtual reality may be changed and displayed only when the degree of concentration is high.

In addition, to prevent and treat cognitive dysfunction, such as dementia, the display of the virtual reality content through the goggles smart glasses 156, and the EMG sensor 144 to confirm that the problem and behavior given to the user to resolve In this case, the contents of the virtual reality are changed and displayed only when the solution is solved, thereby preventing a decrease in cognitive function along with muscle exercise.

Accordingly, the present invention provides a bodily signal interlocking experience in which smart device technology, which incorporates biosignal sensors such as EEG and EMG and virtual reality contents, is used for the prevention and rehabilitation of cognitive impairment such as attention deficit hyperactivity disorder (ADHD) and dementia. It is possible to provide a type virtual reality-based cognitive rehabilitation system.

The virtual reality content produced for cognitive rehabilitation training in the bio-signal linked virtual reality cognitive rehabilitation apparatus 100 according to the present invention is displayed through the smart glass 156, EEG sensor 142 mounted in the smart glass 156 The neurofeedback training is possible through the EEG signal measured from.

In addition, the EMG sensor 144 attached to the wrist can be used to control the performance of the cognitive rehabilitation content, and position, motion-based control is possible in conjunction with signals such as motion sensor camera mounted in the smart glasses 156. .

In addition, the smart glasses 156 according to the present invention has a structure in which the user can easily wear virtual reality contents in a glasses type, a headband type, or a helmet type.

In addition, the virtual reality content according to the present invention is a content for the purpose of strengthening and treating cognitive function (dementia, ADHD, etc.) content composition, the difficulty of each cognitive function can be adjusted, and recognition through bio-signal analysis such as EEG signals Status analysis and reporting are possible.

The smart glasses 156 according to the present invention function to enlarge and display cognitive rehabilitation content in the eyes of a user.

In addition, EEG sensor 142, motion sensor 143, camera (121), audio (150), wired / wireless communication module 110, etc. are built in utilizing the bio-signal, location-based signals and sound signals, etc. Content composition is possible.

In particular, neurofeedback training and cognitive function analysis is possible using EEG signals, and contents can be uploaded and upgraded using the wired / wireless transmission / reception module 110.

In addition, the EMG sensor 144 according to the present invention is a multi-channel EMG measurement system in the form of a wrist band.

The EMG sensor 144 may transmit and receive an EMG signal with a built-in wireless transmission / reception module, and a motion sensor 143 and a position sensor 115 may be built in, and EMG measurement and muscle strength index calculation may be performed using the EMG sensor 144.

The bio-signal linked virtual reality cognitive rehabilitation device 100 according to the present invention can be used for home use.

FIG. 5 illustrates a detailed embodiment of the present invention using the biosignal-linked virtual reality cognitive rehabilitation system for the prevention and treatment of attention deficit hyperactivity disorder (ADHD).

Referring to Figure 5, the bio-signal linked virtual reality cognitive rehabilitation device 100 according to the present invention can be used as ADHD, dementia patients cognitive reinforcement trainer.

In other words, the individual wears at home, performs memory, attention and concentration training, it is possible to induce interest using game contents for each difficulty level, provide various contents, pay upgrade of new versions of contents, and analyze cognitive function By providing results, you can monitor the therapeutic and preventive effects of self-diagnosis.

FIG. 6 is a flowchart illustrating specific steps of preventing and treating attention deficit hyperactivity disorder (ADHD) described in FIG. 5.

Referring to FIG. 6, first, a step (S110) of taking off and landing a virtual drone is performed using an EEG signal obtained through the EEG sensor 142.

That is, the virtual drone may be displayed in front of the user through the smart glasses 156.

At this time, the drone may take off or land only when the user concentrates on the virtual drone and detects the alpha wave by the EEG sensor 142.

Thereafter, the user moves his / her body, thereby controlling the direction of the virtual drone using the EMG signal sensed by the EMG sensor 144 (S120).

The direction can be left, right, front and back, and can improve the user's muscle strength or support the effective movement of the area requiring rehabilitation.

Thereafter, step S130 is performed to repeatedly perform the mission using at least one of the EEG signal and the EMG signal.

The mission may be provided in plurality according to the current state of the user.

After the step S130, the step (S140) of providing the mission correction result feedback to the user proceeds.

Furthermore, emotional reflection indicator feedback may be provided to the user (S150).

The step S150 is to provide data comparing the concentration feedback, the fitness required on the average of the user's age, and the user's result feedback with each other.

On the other hand, the bio-signal linked virtual reality cognitive rehabilitation device 100 according to the present invention can be used for the health center and rehabilitation center.

Figure 7 shows the specific appearance of using the bio-signaling virtual reality cognitive rehabilitation system proposed by the present invention for the prevention and treatment of cognitive dysfunction.

Referring to FIG. 7, the biosignal-linked virtual reality cognitive rehabilitation device 100 according to the present invention is provided in a public health center and a rehabilitation center, provides individual training and group training functions, and cognitive rehabilitation content for each cognitive function group and difficulty level. It can provide, and can provide the analysis results for each cognitive function.

In other words, it is possible to produce various types of cognitive rehabilitation contents using biometric sensors, EMG sensors, and motion sensors that can be installed or interlocked in the system, which can be used for the prevention and treatment of cognitive rehabilitation for dementia, ADHD, and stroke. .

In addition, it is possible to analyze the cognitive function and motor function of the user, such as the calculation of the cognitive function reflection index using the EEG signal, the calculation of the muscle strength index using the EMG signal, and thus it is possible to use for the prevention and treatment of cognitive rehabilitation.

In addition, group training contents for cognitive function rehabilitation and prevention can be utilized for group prevention training and treatment in public health centers and rehabilitation centers.

FIG. 8 is a flowchart illustrating specific steps of preventing and treating cognitive dysfunction described in FIG. 7.

Referring to FIG. 8, first, a user performs a preliminary test relating to an EEG sensor 142 and an EMG sensor 144 (S210).

That is, taking into consideration that the use of the elderly is high as it is used for the health center and rehabilitation center, the pre-test related to the EEG sensor 142 and the EMG sensor 144 is performed.

Thereafter, the user performs a dementia prevention and treatment mission (S220).

In step S220, for example, a son / daughter home mission, a path finding mission through number selection, etc. may be provided, and difficulty level setting may be performed.

Thereafter, step S230 of providing the mission performance result feedback to the user is provided.

Furthermore, in the present invention, cognitive function indicator feedback may be provided to the user (S240).

The step S240 is to provide data comparing the cognitive function required by the user's age and the user's result feedback.

As a result, according to the present invention, cognitive rehabilitation, group therapy is possible, computerized cognitive rehabilitation treatment is possible, and cognitive rehabilitation treatment using virtual reality is enabled, thereby enabling personalized treatment.

The above-described configuration of the present invention can provide a virtual reality cognitive rehabilitation device.

Specifically, the present invention can provide a user with a virtual reality cognitive rehabilitation training device that can perform cognitive function prevention training and rehabilitation treatment by displaying virtual reality content on a smart glass device driven in conjunction with a biosignal sensor.

The cognitive rehabilitation device proposed by the present invention is a structure that can display virtual reality content on a smart glass worn like glasses or a helmet, and can be used regardless of a place, and can be used in an EEG sensor or a user's arm embedded in the smart glass. By using the EMG sensor that can be attached, real-time and quantitative analysis of the user's cognitive function and exercise function is possible, and cognitive function training for each level according to the degree of cognitive function may be possible.

In addition, the proposed talent rehabilitation device of the present invention can provide user motion and location-based content using a gyro sensor, a camera, an externally interlockable Kinect sensor, etc. embedded in a smart glass, so that it can be used not only for cognitive rehabilitation but also for exercise rehabilitation system. This is possible.

The present invention can be used in the prevention and treatment of attention deficit hyperactivity disorder (ADHD) and the prevention and treatment of dementia in relation to the prevention and treatment of cognitive dysfunction.

The present invention can be used for cognitive rehabilitation and motor function rehabilitation, cognitive reinforcement training and attention, concentration training due to brain dysfunction.

In addition, the present invention may be used in the concentration game using a bio-signal in relation to the game market.

On the other hand, the present invention can also be embodied as computer readable codes on a computer readable recording medium. Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (for example, transmission over the Internet). Include.

The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. In addition, functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

In addition, the above-described apparatus and method may not be limitedly applied to the configuration and method of the above-described embodiments, but the embodiments may be selectively combined in whole or in part in each of the embodiments so that various modifications may be made. It may be configured.

Claims (16)

1. A head mounted display comprising an optical module configured to transmit image light emitted from at least one display to an eye of a user;

   An EEG sensor sensing the at least one EEG of the user;

   An EMG sensor that senses EMG that changes according to the movement of the user; And

   And a controller configured to control the head mounted display to output another content when the information sensed by at least one of the EEG sensor and the EMG sensor satisfies a predetermined condition. 2.
2. The method of claim 1,

   And an electrocardiogram sensor for sensing an electrocardiogram of the user.

   And the control unit controls the head mounted display to output another content by additionally using information sensed by the ECG sensor.
3. The method of claim 1,

   The headmount display is disposed in front of the eyeball of the user,

   A first interface unit which fixes the head of the user horizontally based on the position of the head mounted display; And

   And a second interface unit configured to fix the head of the user vertically based on the position of the head mounted display.
4. The method of claim 2,

   The head mounted display is a biological signal interlocking virtual reality cognitive rehabilitation system, characterized in that the goggles or helmet form.
5. The method of claim 1,

   The at least one brain wave,

   Bio-signaling virtual reality cognitive rehabilitation, comprising alpha wave (α), beta wave (β), theta wave (θ), gamma wave (γ), delta wave (δ), SMR wave and Mid-β wave system.
6. The method of claim 1,

   The EMG sensor is a biological signal interlocking virtual reality cognitive rehabilitation system, characterized in that the wrist band is fitted to the wrist of the user.
7. The method of claim 1,

   The predetermined condition is

   Bio-signal linked virtual reality cognitive rehabilitation system, characterized in that more than a predetermined value of the brain waves sensed by the EEG sensor.
8. The method of claim 1,

   The predetermined condition is

   And the user's movement included in the information sensed by the EMG sensor corresponds to the guide information displayed through the head mounted display.
9. The method of claim 1,

   Further comprising; a wireless communication unit for receiving the update information from the outside,

   And at least one of the head mounted display, the EEG sensor, and the EMG sensor performs an update by using the update information.
10. The method of claim 1,

    The bio-signal linked virtual reality cognitive rehabilitation system,

    A bio-signal linked virtual reality cognitive rehabilitation system for users with attention deficit hyperactivity disorder (ADHD), mild cognitive impairment (MCI) and cognitive dysfunction.
11. Outputting, by the head mounted display, the first content, the first content comprising an optical module configured to transmit the image light emitted from the at least one display to the eyeball of the user;

    Sensing, by the EEG sensor, at least one brain wave of the user, and by the EMG sensor, sensing the EMG that changes according to the movement of the user;

    Sensing information through at least one of the EEG sensor and the EMG sensor; And

    And outputting, by the head mounted display, another content when the sensed information satisfies a predetermined condition.
12. The method of claim 11,

    The at least one brain wave,

    Bio-signaling virtual reality cognitive rehabilitation comprising alpha waves (α), beta waves (β), theta waves (θ), gamma waves (γ), delta waves (δ), SMR waves and Mid-β waves Way.
13. The method of claim 11,

    The predetermined condition is

    Bio-signal virtual reality cognitive rehabilitation method, characterized in that more than a predetermined value of the brain waves sensed by the EEG sensor.
14. The method of claim 11,

    The predetermined condition is

    And a movement of the user included in the information sensed by the EMG sensor corresponds to the guide information displayed through the head mounted display.
15. The method of claim 11,

    Receiving update information from the outside through the wireless communication unit; And

    And at least one of the head mounted display, the EEG sensor, and the EMG sensor, performing an update by using the update information.
16. The method of claim 11,

    The bio-signal linked virtual reality cognitive rehabilitation method,

    A bio-signal linked virtual reality cognitive rehabilitation method for users with attention deficit hyperactivity disorder (ADHD), mild cognitive impairment (MCI) and cognitive dysfunction.

Images