WO2019212149A1

WO2019212149A1 - Game-based rehabilitation system having brain-computer interface (bci) technology combined with functional electrical stimulation for maximizing activation of mirror nerve cell, and control method therefor

Info

Publication number: WO2019212149A1
Application number: PCT/KR2019/003827
Authority: WO
Inventors: 구정훈
Original assignee: 계명대학교 산학협력단
Priority date: 2018-05-04
Filing date: 2019-04-01
Publication date: 2019-11-07
Also published as: KR20190127489A; KR102142535B1

Abstract

Presented in the present invention are a game-based rehabilitation system having a brain-computer interface (BCI) technology combined with functional electrical stimulation for maximizing the activation of a mirror nerve cell, and a control method therefor, the game-based rehabilitation system differing from the use of flashing light by a conventional system using SSVEP in that a game image, which displays body parts of an object flashing at specific frequencies of SSVEP and makes a body part of the object observed by a user move, is used such that a mirror nerve cell can be activated, image-observing concentration can be increased by inducing interest of the user, and the user can undergo active rehabilitation training.

Description

Game-type rehabilitation system and control method combining functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells

The present invention relates to a rehabilitation system and a method of controlling the same, and to a game-type rehabilitation system and control method combining a functional electrical stimulation and brain-computer interface (BCI) technology that maximizes the activation of mirror neurons.

In general, a brain disease patient having a deficiency of exercise ability is not able to control the paralyzed muscles with his or her will, and the methods of assisting the rehabilitation of such patients include physical therapy, drug therapy, and surgery. In particular, in rehabilitation training using physical therapy, active treatment by the patient's will has been reported to have a high effect of rehabilitation training, but in patients who have limited movement due to muscle paralysis, such rehabilitation training There is a problem that can only be made manually by the physical therapist.

On the other hand, in order to increase the effect of rehabilitation training, there is a treatment method using the stimulation of the mirror nerve cells of the patient. This is meaningful because it is not passive treatment by a physiotherapist, but active rehabilitation training through a patient's attention to specific objects and actions. A mirror nerve cell is a cell that causes the same reaction in the observer's body as if the observer actually acted, not just experiencing it directly, but by seeing another person's behavior. As a rehabilitation training using this method, there is a method of showing a video including the movement of a specific subject in order to activate the patient's mirror nerve cells, this method, a patient who can not operate by his will due to brain injury For example, just watching someone else's actions affects the patient's physical system as if the patient himself was acting on his own.

In recent years, researches related to rehabilitation using brain waves of patients have been conducted. In particular, the BCI (Brain-Computer Interface) refers to a device for transmitting EEG to a computer. Development of rehabilitation system using communication is getting active.

SSVEP (Steady-State Visually Evoked Potentials), which is introduced as a BCI technique, is called the `` steady-state visual oil potential '', which is generated from the user's brain waves when the user watches the blinking light. Points to EEG with the same frequency. That is, in the BCI technology using SSVEP, when the user sees the light flickering at a specific frequency, SSVEP is generated at the back of the user's brain, and the SSVEP measured by the EEG measuring device installed in the user's head is input to the computer. In other words, brain waves can be transmitted to a computer.

1 is a diagram illustrating an example of a system using a conventional SSVEP. As shown in FIG. 1, SSVEP is detected from an EEG of a user using light blinking a specific frequency on a screen, and the detected EEG is transmitted to a computer. In this case, there may be one or more blinking lights, and each specific frequency is different, and through the analysis of the frequency of the SSVEP detected by the brainwave of the user, it is possible to know what light the user is looking at. Each blinking light has a predetermined signal, and the system can remotely control the device corresponding to the light signal that the user watches. Since the system using the blinking light is only using the blinking light, it is difficult for the user to be interested in it, and there is a problem of low concentration. As prior arts related to such a system using SSVEP, Korean Patent Application Publication No. 10-2014-0075049 (name of the invention: a method for evaluating concentration and a device applying the same), and Patent No. 10-1431203 (name of the invention: EEG) Brain machine interface device and method for intention recognition).

As described above, the system using the conventional SSVEP is not interested in the user, the concentration must be low, there is a need for a solution that can increase the concentration of the user, in addition, functional electrical stimulation (Functional Electrical Stimulation) ), The necessity of developing a method of activating the mirror nerve cells that can increase the effectiveness of rehabilitation training is increasing.

The present invention has been proposed to solve the above problems of the conventionally proposed methods. Unlike the conventional SSVEP system, which uses flickering light, the body part of the object flickering at a specific frequency of the SSVEP is displayed. In addition, through the game image that the body part of the object that the user watches, the mirror nerve cell can be activated, and the user's attention can be increased to increase the concentration of the eye to watch the image, and at the same time, the user's active The object of the present invention is to provide a game-type rehabilitation system and control method that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of mirror nerve cells, which enables rehabilitation training.

In addition, the present invention provides a functional electrical stimulation (Functional Electrical Stimulation) to the user's rehabilitation needs site and the functional electrical stimulation to maximize the activation of the mirror nerve cells, which can enable rehabilitation training only by watching the game image and It is an object of the present invention to provide a game-type rehabilitation system and a control method thereof incorporating brain-computer interface (BCI) technology.

In accordance with a feature of the present invention for achieving the above object, a game-type rehabilitation system that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of mirror neurons,

As a rehabilitation system,

A display device for displaying a game image;

An EEG acquisition device for acquiring an EEG of a user corresponding to a game image displayed on the display device;

An EEG analyzer for analyzing EEG of the user acquired by the EEG acquisition apparatus;

An electrical stimulation device for performing a functional electrical stimulation on a rehabilitation site of a user according to a result corresponding to the brain wave analyzed by the EEG analysis device; And

According to a result corresponding to the EEG analyzed by the EEG analysis device, and including a control device for controlling the electric stimulation performed in the game image and the electric stimulation device displayed on the display device,

The control device,

One or more body parts of the object displayed on the game image may be controlled to blink at a specific frequency, and when the user observes the corresponding body part of the object displayed on the game image, the brain wave acquisition device and the EEG analysis device may be controlled. According to the result corresponding to the brain waves acquired and analyzed through the control, the body part of the object displayed on the game image may be controlled to move in a preset manner, and the functional restimulation part of the user may be moved to give a functional electrical stimulation. Can be controlled,

The configuration features the rehabilitation training using the activation of the user's mirror nerve cells according to the movement of the body part of the object that the user selectively watches.

Preferably, the display device,

The display device may further include a guide content for the progress of the game image.

More preferably, the display device,

It may include a voice output device for outputting the voice content corresponding to the guide content.

Preferably, the EEG analysis device,

An EEG detecting unit for detecting EEG when the user selectively looks at a specific body part of the object; And

It may include an EEG analyzer for analyzing the frequency of the EEG detected by the EEG detector.

More preferably, the EEG detection unit,

SSVEP may be detected from the EEG signal of the user corresponding to a specific body part of the object that the user selectively watches.

More preferably, the EEG analysis unit,

The frequency of the SSVEP detected by the EEG detector may be analyzed.

Preferably, the electrical stimulation device,

According to a result corresponding to the EEG analyzed by the EEG analysis device, at least one or more of the intensity and frequency of the electric stimulation may be performed to control the electric stimulation.

Preferably, the electrical stimulation device,

A control signal receiver for receiving a control signal generated by the control signal generator;

A stimulation controller configured to generate an electrical stimulation signal in real time based on the control signal; And

Receiving the electrical stimulation signal from the stimulation control unit, it may include a stimulation unit for performing the electrical stimulation by applying the electrical signal according to the electrical stimulation signal to the rehabilitation needs of the patient.

More preferably, the electrical stimulation device,

The stimulator may further include an input unit configured to input average intensity information of an electrical signal applied to a rehabilitation necessary portion of the patient.

More preferably,

The magnetic pole portion is a plurality,

The stimulus control unit may generate an electrical stimulation signal to be output to the plurality of stimulation units in real time for each of the plurality of stimulation units according to the pattern of the electrical stimulation.

Preferably, the electrical stimulation device,

Attached where nerves or nerves and muscles meet, electrical signals can stimulate both motor and sensory nerves.

Preferably, the control device,

A control signal generator configured to move a body part of the object corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer in a preset manner, and generate a control signal to give a functional electric stimulus to the user's body part in a preset manner;

A display device controller configured to control a display device displaying the movement of the object by using the control signal generated by the control signal generator; And

It may include an electrical stimulation device control unit for controlling the electrical stimulation device for providing a functional electrical stimulation to the body part of the user by using the control signal generated by the control signal generator.

Preferably, the game rehabilitation system,

The specific frequency at which one or more body parts of the object blinks may be the same frequency regardless of body parts, or may be different frequencies for each body part.

Preferably, the game rehabilitation system,

The game image in which the body part moves in a preset manner may include a movement to help the user's rehabilitation.

In addition, according to another aspect of the present invention for achieving the above object, a control method of a game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells,

As a control method of the rehabilitation system,

(1) displaying, by the display device, a game image;

(2) acquiring an EEG of the user corresponding to the game image displayed in the step (1) by the EEG obtaining apparatus;

(3) the EEG analyzing apparatus, analyzing the EEG of the user obtained in the step (2); And

(4) the control device controlling the game image displayed on the display device while causing the electrical stimulation device to give a functional electrical stimulation to the user's rehabilitation site according to the result corresponding to the brain wave analyzed in step (3) Including,

In step (1),

Displaying the game image such that one or more body parts of an object displayed on the game image blink at a specific frequency,

In step (4),

When the user observes the corresponding body part of the object displayed on the game image, the corresponding body of the object displayed on the image according to the result corresponding to the brain wave acquired and analyzed through the steps (2) and (3) To control the area to move in a preset manner, to give a functional electrical stimulation to the user's rehabilitation needs to control the movement,

Preferably, the EEG analysis device,

Preferably, the electrical stimulation device,

More preferably, the electrical stimulation device,

More preferably,

The magnetic pole portion is a plurality,

Preferably, the control device,

It may include an electrical stimulation device control unit for controlling the electrical stimulation device for providing an electrical stimulation to the body part of the user by using the control signal generated by the control signal generator.

According to the game-based rehabilitation system and control method that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells proposed in the present invention, the conventional system using the SSVEP is blinking light Unlike using, the body part of the object flickering at a certain frequency of SSVEP is displayed, and the user's gaze can activate the mirror nerve cell through the game image where the body part of the object moves. It is possible to increase the concentration of attention to watch the image, and at the same time, it is possible to enable active rehabilitation training of the user.

In addition, according to the present invention, by providing a functional electrical stimulation (Functional Electrical Stimulation) to the user's rehabilitation needs site can be able to enable rehabilitation training just by watching the game image.

1 is a diagram illustrating an example of a system using a conventional SSVEP.

2 is a diagram illustrating a frequency analysis result of brain waves output through a conventional system using SSVEP.

Figure 3 is a photograph showing that a certain area of the brain of the observer observing the movement of others is activated.

4 is a diagram showing the configuration of a game-based rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of mirror nerve cells according to an embodiment of the present invention.

FIG. 5 is a view illustrating a user performing rehabilitation training in a game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology maximizing activation of mirror nerve cells according to an embodiment of the present invention. One drawing.

Figure 6 is a game-based rehabilitation system that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, the user of the object of the game image to watch Figure showing the movement of the body parts and at the same time giving a functional electrical stimulation to the user's body parts.

7 is a block diagram of a game-based rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror neurons according to one embodiment of the present invention. Figure shown.

FIG. 8 is a diagram illustrating a part of a game image in a game type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology maximizing activation of mirror nerve cells according to an embodiment of the present invention.

9 is a game-type rehabilitation system that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells according to another embodiment of the present invention, the user rehabilitation training Figure shown.

FIG. 10 is a flowchart of a control method of a game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology maximizing activation of mirror nerve cells according to an embodiment of the present invention. .

10: A game-based rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells according to an embodiment of the present invention

100: display device

110: audio output device

200: EEG acquisition device

300: EEG analysis device

310: brain wave detection unit

320: brain wave analysis unit

400: electrical stimulation device

410: control signal receiver

420: stimulus control unit

430: stimulation unit

440: input unit

500: control unit

510: control signal generation unit

520: display device controller

530: electrical stimulation device control unit

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. However, in describing the preferred embodiment of the present invention in detail, if it is determined that the detailed description of the related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, the same or similar reference numerals are used throughout the drawings for parts having similar functions and functions.

In addition, throughout the specification, when a part is 'connected' to another part, it is not only 'directly connected' but also 'indirectly connected' with another element in between. Include. In addition, "including" a certain component means that it may further include other components, except to exclude other components unless specifically stated otherwise.

1 is a diagram illustrating an example of a system using a conventional SSVEP. As shown in FIG. 1, SSVEP is detected from an EEG of a user by using light blinking at a specific frequency on a screen, and the detected EEG is transmitted to a computer. In this case, there may be one or more blinking lights, and each specific frequency is different, and through the analysis of the frequency of the SSVEP detected by the brainwave of the user, it is possible to know what light the user is looking at. Each blinking light has a predetermined signal, and the system can remotely control the device corresponding to the light signal that the user watches.

FIG. 2 is a diagram illustrating a frequency analysis result of brain waves output through a conventional system using SSVEP. As shown in FIG. 2, in the brainwaves of a user gazing at one or more blinking lights, SSVEP of the same frequency as that of the blinking light gazed by the user may be detected, and peaks are displayed at respective frequencies. You can check it.

3 is a photograph showing that a certain region of the brain of an observer observing the motion of another person is activated. As shown in FIG. 3, in the study results, when the observer observed the transitional motion and the mimicking motion, the observer showed different activities in specific regions of the brain, unlike when observing the same motion in a static picture. It is reported that this depends on the effector participating in the observed behavior. From this, motion observation can confirm that a certain region of the observer's brain is activated, and activated mirror neurons enhance the exercise circuits involved in the observer's actual execution of the observed movement, without the observer's actual movement. You can see that you can do rehabilitation training.

4 is a diagram illustrating the configuration of a game-based rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells in accordance with one embodiment of the present invention. As shown in FIG. 4, a game-based rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror neurons according to one embodiment of the present invention is a rehabilitation system. For example, the display device 100 for displaying a game image, the brain wave acquisition device 200 for acquiring the brain waves of the user corresponding to the game image displayed on the display device 100, the brain wave acquisition device 200 EEG analysis device 300 for analyzing brain waves, electrical stimulation device 400 for performing a functional electrical stimulation to the user's rehabilitation needs area, and EEG analysis according to the results corresponding to the brain waves analyzed by the EEG analysis device 300 According to a result corresponding to the brain wave analyzed by the device 300, the control unit 500 may control the game image and the electrical stimulation device 400 displayed on the display device 100. In particular, the control device 500 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, the game image One or more body parts of the object displayed on the can be controlled to blink at a specific frequency, when the user observes the corresponding body part of the object displayed on the game image, EEG acquisition device 200 and EEG analysis device 300 According to the result obtained according to the analysis and corresponding to the brain wave, it can be controlled to move by giving a functional electrical stimulation to the user's rehabilitation needs site in a preset manner, and at the same time the corresponding body part of the object displayed on the game image in advance It can be controlled to move in a set way, so that the rehabilitation training using the activation of the user's mirror nerve cells It shall be.

In a game-based rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells according to an embodiment of the present invention, a display device for displaying a game image by a user ( 100), using the EEG acquisition device 200 attached to the user's head to obtain the SSVEP having the same frequency as the blinking frequency of the body part of the object displayed on the game image, EEG analysis device 300 ) Analyzes the corresponding frequency of the SSVEP obtained by the EEG acquisition apparatus 200 and uses the analyzed frequency to display the controller according to the control signal generated by the control signal generator 510 of the control apparatus 500. 520 controls the display device 100 displaying the movement of the body part of the object, and at the same time the electrical stimulation device control unit 530 gives a functional electrical stimulation to the user's rehabilitation needs area By using the movement of a specific body part of the object, the user activates the mirror nerve cells of the user, provides functional electrical stimulation to the specific body part of the user, and simultaneously plays a rehabilitation training in the active posture through the user's reaction. You can do it.

According to an embodiment, the display device 100 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention Is a content related to a game, and may display guide content including contents such as a method in which a user participates, and a voice output device capable of outputting a voice corresponding to the guide content and various other contents. 110 may be included. Hereinafter, the guide content and the audio output device 110 will be described.

FIG. 5 is a view illustrating a user performing rehabilitation training in a game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology maximizing activation of mirror nerve cells according to an embodiment of the present invention. One drawing. As shown in FIG. 5, a display device of a game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror neurons according to an embodiment of the present invention. 100 may further include guide content for the progress of the game image. The guide content may be composed of content corresponding to a predetermined movement mode, which will be described below with reference to FIG. 8. In order for the body part of the object to operate the movement suggested by the guide content, when the user looks at the specific body part of the object, the body part of the object moves in a corresponding predetermined movement mode of the guide content. For example, as shown in FIG. 5, by displaying the guide content on the display device 100, 'If you want to swing the knife, keep an eye on the blinking left arm', the user may move the necessary movement to swing the knife. You will know what it is, and the user will watch the left arm of the blinking object to move the left arm of the object. In this case, the predetermined movement corresponding to the guide content may be 'movement of the left arm and the movement of the sword.' Of course, in the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells, the guide content corresponding to the predetermined movement mode is the guide content presented above. It is not limited only to. In FIG. 5, the game-type rehabilitation system 10 combining the functional electrical stimulation and the brain-computer interface (BCI) technology maximizing the activation of the mirror nerve cells according to an embodiment of the present invention has been described in the fencing operation. It is not limited to this, for example, may be described by applying to the movement of each part of the face. That is, a face image is provided as an object in the game image, and when the user watches the blinking eye in the face image, a game image of a form in which a winking operation by moving the eyes is performed may be provided.

The display device 100 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of mirror nerve cells according to an embodiment of the present invention, corresponds to the guide content. It may include a voice output device 110 for outputting the voice content. According to an exemplary embodiment, the display device 100 may include a speaker as the voice output device 110 capable of outputting voice content, or may include a device capable of connecting a headset. Of course, in the game-based rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells, the voice thrust device 110 is connected to the speaker, headset presented above The voice output device 110 may be configured separately from the display device 100 according to another embodiment. In addition, the voice content may be composed of not only the voice content corresponding to the guide content, but also various contents required for game progress.

EEG acquisition device 200 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, As can be seen, it can include one or more electrodes for measuring brain waves. According to an embodiment, one or more electrodes may be configured as a device surrounding the user's head, or by coupling the electrodes to the hat, the hat itself may be the EEG acquisition device 200. In addition, the electrode can also be used by applying an electrolyte gel, since the electrolyte gel plays a role in delivering the EEG detected from the scalp to the electrode well.

Figure 6 is a game-based rehabilitation system that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, the user of the object of the game image to watch FIG. 7 is a diagram illustrating a state in which a body part moves and at the same time gives a functional electric stimulus to a user's body part, and FIG. 7 is a function of maximizing activation of mirror nerve cells according to an embodiment of the present invention. A block diagram of a game-based rehabilitation system that combines electrical stimulation and brain-computer interface (BCI) technology. 6 and 7, in the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells, in the EEG acquisition apparatus 200 The obtained EEG may be connected to an EEG analyzing apparatus 300 including an EEG detecting unit 310 and an EEG analyzing unit 320. In addition, the EEG analysis device 300 is connected to the control device 500 including the control signal generation unit 510, the display device control unit 520, and the electrical stimulation device control unit 530. The brain wave analyzed in 300 may be transmitted to the control device 500, and the control device 500 displays the movement of the object by using the control signal generated by the control signal generator 510. And it can control the electrical stimulation device 400 to give a functional electrical stimulation to the user's rehabilitation needs site.

As shown in Figures 6 and 7, EEG of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention The analysis device 300 may include an EEG detector 310 for detecting EEG when the user selectively looks at a specific body part of the object, and an EEG analyzer for analyzing the frequency of the EEG detected by the EEG detector 310. 320 may be included.

EEG detection unit 310 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, the user selectively SSVEP may be detected from the EEG signal of the user corresponding to the specific body part of the object to be observed. When the user observes a body part blinking at a specific frequency with respect to an object displayed on the game image of the display device 100, an EEG having the same frequency as that of the body part is physically in the visual cortex of the user's occipital lobe. Induced, the EEG detection unit 310 is able to detect the SSVEP having the same frequency as the specific frequency of the blinking body part in the EEG of the user.

EEG analysis unit 320 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, EEG detection unit ( The frequency of the SSVEP having a specific frequency selected by the user, detected at 310, may be analyzed. The frequency of the SSVEP is analyzed to determine whether the SSVEP having the same frequency as the frequency of the body part of the blinking object displayed on the display device 100 is detected in the EEG of the user. When the SSVEP having the corresponding frequency is detected in the EEG of the user, the control device 500 generates a control signal for moving the corresponding body part of the object in a preset manner.

Electrical stimulation device 400 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, the user's rehabilitation It can serve to provide functional electrical stimulation to the area of need. Functional electrical stimulation means applying electrical stimulation to the paralyzed muscles or nerves to obtain functional movement of the muscles. Functional electrical stimulation treatments provide electrical stimulation to paralyzed muscles caused by central nervous system damage, resulting in functional contraction of the muscles, as well as reducing muscle stiffness and improving muscle control while stimulation is applied. Say. In some embodiments, the electrical stimulation device 400 may be attached to a place where nerves or nerves and muscles meet to stimulate both motor and sensory nerves through electrical signals, and functional electric stimulation may cause a deficiency of motor ability. The eggplant may apply electrical stimulation to the paralyzed muscles or nerves to assist the rehabilitation of the brain disease patient. Electrical stimulation device 400 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, the electrical stimulation device It may be controlled by the controller 530.

The electrical stimulation device 400 may perform electrical stimulation in which at least one or more of the intensity and frequency of the electrical stimulation are adjusted according to the result corresponding to the brain waves analyzed by the EEG analysis device. For example, the electrical stimulation may be adjusted by increasing the frequency of the electrical stimulation when the object that the user selectively watches moves rapidly, or increasing the intensity of the electrical stimulation when the object that the user selectively watches largely moves. .

The electrical stimulation device 400 includes a control signal receiver 410 for receiving a control signal generated by the control signal generator from the electrical stimulation device controller 530 and a stimulus for generating an electrical stimulation signal in real time based on the control signal. The control unit 420 and the stimulation unit 430 for receiving the electrical stimulation signal from the stimulation control unit, applying an electrical signal according to the electrical stimulation signal to the rehabilitation needs of the patient to perform electrical stimulation It may be configured to further include an input unit 440.

The control signal receiver 410 may receive a control signal generated by the control signal generator from the electrical stimulation device controller. The control signal receiver may transmit the received control signal to the stimulus controller 420.

The stimulus controller 420 may generate an electrical stimulus signal in real time based on the received control signal. That is, the stimulation control unit 420 is configured to control the stimulation unit 430 to be described below, based on the control signal electrical stimulation signal for controlling the stimulation unit 430 so that the electrical stimulation is performed on the site of the patient needs rehabilitation Can be generated in real time.

On the other hand, the stimulation control unit 420 may apply the electrical stimulation signal to be output to the plurality of stimulation unit in accordance with the pattern of the electrical stimulation to the user's rehabilitation necessary area to perform the electrical stimulation. The stimulation unit 430 may be configured to apply an electrical signal to a user's rehabilitation necessary area to stimulate the user, and may attach an electrode to which a current is applied to the user's rehabilitation necessary area to perform electrical stimulation. At this time, the stimulation unit 430, as a configuration attached to the rehabilitation site of the user, may be composed of a plurality. Therefore, depending on the electrical stimulation pattern, the strength or frequency of the electrical stimulation applied to the rehabilitation needs of the user in each stimulation unit 430 may be different from each other.

The input unit 440 may input average intensity information of an electrical signal applied to the rehabilitation necessary portion of the user by the stimulator 430. Depending on the user's condition, it may be necessary to limit the average intensity or maximum intensity of the electrical signal. Accordingly, by receiving the average intensity information from the input unit and transmitting the average intensity information to the stimulus control unit, the stimulus control unit can control the stimulation unit so that the electric stimulation of appropriate intensity can be performed to the user. The input unit may be implemented in various ways such as a button, a bar, and a touch screen, and may be implemented in various forms as long as the input unit can receive intensity information of an electric signal such as average intensity information, maximum intensity information, and minimum intensity information.

Control device of a game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells according to an embodiment of the present invention The control unit 500 may include the control signal generator 510, the display device controller 520, and the electrical stimulation device controller 530, which will be described in detail below with reference to FIG. 8.

8 is a game-based rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror neurons according to an embodiment of the present invention. The figure shows a part of the game image. As shown in FIG. 8, a control device of a game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror neurons according to an embodiment of the present invention. 500 is a control signal generator 510 for generating a control signal for moving a body part of an object corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer 320 in a preset manner, and a control signal generator ( Rehabilitation of the user is required by using the control signal generated by the display device controller 520 and the control signal generator 510 that control the display device 100 displaying the movement of the object using the control signal generated by the 510. It may include an electrical stimulation device control unit 530 for controlling the electrical stimulation device 400 for giving a functional electrical stimulation to the site. That is, the control device 500 transmits the control signal generated by the control signal generator 510 to the display device controller 520 and the electrical stimulation device controller 530, thereby receiving the control signal. Allows the user to control the display device 100 displaying the movement of the object, and the electric stimulation device controller 530 that receives the control signal provides the electric stimulation device 400 that provides a functional electric stimulation to the user's rehabilitation necessary area. Can be controlled.

According to an exemplary embodiment, a signal corresponding to an SSVEP having the same frequency generated by a user watching a body part of an object blinking at a specific frequency, and a control signal for controlling a game image is an object previously designated by a user. It may include the movement mode of. The movement mode is content related to the movement of an object necessary for the user to play a game image and may include a configuration in which a specific body part of the object moves. That is, the movement mode refers to a control signal for moving the corresponding body part observed by the user in a preset manner when the user watches the blinking body part of the object.

For example, as shown in Figure 8, the movement of the object required to move to the next step of the game image on the game screen is walking on the right road, the guide content presented on the game screen, 'to move the right arm to go to the right road Raise and lower ', so the user must raise and lower the right arm of the object. In order to proceed with the game, when the user looks at the right arm of the object flashing at 40 kHz on the game screen, the user's brain wave detects and analyzes the SSVEP of 40 kHz, which is the same frequency as the right arm of the object, and the control signal generator In 510, a control signal is generated. In this case, the predetermined movement mode may be a movement in which the right arm of the object moves up and down, a movement in which the object walks on the right road, and the like. Of course, in a game-based rehabilitation system that combines functional electrical stimulation that maximizes the activation of mirror neurons and brain-computer interface (BCI) technology, the control signal corresponding to SSVEP having a specific frequency is limited only to the control signal presented above. It doesn't happen. In addition, the display device controller 520 of the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, As described above, the game device may be controlled by controlling the display device 100 displaying the movement of the object according to the control signal generated by the control signal generator 510, and the electrical stimulation device controller 530 may be configured as described above. As described above, the electrical stimulation device 400 that provides a functional electrical stimulation to a rehabilitation necessary portion of the user according to the control signal generated by the control signal generator 510 may be controlled.

In the game-type rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, the body part is a game moving in a predetermined manner The image may include movements that help rehabilitation of the user. According to an embodiment, the movement of the body part may include a hand, a foot, a head, an arm, a leg, and the like, and may move a part of the core. In addition, the movement of the body part may include bending a waist, twisting a leg, and the like. have. This operation is for activating the user's mirror nerve cell by moving the corresponding body part of the object by watching the blinking body part of the object displayed on the display device 100. Of course, in a game-based rehabilitation system 10 that combines functional electrical stimulation that maximizes the activation of mirror neurons and brain-computer interface (BCI) technology, the movement of the image moving in a predetermined manner is only the movements presented above. It is not limited. For example, the movement of the leg part of the object may be a movement of the body part in a predetermined manner, and the user may watch the flicker of the leg part of the object to allow the leg of the object to move, By monitoring the movement of the leg area can be obtained the effect of rehabilitation of the leg area through the activation of the mirror nerve cells.

In a game-based rehabilitation system 10 that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of mirror nerve cells in accordance with one embodiment of the present invention, one or more body parts of the object flicker. The specific frequency may be the same frequency regardless of the body part, or may be a different frequency for each body part. In the case of a body part capable of moving in an object, for example, when the frequency of flickering of the hand, foot, neck, arm, leg, waist, etc. is the same, the hardware of the present invention is constructed as compared to the case where the body parts have different frequencies. It has the advantage of being convenient. On the other hand, it is preferable that each body part blinks at a different frequency. Since different frequencies are set for each different body part, the body part that the user watches is determined by judging only the SSVEP of a specific frequency detected by the user's brain waves. This is because it can be easily determined to which part. According to an embodiment, the body parts such as the arms and legs of the object may all blink at 30 Hz, the arm of the object may be flickered at different frequencies according to the body region at 35 Hz, and the legs at 40 Hz. The motion of A related to 30㎐ and the motion of B related to the right arm of the object is 40㎐, even though the same body part may be flickered at different frequencies depending on the related motion or situation. In the case of the same body part, there may be a case where the first scene displayed on the display device 100 and the second scene have different frequencies.

According to an embodiment, the specific frequency at which the body part blinks may use a frequency range of 7 Hz to 20 Hz, but in general, in the frequency region of 7 Hz to 20 Hz, the user may recognize the blinking. Since the user may easily feel eye fatigue, the user may reduce eye fatigue by using a frequency of 30 Hz or more that the user cannot recognize blinking.

9 is a game-type rehabilitation system that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells according to another embodiment of the present invention, the user rehabilitation training Figure is shown. As shown in FIG. 9, a display device 100 of a game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology for maximizing activation of mirror nerve cells according to an embodiment of the present invention. There may be more than one object displayed, and one or more users may play games together and rehabilitation.

FIG. 10 is a flowchart of a control method of a game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology maximizing activation of mirror nerve cells according to an embodiment of the present invention. to be. As shown in FIG. 10, a control method of a game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology maximizing activation of mirror nerve cells according to an embodiment of the present invention is a display device. In step S100, displaying the game image, the brain wave obtaining apparatus acquires the brain wave of the user corresponding to the game image displayed in step S100 (S200), and the brain wave analyzing apparatus is obtained in step S200. Analyzing the brain waves of the user (S300), and the control device causes the electrical stimulation device to give a functional electrical stimulation to the user's rehabilitation necessary area at the same time as the result corresponding to the brain waves analyzed in step S300; And controlling the displayed game image (S400). That is, in step S100, the game image is displayed such that at least one body part of the object displayed on the game image blinks at a specific frequency, and in step S400, when the user watches the body part, it is obtained through steps S200 and S300. According to the result corresponding to the analyzed EEG, the electrical stimulation device can give a functional electrical stimulation to the user's rehabilitation needs area, and control the body part of the object displayed on the display device to move in a preset manner. In response to the movement of the body part of the object to be selectively monitored, the activation of the user's mirror nerve cells can be maximized to help rehabilitation training.

According to an embodiment, step S300, the EEG detection unit 310 detects the SSVEP from the EEG signal of the user corresponding to the specific body part of the object that the user selectively monitors, and the EEG analysis unit 320 The method may further include analyzing a frequency of the SSVEP having a specific frequency selected by the user, detected by the EEG detector 310. In operation S400, the control signal generator 510 generates a control signal corresponding to the SSVEP having a specific frequency, and the electrical stimulation device controller 530 generates the control signal generated by the control signal generator 510. By using the control to generate a functional electrical stimulation to the user's body part using the control unit 520 controls the display device 100 to display the movement of the object using the control signal generated by the control signal generator 510 It may further comprise the step.

As described above, the game-type rehabilitation system and control method combining the functional electrical stimulation and the brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cells according to an embodiment of the present invention, the control method of the existing SSVEP Unlike the flashing light system, the system displays the body part of the blinking object at a certain frequency of SSVEP and activates the mirror nerve cell through the game image in which the body part of the object that the user watches is moved. In addition, it is possible to increase the concentration of attention to the image by inducing the interest of the user, and at the same time, by providing the functional electrical stimulation (Functional Electrical Stimulation) to the user's need for rehabilitation so that rehabilitation training can be done just by watching the game image. Can be.

The present invention described above may be variously modified or applied by those skilled in the art, and the scope of the technical idea according to the present invention should be defined by the following claims.

Claims

As a rehabilitation system,

A display device for displaying a game image;

An EEG acquisition device for acquiring an EEG of a user corresponding to a game image displayed on the display device;

An EEG analyzer for analyzing EEG of the user acquired by the EEG acquisition apparatus;

An electrical stimulation device for performing a functional electrical stimulation on a rehabilitation site of a user according to a result corresponding to the brain wave analyzed by the EEG analysis device; And

According to a result corresponding to the EEG analyzed by the EEG analysis device, and including a control device for controlling the electric stimulation performed in the game image and the electric stimulation device displayed on the display device,

The control device,

One or more body parts of the object displayed on the game image may be controlled to blink at a specific frequency, and when the user observes the corresponding body part of the object displayed on the game image, the brain wave acquisition device and the EEG analysis device may be controlled. According to the result corresponding to the brain waves acquired and analyzed through the control, the body part of the object displayed on the game image may be controlled to move in a preset manner, and the functional restimulation part of the user may be moved to give a functional electrical stimulation. Can be controlled,

Functional electrical stimulation and brain-computer maximizing the activation of the mirror nerve cells, characterized in that the rehabilitation training using the activation of the mirror nerve cells of the user according to the movement of the body parts of the object that the user selectively watches. Gaming rehabilitation system that combines interface (BCI) technology.
The display device of claim 1, wherein the display device comprises:

A game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology that maximizes the activation of mirror nerve cells, characterized in that the display device further comprises a display device for displaying the progression of the game image. .
The display device of claim 2, wherein the display device comprises:

And a voice output device for outputting voice content corresponding to the guide content. A game-type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells.
According to claim 1, The EEG analysis device,

An EEG detecting unit for detecting EEG when the user selectively looks at a specific body part of the object; And

Game brain rehabilitation system that combines functional electrical stimulation and brain-computer interface (BCI) technology to maximize the activation of the mirror nerve cell, characterized in that it comprises an EEG analyzer for analyzing the frequency of the EEG detected by the EEG detector.
The method of claim 4, wherein the EEG detection unit,

Functional electrical stimulation and brain-computer interface (BCI) technology that maximizes the activation of mirror neurons, characterized in that SSVEP is detected in a user's EEG signal corresponding to a specific body part of an object that the user selectively watches. A game-based rehabilitation system that combines.
The method of claim 4, wherein the EEG analysis unit,

A game type rehabilitation system combining functional electrical stimulation and brain-computer interface (BCI) technology to maximize activation of mirror nerve cells, characterized in that the frequency of the SSVEP detected by the EEG detector.
According to claim 1, The electrical stimulation device,

According to the results corresponding to the brain waves analyzed by the EEG analysis device, characterized in that to perform at least one or more of the intensity and frequency of the electrical stimulation controlled electrical stimulation, functional electrical stimulation to maximize the activation of the mirror nerve cells and Gaming rehabilitation system that combines brain-computer interface (BCI) technology.
According to claim 1, The electrical stimulation device,

A control signal receiver for receiving a control signal generated by the control signal generator;

A stimulation controller configured to generate an electrical stimulation signal in real time based on the control signal; And

Receiving the electrical stimulation signal from the stimulation control unit, and applying an electrical signal according to the electrical stimulation signal to the rehabilitation necessary portion of the patient comprising a stimulator for performing electrical stimulation, maximizing the activation of the mirror nerve cells A game-based rehabilitation system that combines functional electrical stimulation with brain-computer interface (BCI) technology.
The method of claim 8, wherein the electrical stimulation device,

A functional electrical stimulation and brain-computer interface (BCI) for maximizing the activation of mirror nerve cells, further comprising an input unit for inputting the average intensity information of the electrical signal applied to the rehabilitation needs of the patient in the stimulation unit A game-based rehabilitation system that combines technology.
The method of claim 8,

The magnetic pole portion is a plurality,

The stimulation control unit is characterized in that to generate an electrical stimulation signal to be output to the plurality of stimulation unit in real time for each of the plurality of stimulation unit in accordance with the pattern of the electrical stimulation, functionality to maximize the activation of the mirror nerve cells Gaming rehabilitation system that combines electrical stimulation and brain-computer interface (BCI) technology.
According to claim 1, The electrical stimulation device,

A functional electrical stimulation and brain-computer interface (BCI) technology that maximizes the activation of mirror nerve cells, which is attached to where nerves or nerves and muscles meet and stimulates both motor and sensory nerves through electrical signals. Combined game rehabilitation system.
The method of claim 1, wherein the control device,

A control signal generator configured to move a body part of the object corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer in a preset manner, and generate a control signal to give a functional electric stimulus to the user's body part in a preset manner;

A display device controller configured to control a display device displaying the movement of the object by using the control signal generated by the control signal generator; And

And an electrical stimulation device control unit for controlling an electrical stimulation device to give a functional electrical stimulation to the body part of the user by using the control signal generated by the control signal generation unit. A game-based rehabilitation system that combines functional electrical stimulation with brain-computer interface (BCI) technology.
According to claim 1, The game system rehabilitation system,

The specific frequency at which one or more body parts of an object blinks is the same frequency, regardless of body parts, or different frequencies for each body part. Functional electrical stimulation and brain-computer interface to maximize activation of mirror nerve cells. A game-based rehabilitation system that combines (BCI) technology.
According to claim 1, The game system rehabilitation system,

The game image, in which the body part moves in a preset manner, includes a movement that helps the user's rehabilitation, combining functional electrical stimulation that maximizes the activation of mirror nerve cells and brain-computer interface (BCI) technology. Game-type rehabilitation system.
As a control method of the rehabilitation system,

(1) displaying, by the display device, a game image;

(2) acquiring an EEG of the user corresponding to the game image displayed in the step (1) by the EEG obtaining apparatus;

(3) the EEG analyzing apparatus, analyzing the EEG of the user obtained in the step (2); And

(4) the control device controlling the game image displayed on the display device while causing the electrical stimulation device to give a functional electrical stimulation to the user's rehabilitation site according to the result corresponding to the brain wave analyzed in step (3) Including,

In step (1),

Displaying the game image such that one or more body parts of an object displayed on the game image blink at a specific frequency,

In step (4),

When the user observes the corresponding body part of the object displayed on the game image, the corresponding body of the object displayed on the image according to the result corresponding to the brain wave acquired and analyzed through the steps (2) and (3) To control the area to move in a preset manner, to give a functional electrical stimulation to the user's rehabilitation needs to control the movement,

Functional electrical stimulation and brain-computer maximizing the activation of the mirror nerve cells, characterized in that the rehabilitation training using the activation of the mirror nerve cells of the user according to the movement of the body parts of the object that the user selectively watches. Control method of game-type rehabilitation system incorporating interface (BCI) technology.
The method of claim 15, wherein the EEG analysis device,

An EEG detecting unit for detecting EEG when the user selectively looks at a specific body part of the object; And

In the game-type rehabilitation system of the brain-computer interface (BCI) technology combined with a functional electrical stimulation to maximize the activation of the mirror neurons, characterized in that it comprises an EEG analysis unit for analyzing the frequency of the EEG detected by the EEG detection unit Control method.
The method of claim 15, wherein the electrical stimulation device,

A control signal receiver for receiving a control signal generated by the control signal generator;

A stimulation controller configured to generate an electrical stimulation signal in real time based on the control signal; And

Receiving the electrical stimulation signal from the stimulation control unit, and applying an electrical signal according to the electrical stimulation signal to the rehabilitation necessary portion of the patient comprising a stimulator for performing electrical stimulation, maximizing the activation of the mirror nerve cells A method of controlling a game-based rehabilitation system that combines functional electrical stimulation and brain-computer interface (BCI) technology.
The method of claim 17, wherein the electrical stimulation device,

A functional electrical stimulation and brain-computer interface (BCI) for maximizing the activation of mirror nerve cells, further comprising an input unit for inputting the average intensity information of the electrical signal applied to the rehabilitation needs of the patient in the stimulation unit Control method of game-type rehabilitation system combining technology.
The method of claim 17,

The magnetic pole portion is a plurality,

The stimulation control unit is characterized in that to generate an electrical stimulation signal to be output to the plurality of stimulation unit in real time for each of the plurality of stimulation unit in accordance with the pattern of the electrical stimulation, functionality to maximize the activation of the mirror nerve cells Control method of game-type rehabilitation system combining electric stimulation and brain-computer interface (BCI) technology.
The method of claim 15, wherein the control device,

A control signal generator configured to move a body part of the object corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer in a preset manner, and generate a control signal to give a functional electric stimulus to the user's body part in a preset manner;

A display device controller configured to control a display device displaying the movement of the object by using the control signal generated by the control signal generator; And

Maximizing the activation of the mirror nerve cell, characterized in that it comprises an electrical stimulation device control unit for controlling the electrical stimulation device to give a controlled electrical stimulation to the body part of the user using the control signal generated by the control signal generation unit A method of controlling a game-based rehabilitation system that combines functional electrical stimulation and brain-computer interface (BCI) technology.