WO2020226371A1

WO2020226371A1 - Virtual hand illusion system for treatment of hemiplegia patient by using brain stimulus and operation method therefor

Info

Publication number: WO2020226371A1
Application number: PCT/KR2020/005821
Authority: WO
Inventors: 구정훈
Original assignee: 계명대학교 산학협력단
Priority date: 2019-05-03
Filing date: 2020-05-01
Publication date: 2020-11-12
Also published as: KR102164965B1

Abstract

According to a virtual hand illusion system for treatment of hemiplegia patients by using brain stimuli and an operation method therefor, proposed in the present invention, a head mounted display (HMD) device is used in combination with conventional mirror therapy to allow the user to enter a flow state in a virtual reality (VR) or augmented/mixed reality (MR) circumstance and to undergo rehabilitation in more comfortable postures, thereby maximizing the effect of misunderstanding the motion of a non-paralyzed limb as that of a paralyzed limb and throwing brain cognitive function into confusion to reduce pain that may be generated during rehabilitation. In this condition, the patient is subjected to rehabilitation while seeing only motion images on the display without looking his or her real paralyzed limb. In a flow state enhanced to the same degree, thus, the patient can receive rehabilitation therapy and ultimately the time taken for rehabilitation of hemiplegia patients can be reduced.

Description

Virtual hand illusion system for treatment of hemiplegic patients using brain stimulation and its driving method

The present invention relates to a virtual hand delusion system for treatment of hemiplegic patients and a driving method thereof, and more particularly, to a virtual hand delusion system for treatment of hemiplegia patients and a driving method thereof using brain stimulation.

Diseases such as stroke or cerebral infarction are usually accompanied by hemiplegia, and occur because blood supplied to the brain cannot be delivered due to blockage of blood vessels. Patients with hemiplegia due to stroke are usually accompanied by a number of disorders such as motor dysfunction, cognitive and perceptual disorders, sensory disorders, and speech disorders. The disorder causes limitations in daily life movements such as eating and detachment. About 66% of them have physical dysfunction and about 75% of them have problems with daily life. In order to assist in the rehabilitation of such hemiplegic patients, various rehabilitation treatment methods are known, and one of them is mirror treatment.

Mirror therapy is one of the treatments for patients with cranial nerve injury based on the principle of cranial plasticity that the cranial nerves can be structurally and functionally changed and reorganized. By inducing motor function recovery and movement of the affected side, the patient's paralysis side of the body recovers functions. Promote. Mirror therapy is a new treatment that focuses on intact limb movement. It was first introduced by Ramachandran and RogersRamachandran (1996) as a method of treating phantom pain after amputation, and was subsequently performed for patients with acute stroke. In several experiments, it was confirmed that it is effective in restoring the function of the paralyzed body. In other words, it is a theory that the motion of the non-paralyzed limb is projected to the motion of the paralyzed limb through mirror reflection, and the image given by the visual information superimposed on the paralyzed limb stimulates the brain.

1 is a view showing a conventional mirror treatment method for rehabilitation treatment of a hemiplegic patient. As shown in FIG. 1, mirror treatment is typically performed using a mirror treatment device, in which two square plates are connected to form a bracket, and one of the two plates is composed of a mirror. By providing a visual illusion to the patient by placing a mirror vertically in the center of the non-paralytic side and the middle of the paralyzed limb, and making the shape of the non-paralytic limb projected on the mirror coincide with the paralyzed limb, It gives an illusion.

However, the conventional mirror treatment has a problem that the patient's posture is poor due to the asymmetry of the torso because the body must be moved to the non-paralytic side to see the image, which makes rehabilitation treatment difficult. In other words, in the conventional mirror treatment, the body is tilted toward the non-paralytic side to see the limbs in the mirror. At this time, when the angle between the mirror and the ground increases, the asymmetry of the body increases by supporting the body weight toward the non-paralytic side. As the angle decreases, the asymmetry in the mirror increases and the effect of illusion such as moving the paralyzed limb decreases. Therefore, there is a need for an implementation method that uses the existing mirror therapy principle, but enhances the illusion of movement.

On the other hand, as a prior art related to the present invention, Korean Patent Registration No. 10-1698244 (name of the invention: Pain treatment device for physically symmetrical physical diseases, notification date: February 01, 2017) has been disclosed. .

The present invention has been proposed to solve the above problems of the previously proposed methods, and a head mounted display that immerses a user in a virtual reality (VR) or augmented/mixed reality (MR) environment to the existing mirror treatment method ( HMD) device enables rehabilitation treatment in a more comfortable posture, maximizing the effect of mistaking the movement of the non-paralyzed limb as the movement of the paralyzed limb and disrupting the brain sensory cognitive function, which can occur during rehabilitation. Pain can be alleviated, and the patient cannot actually see his paralyzed limb and is engaged in rehabilitation treatment by looking only at the motion image from the display unit, so that the immersion is improved so that the patient can engage in rehabilitation treatment. It is an object of the present invention to provide a virtual hand delusion system and a driving method for treating hemiplegic patients using brain stimulation, which can shorten the time required for rehabilitation treatment of hemiplegic patients.

In addition, the present invention introduces an EEG stimulation system to mirror therapy using a virtual reality (VR) or augmented/mixed reality (MR) environment, thereby analyzing the patient's EEG in the middle of the hemiplegic patient's rehabilitation treatment. It is possible to stimulate appropriate functional EEG according to changes in state, further maximizing the effect of mirror therapy, which mistaken the movement of the non-paralyzing limb as the movement of the paralyzing limb, and allowing the patient to focus on his or her own rehabilitation treatment. Another object of the present invention is to provide a virtual hand illusion system and a driving method for treating hemiplegic patients using brain stimulation, which can increase the immersion of treatment by appropriate stimulation.

A virtual hand illusion system for treating hemiplegic patients using brain stimulation according to the features of the present invention for achieving the above object,

As a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation,

A motion tracker mounted on the user's non-paralyzed hand and measuring three-dimensional motion information of the non-paralyzed hand;

A controller that analyzes the information collected by the motion tracker and processes an image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand; And

It is characterized in that it comprises a display unit that displays the image processed by the control unit to the user.

Preferably, the motion tracker (Motion Tracker),

A finger position tracker that measures a position of a fingertip movement;

A joint angle tracker that measures the angle of movement of a finger joint; And

It can be configured to include a hand orientation tracker (Hand Orientation Tracker) that measures the movement according to the rotation of the hand.

More preferably, the finger position tracker (Finger Position Tracker),

It includes at least one position sensor positioned at each fingertip of the user, and the position of each fingertip may be sensed through three-dimensional position information of the fingertip movement measured by the position sensor.

More preferably, the joint angle tracker (Finger Joint Angle Tracker),

It includes at least one angle sensor positioned at each finger joint of the user, and the movement of each finger joint may be detected through angle information of the finger joint measured by the angle sensor.

More preferably, the hand orientation tracker (Hand Orientation Tracker),

It may be configured to include a three-axis angular velocity sensor and a three-axis acceleration sensor for detecting the rotational movement of the user's hand along the x-axis, y-axis, and z-axis.

Preferably, the control unit,

A motion receiver configured to receive a motion of the non-paralyzed hand detected by the motion tracker as a first motion image;

A motion conversion unit for converting the first motion image received by the motion receiver into a second motion image by mirror inversion processing; And

It may be configured to include a motion transmission unit for transmitting the second motion image converted by the motion conversion unit to the display unit.

More preferably, the motion transmission unit,

The first exercise image received by the motion receiver and the second exercise image converted by the motion converter may be transmitted to the display unit together.

More preferably, the display unit,

The second motion image received from the motion transmitter may be visually rendered to look like the user's paralyzed hand and displayed to the user.

Preferably, the display unit,

It may be implemented as a head mounted display (HMD) device that immerses the user in a virtual reality (VR) or augmented/mixed reality (MR) environment.

Preferably,

When the user views the second motion image through the display unit, it may further include an EEG control unit for further maximizing an illusion of recognizing the motion of the non-paralyzed hand as the motion of the paralyzed hand.

Preferably, the brain wave control unit,

An EEG acquisition unit for obtaining a user's EEG in real time;

An EEG analysis unit that analyzes the EEG obtained by the EEG acquisition unit; And

It may be configured to include an EEG stimulation unit for stimulating EEG based on the analysis by the EEG analysis unit.

A method of driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to a feature of the present invention for achieving the above object,

As a method of driving a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation,

(1) measuring three-dimensional motion information of the non-paralyzed hand in the motion tracker mounted on the non-paralyzed hand of the user;

(2) analyzing the motion information measured in step (1), and processing the image so that the control unit mistaken the motion of the non-paralyzed hand as the motion of the paralyzed hand; And

(3) It may be implemented including the step of outputting the image processed in step (2) to the user from the display unit.

Preferably, the step (1),

(1-1) measuring the position of the fingertip movement on the finger position tracker;

(1-2) measuring a movement angle of a finger joint in a joint angle tracker; And

(1-3) It may be implemented including the step of measuring the movement according to the rotation of the hand on the hand direction tracker.

More preferably, the step (1-1),

At least one position sensor is located at the tip of each finger of the user, and the position of each finger may be sensed through three-dimensional position information of the movement of the finger tip measured by the position sensor.

More preferably, the step (1-2),

At least one angle sensor is located on each finger joint of the user, and the movement of each finger joint may be detected through angle information of the finger joint measured by the angle sensor.

More preferably, the step (1-3),

In the 3-axis angular velocity sensor and the 3-axis acceleration sensor, it is possible to detect the rotational movement of the user's hand along the x-axis, y-axis, and z-axis.

Preferably, the step (2),

(2-1) receiving the motion of the non-paralyzed hand detected in step (1) as a first motion image by a motion receiver;

(2-2) converting the first motion image received in step (2-1) into a second motion image by mirror-reversing the motion conversion unit; And

(2-3) The second motion image converted in step (2-2) may be transmitted from the motion transmitter to the display.

More preferably, the step (2-3),

The first exercise image received in step (2-1) and the second exercise image converted in step (2-2) may be transmitted to the display unit together.

More preferably, the step (3),

The second motion image received in step (2-3) may be visually rendered to look like the user's paralyzed hand and displayed to the user.

Preferably, the step (3),

It may be implemented through a head mounted display (HMD) device that immerses the user in a virtual reality (VR) or augmented/mixed reality (MR) environment.

Preferably,

(4) When the user views the second motion image in step (3), controlling the EEG by the EEG control unit to further maximize the illusion of recognizing the motion of the non-paralyzed hand as the motion of the paralyzed hand. It may be implemented further including.

Preferably, the step (4),

(4-1) obtaining a user's EEG in real time by the EEG acquisition unit;

(4-2) analyzing the EEG obtained in step (4-1) by the EEG analysis unit; And

(4-3) Based on the analysis in step (4-2), it may be implemented including the step of stimulating an EEG in the EEG stimulation unit.

According to the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation proposed in the present invention and the driving method thereof, the user is immersed in a virtual reality (VR) or augmented/mixed reality (MR) environment in the conventional mirror treatment method. By using a head-mounted display (HMD) device, it is possible to perform rehabilitation treatment in a more comfortable posture, maximizing the effect of mistaking the movement of the non-paralyzed limb as the movement of the paralyzed limb and reducing the brain sensory cognitive function to confusion. It can alleviate the pain that may occur during rehabilitation, and the patient cannot actually see his paralyzed limb and is engaged in rehabilitation treatment by looking only at the motion image from the display unit. As a result, the time required for rehabilitation treatment of hemiplegic patients can be shortened.

In addition, according to the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation proposed in the present invention and the driving method thereof, an EEG stimulation system for mirror therapy using a virtual reality (VR) or augmented/mixed reality (MR) environment In the middle of the hemiplegic patient's rehabilitation treatment, it is possible to analyze the patient's EEG and stimulate the appropriate functional EEG according to the patient's state change, so that the movement of the non-paralytic limb is mistaken for the movement of the paralyzed limb. The effect of mirror therapy can be further maximized and the degree of immersion in therapy can be increased by appropriately stimulating the brain so that the patient can focus only on his or her rehabilitation therapy.

1 is a view showing a conventional mirror treatment method for rehabilitation treatment of hemiplegic patients.

Figure 2 is a diagram showing the configuration of a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block.

3 is a view showing a motion tracker configuration of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block.

4 is a view showing a perspective view of a motion tracker of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.

5 is a view showing an example of an image of a display unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.

6 is a view showing another example of an image of a display unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.

7 is a diagram showing the configuration of an EEG control unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block.

8 is a view showing the wearing of a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention.

9 is a view showing the flow of a method of driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.

10 is a view showing the flow of a hand movement measurement method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.

11 is a diagram illustrating a flow of an image processing method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.

12 is a view showing a flow of a brain wave control method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.

100: motion tracker

110: finger position tracker

111: position sensor

120: joint angle tracker

121: angle sensor

130: Hand direction tracker

131: 3-axis angular velocity sensor

132: 3-axis acceleration sensor

200: control unit

210: motion receiver

220: motion conversion unit

230: motion transmitter

300: display unit

400: brain wave control unit

410: brain wave acquisition unit

420: brain wave analysis unit

430: brain wave stimulation unit

S100: Measuring 3D motion information of the user's non-paralyzed hand

S110: measuring the position of the fingertip movement

S120: Measuring the angle of movement of the finger joint

S130: measuring movement according to the rotation of the hand

S200: Analyzing the measured motion information and processing the image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand

S210: Receiving the motion of the non-paralyzed hand as a first motion image

S220: Converting the received first motion image into a second motion image by mirror inversion processing

S230: Transmitting the converted second exercise image to the display unit

S300: outputting the processed image to the user

S400: Controlling brain waves to further maximize illusion

S410: Acquiring the user's EEG in real time

S420: Analyzing the acquired EEG

S430: Stimulating brain waves based on the analyzed

Hereinafter, preferred embodiments will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. However, in describing a preferred embodiment of the present invention in detail, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, the same reference numerals are used throughout the drawings for portions having similar functions and functions.

In addition, throughout the specification, when a part is said to be connected to another part, this includes not only the case that it is directly connected, but also the case that it is indirectly connected with another element interposed therebetween. In addition, the inclusion of certain components means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

A virtual hand illusion system for treating hemiplegic patients using brain stimulation and a driving method thereof according to an embodiment of the present invention is a rehabilitation treatment method using the principle of mirror treatment, and one of the imagination training methods, the mirror treatment method, is non- By reflecting the movements of the paralyzed limb in a mirror, the primary motor region of the brain connected to the opposite limb is excited and reorganized to replace its function in other regions around the injured brain, resulting in motor recovery, upper and lower limb functions. It is a rehabilitation treatment method that helps to improve.

2 is a diagram showing the configuration of a virtual hand delusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block. As shown in FIG. 2, the virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention is mounted on the non-paralyzed hand of the user, and three-dimensional movement of the non-paralyzed hand A motion tracker 100 that measures information; A controller 200 that analyzes the information collected by the motion tracker 100 and processes an image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand; And a display unit 300 that displays an image processed by the control unit 200 to a user, and further maximizes the illusion of recognizing the movement of the non-paralyzed hand as the movement of the paralyzed hand. ) May be further included and configured.

Motion Tracker (100) is mounted on the non-paralyzed hand of a hemiplegic patient to recognize the three-dimensional position of the hand and measure the rotation of the user's hand, which occurs as the patient freely moves the non-paralyzed hand. This is a configuration that integrates posture recognition and angle measurement recognition that can measure the movement of a finger joint.

3 is a diagram showing a motion tracker configuration of a virtual hand delusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a function block, and FIG. 4 is a brain stimulation according to an embodiment of the present invention. It is a view showing a perspective view of a motion tracker of a virtual hand illusion system for treatment of hemiplegic patients using. As shown in Figure 3, the motion tracker (Motion Tracker) 100 of the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention, a finger for measuring the position of the fingertip movement Position Tracker (Finger Position Tracker) 110; A joint angle tracker 120 for measuring a movement angle of a finger joint; And it may be configured to include a hand orientation tracker (Hand Orientation Tracker) 130 for measuring the movement according to the rotation of the hand. That is, the motion tracker 100 may be implemented in the form of a glove that can be worn on at least a part of the hand of the hemiplegic patient by integrating the finger position tracker 110, the joint angle tracker 120, and the hand direction tracker 130. The tracker 100 may be implemented in the form of socks for measuring movement of the hemiplegic patient's foot as well as the hand of the hemiplegic patient. Hereinafter, each component constituting the motion tracker 100 will be examined in detail using FIGS. 3 and 4.

The finger position tracker 110 is a device constituting the motion tracker 100 and can measure the movement of each user's fingertips. That is, the finger position tracker 110 includes at least one position sensor 111 located at the tip of each finger of the user, but the three-dimensional movement of the finger tip measured by the position sensor 111 The position of each finger tip can be detected through the enemy location information. Preferably, the finger position tracker 110 may be implemented to detect a three-dimensional position of the position sensor 111 moving in space with an error of 5 or less.

The finger joint angle tracker 120 is another device constituting the motion tracker 100 and may measure a movement angle of a finger joint. As shown in Figure 4, the joint angle tracker (Finger Joint Angle Tracker) 120 is configured to include at least one angle sensor 121 located at each finger joint of the user, but in the angle sensor 121 The movement of each finger joint can be detected through the measured angle information of the finger joint. That is, an angle sensor 121 is provided for each finger joint to measure the degree of bending of the finger joint, and preferably, the movement of the finger joint can be measured within an error range of 5 degrees using the angle sensors 121. It can be configured to be.

The hand orientation tracker 130 is another device constituting the motion tracker 100, and may measure movement according to the rotation of the hand and the posture of the hand. As shown in FIG. 4, the hand orientation tracker 130 may be disposed on the user's hand, and the like, and when the user rotates his or her hand, the degree of rotation of the hand is measured. That is, it may be configured to include a three-axis angular velocity sensor 131 and a three-axis acceleration sensor 132 for detecting rotational motion along the x-axis, y-axis and z-axis of the user's hand, preferably each x-axis , y-axis, z-axis can be configured to have a precision of about 7 to 10 degrees.

That is, as shown in Figure 4, the motion tracker (Motion Tracker) 100, a finger position tracker (Finger Position Tracker) 110, a joint angle tracker (Finger Joint Angle Tracker) 120, and a hand direction tracker ( It may include a Hand Orientation Tracker (130), and is mounted in the form of a glove on the non-paralyzed hand of a hemiplegic patient, so that the three-dimensional movement of the non-paralyzed hand can be more accurately measured.

The controller 200 may analyze the information collected by the motion tracker 100 and process the image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand. As shown in FIG. 1, the controller includes a motion receiver 210 for receiving a motion of a non-paralyzed hand detected by the motion tracker 100 as a first motion image; A motion conversion unit 220 for converting the first motion image received by the motion receiving unit 210 into a second motion image by mirror inversion processing; And a motion transmitter 230 that transmits the second motion image converted by the motion conversion unit 220 to the display unit 300. More specifically, 3D position information of the finger position tracker 110 in the motion tracker 100, the movement of the joint angle of the joint angle tracker 120, and the rotation of the user's hand of the hand direction tracker 130 After receiving the location information of the hand, the movement of the user's hand is received as a first movement image, and the received first movement image is mirror-reversed to convert it into a second movement image to appear as the movement of the paralyzed hand of the hemiplegic patient. The converted second motion image is transmitted to the display unit 300 so that the user can see it and mistake it for the motion of the paralyzed hand.

FIG. 5 is a view showing an example of an image of a display unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention, and FIG. 6 is a brain stimulation according to an embodiment of the present invention. A diagram showing another example of an image of a display unit of a virtual hand illusion system for treating a hemiplegic patient using. 5 and 6, the motion transmitting unit 230 may transmit only the second motion image converted by the motion conversion unit 220 to the display unit 300, and received by the motion receiving unit 210 The converted first exercise image and the second exercise image converted by the motion conversion unit 220 may be transmitted to the display unit 300 together.

The display unit 300 may visually render the second exercise image received from the motion transmitter 230 or the first exercise image and the second exercise image received from the motion transmitter 230 together and display it to the user. That is, as shown in Figs. 5 and 6, when the hemiplegic patient moves the non-paralyzed hand equipped with the motion tracker 100, the movement of the non-paralyzed hand is recognized as the movement of the paralyzed hand. It can be rendered visually to increase the illusion effect and show it more realistically. Further, the display unit 300 may be implemented through a head mounted display (HMD) device that immerses a user in a virtual reality (VR) or augmented/mixed reality (MR) environment. Therefore, hemiplegic patients can perform rehabilitation treatment in a more comfortable posture by installing a head mounted display (HMD) device on their head and using a mirror treatment fee in virtual reality, thereby increasing the degree of immersion in the rehabilitation treatment. It can increase the effect of mistaken hand movements.

When viewing the second motion image through the display unit 300, the EEG controller 400 may further maximize the illusion of recognizing the movement of the non-paralyzed hand as the movement of the paralyzed hand. That is, while a hemiplegic patient undergoes rehabilitation treatment using a virtual hand illusion system, the effect of mirror treatment can be enhanced by acquiring the patient's EEG, analyzing the EEG, and stimulating the EEG appropriately according to the patient's condition. Hereinafter, the configuration of the EEG controller 400 will be described in more detail with reference to FIG. 7.

7 is a diagram showing a configuration of an EEG control unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block. As shown in FIG. 7, the EEG control unit 400 includes an EEG acquisition unit 410 for obtaining a user's EEG in real time, an EEG analysis unit 420 for analyzing EEG obtained from the EEG acquisition unit 410, and It may be configured to include an EEG stimulation unit 430 for stimulating EEG based on the analysis by the EEG analysis unit 420. In other words, by acquiring the EEG of a patient undergoing rehabilitation treatment using mirror therapy, and applying differently the part and method of brain stimulation according to the acquired EEG, the patient can change the movement of the non-paralytic limb It can further maximize the effect of being mistaken for and increase the degree of immersion in treatment so that the patient can focus only on their own rehabilitation treatment. The EEG control unit 400 may include one or more electrodes for measuring EEG. According to an embodiment, the EEG control unit 400 may be configured as a device in which one or more electrodes are wrapped around a user's head, or an electrode is coupled to a hat. By doing so, the hat itself may become the brainwave control unit 400. In addition, it is also possible to apply an electrolyte gel to the electrode, which allows the EEG detected from the scalp to be well transmitted to the electrode.

8 is a diagram showing a wearing state of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention. As shown in Fig. 8, the patient measures the movement of the non-paralyzed hand by attaching a motion tracker 100 implemented in the form of a glove to the non-paralyzed hand, and the measured movement is mirrored in the controller 200. The patient's paralyzed hand is converted into a moving image, and then it can be viewed through virtual reality through the display unit 300 of a head mounted display (HMD) device mounted on the patient's head. The attached EEG controller 400 acquires and analyzes the EEG of the patient, and appropriately stimulates EEG, thereby enhancing the effect of the illusion.

9 is a diagram illustrating a flow of a method of driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention. As shown in FIG. 9, a method of driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention includes a motion tracker 100 mounted on a non-paralyzed hand of a user. Step of measuring the three-dimensional motion information of the paralyzed hand (S100), by analyzing the measured motion information, the controller 200 processes the image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand It may be implemented including the step of performing (S200) and the step of outputting the processed image to the user from the display unit 300 (S300), and when the user views the output image, the movement of the hand on the non-paralyzed side is In order to further maximize the illusion of hand movement, the EEG control unit 400 may further include a step S400 of controlling the EEG.

10 is a diagram illustrating a flow of a method for measuring hand movement of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention. As shown in FIG. 10, the method of measuring hand movement of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention measures the position of the fingertip movement in the finger position tracker 110. Implementing including the step (S110), measuring the movement angle of the finger joint in the joint angle tracker 120 (S120), and measuring the movement according to the rotation of the hand in the hand direction tracker 130 (S130) Can be.

11 is a diagram illustrating a flow of an image processing method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention. As shown in FIG. 11, the image processing method of the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention includes the movement of the non-paralyzed hand detected in step S100. Receiving the first motion image as a first motion image in step 210 (S210), the step of converting the received first motion image into a second motion image by mirror inversion processing in the motion conversion unit 220 (S220), and the converted second motion image It may be implemented including the step (S230) of transmitting an image from the motion transmission unit 230 to the display unit 300.

12 is a diagram illustrating a flow of an EEG control method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention. As shown in FIG. 12, the EEG control method of the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention, in which the EEG acquisition unit 410 acquires the user's EEG in real time. It may be implemented including the step S410, the step of analyzing the acquired EEG in the EEG analysis unit 420 (S420), and the step of stimulating the EEG in the EEG stimulation unit 430 based on the analyzed (S430). .

Details related to each step have been sufficiently described in relation to the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention, and thus detailed descriptions will be omitted.

As described above, according to the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention and the driving method thereof, in the conventional mirror treatment method, virtual reality (VR) or augmented/mixed reality ( By using a head mounted display (HMD) device that immerses the user in the MR) environment, rehabilitation treatment can be performed in a more comfortable posture, maximizing the effect of mistaking the movement of the non-paralyzed limb as the movement of the paralyzed limb. It can alleviate the pain that may occur during rehabilitation by disrupting the brain sensory cognitive function, and the patient cannot actually see his paralyzed limb and engages in rehabilitation treatment only by looking at the motion image from the display. As rehabilitation treatment can be performed in an improved state, the time required for rehabilitation treatment of hemiplegic patients can be shortened. In addition, according to the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention and the driving method thereof, EEG for mirror therapy using a virtual reality (VR) or augmented/mixed reality (MR) environment By introducing a stimulation system, it is possible to analyze the patient's EEG in the middle of the rehabilitation treatment of the hemiplegic patient and stimulate the appropriate functional EEG according to the patient's state change. The effect of misunderstanding mirror therapy can be further maximized and the degree of immersion in therapy can be increased by appropriately stimulating the brain so that the patient can focus only on his or her rehabilitation therapy.

The present invention described above can be modified or applied in various ways by those of ordinary skill in the technical field to which the present invention belongs, and the scope of the technical idea according to the present invention should be determined by the following claims.

Claims

As a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation,

A motion tracker 100 mounted on the non-paralyzed hand of the user and measuring three-dimensional motion information of the non-paralyzed hand;

A controller 200 that analyzes the information collected by the motion tracker 100 and processes an image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand; And

A virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation, comprising: a display unit 300 showing an image processed by the control unit 200 to a user.
The method of claim 1, wherein the motion tracker (100),

A finger position tracker 110 for measuring a position of a fingertip movement;

A joint angle tracker 120 for measuring a movement angle of a finger joint; And

A virtual hand delusion system for the treatment of hemiplegic patients using brain stimulation, characterized in that it comprises a hand direction tracker 130 for measuring movement according to the rotation of the hand.
The method of claim 2, wherein the finger position tracker (110),

Including at least one position sensor 111 positioned at each finger tip of the user, but detecting the position of each finger tip through three-dimensional position information of the finger tip movement measured by the position sensor 111 Characterized in, a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation.
The method of claim 2, wherein the joint angle tracker 120,

Consisting of including at least one angle sensor 121 positioned on each finger joint of the user, characterized in that the movement of each finger joint is detected through angle information of the finger joint measured by the angle sensor 121 , Virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation.
The method of claim 2, wherein the hand direction tracker (130),

Hemiplegic patients using brain stimulation, characterized in that it comprises a 3-axis angular velocity sensor 131 and a 3-axis acceleration sensor 132 for detecting rotational motion along the x-axis, y-axis, and z-axis of the user's hand Virtual hand illusion system for treatment.
The method of claim 1, wherein the control unit 200,

A motion receiver 210 for receiving the motion of the non-paralyzed hand detected by the motion tracker 100 as a first motion image;

A motion conversion unit 220 for converting the first motion image received by the motion receiver 210 into a second motion image by mirror-reversing the motion image; And

It characterized in that it comprises a motion transmitting unit 230 for transmitting the second motion image converted by the motion conversion unit 220 to the display unit 300, a virtual treatment for hemiplegic patients using brain stimulation Hand illusion system.
The method of claim 6, wherein the motion transmission unit 230,

The first motion image received by the motion receiver 210 and the second motion image converted by the motion converter 220 are transmitted to the display unit 300 together. Virtual hand illusion system for treatment of hemiplegic patients.
The method of claim 1, wherein the display unit 300,

A virtual hand illusion system for treating hemiplegic patients using brain stimulation, characterized in that it is a head mounted display (HMD) device that immerses a user in a virtual reality (VR) or augmented/mixed reality (MR) environment.
The method of claim 1,

When the user views the second motion image through the display unit 300, further comprising an EEG control unit 400 for further maximizing an illusion of recognizing the movement of the non-paralyzed hand as the movement of the paralyzed hand. A virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation.
The method of claim 9, wherein the brain wave control unit 400,

An EEG acquisition unit 410 for obtaining a user's EEG in real time;

An EEG analysis unit 420 that analyzes the EEG acquired by the EEG acquisition unit 410; And

A virtual hand illusion system for treating hemiplegic patients using brain stimulation, characterized in that it comprises an EEG stimulation unit 430 for stimulating EEG based on what is analyzed by the EEG analysis unit 420.
As a method of driving a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation,

(1) measuring three-dimensional motion information of the non-paralyzed hand by the motion tracker 100 mounted on the non-paralyzed hand of the user;

(2) analyzing the motion information measured in step (1) and processing the image so that the controller 200 mistaken the motion of the non-paralyzed hand as the motion of the paralyzed hand; And

(3) A method of driving a virtual hand illusion system for treatment of hemiplegic patients using brain stimulation, characterized in that it is implemented including the step of outputting the image processed in step (2) to the user on the display unit 300.
The method of claim 11, wherein the step (1),

(1-1) measuring the position of the fingertip movement in the finger position tracker 110;

(1-2) measuring the movement angle of the finger joint in the joint angle tracker 120; And

(1-3) A method of driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation, characterized in that it is implemented including the step of measuring movement according to the rotation of the hand in the hand direction tracker 130.
The method of claim 12, wherein the step (1-1),

At least one position sensor 111 is located at the end of each finger of the user, characterized in that it detects the position of each finger through three-dimensional position information of the fingertip movement measured by the position sensor 111, brain A method of driving a virtual hand illusion system for the treatment of hemiplegic patients using stimulation.
The method of claim 12, wherein the step (1-2),

At least one angle sensor 121 is located on each finger joint of the user, characterized in that detecting the movement of each finger joint through the angle information of the finger joint measured by the angle sensor 121, brain stimulation A virtual hand illusion system driving method for the treatment of hemiplegic patients using.
The method of claim 12, wherein the step (1-3),

In the three-axis angular velocity sensor 131 and the three-axis acceleration sensor 132, characterized in that it detects the rotational movement of the user's hand along the x-axis, y-axis, z-axis, a virtual treatment for hemiplegic patients using brain stimulation How to drive the hand illusion system.
The method of claim 11, wherein the step (2),

(2-1) receiving the motion of the non-paralyzed hand detected in step (1) as a first motion image by the motion receiver 210;

(2-2) converting the first motion image received in the step (2-1) into a second motion image by mirror-reversing the motion conversion unit 220; And

(2-3) It characterized in that it is implemented including the step of transmitting the second motion image converted in the step (2-2) from the motion transmitter 230 to the display unit 300, the brain stimulation A virtual hand illusion system driving method for the treatment of hemiplegic patients using.
The method of claim 16, wherein the step (2-3),

The first exercise image received in the step (2-1) and the second exercise image converted in the step (2-2) are transmitted to the display unit 300 together. A virtual hand illusion system driving method for the treatment of hemiplegic patients using.
The method of claim 16, wherein the step (3),

Driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation, characterized in that the second motion image received in step (2-3) is visually rendered to look like the user's paralyzed hand and displayed to the user. Way.
The method of claim 11,

(4) When the user views the second motion image in step (3), the EEG control unit 400 generates an EEG in order to further maximize the illusion of recognizing the movement of the non-paralyzed hand as the movement of the paralyzed hand. A method of driving a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation, characterized in that it is implemented further comprising the step of controlling.
The method of claim 19, wherein the step (4),

(4-1) obtaining a user's EEG in real time by the EEG acquisition unit 410;

(4-2) analyzing the EEG obtained in step (4-1) by the EEG analysis unit 420; And

(4-3) A virtual treatment for hemiplegic patients using brain stimulation, characterized in that it is implemented including the step of stimulating an EEG in the EEG stimulation unit 430 based on the analysis in step (4-2). How to drive the hand illusion system.