WO2020226371A1 - Système pour donner l'illusion d'une main virtuelle pour le traitement d'un patient hémiplégique par utilisation de stimuli cérébraux et son procédé de fonctionnement - Google Patents

Système pour donner l'illusion d'une main virtuelle pour le traitement d'un patient hémiplégique par utilisation de stimuli cérébraux et son procédé de fonctionnement Download PDF

Info

Publication number
WO2020226371A1
WO2020226371A1 PCT/KR2020/005821 KR2020005821W WO2020226371A1 WO 2020226371 A1 WO2020226371 A1 WO 2020226371A1 KR 2020005821 W KR2020005821 W KR 2020005821W WO 2020226371 A1 WO2020226371 A1 WO 2020226371A1
Authority
WO
WIPO (PCT)
Prior art keywords
motion
hand
treatment
eeg
tracker
Prior art date
Application number
PCT/KR2020/005821
Other languages
English (en)
Korean (ko)
Inventor
구정훈
Original Assignee
계명대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 계명대학교 산학협력단 filed Critical 계명대학교 산학협력단
Publication of WO2020226371A1 publication Critical patent/WO2020226371A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1071—Measuring physical dimensions, e.g. size of the entire body or parts thereof measuring angles, e.g. using goniometers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1124—Determining motor skills
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/6804—Garments; Clothes
    • A61B5/6806—Gloves
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/70—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0011—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus in a subliminal way, i.e. below the threshold of sensation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0044—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/50—General characteristics of the apparatus with microprocessors or computers
    • A61M2205/502—User interfaces, e.g. screens or keyboards
    • A61M2205/507—Head Mounted Displays [HMD]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2230/00—Measuring parameters of the user
    • A61M2230/08—Other bio-electrical signals
    • A61M2230/10—Electroencephalographic signals
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2230/00—Measuring parameters of the user
    • A61M2230/63—Motion, e.g. physical activity

Definitions

  • the present invention relates to a virtual hand delusion system for treatment of hemiplegic patients and a driving method thereof, and more particularly, to a virtual hand delusion system for treatment of hemiplegia patients and a driving method thereof using brain stimulation.
  • hemiplegia Diseases such as stroke or cerebral infarction are usually accompanied by hemiplegia, and occur because blood supplied to the brain cannot be delivered due to blockage of blood vessels.
  • Patients with hemiplegia due to stroke are usually accompanied by a number of disorders such as motor dysfunction, cognitive and perceptual disorders, sensory disorders, and speech disorders.
  • the disorder causes limitations in daily life movements such as eating and detachment. About 66% of them have physical dysfunction and about 75% of them have problems with daily life.
  • various rehabilitation treatment methods are known, and one of them is mirror treatment.
  • Mirror therapy is one of the treatments for patients with cranial nerve injury based on the principle of cranial plasticity that the cranial nerves can be structurally and functionally changed and reorganized. By inducing motor function recovery and movement of the affected side, the patient's paralysis side of the body recovers functions. Promote. Mirror therapy is a new treatment that focuses on intact limb movement. It was first introduced by Ramachandran and RogersRamachandran (1996) as a method of treating phantom pain after amputation, and was subsequently performed for patients with acute stroke. In several experiments, it was confirmed that it is effective in restoring the function of the paralyzed body. In other words, it is a theory that the motion of the non-paralyzed limb is projected to the motion of the paralyzed limb through mirror reflection, and the image given by the visual information superimposed on the paralyzed limb stimulates the brain.
  • FIG. 1 is a view showing a conventional mirror treatment method for rehabilitation treatment of a hemiplegic patient.
  • mirror treatment is typically performed using a mirror treatment device, in which two square plates are connected to form a bracket, and one of the two plates is composed of a mirror.
  • a mirror treatment device in which two square plates are connected to form a bracket, and one of the two plates is composed of a mirror.
  • the conventional mirror treatment has a problem that the patient's posture is poor due to the asymmetry of the torso because the body must be moved to the non-paralytic side to see the image, which makes rehabilitation treatment difficult.
  • the body is tilted toward the non-paralytic side to see the limbs in the mirror.
  • the asymmetry of the body increases by supporting the body weight toward the non-paralytic side.
  • the asymmetry in the mirror increases and the effect of illusion such as moving the paralyzed limb decreases. Therefore, there is a need for an implementation method that uses the existing mirror therapy principle, but enhances the illusion of movement.
  • Korean Patent Registration No. 10-1698244 name of the invention: Pain treatment device for physically symmetrical physical diseases, notification date: February 01, 2017
  • Korean Patent Registration No. 10-1698244 name of the invention: Pain treatment device for physically symmetrical physical diseases, notification date: February 01, 2017
  • the present invention has been proposed to solve the above problems of the previously proposed methods, and a head mounted display that immerses a user in a virtual reality (VR) or augmented/mixed reality (MR) environment to the existing mirror treatment method ( HMD) device enables rehabilitation treatment in a more comfortable posture, maximizing the effect of mistaking the movement of the non-paralyzed limb as the movement of the paralyzed limb and disrupting the brain sensory cognitive function, which can occur during rehabilitation. Pain can be alleviated, and the patient cannot actually see his paralyzed limb and is engaged in rehabilitation treatment by looking only at the motion image from the display unit, so that the immersion is improved so that the patient can engage in rehabilitation treatment. It is an object of the present invention to provide a virtual hand delusion system and a driving method for treating hemiplegic patients using brain stimulation, which can shorten the time required for rehabilitation treatment of hemiplegic patients.
  • the present invention introduces an EEG stimulation system to mirror therapy using a virtual reality (VR) or augmented/mixed reality (MR) environment, thereby analyzing the patient's EEG in the middle of the hemiplegic patient's rehabilitation treatment. It is possible to stimulate appropriate functional EEG according to changes in state, further maximizing the effect of mirror therapy, which mistaken the movement of the non-paralyzing limb as the movement of the paralyzing limb, and allowing the patient to focus on his or her own rehabilitation treatment.
  • Another object of the present invention is to provide a virtual hand illusion system and a driving method for treating hemiplegic patients using brain stimulation, which can increase the immersion of treatment by appropriate stimulation.
  • a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to the features of the present invention for achieving the above object
  • a motion tracker mounted on the user's non-paralyzed hand and measuring three-dimensional motion information of the non-paralyzed hand;
  • a controller that analyzes the information collected by the motion tracker and processes an image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand;
  • It is characterized in that it comprises a display unit that displays the image processed by the control unit to the user.
  • the motion tracker Motion Tracker
  • a finger position tracker that measures a position of a fingertip movement
  • a joint angle tracker that measures the angle of movement of a finger joint
  • Hand orientation Tracker Hand Orientation Tracker
  • the finger position tracker (Finger Position Tracker)
  • It includes at least one position sensor positioned at each fingertip of the user, and the position of each fingertip may be sensed through three-dimensional position information of the fingertip movement measured by the position sensor.
  • the joint angle tracker (Finger Joint Angle Tracker)
  • It includes at least one angle sensor positioned at each finger joint of the user, and the movement of each finger joint may be detected through angle information of the finger joint measured by the angle sensor.
  • the hand orientation tracker (Hand Orientation Tracker)
  • It may be configured to include a three-axis angular velocity sensor and a three-axis acceleration sensor for detecting the rotational movement of the user's hand along the x-axis, y-axis, and z-axis.
  • control unit Preferably, the control unit,
  • a motion receiver configured to receive a motion of the non-paralyzed hand detected by the motion tracker as a first motion image
  • a motion conversion unit for converting the first motion image received by the motion receiver into a second motion image by mirror inversion processing
  • It may be configured to include a motion transmission unit for transmitting the second motion image converted by the motion conversion unit to the display unit.
  • the motion transmission unit More preferably, the motion transmission unit,
  • the first exercise image received by the motion receiver and the second exercise image converted by the motion converter may be transmitted to the display unit together.
  • the display unit More preferably, the display unit,
  • the second motion image received from the motion transmitter may be visually rendered to look like the user's paralyzed hand and displayed to the user.
  • the display unit Preferably, the display unit, the display unit, and
  • HMD head mounted display
  • VR virtual reality
  • MR augmented/mixed reality
  • the user may further include an EEG control unit for further maximizing an illusion of recognizing the motion of the non-paralyzed hand as the motion of the paralyzed hand.
  • the brain wave control unit Preferably, the brain wave control unit, the brain wave control unit, and
  • An EEG analysis unit that analyzes the EEG obtained by the EEG acquisition unit
  • It may be configured to include an EEG stimulation unit for stimulating EEG based on the analysis by the EEG analysis unit.
  • a method of driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to a feature of the present invention for achieving the above object
  • step (2) analyzing the motion information measured in step (1), and processing the image so that the control unit mistaken the motion of the non-paralyzed hand as the motion of the paralyzed hand;
  • step (3) It may be implemented including the step of outputting the image processed in step (2) to the user from the display unit.
  • (1-3) It may be implemented including the step of measuring the movement according to the rotation of the hand on the hand direction tracker.
  • step (1-1) More preferably, the step (1-1),
  • At least one position sensor is located at the tip of each finger of the user, and the position of each finger may be sensed through three-dimensional position information of the movement of the finger tip measured by the position sensor.
  • step (1-2) More preferably, the step (1-2),
  • At least one angle sensor is located on each finger joint of the user, and the movement of each finger joint may be detected through angle information of the finger joint measured by the angle sensor.
  • step (1-3) More preferably, the step (1-3),
  • the 3-axis angular velocity sensor and the 3-axis acceleration sensor it is possible to detect the rotational movement of the user's hand along the x-axis, y-axis, and z-axis.
  • step (1) receiving the motion of the non-paralyzed hand detected in step (1) as a first motion image by a motion receiver;
  • step (2-2) converting the first motion image received in step (2-1) into a second motion image by mirror-reversing the motion conversion unit;
  • the second motion image converted in step (2-2) may be transmitted from the motion transmitter to the display.
  • the first exercise image received in step (2-1) and the second exercise image converted in step (2-2) may be transmitted to the display unit together.
  • step (3) More preferably, the step (3),
  • the second motion image received in step (2-3) may be visually rendered to look like the user's paralyzed hand and displayed to the user.
  • HMD head mounted display
  • VR virtual reality
  • MR augmented/mixed reality
  • step (3) controlling the EEG by the EEG control unit to further maximize the illusion of recognizing the motion of the non-paralyzed hand as the motion of the paralyzed hand. It may be implemented further including.
  • step (4-3) Based on the analysis in step (4-2), it may be implemented including the step of stimulating an EEG in the EEG stimulation unit.
  • the user is immersed in a virtual reality (VR) or augmented/mixed reality (MR) environment in the conventional mirror treatment method.
  • VR virtual reality
  • MR augmented/mixed reality
  • HMD head-mounted display
  • an EEG stimulation system for mirror therapy using a virtual reality (VR) or augmented/mixed reality (MR) environment In the middle of the hemiplegic patient's rehabilitation treatment, it is possible to analyze the patient's EEG and stimulate the appropriate functional EEG according to the patient's state change, so that the movement of the non-paralytic limb is mistaken for the movement of the paralyzed limb.
  • the effect of mirror therapy can be further maximized and the degree of immersion in therapy can be increased by appropriately stimulating the brain so that the patient can focus only on his or her rehabilitation therapy.
  • FIG. 1 is a view showing a conventional mirror treatment method for rehabilitation treatment of hemiplegic patients.
  • Figure 2 is a diagram showing the configuration of a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block.
  • FIG. 3 is a view showing a motion tracker configuration of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block.
  • FIG. 4 is a view showing a perspective view of a motion tracker of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • FIG. 5 is a view showing an example of an image of a display unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • FIG. 6 is a view showing another example of an image of a display unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • FIG. 7 is a diagram showing the configuration of an EEG control unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block.
  • FIG. 8 is a view showing the wearing of a virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • FIG. 9 is a view showing the flow of a method of driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • FIG. 10 is a view showing the flow of a hand movement measurement method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • FIG. 11 is a diagram illustrating a flow of an image processing method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • FIG. 12 is a view showing a flow of a brain wave control method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • a virtual hand illusion system for treating hemiplegic patients using brain stimulation and a driving method thereof is a rehabilitation treatment method using the principle of mirror treatment, and one of the imagination training methods, the mirror treatment method, is non- By reflecting the movements of the paralyzed limb in a mirror, the primary motor region of the brain connected to the opposite limb is excited and reorganized to replace its function in other regions around the injured brain, resulting in motor recovery, upper and lower limb functions. It is a rehabilitation treatment method that helps to improve.
  • FIG. 2 is a diagram showing the configuration of a virtual hand delusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a functional block.
  • the virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention is mounted on the non-paralyzed hand of the user, and three-dimensional movement of the non-paralyzed hand
  • a motion tracker 100 that measures information
  • a controller 200 that analyzes the information collected by the motion tracker 100 and processes an image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand
  • a display unit 300 that displays an image processed by the control unit 200 to a user, and further maximizes the illusion of recognizing the movement of the non-paralyzed hand as the movement of the paralyzed hand.
  • Motion Tracker (100) is mounted on the non-paralyzed hand of a hemiplegic patient to recognize the three-dimensional position of the hand and measure the rotation of the user's hand, which occurs as the patient freely moves the non-paralyzed hand.
  • This is a configuration that integrates posture recognition and angle measurement recognition that can measure the movement of a finger joint.
  • FIG. 3 is a diagram showing a motion tracker configuration of a virtual hand delusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention as a function block
  • FIG. 4 is a brain stimulation according to an embodiment of the present invention. It is a view showing a perspective view of a motion tracker of a virtual hand illusion system for treatment of hemiplegic patients using.
  • the motion tracker (Motion Tracker) 100 of the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention, a finger for measuring the position of the fingertip movement Position Tracker (Finger Position Tracker) 110; A joint angle tracker 120 for measuring a movement angle of a finger joint; And it may be configured to include a hand orientation tracker (Hand Orientation Tracker) 130 for measuring the movement according to the rotation of the hand. That is, the motion tracker 100 may be implemented in the form of a glove that can be worn on at least a part of the hand of the hemiplegic patient by integrating the finger position tracker 110, the joint angle tracker 120, and the hand direction tracker 130.
  • the tracker 100 may be implemented in the form of socks for measuring movement of the hemiplegic patient's foot as well as the hand of the hemiplegic patient.
  • each component constituting the motion tracker 100 will be examined in detail using FIGS. 3 and 4.
  • the finger position tracker 110 is a device constituting the motion tracker 100 and can measure the movement of each user's fingertips. That is, the finger position tracker 110 includes at least one position sensor 111 located at the tip of each finger of the user, but the three-dimensional movement of the finger tip measured by the position sensor 111 The position of each finger tip can be detected through the enemy location information. Preferably, the finger position tracker 110 may be implemented to detect a three-dimensional position of the position sensor 111 moving in space with an error of 5 or less.
  • the finger joint angle tracker 120 is another device constituting the motion tracker 100 and may measure a movement angle of a finger joint.
  • the joint angle tracker (Finger Joint Angle Tracker) 120 is configured to include at least one angle sensor 121 located at each finger joint of the user, but in the angle sensor 121 The movement of each finger joint can be detected through the measured angle information of the finger joint. That is, an angle sensor 121 is provided for each finger joint to measure the degree of bending of the finger joint, and preferably, the movement of the finger joint can be measured within an error range of 5 degrees using the angle sensors 121. It can be configured to be.
  • the hand orientation tracker 130 is another device constituting the motion tracker 100, and may measure movement according to the rotation of the hand and the posture of the hand. As shown in FIG. 4, the hand orientation tracker 130 may be disposed on the user's hand, and the like, and when the user rotates his or her hand, the degree of rotation of the hand is measured. That is, it may be configured to include a three-axis angular velocity sensor 131 and a three-axis acceleration sensor 132 for detecting rotational motion along the x-axis, y-axis and z-axis of the user's hand, preferably each x-axis , y-axis, z-axis can be configured to have a precision of about 7 to 10 degrees.
  • the motion tracker (Motion Tracker) 100 a finger position tracker (Finger Position Tracker) 110, a joint angle tracker (Finger Joint Angle Tracker) 120, and a hand direction tracker ( It may include a Hand Orientation Tracker (130), and is mounted in the form of a glove on the non-paralyzed hand of a hemiplegic patient, so that the three-dimensional movement of the non-paralyzed hand can be more accurately measured.
  • a Hand Orientation Tracker 130
  • the controller 200 may analyze the information collected by the motion tracker 100 and process the image so that the motion of the non-paralyzed hand is mistaken for the motion of the paralyzed hand.
  • the controller includes a motion receiver 210 for receiving a motion of a non-paralyzed hand detected by the motion tracker 100 as a first motion image; A motion conversion unit 220 for converting the first motion image received by the motion receiving unit 210 into a second motion image by mirror inversion processing; And a motion transmitter 230 that transmits the second motion image converted by the motion conversion unit 220 to the display unit 300.
  • 3D position information of the finger position tracker 110 in the motion tracker 100, the movement of the joint angle of the joint angle tracker 120, and the rotation of the user's hand of the hand direction tracker 130 After receiving the location information of the hand, the movement of the user's hand is received as a first movement image, and the received first movement image is mirror-reversed to convert it into a second movement image to appear as the movement of the paralyzed hand of the hemiplegic patient.
  • the converted second motion image is transmitted to the display unit 300 so that the user can see it and mistake it for the motion of the paralyzed hand.
  • FIG. 5 is a view showing an example of an image of a display unit of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention
  • FIG. 6 is a brain stimulation according to an embodiment of the present invention.
  • the display unit 300 may visually render the second exercise image received from the motion transmitter 230 or the first exercise image and the second exercise image received from the motion transmitter 230 together and display it to the user. That is, as shown in Figs. 5 and 6, when the hemiplegic patient moves the non-paralyzed hand equipped with the motion tracker 100, the movement of the non-paralyzed hand is recognized as the movement of the paralyzed hand. It can be rendered visually to increase the illusion effect and show it more realistically. Further, the display unit 300 may be implemented through a head mounted display (HMD) device that immerses a user in a virtual reality (VR) or augmented/mixed reality (MR) environment.
  • HMD head mounted display
  • hemiplegic patients can perform rehabilitation treatment in a more comfortable posture by installing a head mounted display (HMD) device on their head and using a mirror treatment fee in virtual reality, thereby increasing the degree of immersion in the rehabilitation treatment. It can increase the effect of mistaken hand movements.
  • HMD head mounted display
  • the EEG controller 400 may further maximize the illusion of recognizing the movement of the non-paralyzed hand as the movement of the paralyzed hand. That is, while a hemiplegic patient undergoes rehabilitation treatment using a virtual hand illusion system, the effect of mirror treatment can be enhanced by acquiring the patient's EEG, analyzing the EEG, and stimulating the EEG appropriately according to the patient's condition.
  • the configuration of the EEG controller 400 will be described in more detail with reference to FIG. 7.
  • the EEG control unit 400 includes an EEG acquisition unit 410 for obtaining a user's EEG in real time, an EEG analysis unit 420 for analyzing EEG obtained from the EEG acquisition unit 410, and It may be configured to include an EEG stimulation unit 430 for stimulating EEG based on the analysis by the EEG analysis unit 420.
  • the EEG control unit 400 may include one or more electrodes for measuring EEG.
  • the EEG control unit 400 may be configured as a device in which one or more electrodes are wrapped around a user's head, or an electrode is coupled to a hat. By doing so, the hat itself may become the brainwave control unit 400.
  • FIG. 8 is a diagram showing a wearing state of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • the patient measures the movement of the non-paralyzed hand by attaching a motion tracker 100 implemented in the form of a glove to the non-paralyzed hand, and the measured movement is mirrored in the controller 200.
  • the patient's paralyzed hand is converted into a moving image, and then it can be viewed through virtual reality through the display unit 300 of a head mounted display (HMD) device mounted on the patient's head.
  • the attached EEG controller 400 acquires and analyzes the EEG of the patient, and appropriately stimulates EEG, thereby enhancing the effect of the illusion.
  • HMD head mounted display
  • a method of driving a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention includes a motion tracker 100 mounted on a non-paralyzed hand of a user.
  • FIG. 10 is a diagram illustrating a flow of a method for measuring hand movement of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • the method of measuring hand movement of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention measures the position of the fingertip movement in the finger position tracker 110.
  • Implementing including the step (S110), measuring the movement angle of the finger joint in the joint angle tracker 120 (S120), and measuring the movement according to the rotation of the hand in the hand direction tracker 130 (S130) Can be.
  • the image processing method of the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention includes the movement of the non-paralyzed hand detected in step S100.
  • Receiving the first motion image as a first motion image in step 210 (S210), the step of converting the received first motion image into a second motion image by mirror inversion processing in the motion conversion unit 220 (S220), and the converted second motion image It may be implemented including the step (S230) of transmitting an image from the motion transmission unit 230 to the display unit 300.
  • FIG. 12 is a diagram illustrating a flow of an EEG control method of a virtual hand illusion system for treating hemiplegic patients using brain stimulation according to an embodiment of the present invention.
  • the EEG control method of the virtual hand illusion system for the treatment of hemiplegic patients using brain stimulation according to an embodiment of the present invention in which the EEG acquisition unit 410 acquires the user's EEG in real time. It may be implemented including the step S410, the step of analyzing the acquired EEG in the EEG analysis unit 420 (S420), and the step of stimulating the EEG in the EEG stimulation unit 430 based on the analyzed (S430). .
  • VR virtual reality
  • HMD head mounted display
  • EEG for mirror therapy using a virtual reality (VR) or augmented/mixed reality (MR) environment By introducing a stimulation system, it is possible to analyze the patient's EEG in the middle of the rehabilitation treatment of the hemiplegic patient and stimulate the appropriate functional EEG according to the patient's state change.
  • the effect of misunderstanding mirror therapy can be further maximized and the degree of immersion in therapy can be increased by appropriately stimulating the brain so that the patient can focus only on his or her rehabilitation therapy.

Abstract

L'invention concerne un système pour donner l'illusion d'une main virtuelle pour le traitement de patients hémiplégiques en utilisant des stimuli cérébraux, et un procédé de fonctionnement associé. Selon la présente invention, un dispositif de visiocasque (HMD) est utilisé en combinaison avec une thérapie par le miroir classique pour permettre à l'utilisateur d'entrer dans un état de flux dans une condition de réalité virtuelle (VR) ou de réalité augmentée/mixte (MR) et recevoir une rééducation dans des postures plus confortables, ce qui permet de maximiser l'effet de perception du mouvement d'un membre non paralysé comme celui d'un membre paralysé et de provoquer une confusion de la fonction cognitive du cerveau afin de réduire la douleur qui peut être générée pendant la rééducation. Dans cet état, le patient est soumis à une rééducation en observant uniquement des images de mouvement sur l'affichage sans regarder son membre paralysé réel. Dans un état de flux amélioré au même degré, le patient peut recevoir une thérapie de rééducation et finalement le temps nécessaire pour la rééducation des patients hémiplégiques peut être réduit.
PCT/KR2020/005821 2019-05-03 2020-05-01 Système pour donner l'illusion d'une main virtuelle pour le traitement d'un patient hémiplégique par utilisation de stimuli cérébraux et son procédé de fonctionnement WO2020226371A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2019-0052591 2019-05-03
KR1020190052591A KR102164965B1 (ko) 2019-05-03 2019-05-03 뇌자극을 이용한 편마비 환자 치료용 가상의 손착각 시스템 및 그 구동 방법

Publications (1)

Publication Number Publication Date
WO2020226371A1 true WO2020226371A1 (fr) 2020-11-12

Family

ID=72847384

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/005821 WO2020226371A1 (fr) 2019-05-03 2020-05-01 Système pour donner l'illusion d'une main virtuelle pour le traitement d'un patient hémiplégique par utilisation de stimuli cérébraux et son procédé de fonctionnement

Country Status (2)

Country Link
KR (1) KR102164965B1 (fr)
WO (1) WO2020226371A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102428988B1 (ko) * 2020-10-27 2022-08-05 한국과학기술원 몰입형 가상현실을 통한 행동 관찰로의 운동 이미지 트레이닝 방법 및 시스템
KR102563132B1 (ko) * 2020-10-28 2023-08-03 주식회사 지엘 인지기능 재활훈련 시스템
KR102446921B1 (ko) * 2020-11-11 2022-09-22 이준서 Vr/ar 기반의 가상 이식을 이용한 재활 치료 웨어러블 장치, hmd 장치 및 시스템
KR102446922B1 (ko) * 2020-11-12 2022-09-22 이준서 Vr/ar 기반의 가상 이식을 이용한 재활 치료 장치
KR102253352B1 (ko) * 2020-12-22 2021-05-17 이준서 Vr/ar 기반의 가상 이식 하체를 이용한 재활 콘텐츠 제공 방법 및 장치
KR102253353B1 (ko) * 2020-12-22 2021-05-18 이준서 Vr/ar 기반의 가상 이식 손을 이용한 재활 콘텐츠 제공 방법 및 장치
KR102391177B1 (ko) * 2021-12-15 2022-04-27 박준 가상의 오감 감각 전달을 활용한 심리 변화 유도 방법

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4025230B2 (ja) * 2003-03-31 2007-12-19 株式会社東芝 疼痛治療支援装置及び仮想空間に幻肢画像を動画的に表示する方法
US20090221928A1 (en) * 2004-08-25 2009-09-03 Motorika Limited Motor training with brain plasticity
JP4618795B2 (ja) * 2005-07-15 2011-01-26 独立行政法人産業技術総合研究所 リハビリ装置
KR20140029172A (ko) * 2012-08-30 2014-03-10 서울대학교산학협력단 편마비 치료 장치
WO2015034308A1 (fr) * 2013-09-09 2015-03-12 울산대학교 산학협력단 Appareil de traitement de douleur pour des maladies du corps à l'aide d'une symétrie externe
KR20170033586A (ko) * 2015-09-17 2017-03-27 한국과학기술연구원 단일 뇌에 적용되는 뇌-뇌 인터페이스 시스템

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4025230B2 (ja) * 2003-03-31 2007-12-19 株式会社東芝 疼痛治療支援装置及び仮想空間に幻肢画像を動画的に表示する方法
US20090221928A1 (en) * 2004-08-25 2009-09-03 Motorika Limited Motor training with brain plasticity
JP4618795B2 (ja) * 2005-07-15 2011-01-26 独立行政法人産業技術総合研究所 リハビリ装置
KR20140029172A (ko) * 2012-08-30 2014-03-10 서울대학교산학협력단 편마비 치료 장치
WO2015034308A1 (fr) * 2013-09-09 2015-03-12 울산대학교 산학협력단 Appareil de traitement de douleur pour des maladies du corps à l'aide d'une symétrie externe
KR20170033586A (ko) * 2015-09-17 2017-03-27 한국과학기술연구원 단일 뇌에 적용되는 뇌-뇌 인터페이스 시스템

Also Published As

Publication number Publication date
KR102164965B1 (ko) 2020-10-14

Similar Documents

Publication Publication Date Title
WO2020226371A1 (fr) Système pour donner l'illusion d'une main virtuelle pour le traitement d'un patient hémiplégique par utilisation de stimuli cérébraux et son procédé de fonctionnement
WO2019212150A1 (fr) Système de rééducation ludique combinant une stimulation cérébrale maximisant l'activation neuronale miroir et une technologie d'interface cerveau-machine (bci), et son procédé de commande
WO2016182181A1 (fr) Dispositif portable et procédé permettant de fournir une rétroaction d'un dispositif portable
WO2018080149A2 (fr) Système de rééducation cognitive à réalité virtuelle associé à la biométrique
WO2019054621A1 (fr) Visiocasque
EP2943835A1 (fr) Afficheur facial réalisant un étalonnage du regard, et procédé de commande associé
WO2021162207A1 (fr) Système de réalité virtuelle et procédé permettant de rééduquer des patients souffrant d'exotropie sur la base d'une intelligence artificielle, et support lisible par ordinateur
WO2020122375A1 (fr) Système d'apprentissage basé sur la réalité virtuelle (rv) pour un enfant ayant un trouble du développement
WO2019093637A1 (fr) Dispositif électronique et système de module de charge le comprenant
WO2015034308A1 (fr) Appareil de traitement de douleur pour des maladies du corps à l'aide d'une symétrie externe
WO2019212149A1 (fr) Système de rééducation basé sur le jeu doté d'une technologie d'interface cerveau-ordinateur (bci) combinée à une stimulation électrique fonctionnelle pour maximiser l'activation de neurone miroir, et son procédé de commande
WO2020009395A1 (fr) Couvercle de stérilisation adhésif destiné à une sonde chirurgicale à ultrasons, et son procédé d'utilisation
WO2022139031A1 (fr) Système d'apprentissage de diagnostic de rééducation et procédé d'apprentissage de diagnostic de rééducation
WO2017090815A1 (fr) Appareil et procédé de mesure de l'amplitude de mouvement articulaire
WO2019240564A1 (fr) Module de fonction détachable pour acquérir des données biométriques et visiocasque le comprenant
WO2023136539A1 (fr) Dispositif de lifting facial et son procédé de fonctionnement
WO2020013396A1 (fr) Système et procédé pour améliorer le pouvoir de concentration/attention par l'intermédiaire de stimulus auditif
WO2016179902A1 (fr) Dispositif de diagnostic assisté et de traitement à distance côté patient et procédé de diagnostic assisté et de traitement à distance
WO2018124451A1 (fr) Dispositif et procédé destinés au mouvement de l'œil, utilisant le suivi d'objet
WO2022025563A1 (fr) Dispositif, procédé et système basés sur la réalité virtuelle pour l'entraînement du cerveau d'un patient souffrant d'une maladie démyélinisante du système nerveux central
WO2013111916A1 (fr) Dispositif de revalidation portable
WO2022182060A1 (fr) Dispositif de stimulation cérébrale comprenant un dispositif de navigation pour guider la position d'une bobine et procédé associé
WO2015130036A1 (fr) Appareil de distribution de stimulations tactiles pour l'analyse de la reconnaissance de points de stimulation tactiles, et méthode associée
WO2021071195A1 (fr) Gant de rééducation
WO2022131412A1 (fr) Appareil d'aide au mouvement des doigts

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20802155

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20802155

Country of ref document: EP

Kind code of ref document: A1