KR20230124840A - rehabilitation training apparatus, rehabilitation training system having the same, and rehabilitation training method - Google Patents

Abstract

The rehabilitation training apparatus includes a force measuring unit for measuring the user's hand or finger strength, a camera for capturing the user's movement, a display for displaying a customized rehabilitation training operation to be instructed to the user, and a display for collecting state information of the user. A control unit is included, the user's state information is obtained through the force measurement unit and the camera, and the customized rehabilitation training motion to be instructed to the user is determined based on the user's state information.

Description

Rehabilitation training apparatus, rehabilitation training system including the same, and rehabilitation training method using the same {rehabilitation training apparatus, rehabilitation training system having the same, and rehabilitation training method}

The present invention relates to a rehabilitation training device, a rehabilitation training system including the rehabilitation training device, and a rehabilitation training method using the rehabilitation training system, and more particularly, by identifying a patient's condition at home and proposing a customized rehabilitation training method. , a rehabilitation training device providing convenience for rehabilitation of disabled children, a rehabilitation training system including the rehabilitation training device, and a rehabilitation training method using the rehabilitation training system.

Recently, cases in which families with developmental disabilities make extreme choices are appearing every year. This is a result of the lack of protection for families with disabilities. Especially in pediatric rehabilitation, the role of a guardian is essential, and it is inevitable to expand the support system for the rehabilitation environment. Since the time burden of visiting a treatment institution accounts for a large percentage of the difficulties in rehabilitation of children, technology that allows children with disabilities to receive rehabilitation comfortably can relieve the burden of parents with developmental disabilities.

Although there is a conventional technology for rehabilitation of physically handicapped children, which is a system based on image processing technology such as AR and VR, it is difficult to accurately measure the user's condition, and there are limitations to expert feedback.

Republic of Korea Patent Publication No. 10-2020-0136255 Republic of Korea Patent Publication No. 10-2022-0064593

Accordingly, the technical problem of the present invention is conceived in this respect, and the object of the present invention is to relieve the burden of guardians of children with disabilities who have a time-consuming burden of visiting treatment institutions, and to make rehabilitation fun and comfortable for children with disabilities, thereby helping patients An object of the present invention is to provide a rehabilitation training device that reduces resistance to rehabilitation.

Another object of the present invention is to provide a rehabilitation training system including the rehabilitation training device.

Another object of the present invention is to provide a rehabilitation training method using the rehabilitation training system.

A rehabilitation training apparatus according to an embodiment for realizing the above object of the present invention includes a force measurement unit for measuring a user's hand, finger strength, or grip strength; a camera for capturing the motion of the user; a display displaying customized rehabilitation training motions to be instructed to the user; and a control unit collecting state information of the user, wherein the user's state information is obtained through the force measuring unit and the camera, and the customized rehabilitation to be instructed to the user based on the user's state information. Determine your training moves.

In one embodiment of the present invention, the rehabilitation training apparatus further includes an EMG measurement unit for measuring the user's EMG value, and the user's state information is obtained through the EMG measurement unit, the force measurement unit, and the camera. can do.

In one embodiment of the present invention, the customized rehabilitation training operation determines the user's body condition based on the state information on the user's EMG, hand or finger strength, grip strength, and movement, and displays the display. Through this, an AR game exercise program can be provided.

In one embodiment of the present invention, based on the information on the motion of the user's hand obtained through the camera, the angle of the wrist for the range of motion of the user's wrist, the angle of the finger joint for the range of motion of the fingers, and the Considering the EMG value, suitability or unsuitability of the user's physical ability may be assigned or converted into a score.

In one embodiment of the present invention, the determination of the user's physical condition in consideration of the wrist angle, the finger joint angle, and the EMG value is determined by a preset wrist angle when the user performs the rehabilitation training operation. If it is within the set normal range, it is determined to be suitable, and if the finger joint angle is within the preset normal range during the rehabilitation operation of the user, it is determined to be suitable, and the measured EMG value in the idle state and the customized rehabilitation training A ratio of values measured during an operation is calculated, and when the ratio exceeds a preset value, it is determined that unnecessary muscles are used more than necessary, and thus, it may be determined to be unsuitable.

In one embodiment of the present invention, the customized rehabilitation training motions displayed on the display are fist clenching/extending, V, pointing, best (learning all four directions of the thumb), wrist lifting, finger lifting, finger bending separately, and finger It may include any one or more of separate spread and give (hand flip).

In one embodiment of the present invention, the control unit recognizes the motion of the user obtained through the camera, and the EMG measuring unit, the force measuring unit, the camera, the display, and the control unit use data through a wired/wireless communication method. can be collected, stored, calculated, processed and transmitted.

A rehabilitation training system according to an embodiment for realizing the above objects of the present invention includes: an electromyography measurement unit for examining an electrical activity state of muscles of a physically handicapped person; a force measurement unit for measuring hand or finger strength and grip strength of the physically handicapped person; a camera for capturing hand movements of the handicapped person; a display displaying a hand gesture to be instructed to the handicapped person; And a control unit for collecting state information of the physically handicapped person; including a rehabilitation training device including a server that provides a diagnosis and digital treatment method using data acquired through the rehabilitation training device; A diagnosis and digital treatment method is provided to the guardian terminal of the user's guardian using the data acquired through the training device.

In one embodiment of the present invention, the user's state information is obtained through the EMG measurement unit, the force measurement unit, and the camera, and the server is configured to instruct the user based on the user's state information. A rehabilitation training motion may be determined, and the rehabilitation training motion may be displayed on the display of the rehabilitation training device.

In one embodiment of the present invention, based on the information on the motion of the user's hand obtained through the camera, the angle of the wrist for the range of motion of the user's wrist, the angle of the finger joint for the range of motion of the fingers, and the Considering the EMG value, suitability or unsuitability of the user's physical ability may be assigned or converted into a score.

In one embodiment of the present invention, the determination of the user's physical condition in consideration of the wrist angle, the finger joint angle, and the EMG value is determined by a preset wrist angle when the user performs the rehabilitation training operation. If it is within the set normal range, it is determined to be suitable, and if the finger joint angle is within the preset normal range during the rehabilitation operation of the user, it is determined to be suitable, and the measured EMG value in the idle state and the customized rehabilitation training A ratio of values measured during an operation is calculated, and when the ratio exceeds a preset value, it is determined that unnecessary muscles are used more than necessary, and thus, it may be determined to be unsuitable.

In one embodiment of the present invention, the display prompts the user to make/extend a fist, V, pointing, top (learning all four directions of the thumb), lifting a wrist, lifting a finger, bending a finger separately, spreading a finger separately, and giving ( The video may be transmitted to indicate any one or more of the upturned hands.

A rehabilitation training method according to an embodiment for realizing the above object of the present invention includes measuring EMG in an idle state by measuring EMG in a floating posture; sending a test action on the display; measuring the user's EMG, hand or finger strength, and grip strength, and photographing the user's movement; calculating state information of the user from the measured hand or finger strength, grip strength, electromyogram, and/or captured image; Based on the state information, displaying a customized rehabilitation training operation to be instructed to the user on a display; includes

In one embodiment of the present invention, the customized rehabilitation training operation determines the user's body condition based on the state information on the user's EMG, hand or finger strength, grip strength, and movement, and displays the display. Through this, an AR game exercise program can be provided.

In one embodiment of the present invention, based on the information on the motion of the user's hand obtained through the camera, the angle of the wrist for the range of motion of the user's wrist, the angle of the finger joint for the range of motion of the fingers, and the Considering the EMG value, the user's physical ability is appropriate or unsuitable, or converted into a score, and the user's physical condition is determined by considering the wrist angle, the finger joint angle, and the EMG value, the wrist angle When the user's wrist angle is within a preset normal range during the user's rehabilitation training operation, it is determined as suitable, and when the finger joint angle is within the preset normal range during the user's rehabilitation training operation, it is determined as suitable. and calculates the ratio between the EMG value measured in the idle state and the value measured during the customized rehabilitation training operation, and if the ratio exceeds a preset value, it is determined that unnecessary muscles are used more than necessary, and is unsuitable can be judged by

According to the embodiments of the present invention, it is possible to provide a rehabilitation training system so that a disabled child can receive rehabilitation training at home, so that the guardian can reduce the time burden of going to the hospital, and graft the rehabilitation training system into a game for rehabilitation It can reduce the reluctance that children with disabilities feel about training and increase their interest. In addition, customized rehabilitation training methods can be provided to patients using AI machine learning and deep learning.

That is, with patient information accurately measured by the rehabilitation training device, effective feedback can be given to the patient using the rehabilitation training system using AI machine learning and deep learning.

However, the effects of the present invention are not limited to the above effects, and may be expanded in various ways without departing from the spirit and scope of the present invention.

1 is a schematic diagram of a rehabilitation training system including a rehabilitation training apparatus according to an embodiment of the present invention.
2 is a conceptual diagram illustrating a service flow between a physically handicapped person, a rehabilitation therapist, and a secondary rehabilitation institution using a rehabilitation training system according to an embodiment of the present invention.
3 is a flowchart illustrating a rehabilitation training method according to an embodiment of the present invention.
4A to 4B are diagrams illustrating screens on which a guardian terminal provides information related to rehabilitation training.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

Since the present invention may have various changes and various forms, specific embodiments are illustrated in the drawings and described in detail in the text. However, it should be understood that this is not intended to limit the present invention to the specific disclosed form, and includes all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

1 is a schematic diagram of a rehabilitation training system including a rehabilitation training apparatus according to an embodiment of the present invention.

2 is a conceptual diagram illustrating a service flow between a physically handicapped person, a rehabilitation therapist, and a secondary rehabilitation institution using a rehabilitation training system according to an embodiment of the present invention.

3 is a flowchart illustrating a rehabilitation training method according to an embodiment of the present invention.

Referring to FIG. 1 , the rehabilitation training system may include a rehabilitation training device 100, a server 200, a guardian terminal 10, a rehabilitation therapist terminal 20, and an associated institution 30.

The rehabilitation training apparatus 100 may measure movement, electromyogram, etc. of a physically disabled person requiring rehabilitation treatment, and may instruct a required physical activity for rehabilitation treatment. The rehabilitation training device 100 may include an electromyogram measurement unit 110, a force measurement unit 120, a camera 130, a display 140, and a control unit 150.

The EMG measurement unit 110 may include components such as an EMG (electromyography) patch and a needle for examining an EMG value, which is an electrical activity state of a muscle. In detail, the EMG measurement unit 110 may measure EMG for diagnosis and prognosis of peripheral nerve diseases, muscle diseases, facial paralysis, and neuromuscular junction diseases. Since muscle tissue is a representative electrical conductor, electrical activity of muscle fibers can be recorded. The user's muscle state information measured by the electromyogram measurement unit 110 is transmitted to the control unit 150 to be described later and stored as user state information.

The electromyography (EMG) patch is used for surface electromyography, which is a method of performing electromyography of a user by attaching electrodes to a user's arm muscle. The surface electromyography mainly examines sensory nerves and motor nerves. Although the accuracy of the surface electromyography test is low, it is a test method suitable for application to highly active children because it causes little discomfort during the test and allows the user to perform the test in an active state.

Needle electromyography is a method of performing electromyography by piercing the user's arm muscle with the needle. The needle electromyography may produce more accurate results than the surface electromyography. Occasionally, there may be pain in the area examined, but the needle electromyography is useful if you want accurate results.

The force measurement unit 120 measures the user's hand or finger strength and grip strength. Hand or finger strength and grip strength may be measured using a ready-made grip strength measuring instrument or an elastic body such as a balloon or ball equipped with a pressure sensor or a Force Sensitive Resistor (FSR) sensor. The grip strength measurement values measured by the force measurement unit 120 by the above methods are transmitted to the control unit 150 to be described later and stored as state information of the user.

The ready-made grip strength measuring device is based on the principle that when a user applies force by squeezing a hand, a numerical value of the grip strength is output digitally. The numerical value of the grip strength derived from the above principle can be sent to the screen of the guardian terminal 10 to be described later and checked by the guardian, or sent to the screen of the rehabilitation therapist terminal 20 to be described later so that the rehabilitation therapist can check it.

The pressure sensor is a type of pressure gauge that measures pressure, and refers to a pressure gauge that converts a measurement result into an electrical signal and outputs the result. When a user applies force to the pressure sensor, the sensor converts the displacement into an electrical signal such as voltage or current. As pressure sensors, strain gauge pressure sensor, capacitive pressure sensor, potentiometric pressure sensor, LVDT pressure sensor (Linear Variable Differential Transformer), piezoelectric pressure sensor A piezoelectric pressure sensor, a silicon pressure sensor, an optical pressure transducer, and the like may be used.

The Force Sensitive Resistor (FSR) sensor is a sensor using a property in which a resistance value changes when a user applies a physical force. When pressure is applied to the sensor, the resistance value decreases, and it is suitable for the rehabilitation training device whose purpose is to detect the user's condition in response to touch sensing and weight rather than precise unit measurement.

The camera 130 captures the user's movement and hand movement in 3D and uses them in the rehabilitation training system. For example, when a game is executed using the rehabilitation training system, the camera 130 recognizes certain motions determined in the game, and the character in the game can be moved as desired. In addition, after grasping the hand movement movable range of the physically handicapped person through the camera 130, the hand movement movable range is transmitted to the control unit 150 to be described later, so that the current state of the physically handicapped person or the physically disabled person training achievement can be identified.

The display 140 may transmit an AR game exercise program provided to the user by the rehabilitation training system from the server 200 to the screen. The game exercise program shows customized rehabilitation training motions to be instructed to the user through the screen of the display 140 . For example, video can be transmitted to perform hand gestures such as making/unfolding a fist, V, pointing, top (learning all four directions of the thumb), raising a wrist, lifting a finger, bending a finger separately, extending a finger separately, and giving it up (turning the hand upside down). can

The AR game exercise program provided to the user by the rehabilitation training system is used in the process of rehabilitation training so that the user can perform the rehabilitation training without feeling repulsive. In addition, the user's state information obtained through the AR game exercise program can be accumulated as rehabilitation data that will be the basis for making a diagnosis to the user.

The control unit 150 may obtain the user's state information from the EMG measurement unit 110, the force measurement unit 120, and the camera 130 connected through a network, and may include a separate wired/wireless communication unit. can In the wired/wireless communication method, various communication protocols commonly used in the art may be used to collect, store, calculate, process, and transmit data. Based on the user's condition information, a customized rehabilitation training operation to be instructed to the user may be determined.

The control unit 150 may use ML technology, such as Mediapipe, to detect motions shown by the user. Mediapipe is an open-source ML solution created and managed by Google. It is possible to develop applications using AI functions in just a few steps, so it is effective in identifying the user's movements in the rehabilitation training device.

The control unit 150 collects information on the user's condition through the open source, transmits the information to a network, and stores the information in rehabilitation data that will be the basis for making a diagnosis to the patient through the rehabilitation training system. Rehabilitation data may be exchanged between the server 200, the guardian terminal 10, the rehabilitation therapist terminal 200, and the associated institution 30 through a wired or wireless communication method. In the wired/wireless communication method, various communication protocols commonly used in the art may be used to collect, store, calculate, process, and transmit data.

The server 200 calculates the motion to be performed by the user and the diagnosis and digital treatment method to be applied to the user through AI machine learning or deep learning using the rehabilitation data acquired by the control unit 150, and displays the display 140 ) is sent to In addition, the server 200 transmits related data, such as contents diagnosed through the movement of the user by the association agency 30, to the guardian terminal 10. Therefore, by exchanging rehabilitation data between each terminal in the rehabilitation training system, the guardian can identify the training method for the patient without visiting the associated institution 30, and the patient can reduce the reluctance to receive rehabilitation training at the hospital. there is.

For example, the server 200 may extract data on the user's condition from the control unit 150, determine a customized rehabilitation operation using artificial intelligence, and instruct the user. As the customized rehabilitation motion, various motions may be utilized through previously verified papers on rehabilitation treatment. The controller 150 transmits a customized rehabilitation operation to the screen of the display 140 . When the patient follows the image displayed on the display 140, the server 200 calculates the angle of the wrist and the range of motion of the fingers based on the information obtained by photographing the motion with the camera 130. Acceptability or unsuitability may be assigned or converted into a score by considering the angle of the finger joint and the EMG value.

The condition of the patient is derived by analyzing the image using machine learning or deep learning values, and the angle of the wrist, the angle of the finger joint, and the EMG value may be determined according to the following criteria.

(1) Wrist angle - During rehabilitation training, if the wrist angle is within the preset normal range, it is judged suitable.

(2) Finger joint angle - During rehabilitation training, if the angle of each joint of each finger is within the preset normal range, it is judged suitable.

(3) emg patch score - The EMG value in the idle state and the value during rehabilitation are compared and judged as %. If unnecessary muscles are measured higher than necessary, it is judged to be unsuitable.

In this embodiment, a process of deriving a patient's condition by analyzing an image is implemented in the server 200, but is not limited thereto. For example, the rehabilitation training apparatus 100 may be implemented to derive a patient's condition by analyzing an image through the camera 130 .

The guardian terminal 100 can receive information that needs to be input as a guardian of the disabled person from the guardian. For example, the guardian can create a schedule for the patient's rehabilitation training, and write the progress history of how the rehabilitation training was conducted and the current state of the patient who has undergone treatment in the guardian terminal 10. .

In addition, the operator of the rehabilitation training system operates an expert counseling community so that the guardian can receive diagnosis and treatment methods suitable for each patient through the guardian terminal 10 .

Through the rehabilitation therapist terminal 20, the rehabilitation therapist can grasp the patient's condition and can communicate with the guardian. For example, if you leave feedback on the Q&A left by your guardian in the expert counseling community, or if you have any questions about the customized rehabilitation training method suggested by the linking institution 30, which will be described later, you provide a related report or medical consultation to your guardian or patient. . In addition, if a problem occurs during the rehabilitation training process, the linking institution 30, which will be described later, can figure out and present the correct rehabilitation training method again.

When the controller 150, the server 200, the guardian terminal 10, and the rehabilitation therapist terminal 20 exchange through a network, a separate wired/wireless communication unit may be included. For the wired/wireless communication method, various communication protocols commonly used in the art may be used. Wired and wireless communication methods include a Local Area Network (LAN), a Wide Area Network (WAN), a Value Added Network (VAN), a mobile radio communication network, a satellite communication network, or mutual They can be linked through combinations. Wireless communication methods include, for example, wireless LAN (Wi-Fi), Bluetooth, Bluetooth low energy (Bluetooth low energy), Zigbee, WFD (Wi-Fi Direct), UWB (ultra-wideband), infrared communication (IrDA, infrared Data Association), NFC (Near Field Communication), etc. may be present, but are not limited thereto. The collection, storage, calculation, processing, and transmission of data may be performed by the EMG measurement unit 110, the force measurement unit 120, the camera 130, the display 140, the controller 150, and/or the It can be performed directly on the server 200.

The linking institution 30 checks the patient's condition information left on the guardian terminal 10 or patient data collected through the rehabilitation training device, and presents a customized rehabilitation training method to the patient. In addition, when a problem occurs in the rehabilitation training process, the linking institution 30 may suggest an improvement plan to the guardian or patient through the rehabilitation therapist.

Referring to FIG. 3 , the rehabilitation training method includes a step of measuring an EMG in an idle state by measuring an EMG in a floating posture (S300), transmitting a test motion on a display (S310), and a user's EMG and hand or finger strength. , measuring grip strength and photographing motion (S320), calculating user status information from measured hand or finger strength, grip strength, EMG and/or captured images (S330), transmitting status information to a server It includes a step (S340) and a step (S350) of displaying rehabilitation training to be instructed to the user on a display using artificial intelligence.

In the step of measuring the EMG in the idle state by measuring the EMG in the floating posture (S300), a basic value for comparison with the EMG value during operation can be calculated by measuring the EMG in the user's idle state. EMG can be measured using an electromyography (EMG) patch, a needle, etc., and a test method suitable for the user can be selected in consideration of each characteristic.

In the step of transmitting the test motion from the display (S310), the handicapped person clenches/unfolds a fist, V, points, best (learns all four directions of the thumb), raises a wrist, lifts a finger, bends a finger separately, spreads a finger separately, and A corresponding image may be transmitted to the screen of the display 140 so that the user can follow the motion of giving me (hand flipping).

In step S320 of measuring the user's EMG, hand or finger strength, and grip strength, and photographing the motion, when the user follows the motion of the image transmitted to the display 140, the EMG value and hand or finger strength , the strength of grip strength can be measured, and the motion of the user can be captured in 3D. The EMG value is measured by the EMG measuring unit 110, the strength of the hand or finger strength, and grip strength are measured by the force measuring unit 120, and the user's motion is captured by the camera 130. can

In step S330 of calculating the user's state information from the measured hand or finger strength, grip strength, electromyogram, and/or captured image, the user's electromyogram, hand or finger strength, and grip strength are measured, and motion is captured. The value and image measured in step S320 are collected by the control unit 150 as user's condition information, and can be used as rehabilitation data to be the basis for making a diagnosis in the linking institution 30 .

In the step of transmitting the state information to the server (S340), the data calculated in the step of calculating the state information of the user (S330) from the measured hand or finger strength, grip strength, electromyogram, and/or captured image is transferred to the server ( 200) can be sent. The server 200 may calculate motions to be requested from the physically handicapped, diagnosis and digital treatment methods, etc. through AI machine learning or deep learning using the rehabilitation data acquired by the control unit 150.

The measured EMG, hand or finger strength, grip strength, wrist angle, finger joint angle, and EMG values derived from the image are calculated with weights for each motion to give a pass or fail or convert into a score. The flow of EMG values for each muscle is different according to the motion that the user has to perform, and it can be scored in consideration of this.

In the step of displaying rehabilitation training to be instructed to the user on the display using the artificial intelligence (S350), according to the state information transmitted in the step of transmitting the state information to the server (S340), using artificial intelligence, the user We can offer customized rehabilitation training that is suitable for you. As the customized rehabilitation training is grafted onto an AR game exercise program, rehabilitation training can be performed while reducing the user's alertness to rehabilitation training.

4A to 4B are diagrams showing screens on which the guardian terminal 10 provides information related to rehabilitation training.

Referring to FIG. 4A , the guardian terminal 10 may display a main screen 410 and an exercise assignment screen 430 .

The main screen 410 includes a QR code button 411, a notification setting button 412, a patient collection setting button 413 requiring rehabilitation therapist assignment, a patient list 414, and a patient name search box 415. can do.

The main screen 414 includes the patient's profile picture 416, the patient's name 417, the amount of time each patient performed the rehabilitation training per day 418, and the game result score based on the rehabilitation training system. (419) and current connection status (420). The current connection status 420 may be displayed as a red dot to indicate that the patient has access to the game.

The exercise assignment screen 430 may include an assigned rehabilitation therapist profile 431, a cheer column 432, a QR code 433 to access a game, a weekly schedule 434, and the like.

The weekly schedule 434 indicates training to be performed for each day, and when the more button 435 is pressed, the patient can check a list of specific training to be performed.

Referring to FIG. 4B , the guardian terminal 10 may display a report card screen 440 .

The Report Card screen 440 includes a notification setting button 441, a patient profile picture 442, a patient name 443, a summary column 444, a weekly report column 445, an export button 446, and a weekly rehabilitation list. column 448 and menu list 449;

The summary column 444 may display the total training date, treatment period for 1 month, 1 week or 1 day, total treatment time, daily average treatment time, and the like. The weekly report column 445 may indicate the patient's endurance, accuracy, speed, pressure sensory ability, coordination, and the like, including the performance ratio information 447 for each date. When the export button 446 is pressed, the performance capacity ratio information 447 for each date can be shared with recipients who desire patient information, such as affiliated organizations and rehabilitation therapists. The weekly rehabilitation list 448 may check rehabilitation training performed by the patient, such as palm supination, ulnar flexion, and finger abduction, and the number of rehabilitation training sessions. The menu list 449 may appear at the bottom of the report card screen 440, and may include a home button, a report card button, a QR code button, a chat button, and a profile button.

Referring to FIG. 4C , the guardian terminal 10 may display a chatting screen 430 .

The chat screen 430 may include a QR code button 451, a notification setting button 452, a name search box 453, a chat box 454, and the like.

When the chat box 454 is pressed, the rehabilitation therapist's name 455, the voice call button 456, the video call button 457, the guardian's chat history 458, the rehabilitation therapist's chat history 459, and the conversation content input field (460) and the like appear. Through chatting, guardians can talk about their questions or problems in ongoing training, and receive consulting on customized rehabilitation training while receiving improvement measures from a rehabilitation therapist. Through consulting, it is possible to relieve the guardian's anxiety about the rehabilitation training progress and improve the patient's rehabilitation training environment at the same time.

Although described with reference to the above embodiments, those skilled in the art will understand that the present invention can be variously modified and changed without departing from the spirit and scope of the present invention described in the claims below. You will be able to.

10: guardian terminal 20: rehabilitation therapist terminal
30: associated institution 100: rehabilitation training device
110: electromyography measurement unit 120: force measurement unit
130: camera 140: display
150: control unit 200: server

Claims (14)

a force measuring unit that measures a force applied by a user's hand or finger;
a camera for capturing the motion of the user;
a display displaying customized rehabilitation training motions to be instructed to the user; and
a controller that collects state information of the user;
including,
The user's state information is obtained through the force measurement unit and the camera, and the customized rehabilitation training motion to be instructed to the user is determined based on the user's state information. According to claim 1,
Further comprising an EMG measurement unit for measuring the EMG value of the user;
The user's state information is characterized in that obtained through the EMG measurement unit, the force measurement unit and the camera. According to claim 2,
The customized rehabilitation training operation identifies the user's body condition based on the user's EMG, hand or finger strength, and state information on movement, and provides an AR game exercise program through the display. Rehabilitation training device to be. According to claim 2,
Based on the information about the user's hand movement obtained through the camera,
In consideration of the wrist angle for the range of motion of the user's wrist, the angle of the finger joint for the range of motion of the fingers, and the EMG value, the user's physical ability is appropriate or unsuitable, or converted into a score. Characterized in that rehabilitation training device. According to claim 4,
Determining the user's body condition in consideration of the wrist angle, the finger joint angle, and the EMG value,
When the wrist angle is within a preset normal range during the user's rehabilitation training operation, it is determined that the wrist angle is suitable;
When the angle of the finger joint is within a preset normal range during the rehabilitation operation of the user, it is determined that it is suitable;
Calculate the ratio of the measured EMG value in the idle state and the value measured during the customized rehabilitation training operation, and if the ratio exceeds the preset value, it is determined that unnecessary muscles are used more than necessary, and judged as unsuitable Rehabilitation training device characterized in that. According to claim 5,
The customized rehabilitation training motions displayed on the display are fist clenching/extending, V, pointing, top (learning all four directions of the thumb), wrist lifting, finger lifting, finger bending separately, finger spreading separately, and giving (hand flipping) Rehabilitation training apparatus comprising any one or more of. a force measuring unit that measures hand or finger strength of a physically handicapped person;
a camera for capturing hand movements of the handicapped person;
a display displaying a hand gesture to be instructed to the handicapped person; and
Including a rehabilitation training device including; a control unit to collect state information of the physically disabled person,
a server that provides diagnosis and digital treatment methods using data acquired through the rehabilitation training device;
The rehabilitation training system further includes a diagnosis and digital treatment method for providing a diagnosis and digital treatment method to a guardian terminal of the guardian of the user using data acquired through the rehabilitation training apparatus. According to claim 7,
Further comprising the electromyogram measurement unit for examining the electrical activity state of the muscles of the disabled person;
The user's state information is obtained through the EMG measurement unit, the force measurement unit, and the camera;
The rehabilitation training system, characterized in that the server determines a customized rehabilitation training operation to be instructed to the user based on the user's state information, and displays the rehabilitation training operation on the display of the rehabilitation training device. According to claim 7,
Based on the information about the user's hand movement obtained through the camera,
In consideration of the wrist angle for the range of motion of the user's wrist, the angle of the finger joint for the range of motion of the fingers, and the EMG value, the user's physical ability is appropriate or unsuitable, or converted into a score. Characterized in that rehabilitation training system. According to claim 9,
Determining the user's body condition in consideration of the wrist angle, the finger joint angle, and the EMG value,
When the wrist angle is within a preset normal range during the user's rehabilitation training operation, it is determined that the wrist angle is suitable;
When the angle of the finger joint is within a preset normal range during the rehabilitation operation of the user, it is determined that it is suitable;
Calculate the ratio of the measured EMG value in the idle state and the value measured during the customized rehabilitation training operation, and if the ratio exceeds the preset value, it is determined that unnecessary muscles are used more than necessary, and judged as unsuitable Rehabilitation training system characterized in that. According to claim 9,
The display provides the user with one or more of fist clenching/extending, V, pointing, top (learning all four directions of the thumb), wrist lifting, finger lifting, finger bending separately, finger spreading separately, and giving (hand flipping). A rehabilitation training system characterized in that for transmitting an image to instruct. measuring EMG in an idle state by measuring EMG of the user in a floating posture;
sending a test action on the display;
measuring the user's EMG, hand or finger strength, and photographing the user's movement;
calculating state information of the user from the measured strength of the hand or finger and the captured image; and
based on the state information, displaying a customized rehabilitation training operation to be instructed to the user on a display;
Rehabilitation training method comprising a. According to claim 12,
The customized rehabilitation training operation identifies the user's body condition based on the user's EMG, hand or finger strength, and state information on movement, and provides an AR game exercise program through the display. rehabilitation training method. According to claim 12,
Based on the information about the user's hand movement obtained through the camera,
Considering the wrist angle for the range of motion of the wrist of the user, the angle of the finger joint for the range of motion of the fingers, and the EMG value, the user's physical ability is appropriate or unsuitable, or converted into a score,
Determining the user's body condition in consideration of the wrist angle, the finger joint angle, and the EMG value,
When the wrist angle is within a preset normal range during the user's rehabilitation training operation, it is determined that the wrist angle is suitable;
When the angle of the finger joint is within a preset normal range during the rehabilitation operation of the user, it is determined that it is suitable;
Calculate the ratio of the EMG value measured in the idle state and the value measured during the customized rehabilitation training operation, and if the ratio exceeds a preset value, it is determined that unnecessary muscles are used more than necessary and judged as unsuitable Rehabilitation training method characterized by doing.