JP2018183383A - Rehabilitation support system, rehabilitation support method, and rehabilitation support program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To execute active target updating according to a user's rehabilitation movement.SOLUTION: A rehabilitation support system includes: movement detection means for detecting a first rehabilitation movement of a user; display control means for causing an avatar image moving according to the detected first rehabilitation movement and a target image indicating a target of the first rehabilitation movement to be displayed; evaluation means for comparing the first rehabilitation movement with a target position indicated by the target image, and evaluating the rehabilitation ability of the user; and update means for updating the target position according to a result of the evaluation by the evaluation means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a rehabilitation support system, a rehabilitation support method, and a rehabilitation support program.

  In the above technical field, Patent Document 1 discloses a system that supports rehabilitation performed on a hemiplegic patient due to a stroke or the like.

JP-A-2015-228957

However, in the technique described in the above-mentioned document, active target update according to the user's operation cannot be performed, and there is no choice but to repeat the same load for any user.
The objective of this invention is providing the technique which solves the above-mentioned subject.

In order to achieve the above object, a system according to the present invention provides:
Motion detection means for detecting the first rehabilitation motion of the user;
Display control means for displaying an avatar image that moves in accordance with the detected first rehabilitation operation, and a target image that indicates a target of the first rehabilitation operation;
An evaluation means for evaluating the rehabilitation ability of the user by comparing the first rehabilitation operation with a target position represented by the target image;
Updating means for updating the target position according to the evaluation result by the evaluation means;
Is a rehabilitation support system with

In order to achieve the above object, the method according to the present invention comprises:
A motion detection step of detecting a first rehabilitation motion of the user;
A display control step for displaying an avatar image that moves in response to the detected first rehabilitation motion, and a target image that indicates a target of the first rehabilitation motion;
An evaluation step of evaluating the rehabilitation ability of the user according to a difference between the first rehabilitation operation and a target position represented by the target image;
An update step for updating the target position according to the evaluation result in the evaluation step;
Rehabilitation support method including

In order to achieve the above object, a program according to the present invention provides:
A motion detection step of detecting a first rehabilitation motion of the user;
A display control step for displaying an avatar image that moves in response to the detected first rehabilitation motion, and a target image that indicates a target of the first rehabilitation motion;
An evaluation step of evaluating the rehabilitation ability of the user according to a difference between the first rehabilitation operation and a target position represented by the target image;
An update step for updating the target position according to the evaluation result in the evaluation step;
Is a rehabilitation support program that runs a computer.

  ADVANTAGE OF THE INVENTION According to this invention, the active target update according to a user's rehabilitation operation | movement can be performed.

It is a block diagram which shows the structure of the rehabilitation assistance system which concerns on 1st Embodiment of this invention. It is a block diagram which shows the structure of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the flow of a process of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the other example of a program of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the database of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment of this invention.

  Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. However, the components described in the following embodiments are merely examples, and are not intended to limit the technical scope of the present invention only to them.

[First Embodiment]
A rehabilitation support system 100 as a first embodiment of the present invention will be described with reference to FIG.

  As illustrated in FIG. 1, the rehabilitation support system 100 includes a motion detection unit 101, a display control unit 102, an evaluation unit 103, and an update unit 104.

  The motion detection unit 101 detects the rehabilitation motion of the user 110. The display control unit 102 displays an avatar image that moves according to the detected rehabilitation operation and a target image that indicates a target of the rehabilitation operation.

  The evaluation unit 103 evaluates the rehabilitation ability of the user according to the difference between the rehabilitation operation and the target position represented by the target image. The update unit 104 updates the target position according to the evaluation result by the evaluation unit 103.

  According to the present embodiment, a load corresponding to the progress of rehabilitation can be given to the user.

[Second Embodiment]
Next, a rehabilitation support system 200 according to the second embodiment of the present invention will be described with reference to FIG. FIG. 2 is a diagram for explaining the configuration of the rehabilitation support system according to the present embodiment.

  As shown in FIG. 2, the rehabilitation support system 200 includes a rehabilitation support server 210, two base stations 231 and 232, a head mounted display 233, and two controllers 234 and 235. The head mounted display 233 may be a non-transmissive type, a video see-through type, or an optical see-through type.

  The rehabilitation support server 210 includes an operation detection unit 211, a display control unit 212, an evaluation unit 213, an update unit 214, a voice input / output unit 215, a target database 216, and a background image + question / answer database 217.

  The motion detection unit 211 acquires the positions of the controllers 234 and 235 held by the user 220 and the position of the head mounted display 233 via the base stations 231 and 232, and detects the rehabilitation motion of the user 220 based on the change in the position. .

  The display control unit 212 causes the head mounted display 233 to display an avatar image that moves according to the detected rehabilitation operation and a target image that indicates the target of the rehabilitation operation. FIG. 3 is a diagram illustrating an example of the avatar images 311 and 312 on the screen 301 displayed on the head mounted display 233. The avatar images 311 and 312 are superimposed on the background image 313. In this example, the avatar images 311 and 312 have the same shape as the controllers 234 and 235, and move on the screen 301 in accordance with the movement of the controllers 234 and 235. Further, the background image 313 changes according to the position and orientation of the head mounted display 233. As displayed on the avatar images 311 and 312, buttons are prepared for the controllers 234 and 235 so that various setting operations can be performed. As the background image 313, here, a landscape image obtained by capturing an actual landscape (for example, a moving image capturing the streets of New York) is displayed. As the scenery image, an image of a road around the rehabilitation facility may be used, and it is possible to make the person feel like taking a walk in a foreign country or to take a walk in a familiar place. By superimposing scenery images, it is possible to realize training in a large amount of information while making the patient entertained.

  In addition, for example, as illustrated in FIG. 4, the display control unit 212 displays the object 411 by superimposing the background image 313 on the screens 401 to 403 of the head mounted display 233. The object 411 is displayed by gradually changing the display position and size so that the object 411 is descending downward from the overhead direction of the user 220. The user 220 moves the controllers 234 and 235 to bring the avatar image 311 on the screen closer to the object 411. When the avatar image 311 hits the object 411, the object 411 disappears.

  The evaluation unit 213 compares the rehabilitation motion detected by the motion detection unit 211 with the target position represented by the target image displayed by the display control unit 212 to evaluate the user's rehabilitation ability. Specifically, whether or not the avatar image 311 moved corresponding to the rehabilitation motion detected by the motion detection unit 211 overlaps the object 411 as the target image is determined by comparing the positions in the three-dimensional virtual space. . As a result, if they overlap, it is evaluated that one rehabilitation operation has been cleared, and points are added. The position of the object 411 in the depth direction is prepared in various stages (for example, three stages), and different points (a high point for a distant object and a low point for a close object) are set.

  The update unit 214 updates the target task according to the accumulated points. For example, the target task may be updated using a task achievement rate (target achievement number / number of tasks).

  FIG. 5 is a flowchart showing the flow of processing in the rehabilitation support server 210. In step S501, as a calibration process, a rehabilitation target is initialized in accordance with the user. Specifically, each patient first performs work in the actionable range as a calibration, sets the initial value, and initializes the target according to the user.

  In addition, referring to the target database 216, the target is set according to the user's attribute information (for example, whether it is an athlete or Parkinson's disease). For example, in the case of an injured athlete, an initial value that does not worsen the injury is set, and in the case of a user suffering from Parkinson's disease, an exercise that slows the progression of the disease is set as the initial value. To do. Further, each patient is first asked to perform work in the actionable range, and after setting it to an initial value, the target is initialized according to the user.

  Next, in step S503, the avatar images 311 and 312 are displayed according to the positions of the controllers 234 and 235 detected by the motion detection unit 211. In step S505, the object 411 is displayed at a position and speed corresponding to the set task.

  In step S507, the movement of the avatar images 311 and 312 and the movement of the object 411 are compared to determine whether the task has been cleared. If the assignment has not been cleared, the process returns to step S505 as it is, and the next object is displayed without changing the difficulty level of the assignment.

  If the task is cleared, the process proceeds to step S509, and accumulated points, task achievement probabilities, and the like are calculated. The process further proceeds to step S511, where the accumulated points, task achievement probabilities, and the like are compared with a threshold T. If the accumulated points, task achievement probabilities, etc. exceed a predetermined threshold T, the process proceeds to step S513 to update the exercise intensity of the task. . If the accumulated points, the task achievement probability, etc. do not reach the threshold value T, the process returns to step S505, and the next object is displayed without changing the difficulty level of the task.

  For example, when the achievement degree of the short distance exceeds 80% (or the number of times such as 10 is acceptable), the display frequency of the medium distance object is increased. When the achievement rate of the medium-distance object exceeds 80% (or even 10 times, etc.), the display frequency of the long-distance object is increased.

  The task update here is also changed according to the user's attribute (whether it is an injured athlete or a Parkinson's disease patient, etc.). As a method for updating the assignment, a method of switching the background image is also conceivable.

  After updating the task, the process proceeds to step S515, where the user's fatigue level is calculated and compared with the threshold value N. If the degree of fatigue exceeds a predetermined threshold, the process ends as a “stop condition”. For example, it can be calculated as (Fatigue level = 1−Recovery rate of the closest object). Alternatively, it may be calculated as (Fatigue degree = 1 / Eye movement). If you are clearly not concentrating (not looking for an object at all, not shaking your head, etc.), there is no point in continuing further rehabilitation, so you will have a break. Furthermore, the degree of fatigue may be calculated by detecting (acceleration) a decrease in speed when extending the arm.

  Further, for example, if the accumulated point exceeds a predetermined threshold value, as shown in the character image 601 in FIG. 6, which of the two controllers 234 and 235 should be touched on the object 411 (right here). Instruct. As a result, a recognition function for recognizing characters is required, and the difficulty of movement increases, and a higher motor function is required. In other words, a dual task (dual task) of cognitive function and motor function is required.

  In FIG. 6, the instruction is performed using characters, but the present invention is not limited to this, and the instruction may be performed using arrows, colors, or voices. Thus, in this embodiment, the load is updated according to the evaluation of the rehabilitation operation.

(About dual task)
Healthy people do two or more things at the same time, such as “walking while talking” in everyday life. This “ability to do two things at the same time” declines with age. For example, “If you talk while walking, you will stop your foot”. It is considered that the cause of the fall of the elderly is not only “the motor function is reduced” but also “the ability to do two things at the same time”. Actually, even if it is judged that the motor function has been sufficiently recovered by rehabilitation, there are many elderly people who fall after returning home. One reason for this is that rehabilitation is performed in a state in which the environment and conditions that can concentrate on the rehabilitation operation are prepared. In other words, in the living environment, the operation is often performed under such a condition that the user cannot concentrate on the operation, for example, the view is bad, there is an obstacle, and the conversation is conscious.

  Therefore, it is considered important to perform rehabilitation that disperses attention, and it is desirable to give a specific dual task for training. Such dual task training is an effective program not only for falling elderly people but also for preventing dementia.

  Dual task training includes training combining two types of exercise tasks in addition to training combining cognitive tasks and exercise tasks.

  As the cognitive task + exercise task, training such as walking while subtracting one by one from 100, and as the exercise task + exercise task, training such as walking so as not to overflow the water in the cup.

  When the walking speed is delayed by about 20% in the dual task walking test compared to simple walking, the evaluation unit 213 evaluates that the risk of falling is high and notifies the display control unit 212 to repeat the dual task. .

  Note that dual tasks are more effective for “persons with relatively high mobility”. For example, for elderly people who can not let go of the cane even when moving indoors, strengthening balance ability (muscle strength, sense of balance, etc.) has a higher priority than dual task ability. As a rough judgment, it can be expressed that dual task ability is important for those who need assistance, and balance ability other than dual task ability is important for those who need care. Display calibration time series and visually display improvement in your range of motion.

(Setting change by user attribute)
For patients who can expect normal improvement (assuming complete improvement for orthopedic diseases such as fractures), set the hardest rehabilitation action to accelerate the improvement.

  For patients with different degrees of improvement depending on the individual (patients with cerebral infarction and other forms of paralysis that differ depending on the lesion site), the burden of the task can be increased to a certain extent. Stop.

  For patients whose functions decline in principle, such as Parkinson's disease, it is always useful to regularly evaluate the current state of exercise.

(Other dual task training examples)
FIG. 7 is a diagram showing another example of images for dual task training. Request cognitive function by putting a bomb on an object. Alternatively, as shown in FIG. 8, a question image (multiplication as an example here) may be superimposed on the background screen and only the acquisition of the object on which the answer is displayed may be evaluated. One of goo, choki, and par may be displayed on the background screen, and the collection of the object on which the winning mark is displayed may be requested.

  Further, it may be possible to simply display a number on the object and evaluate only acquisition of an object having a large number. In addition, if the signal is displayed in the background image 313 and an object is taken when the signal is red, the evaluation unit 213 may make the point negative.

  According to this embodiment, since a subject is updated according to the achievement degree (achievement probability etc.) of rehabilitation operation | movement, the load according to the progress of rehabilitation can be given to a user. In addition, by displaying the background image 313, not only can the patient enjoy it, but also rehabilitation can be performed in a situation where attention is directed to the surroundings, and a safer life can be realized when returning to the real world.

  FIG. 9 is a diagram illustrating another example of dual task training. As shown in FIG. 9, the voice input / output unit 215 outputs a question voice regarding the background image to the headphones 901, and obtains an answer to the question via the microphone 902 provided in the head mounted display 233. The evaluation unit 213 performs voice recognition processing on the answer acquired as voice information, compares the answer with a prepared answer, and evaluates the user's rehabilitation ability according to the comparison result.

  FIG. 10 is a diagram showing an example of the contents of the background image / question / answer database 217. A question voice, an answer, and a point are stored in association with the background moving image.

  As a response from the user, it is expected that the recovery rate of the object decreases in the dual task. The goal is that the achievement rate of collecting objects will not change even if dual tasks are displayed. The object recovery rate or the reach rate to the object is compared between the single task and the dual task, and the training is repeated until it falls within a certain range.

  The above is the dual task training that requires the motor function and the cognitive function at the same time. However, the present invention is not limited to this, and the dual task training that simultaneously requires two motor functions may be used.

  For example, as shown in FIG. 11, it may be requested to pick up the object 411 while avoiding the flying object 1111. By detecting the position of the sensor provided on the head mounted display 233, it can be determined whether or not the object 1111 has been successfully managed. The evaluation and the update of the task may be performed based on the achievement points (for example, achievement rate) of both of the two rehabilitation operations.

  Also, for example, as shown in an image 1201 in FIG. 12, cup images 1211, 1212 containing water are displayed as avatar images that move according to the operation of the controllers 234, 235, and these cup images 1211, 1212 are moved. Then, the object 411 may be collected. However, when the cup image 1221 is tilted and water is spilled as shown in the image 1202, no points can be obtained even if the object 411 is collected from the cup image 1222. Points are added only when the object 411 is collected without spilling water in the cup images 1231 and 1232 as in the image 1203.

  In addition, it is conceivable that the avatar image on the side opposite to the avatar image on the object collecting side is requested to always touch a designated place. Of the buttons provided in the controllers 234 and 235, it may be requested to collect the object while pressing a designated button a predetermined number of times. In addition, when a sensor for acquiring the movement of the user's foot is provided, the specified movement of the foot may be requested.

[Other Embodiments]
While the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. For example, the display device is not limited to the head mount and may be a large screen. The controller is not limited to the grip type, and may be a wearable sensor.

  Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In addition, a system or an apparatus in which different features included in each embodiment are combined in any way is also included in the scope of the present invention.

  In addition, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied to a case where an information processing program that implements the functions of the embodiments is supplied directly or remotely to a system or apparatus. Therefore, in order to realize the functions of the present invention on a computer, a program installed in the computer, a medium storing the program, and a WWW (World Wide Web) server that downloads the program are also included in the scope of the present invention. . In particular, at least a non-transitory computer readable medium storing a program for causing a computer to execute the processing steps included in the above-described embodiments is included in the scope of the present invention.

Claims (11)

Motion detection means for detecting the first rehabilitation motion of the user;
Display control means for displaying an avatar image that moves in accordance with the detected first rehabilitation operation, and a target image that indicates a target of the first rehabilitation operation;
An evaluation means for evaluating the rehabilitation ability of the user by comparing the first rehabilitation operation with a target position represented by the target image;
Updating means for updating the target position according to the evaluation result by the evaluation means;
Rehabilitation support system with The display control means displays a background image superimposed on the avatar image and the target image,
Voice output means for outputting a question about the background image by voice;
The rehabilitation support system according to claim 1, wherein the evaluation unit further evaluates the rehabilitation ability of the user according to an answer to the question.   The rehabilitation support system according to claim 2, further comprising voice recognition means for acquiring an answer to the question by voice recognition.   4. The rehabilitation support system according to claim 2, wherein the voice output unit outputs a question about the background image by voice when the evaluation unit evaluates the first rehabilitation operation at a predetermined level or higher. 5. The display control means displays a question image superimposed on the avatar image and the target image,
The rehabilitation support system according to any one of claims 1 to 4, wherein the evaluation unit further evaluates the rehabilitation ability of the user according to an answer to the question image.   The rehabilitation support system according to claim 5, further comprising voice recognition means for acquiring an answer to the question image by voice recognition.   The rehabilitation support system according to claim 5 or 6, wherein the display control means superimposes and displays the question image when the evaluation means evaluates the first rehabilitation operation at a predetermined level or higher. The motion detection means is
Furthermore, the second rehabilitation movement of the user during the first rehabilitation movement is detected,
The rehabilitation support system according to any one of claims 1 to 6, wherein the evaluation unit evaluates the rehabilitation ability based on both the first rehabilitation operation and the second rehabilitation operation.   The said evaluation means evaluates the said rehabilitation capability based on both the said 1st rehabilitation operation | movement and the said 2nd rehabilitation operation | movement, when evaluation more than predetermined is performed only about the said 1st rehabilitation operation | movement. Rehabilitation support system. A motion detection step of detecting a first rehabilitation motion of the user;
A display control step for displaying an avatar image that moves in response to the detected first rehabilitation motion, and a target image that indicates a target of the first rehabilitation motion;
An evaluation step of evaluating the rehabilitation ability of the user according to a difference between the first rehabilitation operation and a target position represented by the target image;
An update step for updating the target position according to the evaluation result in the evaluation step;
Rehabilitation support method including A motion detection step of detecting a first rehabilitation motion of the user;
A display control step for displaying an avatar image that moves in response to the detected first rehabilitation motion, and a target image that indicates a target of the first rehabilitation motion;
An evaluation step of evaluating the rehabilitation ability of the user according to a difference between the first rehabilitation operation and a target position represented by the target image;
An update step for updating the target position according to the evaluation result in the evaluation step;
A rehabilitation support program that runs a computer.

Images