JP2022002798A - Rehabilitation assistance system, rehabilitation assistance method, and rehabilitation assistance program - Google Patents

Abstract

To reduce deviation of a target distance set as rehabilitation from an exercise distance over which a user actually exercises.SOLUTION: A target object recognizability enhancing system comprises: an action detection unit to detect a first rehabilitation action of a user; a display control unit to control to display an avatar image that moves according to the detected first rehabilitation action, a target image that indicates a target of the first rehabilitation action, and at least one legibility assistance image for improving legibility of the target image; an evaluation unit to compare the first rehabilitation action with a target position represented by the target image to evaluate the rehabilitation ability of the user; and an update unit to update the target position according to the evaluation result from the evaluation unit.SELECTED DRAWING: Figure 1

Description

The present invention relates to a rehabilitation support system, a rehabilitation support method, and a rehabilitation support program.

In the above technical field, Patent Document 1 discloses a system that supports rehabilitation performed for a hemiplegic patient due to a stroke or the like.

Japanese Unexamined Patent Publication No. 2015-228957

However, the technique described in the above document has a problem that the difference between the exercise distance and the target distance becomes large when a large target is presented to a patient with low cognitive function from the viewpoint of visibility.

An object of the present invention is to provide a technique for solving the above-mentioned problems.

In order to achieve the above object, the rehabilitation support system according to the present invention is
Motion detection means for detecting the user's first rehabilitation motion,
A display control means for displaying an avatar image that moves according to the detected first rehabilitation motion, a target image that shows the target of the first rehabilitation motion, and a visual recognition auxiliary image that improves the visibility of the target image.
An evaluation means for evaluating the rehabilitation ability of the user by comparing the position of the avatar image with the target position represented by the target image.
An update means for updating the target position according to the evaluation result by the evaluation means, and an update means.
To prepare for.

In order to achieve the above object, the rehabilitation support method according to the present invention is:
The motion detection step in which the motion detection unit of the rehabilitation support system detects the user's first rehabilitation motion, and
An avatar image that moves according to the first rehabilitation motion detected by the display control unit of the rehabilitation support system, a target image showing the target of the first rehabilitation motion, and a visual recognition auxiliary image that improves the visibility of the target image. And the display control step to display
An evaluation step in which the evaluation unit of the rehabilitation support system compares the position of the avatar image with the target position represented by the target image to evaluate the rehabilitation ability of the user.
An update step in which the update unit of the rehabilitation support system updates the target position according to the evaluation result in the evaluation step, and
including.

In order to achieve the above object, the rehabilitation support program according to the present invention is:
An operation detection step for detecting the user's first rehabilitation operation, and
An avatar image that moves according to the first rehabilitation motion detected by the display control unit of the rehabilitation support system, a target image showing the target of the first rehabilitation motion, and a visual recognition auxiliary image that improves the visibility of the target image. And the display control step to display
An evaluation step for evaluating the rehabilitation ability of the user by comparing the position of the avatar image with the target position represented by the target image.
An update step for updating the target position according to the evaluation result in the evaluation step, and an update step.
Let the computer run.

According to the present invention, it is possible to suppress the discrepancy between the target distance set as rehabilitation and the exercise distance actually exercised by the user.

It is a block diagram which shows the structure of the target object recognition improvement system which concerns on 1st Embodiment of this invention. It is a block diagram which shows the structure of the target object recognition improvement system which concerns on the prerequisite technology 1. It is a figure which shows the display screen example of the target object recognition improvement system which concerns on the prerequisite technique 1. It is a figure which shows the display screen example of the target object recognition improvement system which concerns on the prerequisite technique 1. It is a flowchart which shows the process flow of the target object recognition improvement system which concerns on the prerequisite technology 1. It is a figure which shows the display screen example of the target object recognition improvement system which concerns on the prerequisite technique 1. It is a figure which shows the display screen example of the target object recognition improvement system which concerns on the prerequisite technique 1. It is a figure which shows the display screen example of the target object recognition improvement system which concerns on the prerequisite technique 1. It is a figure which shows the other structure of the target object recognition improvement system which concerns on the prerequisite technique 1. It is a figure which shows the structure of the database of the target object recognition improvement system which concerns on the prerequisite technology 1. It is a figure which shows the display screen example of the target object recognition improvement system which concerns on the prerequisite technique 1. It is a figure which shows the display screen example of the target object recognition improvement system which concerns on the prerequisite technique 1. It is a figure explaining the outline of the operation of the target object recognition improvement system which concerns on the prerequisite technique 2. It is a figure explaining the outline of the operation of the target object recognition improvement system which concerns on the prerequisite technique 2. It is a figure explaining the outline of the operation of the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a figure explaining the arrangement position of the visual recognition auxiliary image in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a figure explaining another example of the visual aid image in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a figure explaining still another example of the visual aid image in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a figure explaining still another example of the visual aid image in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a figure explaining still another example of the visual aid image in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a figure explaining still another example of the visual aid image in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a figure explaining still another example of the visual aid image in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a block diagram explaining the structure of the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a figure explaining an example of the patient table which the target object recognition improvement server included in the target object recognition improvement system which concerns on 2nd Embodiment of this invention has. It is a figure explaining an example of the display parameter table which the target object recognition improvement server included in the target object recognition improvement system which concerns on 2nd Embodiment of this invention has. It is a figure explaining an example of the image table which the target object recognition improvement server included in the target object recognition improvement system which concerns on 2nd Embodiment of this invention has. It is a block diagram explaining the hardware configuration of the target object recognition improvement server included in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a flowchart explaining the processing procedure of the target object recognition improvement server included in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a flowchart explaining the processing procedure of the visual aid image display of the target object recognition improvement server included in the target object recognition improvement system which concerns on 2nd Embodiment of this invention. It is a block diagram explaining the structure of the target object recognition improvement system which concerns on 3rd Embodiment of this invention. It is a figure explaining an example of the sound table which the target object recognition improvement server included in the target object recognition improvement system which concerns on 3rd Embodiment of this invention has. It is a figure explaining the hardware configuration of the target object recognition improvement server included in the target object recognition improvement system which concerns on 3rd Embodiment of this invention. It is a flowchart explaining the processing procedure of the target object recognition improvement server included in the target object recognition improvement system which concerns on 3rd Embodiment of this invention. It is a flowchart explaining the processing procedure of the sound output control of the target object recognition improvement server included in the target object recognition improvement system which concerns on 3rd Embodiment of this invention.

Hereinafter, embodiments for carrying out the present invention will be described in detail exemplary with reference to the drawings. However, the configuration, numerical values, processing flow, functional elements, etc. described in the following embodiments are merely examples, and their modifications and changes are free, and the technical scope of the present invention is described below. It is not intended to be limited.

[First Embodiment]
The target object recognition improvement system 100 as the first embodiment of the present invention will be described with reference to FIG. The information processing system 100 is a system that supports rehabilitation performed on the user 110.

As shown in FIG. 1, the target recognition improvement system 100 includes an motion detection unit 101, a display control unit 102, an evaluation unit 103, and an update unit 104.

The motion detection unit 101 detects the first rehabilitation motion of the user 110. The display control unit 102 displays an avatar image that moves according to the detected first rehabilitation motion, a target image that shows the target of the first rehabilitation motion, and at least one visual aid image that improves the visibility of the target image. Let me. The evaluation unit 103 evaluates the rehabilitation ability of the user 110 by comparing the first rehabilitation operation with the target position represented by the target image. The updating unit 104 updates the target position according to the evaluation result by the evaluation means.

According to this embodiment, it is possible to suppress the discrepancy between the target distance set as rehabilitation and the exercise distance actually exercised by the user.

[Prerequisite technology 1]
Next, the rehabilitation support system 200 according to the prerequisite technique 1 will be described with reference to FIG. FIG. 2 is a diagram for explaining the configuration of the rehabilitation support system according to the present embodiment.

As shown in FIG. 2, the rehabilitation support system 200 includes a rehabilitation support server 210, two base stations 231 and 232, a head-mounted display 233, and two controllers 234 and 235. The head-mounted display 233 may be a non-transparent type, a video see-through type, or an optical see-through type.

Further, the rehabilitation support server 210 includes an operation detection unit 211, a display control unit 212, an evaluation unit 213, an update unit 214, an audio input / output unit 215, a target database 216, and a background image + question / answer database 217.

The motion detection unit 211 acquires the position of the controller 234 234 and the position of the head-mounted display 233 held by the user 220 via the base stations 231 and 232, and detects the rehabilitation motion of the user 220 by the change in the position. ..

The display control unit 212 causes the head-mounted display 233 to display an avatar image that moves according to the detected rehabilitation motion and a target image that shows the target of the rehabilitation motion. FIG. 3 is a diagram showing an example of avatar images 311 and 312 on the screen 301 displayed on the head-mounted display 233. The avatar images 311 and 312 are superimposed and displayed on the background image 313. In this example, the avatar images 311 and 312 have the same shape as the controllers 234 and 235, and move in the screen 301 according to the movement of the controllers 234 and 235. Further, the background image 313 changes according to the position and orientation of the head-mounted display 233. As displayed in the avatar images 311 and 312, the controllers 234 and 235 are provided with buttons so that various setting operations can be performed. As the background image 313, here, a landscape image obtained by capturing an actual landscape (for example, a moving image of the streets of New York) is displayed. As the landscape image, the image of the road around the rehabilitation facility may be used, and it is possible to make the person feel as if he / she is taking a walk in a foreign country or in a familiar place. By superimposing a landscape image, it is possible to realize training in a large amount of information while entertaining the patient.

Further, for example, as shown in FIG. 4, the display control unit 212 superimposes the object 411 on the background image 313 on the screens 401 to 403 of the head-mounted display 233 to display the object 411. The object 411 is displayed by gradually changing the display position and size so as to descend from the overhead direction of the user 220 downward. The user 220 moves the controller 234 and 235 to bring the avatar image 311 on the screen closer to the object 411. When the avatar image 311 hits the object 411, the object 411 disappears.

The evaluation unit 213 evaluates the rehabilitation ability of the user by comparing the rehabilitation operation detected by the motion detection unit 211 with the target position represented by the target image displayed by the display control unit 212. Specifically, it is determined by comparing the positions in the three-dimensional virtual space whether or not the avatar image 311 moved in response to the rehabilitation motion detected by the motion detection unit 211 and the object 411 as the target image overlap. .. As a result, if these overlap, it is evaluated that one rehabilitation operation has been cleared, and points are added. Various stages (for example, three stages) are prepared for the position of the object 411 in the depth direction, and different points (high points for distant objects and low points for near objects) are set for each.

The update unit 214 updates the target task according to the accumulated points. For example, the target task may be updated using the task achievement rate (number of goals achieved / number of tasks).

FIG. 5 is a flowchart showing a processing flow in the rehabilitation support server 210. In step S501, as a calibration process, the target of the rehabilitation operation is initialized according to the user. Specifically, each patient is first asked to perform work within the range of action as calibration, and after setting it as an initial value, the target is initialized according to the user.

Further, the target database 216 is referred to, and a target is set according to the user's attribute information (for example, whether it is an athlete or Parkinson's disease). For example, in the case of an injured athlete, an initial value is set so that the injury does not worsen, and in the case of a user suffering from Parkinson's disease, an exercise that slows the progression of the condition is set as the initial value. do. Furthermore, each patient is asked to perform work within the range of action that can be performed first, and after setting it as an initial value, the goal is initialized according to the user.

Next, in step S503, the avatar images 311 and 312 are displayed according to the positions of the controllers 234 and 235 detected by the motion detection unit 211. Further, in step S505, the object 411 is displayed at a position and a speed corresponding to the set task.

In step S507, the movement of the avatar images 311 and 312 and the movement of the object 411 are compared to determine whether or not the task has been cleared. If the task is not cleared, the process returns to step S505 as it is, and the next object is displayed without changing the difficulty level of the task.

When the task is cleared, the process proceeds to step S509, and the cumulative points, the task achievement probability, and the like are calculated. Further, the process proceeds to step S511 to compare the cumulative points, the task achievement probability, etc. with the threshold value T, and if the cumulative points, the task achievement probability, etc. exceed a predetermined threshold value T, the process proceeds to step S513 to update the exercise intensity of the task. .. If the accumulated points, the task achievement probability, or the like do not reach the threshold value T, the process returns to step S505, and the next object is displayed without changing the difficulty level of the task.

For example, when the achievement level of the short distance exceeds 80% (or the number of times such as 10 times is acceptable), the display frequency of the medium-distance object is increased. When the achievement level of the medium-distance object exceeds 80% (or the number of times such as 10 times is acceptable), the display frequency of the long-distance object is increased.

The update of the task here will also be changed according to the user's attributes (whether it is an injured athlete or a Parkinson's disease patient, etc.). As a method of updating the task, a method of switching the background image can be considered.

After updating the task, the process proceeds to step S515 to calculate the degree of fatigue of the user and compare it with the threshold value N. If the degree of fatigue exceeds a predetermined threshold value, the process is terminated as a "stop condition". For example, it can be calculated as (fatigue degree = 1-recovery rate of the most proximal object). Alternatively, it may be calculated as (fatigue degree = 1 / eye movement). If you are clearly not focused (not looking for an object at all, do not shake your head, etc.), it makes no sense to continue rehabilitation anymore, so you will have to take a break. Furthermore, the degree of fatigue may be calculated by detecting (acceleration) that the speed at which the arm is extended decreases.

Further, for example, if the cumulative point exceeds a predetermined threshold value, as shown in the character image 601 of FIG. 6, which of the two controllers 234 and 235 should touch the object 411 (here, right). To instruct. As a result, a cognitive function for recognizing characters is required, the difficulty of movement is increased, and a higher motor function is required. That is, a dual task (dual task) of cognitive function and motor function is required.

Although the instruction is given by characters in FIG. 6, the present invention is not limited to this, and the instruction may be given by an arrow, a color, or a voice. As described above, in the present embodiment, the load is updated according to the evaluation of the rehabilitation operation.

(About dual task)
Healthy people do two or more things at the same time, such as "walking while talking" in their daily lives. Such "ability to do two things at the same time" declines with aging. For example, "If you talk to me while walking, you will stop." It is considered that the cause of falls in the elderly is not only "decreased motor function" but also "decreased ability to do two things at the same time". In fact, there are many elderly people who fall after returning home, even if it is judged that their motor function has been sufficiently restored by rehabilitation. One of the reasons for this is that rehabilitation is performed in a state where the environment and conditions are prepared so that the person can concentrate on the rehabilitation operation. In other words, in the living environment, it is often the movement under such conditions that it is not possible to concentrate on the movement, for example, the view is poor, there is an obstacle, or the person is conscious of conversation.

Therefore, it is important to perform rehabilitation that disperses attention, and it is desirable to specifically give dual tasks for training. Such dual task training is an effective program not only for falls in the elderly but also for the prevention of dementia.

Dual-task training includes training that combines cognitive tasks and exercise tasks, as well as training that combines two types of exercise tasks.

Examples of the cognitive task + exercise task include training such as walking while subtracting 1 from 100, and examples of the exercise task + exercise task include training such as walking so as not to overflow the water in the cup.

The evaluation unit 213 evaluates that the risk of falling is high when the walking speed is delayed by about 20% in the dual task walking test compared to the simple walking, and notifies the display control unit 212 to repeat the dual task. ..

It should be noted that "people with relatively high mobility" are more likely to be effective in dual tasks. For example, for elderly people who cannot part with their canes even when moving indoors, strengthening their balance ability (muscle strength, sense of balance, etc.) has a higher priority than dual task ability. As a rough judgment, it can be said that the dual task ability is important for the person requiring support, and the balance ability other than the dual task ability is important for the person requiring long-term care. Display the time-series changes in calibration and visually display the improvement of your range of motion.

(Setting change by user attribute)
For patients who are expected to improve normally (for orthopedic diseases such as bone fractures and assume complete improvement), set the hardest rehabilitation movement to accelerate the improvement.

For patients with different degrees of improvement depending on the individual (patients with different forms of paralysis depending on the lesion site such as cerebral infarction), the load of the task is improved to some extent. Stop.

In the case of patients with Parkinson's disease, etc., whose function declines in principle, it is useful to always evaluate the current state of exercise on a regular basis.

(Other dual task training examples)
FIG. 7 is a diagram showing an example of an image for another dual task training. Cognitive function is required by charging an object with a loss (bomb). Alternatively, as shown in FIG. 8, a question image (here, multiplication as an example) may be superimposed and displayed on the background screen, and only the acquisition of the object in which the answer is displayed may be evaluated. You may display one of the goo, choki, and par on the background screen and request the collection of the object with the winning mark.

Furthermore, it is possible to simply display a number on the object and evaluate only the acquisition of the object having a large number. In addition, if a signal is displayed in the background image 313 and an object is taken at the time of a red light, the evaluation unit 213 may set the point to minus.

According to the present embodiment, since the task is updated according to the degree of achievement (achievement probability, etc.) of the rehabilitation operation, it is possible to give the user a load according to the progress of the rehabilitation. Further, by displaying the background image 313, not only the patient can enjoy it, but also the rehabilitation can be performed in a situation where the patient is conscious of the surroundings, and a safer life can be realized when returning to the real world.

FIG. 9 is a diagram showing another example of dual task training. As shown in FIG. 9, the audio input / output unit 215 outputs a question voice regarding the background image to the headphones 901, and obtains an answer to the question via the microphone 902 provided in the head-mounted display 233. The evaluation unit 213 performs voice recognition processing on the answer acquired as voice information, compares it with the answer prepared in advance, and evaluates the rehabilitation ability of the user according to the comparison result.

FIG. 10 is a diagram showing an example of the contents of the background image / question / answer database 217. The question voice, the answer, and the point are associated and stored with respect to the background video.

As a user reaction, it is expected that the dual task will reduce the object recovery rate. The goal is to expect the result that the collection achievement rate of the object does not differ even if the dual task is displayed. The object recovery rate or the reach rate to the object is compared between the single task and the dual task, and training is repeated until it falls within a certain range.

The above is dual task training that requires motor function and cognitive function at the same time, but the present invention is not limited to this, and dual task training that requires two motor functions at the same time may be used.

For example, as shown in FIG. 11, it may be requested to pick up the object 411 while avoiding the flying object 1111. By detecting the position of the sensor provided on the head-mounted display 233, it is possible to determine whether or not the object 1111 has been successfully avoided. Evaluations and task updates may be performed based on the achievement points (eg, achievement rate, etc.) of both of the two rehabilitation movements.

Further, for example, as shown in image 1201 of FIG. 12, as avatar images that move according to the operation of the controller 234 and 235, cup images 1211, 1212 containing water are displayed, and these cup images 1211, 1212 are moved. You may let the object 411 be recovered. However, if the cup image 1221 is tilted and water spills as shown in the image 1202, points cannot be obtained even if the object 411 is collected by the cup image 1222. Points are added only when the object 411 is collected without spilling the water in the cup images 1231, 1232 as in the image 1203.

Another possibility is to require the avatar image on the opposite side of the avatar image on the side that collects the object to always touch the specified place. Of the buttons provided on the controller 234 and 235, the object may be requested to be collected while pressing the specified button a predetermined number of times. Further, when a sensor for acquiring the movement of the user's foot is provided, the designated movement of the foot may be requested.

[Second Embodiment]
Next, the target object recognition improvement system according to the second embodiment of the present invention will be described with reference to FIGS. 13A to 17B. FIG. 13A is a diagram illustrating an outline of the operation of the prerequisite technology 2 of the target object recognition improvement system according to the present embodiment. FIG. 13B is a diagram illustrating an outline of the operation of the prerequisite technology 2 of the target object recognition improvement system according to the present embodiment. The target object recognition improvement system according to the present embodiment is different from the above-mentioned prerequisite technology 1 in that it displays a visual recognition auxiliary image that improves the recognition property (for example, visibility) of the target image. Since other configurations and operations are the same as those of the prerequisite technique 1, the same configurations and operations are designated by the same reference numerals and detailed description thereof will be omitted.

In the prerequisite technique 2, the moving distance of the avatar image 1320, that is, the motion distance 1312 of the user 220 is measured by the distance between the reference 1310 and the sensor of the avatar image 1320 (head portion of the avatar image 1320). The target distance 1311, which is the distance at which the user 220 must move his / her arm or the like, is determined based on the distance between the reference 1310 and the reference line 1331 of the object 1330 as the target image. Then, the user 220 moves the avatar image 1320 to approach the object 1330 as a rehabilitation exercise.

However, as shown in FIG. 13B, when the avatar image 1320 touches the apex 1332 of the object 1330, the system determines that one of the rehabilitation actions of the user 220 has been completed and sets a new object 1330 as the next goal. indicate.

As a rehabilitation exercise, the system provider wants the avatar image 1320 to come into contact with the object 1330 when the user 220 fully extends his arm. However, if the size of the object 1330 is large (the distance between the apex and the reference line 1331 is large), it is determined that the object 1330 is in contact with the avatar image 1320 only by touching the edge of the object 1330. Therefore, the user 220 cannot move his / her arm by the originally expected distance, and it becomes difficult to obtain the expected rehabilitation effect.

Further, since the user 220 can touch the object 1330 before the arm is fully extended, the sense of accomplishment and satisfaction of the rehabilitation exercise cannot be sufficiently obtained, and the motivation for rehabilitation may be reduced. ..

In this case, the movement distance 1312, which is the distance actually moved by the avatar image 1320, deviates from the target distance 1311, which is the distance that the user 220 should originally move. Therefore, the user 220 is not exercising at the exercise distance 1312 set before the start of rehabilitation, and the effect obtained by the rehabilitation is less than the expected effect.

For example, the length of one side of the object 1330 is 20.0 cm, and the diameter 1321 of the sensor unit (head portion of the avatar image 1320) of the avatar image 1320 is 5.0 cm. In this case, when the user 220 brings the avatar image 1320 into contact with the apex 1332 instead of the reference line 1331 of the object 1330, an error of about 10.0 cm occurs between the target distance 1311 and the motion distance 1312.

Therefore, since the user 220 does not move the avatar image 1320 by the amount of the exercise distance 1312 assumed before the start of the rehabilitation, the effect of the rehabilitation that the user 220 should have originally enjoyed is reduced.

If the object 1330 is made smaller so that the user 220 can touch the object 1330 when the arm is fully extended, it becomes difficult for the user 220 to visually recognize the position of the object 1330 on the screen. If the object 1330 cannot be visually recognized, rehabilitation cannot be established.

Therefore, the sensor portion (reaction portion) of the avatar image 1320 is set as a region smaller than the head portion of the avatar image 1320. As a result, the dissociation (error) between the target distance 1311 and the motion distance can be made smaller.

FIG. 13C is a diagram illustrating an outline of the operation of the target object recognition improvement system according to the present embodiment. Therefore, in the present embodiment, the gradation at the center of the object 1330 is darkened to serve as the reaction portion so that there is no discrepancy between the assumed target distance 1311 and the motion distance 1312 by the avatar image 1320. Then, the gradation of the portion around the reaction portion of the object 1330 is reduced. That is, the size of the object 1330 shown in FIGS. 13A and 13B is reduced, and the object 1330 is surrounded by the visual aid image 1333, which is larger than the object 1330. That is, the object 1330 and the visual recognition auxiliary image 1333 are superimposed and displayed.

From the user's point of view, if the size of the object 1330 is reduced, the object 1330 becomes difficult to see (the visibility is reduced), but in order to compensate for the reduction in visibility, a visual aid image is formed around the reduced object 1330. Place 1333.

For example, the length of one side of the object 1330 is 5.0 cm, the length of one side of the visual recognition auxiliary image 1333 is 20.0 cm, and the diameter of the sensor unit 1322 of the avatar image 1320 is 2.0 cm. Then, the error (difference) between the target distance 1311 and the motion distance 1312 decreases to around 2.0 cm.

As a result, the deviation (error) between the target distance 1311 and the motion distance 1312 can be reduced while preventing the deterioration of the visibility of the object 1330 due to the difference in the gradation and the difference in the size of the object 1330 and the visual aid image 1333. Can be done. Further, as a secondary effect, the degree of experience when the avatar image 1320 is brought into contact with the object 1330 is increased. That is, for the user 220, the feeling when touching the object 1330 becomes clear, and the joy of achieving the rehabilitation goal is also increased.

FIG. 13D is a diagram illustrating an arrangement position of a visual recognition auxiliary image in the target object recognition improvement system according to the present embodiment. In FIG. 13C, the object 1330 as the target image is displayed so as to be included in the visual recognition auxiliary image 1333, and is further arranged near the center of the visual recognition auxiliary image 1333.

However, as shown in FIG. 13D, the object 1330 may be arranged near the lower side in front of the visual recognition auxiliary image 1333. That is, the object 1330 may be arranged on the front side when viewed from the user 220. As described above, the object 1330 may be arranged at any position of the visual aid image 1333 as long as it is displayed so as to be contained in the visual aid image 1333. In this way, if the size of the object 1330 is reduced to reduce the deviation between the target distance 1311 and the motion distance 1312, the visibility of the object 1330 is reduced. Therefore, in order to improve the visibility of the object 1330, the deterioration of the visibility of the object 1330 is compensated for by displaying the visual recognition auxiliary image 1333 larger than the object 1330 around the object 1330. The visual recognition auxiliary image 1333 for improving the visibility of the object 1330 is not limited to the cube in which the magnification of the cube object 1330 is enlarged as shown here.

Next, other shapes of the visual recognition auxiliary image 1333 will be described with reference to FIGS. 13E to 13I. FIG. 13E is a diagram illustrating another example of the visual recognition auxiliary image in the target object recognition improvement system according to the present embodiment. FIG. 13F is a diagram illustrating still another example of the visual recognition auxiliary image in the target object recognition improvement system according to the present embodiment. FIG. 13G is a diagram illustrating still another example of the visual recognition auxiliary image in the target object recognition improvement system according to the present embodiment. FIG. 13H is a diagram illustrating still another example of the visual recognition auxiliary image in the target object recognition improvement system according to the present embodiment. FIG. 13I is a diagram illustrating still another example of the visual recognition auxiliary image in the target object recognition improvement system according to the present embodiment.

As shown in FIG. 13E, the visual recognition auxiliary image 1340 may have, for example, an arrow shape indicating the existence position of the object 1330. The object 1330 is not included in the arrow-shaped visual aid image 1340. That is, the object 1330 as the target image and the visual aid image 1340 are not displayed superimposed, but the visual aid image 1340 is arranged outside the object 1330. As described above, if the arrow-shaped visual aid image 1340 is used, the user 220 can easily recognize that the object 1330 exists at the tip of the arrow.

As shown in FIG. 13F, the visual recognition auxiliary image 1350 may have a shape that attracts the attention of the user 220. The shape that attracts the attention of the user 220 is not limited to the shape shown in FIG. 13F, and may be, for example, a star shape, a cross shape, a polygonal shape, or the like. Further, the vertical line 1351 and the horizontal line 1352 may be displayed together to indicate that the object 1330 is arranged at the center of the vertical line 1351 and the horizontal line 1352.

As shown in FIG. 13G, the visual recognition auxiliary image 1360 may be a alternate long and short dash line extending from the sensor unit 1322 of the avatar image 1320 toward the object 1330. The visual recognition auxiliary image 1360 is not limited to the one-dot chain line, and may be, for example, a straight line, a two-dot chain line, or a dotted line.

Then, the user 220 can visually recognize the object 1330 and recognize the existence position of the object 1330 by moving the line of sight along the alternate long and short dash line using the alternate long and short dash line of the visual recognition auxiliary image 1360 as a guideline. Further, by moving the avatar image 1320 along the alternate long and short dash line, the object 1330 can be touched with the avatar image 1320. If the visual recognition auxiliary image 1333 is displayed together with the visual recognition auxiliary image 1370, the visibility of the object 1330 is further improved.

As shown in FIG. 13H, the visual recognition auxiliary image 1370 may have a plurality of arrows arranged in a straight line from the sensor unit 1322 toward the object 1330. Then, the user 220 can visually recognize the object 1330 and recognize the existence position of the object 1330 by moving the line of sight along the plurality of arrows using the plurality of arrows as a guideline. Further, by moving the avatar image 1320 along the plurality of arrows, the object 1330 can be touched with the avatar image 1320. If the visual recognition auxiliary image 1333 of the cube is displayed together with the visual recognition auxiliary image 1370, the visibility of the object 1330 is further improved.

As shown in FIG. 13I, a plurality of spherical visual aid images 1380 are arranged at positions on the top, bottom, left, and right of the object 1330. That is, in FIG. 13I, a plurality of spherical visual aid images 1380 are arranged around the object 1330 so that the object 1330 is arranged at the center of the four visual aid images 1380. The shape of the visual recognition auxiliary image 1380 is not limited to a spherical shape, and may be, for example, a triangular shape, a rectangular shape, a polygonal shape, a star shape, or the like.

FIG. 13J is a diagram illustrating still another example of the visual recognition auxiliary image in the target object recognition improvement system according to the present embodiment. The target recognition improvement server may change the size of the visual recognition auxiliary image 1333 displayed on the display unit 1402 according to the progress of the rehabilitation of the user 220, for example. For example, the target recognition improvement server displays a large visual aid image 1333 at the initial stage of rehabilitation. Then, in a state where the rehabilitation of the user 220 has progressed, the size of the visual recognition auxiliary image 1333 may be reduced according to the progress of the rehabilitation.

Further, the target recognition improvement server may change the size of the visual recognition auxiliary image 1333 according to, for example, the visual acuity of the user 220, instead of adjusting to the progress of the rehabilitation of the user 220. That is, the target recognition improvement server displays a large visual acuity auxiliary image 1333 for a user 220 with poor visual acuity, and displays a small visual acuity auxiliary image 1333 for a user 220 with relatively good visual acuity. May be good. In this way, the target recognition improvement server may display a visual recognition auxiliary image having a size corresponding to the visual acuity of the user 220.

Further, for example, when the user 220 has dementia, the target recognition improvement server may display a visual recognition assist image 1333 having a size suitable for the progress of dementia and the cognitive function. Even if the target recognition improvement server automatically changes the size of the visual aid image 1333, the operator such as a doctor who operates the target recognition improvement system manually changes it, and the user 220 changes it. You may.

FIG. 14 is a block diagram illustrating the configuration of the target object recognition improvement system according to the present embodiment. The target object recognition improvement system 1400 has a target object recognition improvement server 1401 and a display unit 1402. The elements included in the target recognition improvement system 1400 are not limited to these. The target recognition improvement server 1401 has an operation detection unit 1411, a display control unit 1412, an evaluation unit 1413, and an update unit 1414.

The motion detection unit 1411 acquires the position of the controller held by the user 220 and the position of the head-mounted display worn by the user 220, and based on the change in the acquired position, the motion of the user 220 (the movement of the user 220 ( Rehabilitation operation) is detected.

The display control unit 1412 displays an avatar image 1320 that moves according to the detected rehabilitation motion, a target image that shows the target of the rehabilitation motion, and at least one visual aid image 1333 that improves the visibility of the target image. Display on etc.

The display control unit 1412 superimposes and displays the target image and the visual recognition auxiliary image 1333. For example, the size of the target image is made smaller than the size of the visual aid image 1333, and the target image is displayed so as to be included in the visual aid image 1333.

The display control unit 1412 may display the target image in the vicinity of the center of the visual recognition auxiliary image 1333, for example. Further, the display control unit 1412 includes the target image not in the vicinity of the center of the visual recognition auxiliary image 1333 but in the visual recognition auxiliary image 1333, and further displays the target image on the side closer to the avatar image 1320, that is, on the front side when viewed from the user 220. You may let me.

The display control unit 1412 may display the object 1330 and the visual recognition auxiliary image 1333 so as to be distinguishable. Specifically, for example, the gradation of the object 1330 is displayed darker than the gradation of the visual recognition auxiliary image 1333. As a result, since the object 1330 is displayed darkly, the user 220 can reliably recognize the object 1330 due to a difference in contrast from the lightly displayed visual aid image 1333. The method of adding the gradation to the object 1330 and the visual recognition auxiliary image 1333 is not limited to the method shown here. For example, even the user 220 having weak eyesight may have a method of adding a gradation that can surely distinguish between the object 1330 and the visual recognition auxiliary image 1333.

Further, the display control unit 1412 displays the object 1330 and the visual aid image 1333 in different colors in order to display the object 1330 and the visual aid image 1333 in a distinguishable manner. The display control unit 1412, for example, colors the object 1330 with a dark color and colors the visual recognition auxiliary image 1333 with a light color, but the combination (pattern) of the colors to be colored is not limited to this. For example, even a user 220 with color blindness (color blindness) may be colored with a color combination that can reliably distinguish between the object 1330 and the visual recognition auxiliary image 1333. Further, the display control unit 1412 may be colored so as to be compatible with various types of users 220 such as amblyopia, narrowing of the visual field, and color vision deficiency. The color to be colored in the object 1330 and the visual recognition auxiliary image 1333 may be selected by the user 220 or by an operator such as a doctor.

Although the gradations and colors of the object 1330 and the visual aid image 1333 have been described here, the gradations and colors of the other visual aid images 1340, 1350, 1360, 1370, and 1380 may be changed in the same manner. ..

Further, the display control unit 1412 controls the change of the display of the visual recognition auxiliary image 1333 according to at least one of the visual acuity of the user 220 and the evaluation result by the evaluation unit 1413. For example, the display control unit 1412 changes the size of the visual aid image 1333 according to the visual acuity of the user 220, the progress of rehabilitation of the user 220, the progress of dementia of the user 220, and the like.

The evaluation unit 1413 evaluates the rehabilitation ability of the user 220 by comparing the rehabilitation operation detected by the motion detection unit 1411 with the target position represented by the object 1330 as the target image displayed by the display control unit 1412.

The update unit 1414 updates the target position represented by the object 1330 according to the evaluation result by the evaluation unit 1413.

The display unit 1402 displays a target image, a visibility auxiliary image, and the like under the control of the display control unit 1412. The display unit 1402 is, but is not limited to, a head-mounted display, a display, a screen, and the like.

FIG. 15A is a diagram illustrating an example of a patient table included in the target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. The patient table 1501 stores attribute information 1512, rehabilitation target 1513, current level 1514, and rehabilitation menu 15115 in association with the patient ID (Identifier) 1511. The patient ID 1511 is an identifier for identifying the patient. The attribute information 1512 is information indicating the attributes of the patient such as age and gender. The rehabilitation target 1513 is data indicating which part of the body of the patient is the target of rehabilitation, and is data representing, for example, a part of the body such as an arm or a leg.

Current level 1514 is data indicating the patient's current level of rehabilitation. That is, it is data showing the progress of rehabilitation of the patient. The data is divided into a plurality of ranks, for example, A rank and B rank, from the initial stage to the final stage of rehabilitation. The method of dividing the level of rehabilitation is not limited to this. The rehabilitation menu 1515 is information about the rehabilitation menu that the patient should receive.

Next, FIG. 15B is a diagram illustrating an example of a display parameter table included in the target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. The display parameter table 1502 stores the target image ID 1521, the visual recognition auxiliary image ID 1522, and the display parameter 1523 in association with the rehabilitation menu 1515.

The target image ID 1521 is an identifier that identifies the object 1330 to be displayed on the display unit 1402. The visual recognition auxiliary image ID is an identifier that identifies the visual recognition auxiliary images 1333, 1340, 1350, 1360, 1370, and 1380 to be displayed on the display unit 1402. The display parameter 1523 is a parameter required for displaying the object 1330 and the visual aid images 1333, 1340, 1350, 1360, 1370, and 1380 on the display unit 1402. The display parameter 1523 includes, for example, information such as position and magnification, but the information included in the display parameter 1523 is not limited to these.

FIG. 15C is a diagram illustrating an example of an image table included in the target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. The image table 1503 stores image data 1532, display position 1533, and magnification 1534 in association with image type 1531. The items stored in the image table 1503 are not limited to these.

The image type 1531 is information for distinguishing whether the image to be displayed is a target image or a visual recognition auxiliary image. The image data 1532 is image data such as an object 1330 and a visual recognition auxiliary image 1333 displayed on the display unit 1402, and includes image data in various image file formats. The display position 1533 is data indicating which position in the display unit 1402 should be displayed, and is, for example, a set of data (X coordinate position, Y coordinate position, Z coordinate position). The magnification 1534 is data for determining the size of the display unit 1402 to display the object 1330, the visual recognition auxiliary image 1333, and the like.

Then, the target object recognition improvement server 1401 refers to these tables 1501, 1502, 1503 to display the visual recognition auxiliary images 1333, 1340, 1350, 1360, 1370, and 1380 on the display unit 1402.

FIG. 16 is a block diagram illustrating a hardware configuration of a target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. The CPU (Central Processing Unit) 1610 is a processor for arithmetic control, and realizes the functional component of the target recognition improvement server 1401 of FIG. 14 by executing a program. The ROM (Read Only Memory) 1620 stores fixed data such as initial data and programs, and other programs. Further, the network interface 1630 communicates with other devices and the like via the network. The CPU 1610 is not limited to one, and may be a plurality of CPUs or may include a GPU (Graphics Processing Unit) for image processing. Further, it is desirable that the network interface 1630 has a CPU independent of the CPU 1610 and writes or reads transmission / reception data in the area of the RAM (Random Access Memory) 1640. Further, it is desirable to provide a DMAC (Direct Memory Access Controller) for transferring data between the RAM 1640 and the storage 1650 (not shown). Further, it is desirable that the input / output interface 1660 has a CPU independent of the CPU 1610 and write or read input / output data in the area of the RAM 1640. Therefore, the CPU 1610 recognizes that the data has been received or transferred to the RAM 1640 and processes the data. Further, the CPU 1610 prepares the processing result in the RAM 640, and leaves the subsequent transmission or transfer to the network interface 1630, DMAC, or the input / output interface 1660.

The RAM 1640 is a random access memory used by the CPU 1610 as a temporary storage work area. The RAM 1640 secures an area for storing data necessary for realizing the present embodiment. The patient data 1641 is data regarding a patient undergoing rehabilitation using the target recognition improvement system. The image data 1642 is data such as an object 1330 as a target image and a visual recognition auxiliary image 1333 displayed on the display unit 1402. The display position 1643 is data indicating at which position on the display unit 1402 the object 1330 and the visual recognition auxiliary image 1333 are displayed. The magnification 1644 is data indicating how large an image such as an object 1330 or a visual recognition auxiliary image 1333 is displayed on the display unit 1402. Then, these data are read from, for example, the patient table 1501, the display parameter table 1502, and the image table 1503.

The input / output data 1645 is data input / output via the input / output interface 1660. The transmission / reception data 1646 is data transmitted / received via the network interface 1630. Further, the RAM 1640 has an application execution area 1647 for executing various application modules.

The storage 1650 stores a database, various parameters, and the following data or programs necessary for realizing the present embodiment. The storage 1650 stores a patient table 1501, a display parameter table 1502, and an image table 1503. The patient table 1501 is a table shown in FIG. 15A that manages the relationship between the patient ID 1511 and the attribute information 1512 and the like. The display parameter table 1502 is a table shown in FIG. 15B that manages the relationship between the rehabilitation menu 1515 and the display parameters 1523 and the like. The image table 1503 is a table shown in FIG. 15C that manages the relationship between the image type 1531 and the image data 1532.

The storage 1650 further houses the motion detection module 1651, the display control module 1652, the evaluation module 1653, and the update module 1654.

The motion detection module 1651 is a module that detects the rehabilitation motion of the user 220. The display control module 1652 is a module for displaying an avatar image 1320, an object 1330 as a target image, a visual recognition auxiliary image 1333 for improving the visibility of the object 1330, and the like on the display unit 1402. The evaluation module 1653 is a module for evaluating the rehabilitation ability of the user 220. The update module 1654 is a module that updates the target position represented by the target image according to the evaluation result. These modules 1651 to 1654 are read by the CPU 1610 into the application execution area 1647 of the RAM 1640 and executed. The control program 1655 is a program for controlling the entire target recognition improvement server 1401.

The input / output interface 1660 interfaces input / output data with an input / output device. A display unit 1661 and an operation unit 1662 are connected to the input / output interface 1660. Further, a storage medium 1664 may be further connected to the input / output interface 1660. Further, a speaker 1663 which is an audio output unit, a microphone which is an audio input unit, or a GPS (Global Positioning System) position determination unit may be connected. The RAM 1640 and the storage 1650 shown in FIG. 16 do not show programs or data related to general-purpose functions and other feasible functions of the target recognition improvement server 1401.

FIG. 17A is a flowchart illustrating a processing procedure of the target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. FIG. 17B is a flowchart illustrating a processing procedure for displaying a visual aid image of a target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. These flowcharts are executed by the CPU 1610 using the RAM 1640, and realize the functional component of the target recognition improvement server 1401 in FIG.

In step S1701, the target recognition improvement server 1401 causes the display unit 1402 or the like to display the visual recognition auxiliary image.

In step S1721, the target recognition improvement server 1401 acquires patient information such as the attributes of the patient undergoing rehabilitation and what kind of rehabilitation menu is received by using the target recognition improvement system 1400.

In step S1723, the target object recognition improvement server 1401 acquires display parameters necessary for displaying the visual recognition auxiliary image 1333 or the like to be displayed on the display unit 1402 on the display unit 1402. The display parameters to be acquired are, for example, parameters related to the position and magnification of the visual recognition auxiliary image 1333 and the like.

In step S1725, the target recognition improvement server 1401 acquires the image data of the visual recognition auxiliary image 1333. In step S1727, the target object recognition improvement server 1401 displays the visual recognition auxiliary image 1333 and the like on the display unit 1402.

In step S1729, the target object recognition improvement server 1401 determines whether or not it is necessary to change the display of the visual recognition auxiliary image 1333 or the like. When the display change is not necessary (NO in step S1729), the target recognition improvement server 1401 ends the process. When the display needs to be changed (YES in step S1729), the target recognition improvement server 1401 proceeds to the next step.

In step S1731, the target recognition improvement server 1401 changes the size of the visual recognition auxiliary image 1333 according to the evaluation result of the visual acuity of the user 220 and the rehabilitation ability of the user 220.

According to the present embodiment, in order to reduce the difference between the target distance and the exercise distance, even if the size of the target image is reduced, the target distance and the exercise distance are brought closer to each other while maintaining the visibility of the target image. Therefore, the effect of rehabilitation can be increased. In addition, since the user has a clear feeling when touching the target image, the user can experience the satisfaction of achieving the target.

[Third Embodiment]
Next, the target object recognition improvement system according to the third embodiment of the present invention will be described with reference to FIGS. 18 to 21. FIG. 18 is a block diagram illustrating the configuration of the target object recognition improvement system according to the present embodiment. The target object recognition improvement system according to the present embodiment is different from the above-mentioned prerequisite techniques 1 and 2 in that it has a sound output unit. Since other configurations and operations are the same as those of the first and second embodiments, the same configurations and operations are designated by the same reference numerals and detailed description thereof will be omitted.

The target recognition improvement system 1800 includes a target recognition improvement server 1801 and a sound output unit 1802. The target recognition improvement server 1801 has a sound output control unit 1811. The sound output control unit 1811 controls the sound output according to the positional relationship between the object 1330 as the target image and the avatar image 1320. The sound whose output is controlled by the sound output control unit 1811 is output from the sound output unit 1802.

For example, when the object 1330 is descending from above to below, the sound output control unit 1811 outputs sound based on the distance between the object 1330 and the avatar image 1320, that is, the positional relationship.

As the distance between the object 1330 and the avatar image 1320 decreases, that is, as the object 1330 approaches the avatar image 1320, the output sound may be a high frequency sound. Similarly, as the distance between the object 1330 and the avatar image 1320 increases, that is, as the object 1330 moves away from the avatar image 1320, the output sound may be a low frequency sound. That is, it expresses an acoustic effect in which the frequency of sound (wave) is observed differently according to the distance between the object 1330 (sound source) and the avatar image 1320 (user 220 (observer)), such as the Doppler effect. You may. Instead of changing the frequency of the output sound, the volume of the output sound may be increased or decreased according to the distance between the object 1330 and the avatar image 1320.

Further, the position of the object 1330 may be taught to the user 220 by outputting the sound from the sound output control unit 1811. That is, the position of the object 1330 is taught by using the hearing of the user 220.

For example, consider a case where the user 220 is wearing headphones when using the target recognition improvement system 1800. When the object 1330 as the target image is on the right side of the avatar image 1320 (user 220), the target object recognition improvement server 1801 emits sound from the headphones on the right ear side. Similarly, when the object 1330 is on the left side of the avatar image 1320 (user 220), sound is emitted from the headphones on the left ear side. Thereby, the user 220 can determine whether the object 1330 is on the right side or the left side of the user 220 from the direction of the sound. Further, when the object 1330 is in front of the avatar image 1320 (user 220), sound is emitted from both headphones.

Further, in the above description, the position of the object 1330 is taught by using the visual and auditory senses of the user 220, but the object is given to the user 220 by using the five senses, taste, touch, and smell other than visual and auditory senses. You may teach the position of 1330.

For example, a sensor may be placed on the tongue of the user 220 so that the user 220 can feel the taste according to the position of the object 1330. Alternatively, the controller held by the user 220, the headphones worn by the user 220, the head-mounted display, or the like may be vibrated. That is, the position of the object 1330 may be taught by using the tactile sensation of the user 220.

FIG. 19 is a diagram illustrating an example of a sound table included in the target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. The sound table 1901 stores sound data 1911 in association with the image type 1531. Then, the target recognition improvement server 1801 controls the output sound with reference to the sound table 1901.

FIG. 20 is a diagram illustrating a hardware configuration of a target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. The RAM 2040 is a random access memory used by the CPU 1610 as a temporary storage work area. The RAM 2040 secures an area for storing data necessary for realizing the present embodiment. The sound data 2041 is data relating to the output sound. Then, this data is read from, for example, the sound table 1901.

The storage 2050 stores a database, various parameters, and the following data or programs necessary for realizing the present embodiment. The storage 2050 stores the sound table 1901. The sound table 1901 is a table shown in FIG. 19 that manages the relationship between the image type 1531 and the sound data 1911.

The storage 2050 further stores the sound output control module 2051. The sound output control module 2051 is a module that controls the sound output according to the positional relationship between the object 1330 as the target image and the avatar image 1320. This module 2051 is read by the CPU 1610 into the application execution area 1647 of the RAM 2040 and executed. The RAM 2040 and the storage 2050 shown in FIG. 20 do not show programs or data related to general-purpose functions and other feasible functions of the target recognition improvement server 1801.

FIG. 21A is a flowchart illustrating a processing procedure of the target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. FIG. 21B is a flowchart illustrating a processing procedure of sound output control of the target object recognition improvement server included in the target object recognition improvement system according to the present embodiment. These flowcharts are executed by the CPU 1610 using the RAM 2040, and realize the functional component of the target recognition improvement server 1801 in FIG.

In step S2101, the target recognition improvement server 1801 controls the sound output. In step S2121, the target object recognition improvement server 1801 acquires the position of the avatar image 1320. In step S2123, the target recognition improvement server 1801 acquires the position of the object 1330. In step S2125, the target recognition improvement server 1801 determines the positional relationship between the avatar image 1320 and the object 1330. In step S2127, the target recognition improvement server 1801 controls the sound output according to the determined positional relationship.

According to the present embodiment, since the rehabilitation is performed by using the auditory sense in addition to the visual sense of the user, the user can more easily see the object, and the effect obtained by the rehabilitation can be further enhanced. In addition, the user can grasp the position of the object not only visually but also auditorily. Further, since the sound is output, even a user with weak eyesight can receive the rehabilitation according to the present embodiment.

[Other embodiments]
Although the invention of the present application has been described above with reference to the embodiments, the invention of the present application is not limited to the above-described embodiment. Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the configuration and details of the present invention. Also included in the scope of the present invention are systems or devices in which the different features contained in each embodiment are combined in any way.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention is also applicable when the information processing program that realizes the functions of the embodiment is supplied directly or remotely to the system or device. Therefore, in order to realize the functions of the present invention on a computer, a program installed on the computer, a medium containing the program, and a WWW (World Wide Web) server for downloading the program are also included in the scope of the present invention. .. In particular, at least a non-transitory computer readable medium containing a program for causing a computer to execute the processing steps included in the above-described embodiment is included in the scope of the present invention.

Claims (8)

Motion detection means for detecting the user's first rehabilitation motion,
A display control means for displaying an avatar image that moves according to the detected first rehabilitation motion, a target image that shows the target of the first rehabilitation motion, and a visual recognition auxiliary image that improves the visibility of the target image.
An evaluation means for evaluating the rehabilitation ability of the user by comparing the position of the avatar image with the target position represented by the target image.
An update means for updating the target position according to the evaluation result by the evaluation means, and an update means.
Rehabilitation support system equipped with. The rehabilitation support system according to claim 1, wherein the display control means displays the target image in the vicinity of the center of the visual recognition assist image. The rehabilitation support system according to claim 2, wherein the display control means displays the target image at a position other than the vicinity of the center of the visual recognition assist image. The rehabilitation support system according to claim 1, wherein the display control means displays the target image darker than the visual recognition assist image. The rehabilitation support system according to any one of claims 1 to 4, wherein the display control means displays the target image and the visual recognition assist image in different colors. The rehabilitation support system according to claim 5, wherein the display control means changes the size of the visual aid image according to at least one of the visual acuity of the user and the evaluation result by the evaluation means. The motion detection step in which the motion detection unit of the rehabilitation support system detects the user's first rehabilitation motion, and
An avatar image that moves according to the first rehabilitation motion detected by the display control unit of the rehabilitation support system, a target image showing the target of the first rehabilitation motion, and a visual recognition auxiliary image that improves the visibility of the target image. And the display control step to display
An evaluation step in which the evaluation unit of the rehabilitation support system compares the position of the avatar image with the target position represented by the target image to evaluate the rehabilitation ability of the user.
An update step in which the update unit of the rehabilitation support system updates the target position according to the evaluation result in the evaluation step, and
Rehabilitation support methods including. An operation detection step for detecting the user's first rehabilitation operation, and
A display control step for displaying an avatar image that moves according to the detected first rehabilitation motion, a target image that shows the target of the first rehabilitation motion, and a visual recognition auxiliary image that improves the visibility of the target image.
An evaluation step for evaluating the rehabilitation ability of the user by comparing the position of the avatar image with the target position represented by the target image.
An update step for updating the target position according to the evaluation result in the evaluation step, and an update step.
A rehabilitation support program that lets a computer execute.

Images