JP2023066549A - Rehabilitation support device, rehabilitation support method, and rehabilitation support system - Google Patents

Abstract

To provide a rehabilitation support device capable of determining training contents for obtaining high rehabilitation effect.SOLUTION: A rehabilitation support device 10 includes: an acquisition unit 20 that acquires daily life information, which is information on daily life based on a report of a user undergoing rehabilitation training and objective exercise evaluation information obtained by evaluation of degree of exercise movement performed by the user by a rehabilitation movement evaluation device; a determination unit 30 that determines, on the basis of the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20, contents of guidance and training to be performed by the user U under guidance of an instructor in a rehabilitation facility and contents of self-training to be voluntarily performed by the user U; and an output unit that outputs the guidance and training contents determined by the determination unit 30 and the self-training contents.SELECTED DRAWING: Figure 2

Description

The present invention relates to a rehabilitation support device, a rehabilitation support method, and a rehabilitation support system.

2. Description of the Related Art Conventionally, there has been known a device for determining service contents for users of rehabilitation facilities. Patent Literature 1 discloses a device that determines service content based on information such as a user's ability to perform activities in daily life that is input by the user. Furthermore, Patent Literature 1 discloses that, for example, an improvement in the user's ability to perform activities in daily life can be expected by providing the service content determined by the device to the user.

JP 2019-46474 A

However, the above information is information input by the user, that is, subjective information of the user. Therefore, the above information may not be accurate information, and the determined service content may not be appropriate for the user. In such a case, even if the service content determined by the device is provided, the user's ability to perform daily activities may not be sufficiently improved, and there is a risk that rehabilitation effects may not be obtained. Therefore, it is demanded to provide such users with service contents (for example, rehabilitation training contents) that can obtain a higher rehabilitation effect.

Therefore, the present invention provides a rehabilitation support device and the like that can determine the training content that can obtain a high rehabilitation effect.

A rehabilitation support device according to an aspect of the present invention includes daily life information, which is information about daily life based on a report of a user who undergoes rehabilitation training, and a rehabilitation motion evaluation device that evaluates the degree of exercise motion performed by the user. An acquisition unit that acquires objective exercise evaluation information obtained by evaluation, and the user is provided at a rehabilitation facility under the guidance of an instructor based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit. a determination unit that determines the content of guidance and training to be performed and the content of voluntary training that the user voluntarily performs; and an output unit that outputs the content of guidance and training determined by the determination unit and the content of voluntary training. Prepare.

A rehabilitation support method according to one aspect of the present invention is a rehabilitation support method using a rehabilitation support device, and includes daily life information, which is information related to daily life based on a report of a user undergoing rehabilitation training, and information performed by the user. An acquisition step for acquiring objective exercise evaluation information obtained by evaluating the degree of exercise movement performed by a rehabilitation movement evaluation device, and based on the daily life information and the objective exercise evaluation information acquired by the acquisition step, A determination step of determining the guidance and training content to be performed by the user under the guidance of an instructor in the rehabilitation facility and the self-training content to be voluntarily performed by the user, the guidance and training content determined by the determination step, and the and an output step of outputting the content of the voluntary training.

A rehabilitation support system according to an aspect of the present invention includes the rehabilitation support device described above.

According to the rehabilitation support device and the like of the present invention, it is possible to determine the training content that provides a high rehabilitation effect.

FIG. 1 is a diagram showing a configuration of a rehabilitation support system according to Embodiment 1. FIG. FIG. 2 is a block diagram showing a characteristic functional configuration of the rehabilitation support device according to Embodiment 1. FIG. FIG. 3 is a flowchart showing a processing procedure in which the rehabilitation support device according to Embodiment 1 determines training content for the user. 4A is a diagram showing an example of a screen corresponding to a non-entry table of daily life information according to Embodiment 1. FIG. 4B is a diagram showing an example of a screen corresponding to a table of daily life information for which user's answers are obtained according to Embodiment 1. FIG. FIG. 5 is a diagram showing an example of a screen showing daily activities that require improvement. FIG. 6 is a diagram showing an example of a screen for accepting selection of the detailed life activity that the user is having the most trouble with. FIG. 7 is a diagram showing an example of a screen that accepts selection of information related to the detailed life activity that the user is having the most trouble with. FIG. 8 is a diagram showing an example of a table screen for determining an exercise action to be performed by the user. 9A] FIG. 9A is a flowchart illustrating a processing procedure for determining a short-term goal by a second determining unit according to Embodiment 1. [ FIG. FIG. 9B is a diagram showing an example of a table screen for determining the content of self-training to be performed by the user. FIG. 9C is a diagram showing an example of a screen corresponding to the user's voluntary training content information. FIG. 10 is a diagram showing an example of a screen corresponding to the user's short-term goal information, training content information, and long-term goal information. FIG. 11 is a diagram showing another example of the screen corresponding to the user's short-term goal information, training content information, and long-term goal information. FIG. 12 is a diagram illustrating an example of a screen that receives an operation for changing a long-term goal by the user. FIG. 13 is a diagram showing an example of a screen corresponding to evaluation results. FIG. 14 is a diagram showing an example of a screen showing schedule management information. 15 is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation apparatus according to Embodiment 1. FIG. 16A is a diagram showing one frame of moving image data obtained by photographing a user undergoing rehabilitation training according to Embodiment 1. FIG. FIG. 16B is a diagram in which the skeleton information of the user shown in FIG. 16A is estimated. 17 is a flowchart showing a processing procedure in which the rehabilitation motion evaluation device according to Embodiment 1 evaluates the degree of the user's rehabilitation training motion. FIG. 18A is a diagram showing an example of a screen corresponding to skeleton information of a user estimated by an estimation unit according to Embodiment 1. FIG. FIG. 18B is a diagram showing a process of standardizing multiple joint positions in the skeleton information of FIG. 18A. FIG. 18C is a diagram showing an example of evaluating the degree of rehabilitation training motion based on the standardized multiple joint positions shown in FIG. 18B. FIG. 18D is a diagram showing an example of evaluating the degree of rehabilitation training motion based on a plurality of non-standardized joint positions in the skeleton information shown in FIG. 18A. FIG. 19A is a diagram showing an example of a screen for accepting an operation indicating that settings related to rehabilitation training actions have been completed. FIG. 19B is a diagram illustrating an example of a screen for receiving an operation for starting a rehabilitation training action; FIG. 19C is a diagram showing an example of a screen for evaluating the degree of rehabilitation training action of the user. FIG. 19D is a diagram showing an example of a screen for notifying that the user's rehabilitation training has ended. 19E is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation device according to the modification of Embodiment 1. FIG. 19F is a diagram showing an example of feature amounts calculated by the determination unit according to the modification of Embodiment 1. FIG. 19G is a diagram showing a plurality of joint positions in unknown postures normalized by the normalizing unit according to the modification of Embodiment 1. FIG. 19H is a diagram showing another example of feature amounts calculated by the determination unit according to the modification of Embodiment 1. FIG. 19I is a flowchart showing a processing procedure for evaluating the degree of a user's rehabilitation training motion by the rehabilitation motion evaluation device according to the modification of Embodiment 1. FIG. FIG. 19J is a diagram showing a plurality of joint positions in the trousers raising and lowering training posture standardized by the standardizing unit according to the modification of Embodiment 1; 19K is a diagram showing a plurality of joint positions of unknown postures in the pants raising and lowering training standardized by the standardizing unit according to the modification of Embodiment 1. FIG. 19L is a diagram showing time series changes in the posture of the user U in the trousers raising and lowering exercise according to the modification of Embodiment 1. FIG. 19M is a diagram showing measured values and calculated values of action implementation times in the trousers raising and lowering training according to the modification of Embodiment 1. FIG. FIG. 20 is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation apparatus according to Embodiment 2. FIG. 21 is a flowchart showing a processing procedure for evaluating the degree of a user's rehabilitation training motion by the rehabilitation motion evaluation device according to Embodiment 2. FIG. FIG. 22A is a diagram showing an example of a screen for accepting an operation indicating that settings related to rehabilitation training actions have been completed. FIG. 22B is a diagram showing an example of a screen for accepting an operation for starting a rehabilitation training action. FIG. 22C is a diagram showing an example of a screen for evaluating the degree of the user's rehabilitation training motion. FIG. 22D is a diagram showing another example of a screen for evaluating the degree of rehabilitation training action of the user. FIG. 22E is a diagram showing another example of the screen for evaluating the degree of the user's rehabilitation training action. FIG. 22F is a diagram showing another example of a screen for evaluating the degree of rehabilitation training action of the user. FIG. 22G is a diagram showing an example of a screen for notifying that the user's rehabilitation training has ended.

Hereinafter, embodiments will be specifically described with reference to the drawings. It should be noted that the embodiments described below are all comprehensive or specific examples. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, and the like shown in the following embodiments are examples and are not intended to limit the present invention. Further, among the constituent elements in the following embodiments, constituent elements not described in independent claims will be described as optional constituent elements.

Each figure is a schematic diagram and is not necessarily strictly illustrated. Moreover, in each figure, the same code|symbol is attached|subjected with respect to substantially the same structure, and the overlapping description may be abbreviate|omitted or simplified.

(Embodiment 1)
[Configuration of Rehabilitation Support Device]
A configuration of the rehabilitation support system 1 according to the present embodiment will be described. FIG. 1 is a diagram showing the configuration of a rehabilitation support system 1 according to this embodiment.

The rehabilitation support system 1 is a system for determining and outputting rehabilitation training contents based on user U's daily life information and exercise actions performed by the user U. FIG. In addition, the rehabilitation support system 1 is also a system for evaluating the effect obtained by the user U performing training content. Rehabilitation training is, for example, training aimed at improving the ability of the user U to perform daily activities. In addition, the ability to perform daily activities refers to, for example, the ability of a person to carry out daily life. As a specific example, the rehabilitation support system 1 determines training content for a user U whose ability to perform daily activities has decreased due to aging, illness, or injury, and evaluates the effect of the rehabilitation training performed by the user U.

In addition, two training contents are determined by the rehabilitation support system 1 here. The two training contents are the guidance training contents that the user U performs under the guidance of an instructor in the rehabilitation facility, and the self-training contents that the user U performs voluntarily. Below, the content of guidance training and the content of self-training may be collectively referred to as two training content.

Such a rehabilitation support system 1 is a system operated in a care facility, a medical facility, or the like. A nursing home or a medical facility is, for example, a rehabilitation facility where outpatient rehabilitation is performed. The rehabilitation support system 1 supports work performed by care workers (life counselors, functional training instructors (therapists, nurses, etc.), care helpers, managers of the above facilities, etc.) in the above facility.

As shown in FIG. 1 , the rehabilitation support system 1 includes a rehabilitation support device 10 and an information processing device 100 .

The rehabilitation support device 10 performs rehabilitation based on the daily life information and objective exercise evaluation information obtained by evaluating the degree of exercise performed by the user U with a rehabilitation operation evaluation device (details will be described later). Determine the content of training instruction. Further, the rehabilitation support device 10 determines the self-training contents of the rehabilitation training based on the daily life information and the objective exercise evaluation information. Further, the rehabilitation support device 10 evaluates the effect obtained by the user U performing the two determined training contents. The rehabilitation support device 10 is, for example, a computer, but is not limited to this, and may be a server device.

The information processing device 100 may be a device that includes a display device, a rehabilitation motion evaluation device, and a reception device. The information processing apparatus 100 may be, for example, an information terminal such as a smart phone or a tablet terminal, but is not limited to this.

The information processing device 100 may display, as a display device, two training contents and evaluation results of the effects of the rehabilitation training. Further, the information processing device 100 may display a screen based on screen data output from the rehabilitation support device 10 as a display device.

The display device included in the information processing apparatus 100 is specifically a monitor device configured by a liquid crystal panel, an organic EL panel, or the like. Note that the display device may be a separate device independent of the information processing device 100 .

The rehabilitation motion evaluation device included in the information processing device 100 is a device that obtains objective motion evaluation information by evaluating the degree of motion motion performed by the user U. FIG. The rehabilitation motion evaluation device outputs the obtained objective motion evaluation information to the rehabilitation support device 10 .

For example, the rehabilitation motion evaluation device evaluates the degree of the motion motion (for example, whether the motion motion is successful or not) depending on whether the motion motion performed by the user U satisfies a predetermined motion condition. Here, the exercise motion is a motion for evaluating the user U's ability to perform daily activities. Exercise motions may be motions for people to carry out their daily lives. Further, for example, the exercise motion may be a motion that is performed periodically (for example, once every three months) at a rehabilitation facility. Specifically, the rehabilitation motion evaluation device determines whether or not the user U satisfies the condition of "walking 4m with the assistance of a caregiver" (predetermined motion condition) in "walking" (exercise motion) performed by the user U. evaluate. In other words, the rehabilitation motion evaluation device evaluates whether or not the exercise motion was performed correctly by the user U, and outputs the result to the rehabilitation support device 10 as objective exercise evaluation information. Details of the rehabilitation motion evaluation device will be described with reference to FIG. 15 and subsequent figures.

That is, by evaluating the degree of exercise motion for evaluating the user U's activity in daily life ability by the rehabilitation motion evaluation device, the user U's activity in daily life ability can be evaluated subjectively by the user U as in the prior art. Compared with the case where it is evaluated, the daily life ability of the user U can be evaluated more accurately. Furthermore, by being evaluated by the rehabilitation movement evaluation device in this way, for example, the exercise movement satisfies a predetermined condition, rather than being visually evaluated by a person (for example, a caregiver) for the degree of the exercise movement. It is possible to accurately evaluate whether or not there is an action. In other words, the rehabilitation support device 10 can acquire objective exercise evaluation information that is the result of more accurate evaluation of the user's U ability for activities in daily life.

The reception device included in the information processing device 100 may be a touch panel or hardware buttons. The accepting device may accept an operation for inputting daily life information, for example. The reception device outputs daily life information to the rehabilitation support device 10 based on the received operation. Note that the reception device may receive, for example, an operation related to rehabilitation support from a caregiver and output the operation to the rehabilitation support device 10 .

Here, the daily life information is information related to daily life based on user U's report. The daily life information may include, for example, personal information of the user U and information on daily activities. (Details are explained in FIGS. 4A and 4B). Moreover, since the daily life information is information based on the report of the user U, it can be said that the daily life information is the user U's subjective information regarding daily life. In addition, the daily life information may be information based on the report of the user U's family.

The rehabilitation support device 10 and the information processing device 100 need only be able to transmit and receive information such as objective exercise evaluation information and daily life information. It may be connected so as to be able to communicate wirelessly.

The rehabilitation support device 10 determines two training contents of rehabilitation training based on the daily life information and the objective exercise evaluation information obtained by the rehabilitation motion evaluation device, and outputs the determined two training contents. Moreover, the rehabilitation support apparatus 10 evaluates the effect obtained by the user U performing two training contents. Further, the rehabilitation support device 10 outputs the determined two training contents and the evaluation results obtained by evaluating the effects obtained by the user U performing the two training contents to the information processing device 100, which is a display device.

Therefore, in the rehabilitation support system 1, by evaluating the degree of the exercise motion for evaluating the living activity ability of the user U by the rehabilitation motion evaluation device, whether the exercise motion satisfies a predetermined condition or not. It is possible to accurately evaluate whether or not The rehabilitation support system 1 can determine two training contents of the rehabilitation training based on the accurately evaluated ability of the user U to perform daily activities.

Moreover, the rehabilitation support system 1 can evaluate the effect obtained by the user U performing two training contents.

FIG. 2 is a block diagram showing a characteristic functional configuration of the rehabilitation support device 10 according to this embodiment. The rehabilitation support device 10 includes an acquisition unit 20, a determination unit 30, a first output unit 51 that is an example of an output unit, a first storage unit 41, a first evaluation unit 61, a reception unit 70, and a transmission unit. 71.

The acquisition unit 20 acquires daily life information and objective exercise evaluation information. More specifically, the acquisition unit 20 acquires daily life information and objective exercise evaluation information from the information processing device 100 . The acquisition unit 20 is, for example, a communication interface that performs wired communication or wireless communication.

The acquisition unit 20 may have a first acquisition unit 21 and a second acquisition unit 22 . The first acquisition unit 21 may acquire daily life information, and the second acquisition unit 22 may acquire objective exercise evaluation information. In addition, the second acquisition unit 22 further acquires subjective motor independence information.

The subjective exercise independence degree information is information about the independence degree of the exercise action actually performed by the user U at the user U's home. In other words, the subjective exercise independence information is the result indicating the independence degree of the exercise action actually performed by the user U himself/herself at home. Specifically, the subjective exercise independence information means that when the user U himself/herself "moves from the living room to the toilet", the "walking" (exercise movement) actually performed by the user U is "independent", This is information indicating which of "watching", "partial assistance", and "full assistance" applies. The degree of independence in motor movement decreases in the order of independence, watching over, partial assistance, and full assistance. In addition, when the user U is completely assisted (for example, bedridden), the user U's caregiver (for example, the user U's family) performs exercise motions. That is, the exercise motion may be a motion performed by the user U, or may be a motion performed by the user U and the user U's assistant. Also, as will be described later, the subjective exercise independence information is information based on a predetermined question and an answer to the question (details are shown in FIG. 7). Note that the second acquisition unit 22 may acquire the subjective motor independence degree information from the user U via the information processing device 100, which is a reception device. A certain amount of information based on U's inference may be included.

Based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20, the determination unit 30 determines the instruction and training contents of the rehabilitation training performed by the user U. Also, the determination unit 30 is a processing unit that determines the content of self-training based on the daily life information and the objective exercise evaluation information.

The decision unit 30 is specifically implemented by a processor, microcomputer, or dedicated circuit. Note that the content determined by the determination unit 30 may be output to the first output unit 51 .

The decision unit 30 may have a first decision unit 31 and a second decision unit 32 . The first determination unit 31 may determine the exercise motion based on the daily life information acquired by the first acquisition unit 21 . second
The decision unit 32 decides the contents of guidance and training based on the objective exercise evaluation information acquired by the second acquisition unit 22, and compares the daily life information acquired by the first acquisition unit 21 with the objective information acquired by the second acquisition unit 22. It is preferable to determine the contents of voluntary training based on the exercise evaluation information.

The second determination unit 32 may determine a short-term goal, which is a predetermined short-term rehabilitation goal of the user U, based on the difference between the subjective exercise independence degree information and the objective exercise evaluation information. The short-term goal may be a goal that the user U aims for after a predetermined period (for example, three months) from the start time of the rehabilitation training by the user U receiving the rehabilitation training. Also, the period is not limited to three months. The second determination unit 32 may determine a long-term goal, which is a predetermined long-term rehabilitation goal of the user U, based on the short-term goal. A long-term goal is a goal for a longer period than a short-term goal, and may be, for example, a goal that the user U aims for six months after a predetermined time. Note that the content determined by the first determination unit 31 and the second determination unit 32 may be output to the first output unit 51 as in the determination unit 30 .

The determination unit 30 (more specifically, the first determination unit 31) collates the daily life information acquired by the first acquisition unit 21 with the reference data 45 stored in the first storage unit 41, and uses the information. The exercise action performed by the person U is determined.

The determination unit 30 (more specifically, the second determination unit 32) collates the objective exercise evaluation information acquired by the second acquisition unit 22 with the reference data 45 stored in the first storage unit 41. , determine the training contents (two training contents) that the user U performs. Further, the determination unit 30 (more specifically, the second determination unit 32) stores the difference between the subjective exercise independence degree information and the objective exercise evaluation information acquired by the second acquisition unit 22, and stores the Based on stored information relating to user U, short-term goals for user U may be determined.

The first storage unit 41 is a storage device in which reference data 45 is stored. The details of the reference data 45 will be described later with reference to FIGS. 8 and 9B, but the reference data 45 includes, for example, daily life information and exercise movements, which are used to determine the exercise movements performed by the user U. It is data showing the relationship between The first storage unit 41 is implemented by, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a semiconductor memory, a HDD (Hard Disk Drive), or the like.

Further, in the first storage unit 41, the programs executed by the determination unit 30, the first evaluation unit 61, the reception unit 70, and the transmission unit 71, and the relevant Screen data showing information is also stored.

Furthermore, the information related to the user U acquired by the acquisition unit 20 may be associated with each user U and stored in the first storage unit 41 . The information related to the user U includes daily life information, subjective motor independence degree information, objective motor evaluation information, information on the detailed daily activities that the user U has the most trouble with, and It includes information related to the detailed life activity that U is most troubled by, exercise activity information, etc. (details will be described later).

The first evaluation unit 61 is a processing unit that evaluates the effects obtained by the user U performing two types of training. The first evaluation unit 61 is specifically implemented by a processor, microcomputer, or dedicated circuit.

For example, the first evaluation unit 61 compares the objective exercise evaluation information before and after the user U performs the two training contents of the rehabilitation training, thereby determining the effects obtained by performing the two training contents. may be evaluated. Specifically, the objective exercise evaluation information before the user U performs the two training contents may be the objective exercise evaluation information on the day when the user U started the rehabilitation training. Further, the objective exercise evaluation information after the user U has performed the two training contents may be the objective exercise evaluation information on the day when three months have passed since the user U started the rehabilitation training. In this way, the first evaluation unit 61 evaluates the effect obtained by the user U performing two training contents for a certain period of time (for example, three months). The first evaluation unit 61 stores the objective exercise evaluation information obtained by the obtaining unit 20 after the user U has performed two types of rehabilitation training, and The effect may be evaluated by comparing the objective exercise evaluation information before performing the two training contents of the training. The evaluation result evaluated by the first evaluation unit 61 may be output to the first output unit 51 .

The first output unit 51 outputs the two training contents determined by the determination unit 30 and the evaluation result evaluated by the first evaluation unit 61 to the information processing device 100, which is a display device. The first output unit 51 is, for example, a communication interface that performs wired communication or wireless communication.

The reception unit 70 is a processing unit that receives evaluation of the rehabilitation support device 10 from the user who uses the rehabilitation support device 10 . For example, the reception unit 70 receives evaluations from users via the information processing device 100, which is a reception device.

The user is a person who uses the rehabilitation support device 10 to guide the rehabilitation training that the user U undergoes, and may be, for example, a physical therapist or an occupational therapist. is an instructor. Also, the user may be a caregiver. Additionally, the user may be a physical therapist, an occupational therapist, or a person who assists a caregiver. The evaluation is a score indicating the degree of goodness such as ease of use of the rehabilitation support system 1, and the evaluation may be, for example, the number of stars indicating the degree of goodness, such as "GOOD" or " It may be an opinion such as "BAD".

The transmission unit 71 is a processing unit that transmits the evaluation received by the reception unit 70 to the administrator of the rehabilitation support device 10 .

The transmitter 71 is specifically implemented by a processor, microcomputer, or dedicated circuit. When the transmission unit 71 transmits the evaluation to the administrator, the communication used may be wired communication or wireless communication.

The administrator of the rehabilitation support device 10 is a natural person or a corporation that manages the rehabilitation support device 10 and provides it as a service. The administrator is, for example, the developer of the rehabilitation support device 10, and the administrator uses the transmitted evaluation from the user to improve the ease of use of the rehabilitation support device 10 and the like.

The reception unit 70 and the transmission unit 71 allow the administrator of the rehabilitation support device 10 to obtain an evaluation of the rehabilitation support device from the user who uses the rehabilitation support device 10 .

Note that the determination unit 30, the first evaluation unit 61, the reception unit 70, and the transmission unit 71 may be implemented by a single processor, microcomputer, or dedicated circuit having the respective functions. Also, the determination unit 30, the first evaluation unit 61, the reception unit 70, and the transmission unit 71 may be realized by a combination of two or more of processors, microcomputers, or dedicated circuits.

[Processing Procedure of Rehabilitation Support Method]
Next, a specific processing procedure in the rehabilitation support method executed by the rehabilitation support device 10 will be described.

FIG. 3 is a flow chart showing a processing procedure in which rehabilitation support device 10 according to the present embodiment determines training content for user U. As shown in FIG. More specifically, the rehabilitation support device 10 determines a short-term goal, two training contents, and a long-term goal of the user U, and evaluates the effects obtained by the user U performing the two training contents. It is a flow chart showing.

First, the acquisition unit 20 (more specifically, the first acquisition unit 21) acquires daily life information of the user U via the information processing device 100 (step S10). FIG. 4A is a diagram showing an example of a screen corresponding to an unanswered table of daily life information according to the present embodiment. FIG. 4B is a diagram showing an example of a screen corresponding to a table of daily life information for which user U's answer is obtained according to the present embodiment.

Rehabilitation support device 10 acquires screen data of a screen corresponding to FIG. can be output to Then, a screen for accepting user U's daily life information is displayed on the display device. Thereby, information processing apparatus 100, which is a reception apparatus, may be able to receive daily life information.

At this time, the information processing apparatus 100 receives an operation for inputting daily life information, which is information based on the user U's declaration, as a reception apparatus. The accepting device outputs daily life information to the acquiring unit 20 based on the accepted operation. The person who operates the reception device may be the user U or a family member of the user U. In addition, the person who operates the reception device may be a caregiver who visits the home of the user U, obtains daily life information from the user U and the user U's family, and uses the reception device. The information processing apparatus 100 may receive daily life information by operating. In addition, hereinafter, up to step S22 to be described later, the procedure may be performed when a caregiver in charge of user U (for example, a lifestyle counselor) visits user U's home.

As shown in FIGS. 4A and 4B, the daily life information may include personal information of the user U and information on daily activities. The user U's personal information includes the user's U name, date of birth, sex, level of care, the name of the user's U care worker, and the like. Although not shown in FIGS. 4A and 4B, the user U's personal information may include user U's medical history information. The medical history information is information about the medical history of the user U, for example, information about the past and current morbid and health conditions of the user U.

Furthermore, the information on daily activities is information on daily activities described below. Activities of daily living include activities of daily living (ADL), instrumental activities of daily living (IADL), and activities of daily living.

Activities of daily living include eating, excretion, bathing, dressing, grooming, and transferring. Instrumental activities of daily living include indoor locomotion, outdoor locomotion, stair climbing, cooking, washing and cleaning. Sitting includes the actions of sitting, sitting, standing and standing.

The living activity information includes independence level information, which is information about the independence level of the user U's living activities, task information, and situation and living task information about the living activities. In addition, the information on daily living activities and daily living activities related to instrumental daily living activities further includes information on the environment (place of implementation/assistive equipment).

The degree of independence of the user U decreases in order of independence, watching over, partial assistance, and full assistance, for example. The information on the task of the daily activities for which the user U's degree of independence is equal to or lower than watching over includes the information that there is a task. The information on the environment (implementation status/assistive device) includes information on the type of assistive device or usage status, a caregiver, and the implementation status at home.

Information on situations and life tasks includes information summarized for each of activities of daily living, instrumental activities of daily living, and living.

As described above, the acquisition unit 20 acquires daily life information and outputs the acquired daily life information to the determination unit 30 .

The determination unit 30 (more specifically, the first determination unit 31) determines daily activities that require improvement based on the daily life information output by the acquisition unit 20 (step S11). Specifically, the determining unit 30 extracts the living activity having a problem in the information on the living activity included in the daily life information. For example, as shown in FIG. 4B, the determining unit 30 extracts changing, transferring, moving indoors, and moving outdoors as life activities with problems. The determining unit 30 determines the daily activities that require improvement from among the extracted daily activities that have problems.

The determination unit 30 may determine a living activity that requires improvement based on the independence level information. In other words, the determining unit 30 may determine a living activity with a low degree of independence and a living activity that requires improvement. Further, the determination unit 30 may determine, among the daily activities, a more basic activity as a daily activity that needs to be improved preferentially. The determining unit 30, for example, prioritizes cleaning, washing, cooking, outdoor movement, grooming, bathing, dressing, eating, excretion, stair climbing, indoor movement, transfer, standing position, standing up, sitting position, and getting up in order of priority ( It may be determined as a daily life activity that requires improvement.

Specifically, the determination unit 30 may determine indoor movement and outdoor movement, which have the lowest degree of independence among the extracted daily activities with issues, as daily activities requiring improvement. Furthermore, the determination unit 30 may determine indoor movement, which is a more basic movement, as a living movement that requires improvement, out of indoor movement and outdoor movement.

In this way, the determining unit 30 (more specifically, the first determining unit 31) determines the daily activities that require improvement based on the independence level information, thereby preferentially improving more basic activities. can be determined as necessary life activities.

The determination unit 30 may output to the first output unit 51 the information on the daily activities including the determined daily activities requiring improvement.

The first output unit 51 outputs information on the daily activities determined by the determination unit 30 (step S12). In step S12, the first output unit 51 acquires, for example, the screen data of the screen corresponding to the life activity requiring improvement determined by the determination unit 30 in step S11 from the first storage unit 41, and acquires it to the display device. send the screen data. FIG. 5 is a diagram showing an example of a screen showing daily activities that require improvement.

Information processing apparatus 100, which is a display device, displays a screen showing daily activities that require improvement. As shown in FIG. 5, the daily activities that need improvement determined by the determining unit 30 may be displayed on the screen with priority. In the example shown in FIG. 5, indoor movement, outdoor movement, and grooming are shown in descending order of priority. In addition, as shown in FIG. 5, independence level information may be displayed. The degree of independence in each living activity may be displayed according to four levels of independence, watching over, partial assistance, and total assistance. Specifically, a bar indicating the degree of independence may be displayed below each circled living activity, and the higher the degree of independence, the more the bar may be filled with dots.

At this time, the information processing apparatus 100 may serve as a reception apparatus and receive from the user U an operation for selecting whether or not the life activity requiring improvement determined by the determination unit 30 in step S11 is appropriate. For example, the life activity that needs improvement determined by the determining unit 30 may be changed when the user U determines that the activity is inappropriate. As shown in FIG. 5, characters such as "Please select the life activity you want to maintain/improve most" may be displayed. If the user U determines that the life activity that needs improvement determined by the determination unit 30 is appropriate, the process proceeds to the next step.

Subsequently, the acquisition unit 20 (more specifically, the first acquisition unit 21) acquires detailed information on the most troublesome daily activities of the user U (step S20). Further, the acquisition unit 20 (more specifically, the first acquisition unit 21) acquires subjective motor independence degree information (step S20).

Here, the information processing apparatus 100, as a reception apparatus, receives from the user U an operation for inputting detailed daily activities that the user U is having the most trouble with. For the sake of simplification, "detailed daily activities" are also referred to as "detailed daily activities". The accepting device outputs to the acquiring unit 20 information on the detailed daily activities that the user U is most concerned about based on the accepted operation. The detailed living activity is an activity obtained by subdividing the living activity. For example, indoor movement, which is a living activity, includes specific examples such as "moving within the living room", "moving from the living room to the toilet", and "moving from the living room to the kitchen".

The detailed living activity that the user U is most troubled with is the most difficult and specific activity for the user U among the living activities that require improvement. FIG. 6 is a diagram showing an example of a screen that accepts selection of the detailed life activity that the user U is having the most trouble with. As described above, when it is determined that the detailed living activity requiring improvement is moving indoors, the information processing apparatus 100 displays the screen shown in FIG. In addition, as described above, the detailed living activity that the user U is most troubled by is determined by the living activity that requires improvement, and the living activity that requires improvement is determined by the independence level information. Furthermore, the daily life information includes independence degree information. Therefore, the detailed life activity information that the user U is most concerned about is information based on the daily life information.

The user U or the caregiver selects the detailed life activity that the user U is having the most trouble with. For example, as shown in FIG. 6, "move from living room to toilet" is selected, and the information processing apparatus 100 sends information on the selection to the acquisition unit 20 (that is, the details of the user U's greatest difficulty). daily life activity information).

Next, the acquisition unit 20 (more specifically, the first acquisition unit 21) acquires information on the detailed daily activities that the user U is having the most trouble with. The acquisition unit 20 outputs the acquired information on the detailed daily activities that the user U is having the most trouble with to the determination unit 30 .

Subsequently, the determining unit 30 determines the content of the question of information related to the detailed daily activities that the user U is most troubled by, based on the information on the detailed daily activities that are most troublesome for the user U. For example, when the detailed living activity that the user U is having the most trouble with is "moving from the living room to the toilet", the question is "Do you go to the toilet by yourself?" . For example, the determination unit 30 collates the information of the detailed life activity that the user U is most troubled with the data stored in the first storage unit 41, and determines the detailed life activity that the user U is most troubled by. Determine relevant information questions. At this time, the data stored in the first storage unit 41 include information on the detailed daily activities that the user U is most troubled by, and question contents of information related to the detailed daily activities that the user U is most troubled by. are stored in association with each other.

In addition, at this time, the first storage unit 41 may store detailed information on the daily activities that the user U is having the most trouble with in association with the user U.

The determination unit 30 outputs the determined question content to the first output unit 51 .

The first output unit 51 outputs the question content determined by the determination unit 30 . At this time, the first output unit 51 acquires, for example, screen data of a screen showing the obtained question content from the first storage unit 41 and transmits the acquired screen data to the display device.

Here, further, the information processing apparatus 100, as a receiving apparatus, receives an operation for inputting information related to the detailed daily activities that the user U is having the most trouble with. FIG. 7 is a diagram showing an example of a screen for accepting selection of information related to the detailed daily activities that the user U is having the most trouble with. The information includes, for example, information on the environment in which detailed activities in daily life are most difficult for the user U, and information on the current level of detailed activities in daily life.

The implementation environment information includes information on the degree of independence of a series of detailed living activities that the user U is most troubled by, and information on the user U's home environment for the detailed living activities.

The information on the degree of independence of a series of detailed daily activities with which the user U is most troubled represents, for example, the need for assistance and the need for assistive devices when the user U performs the detailed daily activities. Information. Specifically, the information on the degree of independence of a series of detailed daily activities that the user U is having the most trouble with is, for example, "1) Do you go to the bathroom by yourself?" shown in FIG. ) to 4)” and their answers.

Here, the subjective motor independence information will be described. The subjective motor independence level information is information based on the questions "1) to 3)" about the detailed daily activities that the user U is having the most trouble with and the answers to the questions shown in FIG. Specifically, when the answer to 1) is "doing it alone" and the answer to 2) is "no", the subjective motor independence degree is independence. If the answer to 1) is "doing it alone" and the answer to 2) is "yes", the subjective degree of motor independence is watching over. When the answer to 1) is "I am being helped by someone" and the answer to 3) is "only some movements", the subjective degree of motor independence is partial assistance. When the answer to 1) is "I am being helped by someone" and the answer to 3) is "while moving", the subjective degree of motor independence is total assistance. The subjective motor independence degree thus obtained is included in the subjective motor independence degree information. Also, the subjective motor independence degree may be associated with a score. For example, in the subjective degree of motor independence, full assistance is 1 point, partial assistance is 2 points, watching is 3 points, and independence is 4 points. Note that the subjective motor independence degree is also expressed as a subjective motor independence degree score by being associated with a score.

The information on the home environment is information on the environment of the user U's home. The home environment information is, for example, information about the moving distance, steps, or stairs when the user U performs the detailed daily activities. The home environment information is specifically questions such as "5) home environment" shown in FIG. 7 and answers to the questions. As described above, when the caregiver in charge of user U visits user U's home, by obtaining information on the home environment of user U, when the caregiver does not visit user U's home, In comparison, the rehabilitation support device 10 can acquire information on the home environment of the user U with higher accuracy.

The information on the level of detailed living activities is information summarizing the information on the implementation environment, and as shown in FIG. 7, detailed living activities that the current user U can perform are indicated. Specifically, the level of the detailed living activity is determined by the detailed living activity that the user U is most troubled by (“from the living room to the bathroom”), the degree of independence of the series of activities (“partial assistance”), and the assistive device (“ handrail”) and the home environment (a person can move a distance of “5 m” over a “step”). Here, the assistive devices are, in descending order of difficulty, none, canes, handrails/supports, walkers, and wheelchairs.

The information processing device 100, as a reception device, outputs to the acquiring unit 20 information on the detailed living activity that the user U has the most trouble with and information related to the detailed living activity that the user U has the most trouble with. .

In this way, the acquiring unit 20 (more specifically, the first acquiring unit 21) obtains the information related to the detailed daily activities that the user U is most troubled by and the information related to the detailed daily activities. Acquire home environment information and subjective motor independence level information. The first acquisition unit 21 determines information related to the detailed living activity that the user U is most troubled by, home environment information included in the information related to the detailed living activity, and subjective motor independence level information. Output to unit 30 .

The determination unit 30 (more specifically, the first determination unit 31) determines an exercise motion based on daily life information (step S21). More specifically, the first determining unit 31 divides each of the daily activities based on the detailed information on the most troublesome daily activities of the user U and the information on the home environment. A motion may be determined as an athletic motion.

It should be noted that, as described above, the information related to the detailed living activity that the user U is most concerned about includes information on the home environment. The information related to the detailed life activity most troubled by the user U is information based on the detailed life activity information most troubled by the user U, and the information of the detailed life activity most troubled by the user U. The information based on is information based on information on living activities that need to be improved. Furthermore, the information on living activities requiring improvement is information based on daily life information including information on the degree of independence. Therefore, the information related to the detailed daily activities that the user U is most concerned about is information based on the daily life information. The information related to the detailed daily activities that the user U is having the most trouble with may include the daily activities that require improvement.

The first determination unit 31 collates the daily life information with the reference data 45 stored in the first storage unit 41, and determines the exercise action that the user U performs. More specifically, the first determination unit 31 collates the detailed information on the living activity that is most troublesome for the user U and the information on the home environment with the reference data 45 stored in the first storage unit 41. Then, the exercise motion (here, composition motion) performed by the user U is determined.

Here, the configuration operation will be described using FIG. 8, which is an example of the reference data 45. FIG. FIG. 8 is a diagram showing an example of a table screen for determining the exercise action to be performed by the user U. As shown in FIG. More specifically, in the table shown in FIG. 8, daily activities, detailed daily activities, constituent actions, criteria for judging the degree of independence of constituent actions, and training content (guidance training content) are associated with each other. written as is. The constituent motions are motions obtained by subdividing each motion of the daily life motions. More specifically, the constituent motions are motions obtained by subdividing each motion of the detailed living motions linked to the daily living motions. Note that the criteria for judging the degree of independence of constituent motions and the content of training (contents of guidance training) will be described in step S30 and later.

The first determination unit 31 determines the constituent motion linked to the detailed daily life activity that the user U is having the most trouble with as an exercise motion that is a motion for evaluating the user U's ability for daily activities. For example, if the life activity that needs improvement is "moving indoors" and the detailed life activity that the user U is having the most trouble with is "moving from the living room to the bathroom", the constituent motions are "walking" and "direction Examples include, but are not limited to, "change", "straddle", and "stair (step) ascending and descending". Although not shown in FIG. 8, when the detailed living action is "moving from the living room to the toilet", the constituent actions further include actions such as "opening and closing the sliding door" and "opening and closing the hinged door". may In addition, the table may include other living activities and constituent activities (not shown in FIG. 8). For example, if the daily activity is "bathing", the associated constituent action may be "wash the front of the body", "wash the hair with shampoo", and the like.

As described above, since the first determination unit 31 determines the exercise motion based on the daily life information, the first determination unit 31 selects a more suitable exercise motion in order to evaluate the ability of the user U to perform daily activities. can decide.

In addition, the first determination unit 31 determines constituent motions obtained by subdividing each movement of the daily activities as exercise actions, and the constituent actions are evaluated. can be evaluated more accurately.

When the first determining unit 31 determines an exercise motion, the first determining unit 31 selects a predetermined motion among the constituent motions based on information related to the detailed daily life motion that the user U is most troubled with or medical history information. By exclusion, the constituent motions are determined as motion motions. The predetermined motion is, for example, a motion that is recommended to be avoided based on the medical history. Further, the predetermined action is an action that the user U does not need to perform from the user U's home environment.

Specifically, as shown in FIG. 7, in the home environment of the user U, if there are no stairs in the "movement from the living room to the toilet", the constituent action "up and down the stairs (step)" is excluded. Then, constituent motions of "walking", "turning direction" and "crossing" are determined as exercise motions. Further, if there is a motion to be avoided based on the medical history information, a predetermined motion is excluded from the constituent motions to determine the exercise motion. Also, if a predetermined motion is excluded, an alternative motion may be determined as the exercise motion.

As a result, the rehabilitation support device 10 can determine constituent motions by excluding unnecessary motions based on the home environment or the medical history. In other words, the rehabilitation support device 10 can determine exercise motions (compositional motions) that do not harm the health of the user U, and therefore can more accurately evaluate the user's U ability to perform daily activities.

Furthermore, in step S21, the first storage unit 41 may associate the subjective motor independence degree information with the user U and store it.

The determination unit 30 (more specifically, the first determination unit 31 ) outputs exercise motion information, which is information on the determined exercise motion, to the first output unit 51 .

The first output unit 51 outputs the exercise motion information determined by the determination unit 30 (step S22). In step S22, the first output unit 51 acquires from the first storage unit 41, for example, the screen data of the screen showing the constituent motion included in the exercise motion information determined by the determination unit 30 in step S21, and displays the data. Send the acquired screen data to the device. Also, at this time, the first output unit 51 stores the screen data of the screen for accepting the subjective exercise independence degree information from the user U with respect to the component motion included in the exercise motion information determined by the determination unit 30 to the first storage unit 41 . , and the acquired screen data may be transmitted to the display device.

The information processing device 100, which is a display device, displays a screen showing an exercise action. On the screen showing the exercise action, for example, the content of three constituent actions of "walking", "turning direction" and "stepping over" is displayed as the exercise action.

In addition, as described above, when the caregiver in charge of the user U visits the user U's home, the above processing may be performed. Furthermore, the following processes may be performed, for example, when the user U visits a rehabilitation facility.

Next, the acquisition unit 20 (more specifically, the second acquisition unit 22) acquires facility information and objective exercise evaluation information (step S30). In addition, facility information is information which shows the training equipment installed in the rehabilitation facility. The details of the facility information will be explained in the process of determining the content of voluntary training. Here, a process of acquiring the objective exercise evaluation information by the second acquisition unit 22 via the information processing device 100 will be described.

The information processing device 100, as a rehabilitation movement evaluation device, evaluates the constituent movement performed by the user U and obtains objective movement evaluation information. More specifically, the information processing apparatus 100 evaluates whether or not each constituent motion of "walking", "changing direction", and "straddling" performed by the user U satisfies a predetermined exercise condition. For example, the information processing apparatus 100 performs image processing on moving image data obtained by photographing a user U performing a composing action, and the composing action performed by the user U is based on the determination criteria for the degree of independence of the composing action (described in FIG. 8). The degree of autonomy of the composition operation may be determined by evaluating whether or not the condition is satisfied. In other words, the above-mentioned predetermined exercise conditions are the conditions shown in the criteria for judging the degree of independence of constituent motions shown in FIG. Moreover, the following is described as a specific example. The information processing apparatus 100 does not satisfy the requirement of "walking speed is 40 cm/s or less, or is 40 cm/s or more but the balance function test is watching over" for the constituent action "walking", and "can walk 4 m with the help of a caregiver". If it is satisfied, the degree of independence of the composition operation is evaluated as 2 points. The evaluation method performed by the information processing apparatus 100 is not limited to the above, but will be described in detail with reference to FIG. 15 and subsequent figures.

Here, the objective exercise evaluation information is the result of evaluating the independence degree of the composition motion according to the independence degree judgment criteria for the composition motion shown in FIG. In addition, the degree of independence of the constituent motion is also expressed as an objective motion evaluation score.

The objective exercise evaluation information includes objective exercise evaluation score information for all constituent actions performed by the user U.

The information processing device 100 outputs the evaluated objective exercise evaluation information to the acquisition unit 20 of the rehabilitation support device 10 .

The same assistive device may be used for both the subjective exercise independence information and the objective exercise evaluation information. At this time, the assistive tool may be an assistive tool (for example, a handrail/support) included in the information related to the detailed daily activities that the user U is having the most trouble with, as shown in FIG. 7 . Further, the information processing apparatus 100, as a reception apparatus, may receive an operation from the user U to select whether or not the aid is appropriate. For example, if the user U determines that the assistive device is inappropriate, the assistive device may be changed.

As described above, the second acquisition unit 22 acquires objective exercise evaluation information. The second acquisition unit 22 outputs the acquired objective exercise evaluation information to the determination unit 30 .

The determination unit 30 (more specifically, the second determination unit 32) determines the instruction and training content based on the objective exercise evaluation information acquired by the second acquisition unit 22 (step S31). Further, the determination unit 30 (more specifically, the second determination unit 32) performs voluntary training based on the daily life information acquired by the first acquisition unit 21 and the objective exercise evaluation information acquired by the second acquisition unit 22. The content is determined (step S31). Here, a processing procedure in which the determination unit 30 determines a short-term goal, two training contents, and a long-term goal will be described.

First, the second determination unit 32 determines a short-term rehabilitation goal, which is a predetermined short-term rehabilitation goal of the user U, based on the difference between the objective exercise evaluation information and the subjective exercise independence degree information. More specifically, the second determination unit 32 stores the difference between the subjective exercise independence degree information stored in the first storage unit 41 and the objective exercise evaluation information acquired by the second acquisition unit 22, A short-term goal may be determined based on information related to user U stored in unit 41 . Here, as the information related to the user U, information on the level of the detailed daily activities that the user U has the most trouble with may be used. FIG. 9A is a flowchart showing a processing procedure for determining a short-term goal by the second determination unit 32 according to this embodiment.

The second determination unit 32 compares the objective exercise evaluation information and the subjective exercise independence information (step S311). Specifically, the second determination unit 32 compares the objective motor evaluation score and the subjective motor independence score. The second determination unit 32 compares the objective motion evaluation score and the subjective motion independence score for, for example, "walking", "turning direction", and "stepping over", which are one of the component motions. Note that, as described above, the subjective motor independence degree information includes the subjective motor independence degree points for the detailed daily activities that the user U has the most trouble with, and does not include points for individual constituent actions. not Therefore, here, the subjective motor independence score for each of the constituent motions is the same as the subjective motor independence score for the detailed daily life motion that the user U is having the most trouble with. Specifically, when the subjective motor independence score for the detailed daily activities that the user U has the most trouble with is 2 points, the subjective motor independence scores for the constituent motions of “walking”, “turning” and “stepping over” are calculated. The degree of motor independence score is "walking": 2 points, "direction change": 2 points, and "stepping": 2 points.

Next, the second determining unit 32 determines whether or not the objective motor evaluation score is equal to or higher than the subjective motor independence score for all constituent motions (step S312).

First, the case where the objective motor evaluation score is equal to or higher than the subjective motor independence score in all constituent motions (Yes in step S312) will be described. In this case, the second determining unit 32 determines, as a short-term goal, a level obtained by increasing the degree of independence of detailed activities of daily living at the level of the detailed activities of daily living which is the most troublesome for the user U (step S313).

The case of “Yes in step S312” specifically means that, as shown in FIG. , and the subjective motor independence score is “walking”: 2 points, “turning”: 2 points, and “stepping”: 2 points.

Note that the user U's objective exercise evaluation score and subjective exercise independence score may be processed into a graph such as a radar chart and displayed on the display device, as shown in FIG. 9A. In this graph, the outermost triangle represents independence (4 points), and as the triangles move inward, each triangle represents watching over (3 points), partial assistance (2 points), and the center point of the triangle. may represent total assistance (1 point).

In this case, the second determination unit 32 determines, as a short-term goal, a level obtained by increasing the degree of independence of the detailed activities of daily living at the level of the detailed activities of daily living at which the user U is most troubled. As shown in FIG. 7, the level of the detailed living activity that the current user U is most troubled by is, for example, "From the living room to the toilet" with "partial assistance" using the "handrail" and the distance of "5m". can move over the "step". Therefore, the second decision unit 32 decides that ``the user can move ``from the room to the toilet'' using the ``handrail'' while ``watching'' over the ``step'' for a distance of ``5m'' as a short-term goal.

On the other hand, a case in which the objective motor evaluation score is not equal to or higher than the subjective motor independence score in all constituent motions (No in step S312) will be described. That is, at least one of the objective motor evaluation scores is less than the subjective motor independence score. In this case, the second determining unit 32 determines a level that maintains the degree of independence of the detailed activities of daily living at the level of the detailed activities of daily living at which the user U is most troubled, as a short-term goal (step S314).

Specifically, as shown in FIG. 9A, the case of "No in step S312" means that the objective exercise evaluation points are "walking": 3 points, "direction change": 1 point, "stepping": 2 points. and the subjective motor independence score is "walking": 2 points, "change of direction": 2 points, and "stepping": 2 points.

In this case, the second determination unit 32 determines a level that maintains the degree of independence of the detailed activities of daily living at the level of the detailed activities of daily living at which the user U is most troubled, as a short-term goal. In other words, the second determining unit 32 determines the level of the detailed living activity that the current user U is most troubled by, which is the level of "from the living room to the toilet" with "partial assistance" using the "handrail" and the distance of "5 m". be able to move over the “step” as a short-term goal.

In this way, the rehabilitation support device 10 can determine the difference between the user U's own activity in daily life based on the exercise action performed by the user U at home and the activity in life accurately evaluated by the rehabilitation action evaluation device. and then set short-term goals.

It should be noted that if the objective motor evaluation score is equal to or higher than the subjective motor independence score in all of the constituent motions (Yes in step S312), the short-term goal is not limited to the above. For example, the second determination unit 32 may determine, as a short-term goal, a level obtained by increasing the level of difficulty of the assistive device by one level at the level of the detailed daily activities that the user U is having the most trouble with.

Subsequently, the second determination unit 32 determines two training contents.

First, the second determination unit 32 determines the content of guidance and training based on the objective exercise evaluation information acquired by the second acquisition unit 22 .

The objective exercise evaluation information is information obtained by evaluating the degree of the exercise action performed by the user U (that is, the constituent action) by the rehabilitation action evaluation device. Further, the constituent motions are motions obtained by subdividing each motion of the daily life motions, and are motions determined as exercise motions based on the daily life information as described above.

That is, here, the determination unit 30 (more specifically, the second determination unit 32) determines the guidance and training content based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20. .

More detailed processing will be described below.

The second determination unit 32 collates the objective exercise evaluation points included in the objective exercise evaluation information with the reference data 45 stored in the first storage unit 41, and determines the guidance and training content.

The guidance and training content is, as described above, the content of training performed by the user U under the guidance of an instructor at the rehabilitation facility. Here, even if the training content is performed by the user U at the rehabilitation facility, it does not correspond to the guidance training content unless it is performed under the guidance of an instructor.

Moreover, FIG. 8 describes the physical function elements of the user U that are linked to the guidance and training content and strengthened by the guidance and training content. A physical function element is a physical function of the user U that is to be strengthened as a result of the user U implementing the guidance and training content. gender and so on.

The second determining unit 32 selects the training content linked to the constituent motion with the lowest objective motion evaluation score and the training content linked to the constituent motion having the second lowest objective motion evaluation score, and performs guidance training. Decide on the content. Note that the second determination unit 32 may determine only the training content linked to the constituent motion with the lowest objective exercise evaluation score as the guidance and training content. As shown in the column of guidance and training contents in FIG. 8, the constituent motions, the objective exercise evaluation points, and the training contents are stored in association with each other. For example, a case where the constituent motions (exercise motions) are "walking", "turning direction", and "straddling" will be described. In this case, if the objective motion evaluation score of "walking" is 3 points, the training content of "turning and walking training" linked to "walking" is also 3 points. Similarly, if the objective motion evaluation score of "change of direction" is 2 points, "change of direction and walking training", which is the training content linked to "change of direction", is also set to 2 points. If the objective exercise evaluation score of "straddling" is 1 point, "step-over training", which is the training content linked to "straddling", is also scored as 1 point. In this case, the second determining unit 32 selects “step-crossing training”, which is the training content linked to the constituent motions (“stepping” and “turning”) with the lowest and second lowest objective motion evaluation points. And "turning and walking training" are determined as instruction and training contents.

Also, as a specific example, as indicated by the case of Yes in step S312 of FIG. 9A, when the objective exercise evaluation points are “walking”: 3 points, “direction change”: 2 points, and “stepping”: 2 points. will be explained. In other words, there are two constituent motions ("change direction" and "straddle") with the lowest objective motion score. In this case, the second determination unit 32 may determine the training content for the constituent motions of "change direction" and "straddle" as the guidance training content with a higher priority.

In this way, the second determination unit 32 determines the guidance and training content based on the objective exercise evaluation information acquired by the second acquisition unit 22 .

Further, the second determining unit 32 preferably compares the constituent motion with the lowest objective exercise evaluation score of the user U with the reference data 45 stored in the first storage unit 41 to determine the contents of the self-training. . Note that here, the second determining unit 32 determines the composition motion with the lowest objective exercise evaluation score of the user U, the composition motion with the second lowest objective exercise evaluation score of the user U, and the first storage unit Reference data 45 stored in 41 is collated to determine the contents of self-training.

The objective exercise evaluation information including the objective exercise evaluation score is information obtained by evaluating the degree of the exercise action performed by the user U (that is, the constituent action) by the rehabilitation action evaluation device. Further, the constituent motion is a motion determined as an exercise motion based on daily life information. That is, here, the determination unit 30 (more specifically, the second determination unit 32) determines the content of self-training based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20. .

The content of voluntary training is, as described above, the content of training that the user U performs voluntarily. The contents of the voluntary training may be training contents that the user U voluntarily performs, and the contents of the voluntary training may be performed by the user U at any place. That is, the voluntary training content may be performed by the user U at the rehabilitation facility or at the user's U home. However, as described above, the content of training performed by the user U under the guidance of an instructor at the rehabilitation facility corresponds to the content of guidance training.

Here, the process of determining the contents of voluntary training will be described using FIG. 9B, which is an example of the reference data 45. FIG.

FIG. 9B is a diagram showing an example of a table screen for determining the contents of self-training to be performed by the user U. As shown in FIG. More specifically, the table shown in FIG. 9B includes daily activities, constituent activities, instructional training contents, training contents (self-training contents), postures, implementation locations, training facilities, and priority levels. , and body function elements are described in a state in which they are associated with each other.

The posture is the posture in which the corresponding voluntary training content is implemented. The implementation site is the location where the corresponding voluntary training content is implemented. A training facility is a training machine used in the corresponding voluntary training content. The priority indicates the degree to which implementation by the user U is recommended, and the smaller the numerical value of the priority, the more recommended the implementation. A physical function element is an element of the user's U physical function that is strengthened by implementing the corresponding self-training content.

Here, a case will be described where the constituent motions with the lowest and second lowest objective motion evaluation points of the user U are "opening and closing hinged doors" and "walking."

In this case, the second determination unit 32 determines the training content linked to the constituent actions (“opening and closing hinged door” and “walking”) as the voluntary training content. Here, the second determination unit 32 determines all the training content linked to the constituent motion as the voluntary training content. That is, the second determination unit 32 determines 25 training contents from "holding the ball" to "standing position holding training" described in the "training content (self-training content)" column as the self-training content. do.

Furthermore, in the present embodiment, the following processing may be performed.

As described above, in step S30, the acquisition unit 20 (more specifically, the second acquisition unit 22) acquires facility information. The determination unit 30 (here, the second determination unit 32) selects the first training content using the training equipment indicated by the equipment information acquired by the acquisition unit 20 (more specifically, the second acquisition unit 22) for self-training. It should be determined as the content.

As described above, the equipment information is information indicating the training equipment installed in the rehabilitation facility. Note that, in the present embodiment, the training facility shown in FIG. 9B matches the training facility indicated by the facility information, and is the training facility installed in the rehabilitation facility.

In other words, here, the determining unit 30 (more specifically, the second determining unit 32) selects, among the training contents linked to the constituent actions (“opening and closing the hinged door” and “walking”), the equipment information indicating The first training content in which the training facility is used may be determined as the self-training content. In FIG. 9B, the first training content is "chest press", "shoulder press", "abduction/adduction", "leg press" and " leg extension”.

Moreover, in the present embodiment, the following processing may be performed.

The determining unit 30 (more specifically, the second determining unit 32) may further determine, as the voluntary training content, the second training content in which the physical function element of the user U to be strengthened is not included in the guidance training content. .

That is, the physical element functions of the user U that are strengthened by the user U implementing the second training content, and the physical element functions of the user U that are strengthened by the user U implementing the guidance training content. , are different from each other.

FIG. 8 shows the guidance and training content and the physical function elements of the user U strengthened by the guidance and training content, and FIG. 9B shows the self-training content and the physical function elements of the user U strengthened by the self-training content. It is shown.

For example, if one of the instruction training contents is "direction change and walking training", the body element functions strengthened by "direction change and walking training" are "dynamic balance" and "hip joint muscle strength (flexion)". , “balance control” and “static balance”. Here, the second determination unit 32 determines that the physical function elements of the user U to be strengthened by the second training content are "dynamic balance", "hip joint muscle strength (bending)", "balance control", and "static balance". The second training content is determined so as to be different from. In other words, here, the second training content is training content in which the physical function element to be strengthened is any one of "dynamic balance", "hip joint muscle strength (flexion)", "balance control" and "static balance". This is the training content without Specifically, from the second training content, there are five trainings: “reach training in a sitting position”, “thigh raising training (stepping)”, “standing and sitting training”, “reach training in a standing position” and “holding training in a standing position”. Excludes training content. Furthermore, when the other one of the guidance and training contents is "hand training", the second determination unit 32 performs the following processing. The second determination unit 32 determines the second training content such that the physical function elements of the user U to be strengthened by the second training content are different from the physical element functions to be strengthened by the "hand training". That is, from the second training content, the training content in which the user U's physical function element to be strengthened is the same as "hand training" is further removed.

Furthermore, in the present embodiment, the determination unit 30 (more specifically, the second determination unit 32) selects the voluntary training content as the training content having a higher priority than the second training content. to decide.

For example, as shown in FIG. 9B, the priority of the first training content using the training facility is "1", and the priority of the second training content does not include the physical function element of the user U to be strengthened in the instruction training content. It is preferable to determine the priority of each training content, with the rank being "2". Furthermore, it is preferable that the priority of the third training content, which has the same physical function element of the user U to be strengthened as the guidance training content, is determined as "3". It should be noted that the training content with the smaller priority numerical value is the training content with the higher priority.

In this way, the second determination unit 32 determines that the detailed life activity most troubled by the user U indicated by the information on the detailed life activity most troubled by the user U acquired by the first acquisition unit 21 is linked. Determine the contents of the self-training based on the configuration motion.

Thus, in step S31, the determination unit 30 (more specifically, the second determination unit 32) determines the instruction and training content based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20. . Further, the determination unit 30 (more specifically, the second determination unit 32) determines the content of self-training based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20. FIG. Therefore, step S31 is a determination step.

It should be noted that a step (receiving step). Processing when there is this reception step will be described below.

In this case, the determination unit 30 outputs the voluntary training content determined as described above to the first output unit 51 . More specifically, determination unit 30 outputs voluntary training content information indicating the determined voluntary training content to first output unit 51 .

Furthermore, the first output unit 51 outputs the content of the self-training determined by the determination unit 30 . More specifically, the first output unit 51 acquires the screen data of the screen showing the voluntary training content information from the first storage unit 41 and transmits the acquired screen data to the display device.

Information processing device 100, which is a display device, displays a screen on which voluntary training content information is shown. FIG. 9C is a diagram showing an example of a screen corresponding to user U's voluntary training content information.

In FIG. 9C, the content of the voluntary training determined by the determination unit 30 is described. In FIG. 9C, the contents of the voluntary training whose priorities are "1" and "2" are described above. As an example, eight self-training contents from "hand and finger training using theraplast or putty" to "leg extension" are shown here as the self-training contents that the user U performs in the rehabilitation facility. Similarly, eight voluntary training contents from "clothespins training" to "heel raising training" are shown as the training contents that the user U performs at home.

Further, the information processing device 100 receives an operation by the user U or a caregiver as a reception device. Here, the user U performs an operation of selecting training content that the user U wants to implement or an operation of the caregiver selecting the training content from among the self-training content shown in the image of FIG. 9C.

Note that, as shown in FIG. 9C, the information processing apparatus 100 selects two voluntary training contents as the voluntary training contents to be performed by the user U at the rehabilitation facility, and selects two voluntary training contents as the training contents to be performed by the user U at home. It is preferable to accept an operation for selecting training content.

Here, the contents of the voluntary training of "pinch training" and "leg press" are selected as the contents of the voluntary training that the user U performs at the rehabilitation facility. Furthermore, the contents of the voluntary training of "clothespins training" and "knee-holding stretch" are selected as the contents of voluntary training to be performed by the user U at home. In other words, the operation by the user U indicates training content that the user U himself/herself wishes to perform, and the operation by the caregiver indicates training content that the user U himself/herself is recommended to perform.

The information processing apparatus 100, which is a reception apparatus, outputs information about the operation to the acquisition unit 20. FIG. The acquisition unit 20 outputs the information to the determination unit 30, and the determination unit 30 determines the training content that the user U himself/herself desires to implement indicated by the information as the voluntary training content.

Thus, the rehabilitation support method may include a reception step. In this case, the determination unit 30 once determines the voluntary training content based on the daily life information. Further, the determination unit 30 further determines again the training content that the user U himself/herself desires to implement or the training content selected by the caregiver indicated by the accepted operation, among the self-training content that has been decided once, as the self-training content. You may

In addition, as shown in FIG. 9B, the voluntary training content with a higher priority (the training content with the priority "1" having a smaller priority numerical value) is indicated by a "*" mark in FIG. 9C. It may be shown to be high. Also, the screen shown in FIG. 9C preferably shows the training posture in which the content of the voluntary training is performed.

Step S31 shown in FIG. 3 will be described again. The 2nd determination part 32 determines a short-term goal and two training contents in step S31. Furthermore, the second determination unit 32 may determine a long-term goal, which is a predetermined long-term rehabilitation goal of the user U, based on the short-term goal. Specifically, the second determination unit 32 collates the short-term goal with the information related to the user U stored in the first storage unit 41, and determines the long-term goal. The long-term goal may be, for example, a level in which the level of detailed activities of daily living at which the user U is most troubled is one step higher than the short-term goal. For example, if the short-term goal is to be able to move from the living room to the toilet over a distance of 5m using a handrail while watching over the steps, the long-term goal is to move from the living room to the toilet. It is possible to move ``single'' over a ``step'' over a distance of ``5m'' using a ``handrail''.

In this way, the rehabilitation support device 10 can determine a long-term goal that is reasonable for the user U by determining a long-term goal linked to a short-term goal.

The determination unit 30 outputs the short-term goal, the two training contents, and the long-term goal determined as described above to the first output unit 51 . More specifically, the determination unit 30 outputs short-term goal information, training content information, and long-term goal information, which are information relating to the short-term goal, the two training details, and the long-term goal, to the first output unit 51 .

The first output unit 51 acquires the short-term goal, the two training details, and the long-term goal determined by the determination unit 30, and outputs them to the information processing device 100, which is a display device (step S32). Here, the first output unit 51 outputs short-term goal information, training content information, and long-term goal information. In step S32, the first output unit 51, for example, acquires the screen data of the screen showing the short-term goal information, the training content information, and the long-term goal information from the first storage unit 41, and stores the acquired screen data in the display device. to send.

A screen showing short-term goal information, training content information, and long-term goal information is displayed on the information processing device 100, which is a display device. FIG. 10 is a diagram showing an example of a screen corresponding to user U's short-term goal information, training content information, and long-term goal information. In FIG. 10, of the two training contents indicated by the training content information, the guidance training content is shown, but it is not limited to this, and at least one of the guidance training content and the self-training content may be shown. .

Furthermore, FIG. 11 is a diagram showing another example of the screen corresponding to the user U's short-term goal information, training content information, and long-term goal information. The information processing apparatus 100 displays the screen shown in FIG. 10 or 11 as a display device. For example, as shown in FIG. 11, objective exercise evaluation information may be displayed as measurement results. In addition, when the independence degree of the constituent motion is less than the short-term target, a mark such as “!” may be displayed. In FIG. 11, the guidance and training contents are shown as a training menu, and unlike the above example, "1. Walking" to "6. Sliding door" are determined as the guidance and training contents.

In this way, the screen showing the short-term goal information, the training content information, and the long-term goal information is displayed, so that the user U can easily understand the short-term goal, the training content, and the long-term goal of the user U himself/herself. be able to.

In step S<b>32 , the information processing apparatus 100 may serve as a reception apparatus and receive from the user U an operation for selecting whether the short-term goal and long-term goal determined by the determination unit 30 in step S<b>31 are appropriate. For example, if the decision unit 30 determines that the short-term goal and the long-term goal are inappropriate by the user U, they may be changed. FIG. 12 is a diagram showing an example of a screen that receives an operation for user U to change the long-term goal. The information processing apparatus 100 displays the screen shown in FIG. 12 as a display device. In this way, it may be changeable.

Here, in steps S10 to S32 described so far, the processing procedure before the user U undergoes rehabilitation training (more specifically, two training contents) has been described.

In steps S40 to S42 described below, a processing procedure after the user U undergoes rehabilitation training will be described. For example, here, it is assumed that the user U has undergone rehabilitation training for three months. For the sake of explanation, the objective exercise evaluation information and the subjective exercise independence degree information before the user U undergoes rehabilitation training are referred to as the pre-training objective exercise evaluation information and the pre-training subjective exercise independence degree information. is written as Similarly, hereinafter, the objective exercise evaluation information and subjective exercise independence degree information after the user U has undergone rehabilitation training are referred to as post-training objective exercise evaluation information and post-training subjective exercise independence degree information. .

Next, the acquisition unit 20 acquires post-training objective exercise evaluation information (step S40). More specifically, the acquisition unit 20 acquires the post-training subjective motor independence degree information and the post-training objective motor evaluation information via the information processing device 100 .

The acquiring unit 20 acquires the pre-training subjective motor independence degree information and the pre-training and post-training objective motor evaluation information in the same processing as that shown in steps S20 and S30.

The first evaluation unit 61 evaluates the effect obtained by the user U performing the two training contents (step S41). The first evaluation unit 61 may evaluate the effect by, for example, comparing objective exercise evaluation information obtained by the obtaining unit 20 before and after the user U performs two training contents. That is, the first evaluation unit 61 may evaluate the effect by comparing the pre-training objective exercise evaluation information and the post-training objective exercise evaluation information. For example, the first evaluation unit 61 obtains the post-training objective exercise evaluation information obtained by the obtaining unit 20 after the user U has performed two training contents, and the information about the user U stored in the first storage unit 41 You may evaluate an effect by comparing pre-training objective evaluation information before U performs two training contents.

The first evaluation unit 61 outputs the effect evaluation result to the first output unit 51 .

The first output unit 51 outputs an evaluation result that is the evaluation result of the first evaluation unit 61 (step S42). In step S42, the first output unit 51 acquires, for example, the screen data of the screen showing the evaluation result obtained in step S41 from the first storage unit 41, and transmits the acquired screen data to the display device. .

The information processing device 100, which is a display device, displays a screen showing evaluation results obtained by evaluating the effects obtained by the user U performing the two types of training. FIG. 13 is a diagram showing an example of a screen corresponding to evaluation results.

As a result, the pre-training objective exercise evaluation information and the post-training objective exercise evaluation information obtained by the rehabilitation movement evaluation device are used to quantitatively compare the effects obtained by the user U performing the two training contents. can do.

Further, the first evaluation unit 61 evaluates the effect by comparing the subjective motor independence degree information obtained by the obtaining unit 20 before and after the user U performs the two types of training, for example. good too. That is, the first evaluation unit 61 may evaluate the effect by comparing the pre-training subjective motor independence degree information and the post-training subjective motor independence degree information.

At this time, the second determining unit 32 further determines the short-term goal, the long-term goal, and the two training contents based on the post-training objective exercise evaluation information and the post-training subjective exercise independence information acquired by the acquiring unit 20. may be updated and determined again.

In steps S10 to S42, the processing procedure before and after the user U undergoes rehabilitation training has been described, but the rehabilitation support device 10 is used while undergoing rehabilitation training. It may be a device.

Specifically, the rehabilitation support device 10 may further include a schedule management unit.

The schedule management unit is a processing unit that generates schedule management information including the date and time, guidance and training content of rehabilitation training, and the names of a plurality of users U who perform the guidance and training content, based on the date and time information and the rehabilitation training information. be.

For example, the acquisition unit 20 includes date and time information including a predetermined date and time (for example, the day when the rehabilitation support device 10 is used) and the motion name of the rehabilitation training motion via the information processing device 100, which is a reception device. and rehabilitation training information to the schedule management unit. The motion name of the rehabilitation training motion is, for example, the name of the instruction/training content.

The schedule management unit collates the date and time information and the rehabilitation training information with the reference data 45 stored in the first storage unit 41 to generate schedule management information. In this case, the reference data 45 is data in which the date and time information, the rehabilitation training information, and the name of the user U scheduled to perform the instruction and training content at the predetermined date and time are associated with each other. The schedule management section outputs the generated schedule management information to the first output section 51 .

The first output unit 51 outputs the generated schedule information. The first output unit 51 acquires, for example, the screen data of the screen showing the schedule information from the first storage unit 41 and transmits the acquired screen data to the display device.

A screen showing schedule information is displayed on the information processing apparatus 100, which is a display device. FIG. 14 is a diagram showing an example of a screen showing schedule management information.

As shown in FIG. 14, the information processing device 100, which is a display device, displays a predetermined date, motion names of rehabilitation training motions, and a plurality of users U (Mr. is displayed.

The information processing apparatus 100 serves as a reception apparatus, and receives operations of each user U regarding vitals (pulse rate, blood pressure, etc.), attendance, and training progress (middle or completion, etc.). The information processing device 100 outputs the received result of the operation to the rehabilitation support device 10 . The rehabilitation support device updates the screen data output by the first output unit 51 based on the result of the above operation.

By providing the schedule management unit in this way, the user of the rehabilitation support device 10 can easily understand the person who will perform the instruction/training content on the predetermined date and time.

[Effects, etc.]
As described above, rehabilitation support device 10 according to the present embodiment includes acquisition unit 20, determination unit 30, and output unit.

The acquisition unit 20 obtains the daily life information, which is information about daily life based on the report of the user U who undergoes rehabilitation training, and the degree of the exercise motion performed by the user U by evaluating the rehabilitation motion evaluation device. Obtain objective exercise evaluation information. Based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20, the determination unit 30 determines the content of guidance and training that the user U performs under the guidance of an instructor in the rehabilitation facility and the voluntary training that the user U performs voluntarily. Determine content. The output unit (here, the first output unit 51) outputs the instruction/training content determined by the determination unit 30 and the self-training content.

Thus, in the rehabilitation support device 10, the degree of the exercise motion for evaluating the daily living ability of the user U is evaluated by the rehabilitation motion evaluation device, so that the exercise motion satisfies the predetermined condition. It is possible to accurately assess whether or not The rehabilitation support device 10 can determine two training contents based on the accurately evaluated ability of the user U to perform activities in daily life.

For example, unlike the present embodiment, the two training content determined in the present embodiment, compared with the case where the caregiver who does not have sufficient skills determines the training content without using the rehabilitation support device 10 is expected to have a high rehabilitation effect.

Further, the rehabilitation support device 10 determines two training contents. The content of guidance training is training that is expected to have a higher rehabilitation effect because it is performed by the user U under the guidance of an instructor. Moreover, the content of the self-training can be implemented by the user U without being under the guidance of an instructor. Even if the instructor is busy and the user U cannot carry out the contents of the guidance training, the user U can carry out the contents of the self-training by himself/herself. By determining the two training contents in this way, a higher rehabilitation effect is expected.

As described above, the rehabilitation support device 10 is realized that can determine the training content that provides a high rehabilitation effect.

Moreover, the rehabilitation assistance apparatus 10 can evaluate the effect obtained by the user U performing the training content.

Further, in the present embodiment, the acquisition unit 20 acquires equipment information indicating training equipment installed in the rehabilitation facility. The determination unit 30 determines the first training content using the training equipment indicated by the equipment information acquired by the acquisition unit 20 as the voluntary training content.

The first training content using training equipment is expected to have a higher rehabilitation effect than the training content not using training equipment. The rehabilitation support device 10 determines such first training content as the voluntary training content. In other words, the rehabilitation support device 10 is realized that can determine the training content for obtaining a higher rehabilitation effect.

Further, in the present embodiment, the determination unit 30 further determines the second training content, in which the physical function element of the user U to be strengthened is not included in the guidance training content, as the voluntary training content.

As a result, when the user U implements the voluntary training content, which is the second training content, the body element functions that are not included in the body element functions that are strengthened when the instruction training content is implemented for the user U are strengthened. be done. A higher rehabilitation effect is expected when the user U implements the contents of instructional training and the contents of voluntary training (second training contents). In other words, the rehabilitation support device 10 is realized that can determine the training content for obtaining a higher rehabilitation effect. In addition, it can be said that the contents of guidance training and the contents of voluntary training (second training contents) have a mutually complementary relationship.

Further, in the present embodiment, the determining unit 30 determines the voluntary training content as the training content in which the first training content has a higher priority than the second training content.

Thereby, the rehabilitation support device 10 can determine the first training content as the training content with a higher priority.

Further, the rehabilitation support method according to the present embodiment is a rehabilitation support method using the rehabilitation support device 10, and includes an acquisition step, a determination step, and an output step.

The acquisition step includes daily life information, which is information about daily life based on the report of the user U who undergoes rehabilitation training, and objective Acquire general exercise evaluation information. The determination step determines the content of guidance and training that the user U performs under the guidance of an instructor in the rehabilitation facility and the content of the voluntary training that the user U performs voluntarily based on the daily life information and the objective exercise evaluation information acquired in the acquisition step. decide. The output step outputs the instruction/training content determined by the determining step and the self-training content.

Thus, in the rehabilitation support method, the extent of the exercise motion for evaluating the daily living ability of the user U is evaluated by the rehabilitation motion evaluation device, so that whether or not the exercise motion satisfies the predetermined condition. It is possible to accurately evaluate whether or not The rehabilitation support method can determine two training contents based on such accurately evaluated user U's ability to perform activities in daily life.

For example, unlike the present embodiment, the two training contents determined in the present embodiment are compared with the case where the caregiver who does not have sufficient skills decides the training contents without using the rehabilitation support method. , a high rehabilitation effect is expected.

Furthermore, the rehabilitation support method determines two training contents. The content of guidance training is training that is expected to have a higher rehabilitation effect because it is performed by the user U under the guidance of an instructor. Moreover, the content of the self-training can be implemented by the user U without being under the guidance of an instructor. Even if the instructor is busy and the user U cannot carry out the contents of the guidance training, the user U can carry out the contents of the self-training by himself/herself. By determining the two training contents in this way, a higher rehabilitation effect is expected.

As described above, a rehabilitation support method is realized that can determine training content that provides a high rehabilitation effect.

A rehabilitation support system 1 according to the present embodiment includes a rehabilitation support device 10 .

As described above, the rehabilitation support device 10 according to the present embodiment can determine training content that provides a high rehabilitation effect. Therefore, the rehabilitation support system 1 having such a rehabilitation support device 10 is a system that can determine the training content that provides a high rehabilitation effect.

[Configuration of Rehabilitation Motion Evaluation Device]
Next, the configuration of rehabilitation motion evaluation apparatus 200 according to the present embodiment will be described. FIG. 15 is a block diagram showing a characteristic functional configuration of rehabilitation motion evaluation apparatus 200 according to this embodiment. More specifically, in FIG. 15, a rehabilitation motion evaluation device 200 provided in the information processing device 100 and the like will be described.

As described above, the rehabilitation motion evaluation device 200 is a device that evaluates the degree of exercise motion related to rehabilitation training performed by the user U, but is not limited to this. As shown in FIG. 15, the rehabilitation motion evaluation device 200 may be a device for evaluating the degree of rehabilitation training motion from moving image data of a user U who is undergoing rehabilitation training. Rehabilitation training motions are motions performed by the user U in rehabilitation training for improving the user's U ability to perform daily activities. Further, for example, the rehabilitation training motion may be a motion that is routinely performed in a rehabilitation facility. Note that the training content shown in FIG. 8 may include a rehabilitation training motion. In this case, the training content may include a rehabilitation training motion and the time or number of times the rehabilitation training motion is performed. As a specific example, the rehabilitation motion evaluation device 200 is a device for evaluating whether or not a rehabilitation training motion is performed in a correct motion, or a device for counting and evaluating the number of times a rehabilitation training motion has been performed. is.

Such a rehabilitation motion evaluation device 200 is a device used in nursing care facilities, medical facilities, or the like. The rehabilitation motion evaluation device 200 supports the work performed by an instructor (for example, a physical therapist) who instructs the rehabilitation motion performed by the user U in the facility.

Hereinafter, the rehabilitation motion evaluation device 200 will be described as a device that evaluates the degree of rehabilitation training motion.

As described above, the information processing device 100 includes the reception device 500 , the rehabilitation motion evaluation device 200 , and the display device 400 . Moreover, as shown in FIG. 15, the information processing apparatus 100 may further include an imaging device 300 .

The rehabilitation motion evaluation device 200 acquires moving image data of the user U undergoing rehabilitation training through the imaging device 300, and evaluates the degree of the rehabilitation training motion performed by the user U from the acquired moving image data. It is a device that The rehabilitation motion evaluation device 200 may be, for example, a device configured by a CPU (Central Processing Unit), a memory, and a program, or may be a server.

The photographing device 300 is a device for photographing the user U who is undergoing rehabilitation training. The photographing device 300 may be any device as long as it is capable of photographing moving images, such as a camera or a video camera. Moreover, when the information processing apparatus 100 is a smart phone or a tablet terminal as described above, an attached camera or video camera may be used.

The moving image data obtained by photographing the user U undergoing rehabilitation training is two-dimensional moving image data that does not include distance information. Distance information is distance information between the imaging device 300 and the user U. FIG. In other words, the imaging device 300 may be a device that does not have a ranging function. Note that the imaging device 300 may be a separate device independent of the information processing device 100 .

The imaging device 300 outputs the moving image data to the rehabilitation motion evaluation device 200 .

The display device 400 displays a screen based on screen data output from the rehabilitation motion evaluation device 200 . The display device 400 may display, for example, the result of evaluating the degree of rehabilitation training motion of the user U evaluated by the rehabilitation motion evaluation device 200 . As described above, the display device 400 is specifically a monitor device configured by a liquid crystal panel, an organic EL panel, or the like. Note that the display device 400 may be a separate device independent of the information processing device 100 .

In the present embodiment, the information processing device 100 is a smartphone or a tablet, and when the image capturing device 300 captures an image of the user U undergoing rehabilitation training, the display device 400 displays the image of the imaged user U. U may be displayed.

The accepting device 500 may be a touch panel or hardware buttons. The accepting device 500 , for example, accepts an operation related to evaluation of a rehabilitation training motion from a caregiver, and outputs the accepted operation to the rehabilitation motion evaluation device 200 .

The rehabilitation motion evaluation device 200, the imaging device 300, the display device 400, and the reception device 500 may be connected by wire as long as they can transmit and receive received operation results, moving image data, or screen data. It may be connected so as to be able to communicate wirelessly.

As shown in FIG. 15 , the rehabilitation motion evaluation device 200 includes an acquisition unit, an estimation unit 280 , an evaluation unit, a second output unit 252 and a second storage unit 242 .

In addition, in order to distinguish from the acquisition unit 20 and the first evaluation unit 61 included in the rehabilitation support device 10 shown in FIG. It is described as part 262 .

The acquisition unit (that is, the third acquisition unit 223) included in the rehabilitation motion evaluation device 200 acquires moving image data obtained by the imaging device 300, in which the user U undergoing rehabilitation training is photographed, and obtains distance information. Acquire 2D moving image data not included. The third acquisition unit 223 is, for example, a communication interface that performs wired communication or wireless communication.

The estimation unit 280 is a processing unit that estimates, based on the two-dimensional video data acquired by the third acquisition unit 223, skeleton information indicating the skeleton of the user U in the two-dimensional video data. The estimator 280 is specifically implemented by a processor, microcomputer, or dedicated circuit.

The skeleton information will now be described with reference to FIGS. 16A and 16B. FIG. 16A is a diagram showing one frame of moving image data of a user U who is undergoing rehabilitation training according to the present embodiment. FIG. 16B is a diagram in which skeleton information of user U shown in FIG. 16A is estimated. In FIG. 16B, the circular portions correspond to body parts such as joints, nose, eyes, and ears of the user U, and the body parts are connected by rods. That is, when the estimation unit 280 performs the estimation process on the user U shown in FIG. 16A, skeleton information of the user U shown in FIG. 16B is obtained.

The skeletal information includes information on joint positions at which bones of the user U are connected to each other, as shown in FIG. 16B. Skeleton information may include, for example, information on a plurality of joint positions of one user U in each piece of two-dimensional video data. Also, each of the two-dimensional moving image data may be each frame included in the two-dimensional moving image data. In other words, skeleton information includes information on a plurality of joint positions of one user U for each frame of two-dimensional moving image data in which one user U is shot. ing. The information on a plurality of joint positions may include information on coordinate positions of a plurality of joints corresponding to xy plane coordinates for each joint position.

Note that the skeleton information may also include information on the positions of the user U's nose, eyes, and ears. Therefore, skeleton information is information on the positions of the nose, eyes, and ears of one user U for each frame of the two-dimensional moving image data in which one user U is photographed. may be included. Further, the nose, eye and ear position information may include nose, eye and ear coordinate position information corresponding to xy plane coordinates for each position.

Note that, for estimating skeleton information, for example, a technique such as OpenPose shown in the following document may be used (Non-Patent Document: Zhe Cao et al.: Realtime Multi-Person 2D Human Pose Estimation Using
Part Affinity Fields, CVPR 2017).

The evaluation unit will be described again with reference to FIG. 15 .

Based on the skeleton information estimated by the estimation unit 280, the evaluation unit (that is, the second evaluation unit 262) included in the rehabilitation motion evaluation device 200 estimates the degree of the rehabilitation training motion related to the rehabilitation training performed by the user U (for example, the rehabilitation training Evaluate the performance or failure of a movement. Specifically, the second evaluation unit 262 compares the skeleton information estimated by the estimation unit 280 and the reference data 246 stored in the storage unit (that is, the second storage unit 242) included in the rehabilitation motion evaluation device 200. Match and assess the degree of rehabilitation training movement. The second evaluation unit 262 is specifically implemented by a processor, microcomputer, or dedicated circuit.

Furthermore, the second evaluation section 262 may have a normalization section 2621 and a motion evaluation section 2622 . The standardization unit 2621 uses the distance between the first joint position and the second joint position, which is different from the first joint position, as a reference value among the plurality of joint positions, and uses the reference value to standardize the plurality of joint positions. It is a processing unit that converts The motion evaluation unit 2622 is a processing unit that evaluates the degree of rehabilitation training motion based on the multiple joint positions standardized by the standardization unit 2621 . In this case, the motion evaluation unit 2622 compares the joint positions standardized by the standardization unit 2621 with the reference data 246 stored in the second storage unit 242, and evaluates the degree of rehabilitation training motion.

The second output unit 252 outputs the evaluation result of the rehabilitation training motion performed by the user U evaluated by the second evaluation unit 262 to the display device 400 . The second output unit 252 is, for example, a communication interface that performs wired communication or wireless communication.

The second storage unit 242 is a storage device that stores reference data 246 that indicates the relationship between the action name of the rehabilitation exercise action and a predetermined threshold value. The reference data 246 is referred to by the second evaluation unit 262 when the degree of the user's U rehabilitation training action is evaluated. The second storage unit 242 includes, for example, ROM (Read Only Memory), RAM (Random
Access Memory), semiconductor memory, HDD (Hard Disk Drive), or the like.

In addition, the second storage unit 242 shows the program executed by the estimation unit 280 and the second evaluation unit 262, and the evaluation result used when outputting the evaluation result of the degree of rehabilitation training action of the user U. Screen data is also stored.

Note that the estimation unit 280 and the second evaluation unit 262 may be realized by one processor, microcomputer, or dedicated circuit having the respective functions. Also, the estimation unit 280 and the second evaluation unit 262 may be realized by a combination of two or more of processors, microcomputers, or dedicated circuits.

[Processing procedure of rehabilitation motion evaluation method]
Next, a specific processing procedure in the rehabilitation motion evaluation method executed by the rehabilitation motion evaluation device 200 will be described. FIG. 17 is a flowchart showing a processing procedure for evaluating the degree of rehabilitation training motion of user U by rehabilitation motion evaluation device 200 according to the present embodiment. Here, one-leg standing training is taken as an example of the rehabilitation training motion.

First, the third acquisition unit 223 acquires moving image data (two-dimensional moving image data) of the user U undergoing rehabilitation training via the imaging device 300 (step S110). The two-dimensional moving image data acquired by the third acquiring unit 223 may be moving image data whose figure is one frame as shown in FIG. 16A. The 2D video data may include multiple frames. In addition, the third acquisition unit 223 may acquire, via the reception device 500, the action name of the rehabilitation training action performed by the user U (one leg standing training).

Next, the estimation unit 280 estimates skeleton information of the user U based on the two-dimensional video data (step S120). More specifically, the estimation unit 280 estimates skeleton information of the user U including information on a plurality of joint positions, and outputs the information to the second evaluation unit 262 . The estimating section 280 may also output to the second evaluating section 262 the motion name of the rehabilitation training motion performed by the user U (one leg standing training).

Furthermore, the second evaluation unit 262 evaluates the degree of the rehabilitation training action performed by the user U based on the skeleton information estimated in step S120 (step S130). Details of step S130 will now be described.

FIG. 18A is a diagram showing an example of a screen corresponding to skeleton information of user U estimated by estimation section 280 according to the present embodiment.

The skeleton information of the user U acquired from the estimation unit 280 is, for example, information of a plurality of joint positions of one user U in each frame of the two-dimensional moving image data shown in FIG. 18A.

The information on a plurality of joint positions may include information on coordinate positions of a plurality of joints corresponding to xy plane coordinates for each joint position. Here, the xy plane coordinates may be coordinates corresponding to the pixels of the display device 400, for example.

FIG. 18B is a diagram showing a process of standardizing multiple joint positions in the skeleton information of FIG. 18A. (a) of FIG. 18B is a diagram showing the coordinate positions of a plurality of joints, (b) of FIG. 18B is a diagram of the corrected coordinate positions of (a) of FIG. (c) is a standardized view of (b) of FIG. 18B. For example, the coordinate positions of the joints may be the coordinate positions shown in (a) of FIG. 18B.

First, the second evaluation unit 262 selects the coordinate positions of a plurality of joints included in the skeleton information estimated by the estimation unit 280 so that the coordinate position of a predetermined joint in a predetermined frame becomes the origin. Correct the coordinate position of For example, the predetermined frame may be the time (t0) at which the user U started the rehabilitation training motion, and the predetermined joint may be the joint of the neck. Furthermore, the second evaluation unit 262 corrects the coordinate position of each joint by subtracting the coordinates of the neck joint from the coordinates of each joint. For example, as shown in (b) of FIG. 18B, the coordinate positions of a plurality of joints are set so that the coordinate positions of the joints of the neck in a predetermined frame (t0) are the origin (x=0, y=0). corrected.

Further, the normalization unit 2621 uses the distance between the first joint position and the second joint position different from the first joint position as a reference value among the plurality of joint positions, and uses the reference value to obtain the plurality of joint positions. is normalized (step S131). Note that the standardization section 2621 may output a plurality of standardized joint positions to the motion evaluation section 2622 .

At this time, corrected coordinate positions of a plurality of joints may be used as the first joint position and the second joint position. The normalization unit 2621 uses the distance between the first joint position and the second joint position as a reference value, and divides the corrected coordinate positions of the multiple joints shown in (b) of FIG. 18B by the reference value.

Also, the first joint position and the second joint position may be the joint positions shown in FIG. 18A. The first joint position may be the joint position of the user U's neck, and the second joint position may be the joint position of the user's U waist. Furthermore, the first joint position and the second joint position are not limited to the joint positions shown in FIG. 18A. For example, the first joint position and the second joint position may be virtual joint positions obtained from coordinate positions of a plurality of joints. The virtual joint position is, for example, the central position between the joint position of the right hip and the joint position of the left hip shown in FIG. 18A, and may be the joint position of the central hip. Similarly, the virtual joint position may be a position between the right knee joint position and the left knee joint position, or a position between the right ankle joint position and the left ankle joint position. There may be.

In the present embodiment, the first joint position is the joint position of the neck, and the second joint position is the virtual joint position of the central waist.

The normalization unit 2621 divides the coordinate positions of a plurality of joints by the distance between the joint position of the neck and the joint position of the central waist as a reference value. As a result, the coordinate positions of a plurality of joints are standardized as shown in (c) of FIG. 18B. That is, multiple joint positions are standardized.

Note that the coordinate positions at a predetermined frame (for example, time (t0)) may always be used in the process of correcting and standardizing the coordinate positions of a plurality of joints. That is, the coordinate positions of the multiple joints at times (for example, t1) after the time (t0) when the user U started the rehabilitation training motion may be corrected by the coordinate positions of the neck joint at time (t0). . Furthermore, the coordinate positions of a plurality of joints at time (for example, t1) may be normalized using the distance between the neck joint position and the central waist joint position at time (t0) as a reference value.

By providing the standardization unit 2621 in this way, for example, when the distance between the user U and the imaging device 300 is both short and long, a plurality of joints standardized to have the same length position is obtained. That is, a plurality of joint positions having the same distance between the first joint position and the second joint position are obtained. Similarly, when the tall user U is evaluated and when the short user U is evaluated, the distance between the first joint position and the second joint position is the same. Multiple joint positions are obtained.

Although the distance between the first joint position and the second joint position is used as the reference value, the reference value is not limited to this. For example, the reference value may be defined by two points selected from coordinate positions of joints, nose, eyes and ears.

The normalization unit 2621 may further determine the first joint position and the second joint position based on the initial posture of the rehabilitation training motion performed by the user U.

In other words, the normalization unit 2621 determines a plurality of joint positions available to the normalization unit 2621 as the first joint position and the second joint position in the posture at the time when the user U started the rehabilitation training motion. may For example, a case where there is a tool (such as a desk) used in the rehabilitation training action performed by the user U will be described. In the initial posture described above, if a plurality of joint positions corresponding to the lower body of the user U are blocked by the tool, the normalization unit 2621 cannot obtain the plurality of joint positions corresponding to the lower body. In this case, the normalization unit 2621 may determine a plurality of available joint positions (eg, right shoulder and left shoulder) as the first joint position and the second joint position.

Thereby, a plurality of joint positions that can be obtained by the normalization unit 2621 can be determined as the first joint position and the second joint position.

Subsequently, the motion evaluation unit 2622 evaluates the degree of rehabilitation training motion based on the multiple joint positions standardized by the standardization unit 2621 (step S132).

The motion evaluation unit 2622 collates the motion name of the acquired rehabilitation training motion (one-legged training) with the reference data 246 stored in the second storage unit 242, and acquires a predetermined threshold value. When the coordinate position of the predetermined joint exceeds the threshold value as a result of the user U performing the rehabilitation training motion, the motion evaluation unit 2622 determines that the rehabilitation training motion has been achieved.

A specific example will be described with reference to FIG. 18C.

FIG. 18C is a diagram showing an example of evaluating the degree of rehabilitation training motion based on the standardized multiple joint positions shown in FIG. 18B. More specifically, (a) of FIG. 18C is a diagram showing an example of the time (t0) when the user U started the rehabilitation training motion. (b) of FIG. 18C is a diagram showing an example of the time (t1) when time has elapsed from (a) of FIG. 18C. (c) of FIG. 18C is a diagram showing an example of a time (t2) when more time has elapsed than (b) of FIG. 18C.

Here, the predetermined threshold includes, for example, the first threshold L1 and the second threshold L2. For example, in FIG. 18C, the first threshold L1 has the same y-axis value as the middle position between the right ankle joint coordinate position and the left ankle joint coordinate position at time (t0). Furthermore, the second threshold L2 has a y-axis value that is larger on the positive side than the first threshold L1. For example, the second threshold L2 may be a value that is one greater than the first threshold L1 in the normalized coordinates.

As shown in (a) of FIG. 18C, at time (t0), the coordinate positions of the joints of both ankles of the user U are positioned on the negative side of the y-axis with respect to the second threshold value L2.

As shown in (b) of FIG. 18C , when the user U performs the rehabilitation training motion and the time advances to time (t1), the coordinate position of the right ankle joint of the user U is higher than the time (t0). It is located on the positive side of the y-axis. However, the coordinate position of the right ankle joint of the user U at time (t1) is located on the negative side of the y-axis with respect to the second threshold value L2.

As shown in (c) of FIG. 18C , when the user U performs further rehabilitation training and the time advances to time (t2), the coordinate position of the joint of the right ankle of the user U is higher than the second threshold value L2. is also located on the positive side of the y-axis. That is, since the coordinate position of the predetermined joint (here, the right ankle) exceeds the threshold (here, the second threshold) due to the user U performing the rehabilitation training movement, the movement evaluation unit 2622 determines that the rehabilitation training movement has been achieved. judged to have been

By providing the standardization part 2621 in this way, a plurality of joint positions standardized to the same length can be obtained. That is, a plurality of joint positions having the same distance between the first joint position and the second joint position are obtained. Therefore, even when the distance between the user U and the photographing device is short and long, the rehabilitation motion evaluation device 200 uses a common threshold to evaluate the degree of the rehabilitation training motion performed by the user U. can do.

On the other hand, here, a case where normalization is not performed by the normalization unit 2621, that is, a case where step S131 is not performed will be described. In this case, the second evaluation unit 262 evaluates the degree of rehabilitation exercise movement based on a plurality of non-standardized joint positions.

FIG. 18D is a diagram showing an example of evaluating the degree of rehabilitation training motion based on a plurality of non-standardized joint positions in the skeleton information shown in FIG. 18A. (a) of FIG. 18D is a diagram showing an example of the time (t0) when the user U started the rehabilitation training motion. (b) of FIG. 18D is a diagram showing an example of the time (t1) after the elapsed time from (a) of FIG. 18D. (c) of FIG. 18D is a diagram showing an example of time (t2) when more time has elapsed than (b) of FIG. 18D.

In this case, the predetermined thresholds include, for example, the third threshold L3 and the fourth threshold L4. For example, in FIG. 18D, the third threshold L3 has the same y-axis value as the middle position between the coordinate positions of the right ankle joint and the coordinate position of the left ankle joint at time (t0). Furthermore, the fourth threshold L4 has a y-axis value that is larger on the positive side than the third threshold L3.

As shown in (a) of FIG. 18D , at time (t0), the coordinate positions of the joints of both ankles of the user U are located on the negative side of the y-axis with respect to the fourth threshold value L4.

As shown in (b) of FIG. 18D , when the user U performs a rehabilitation training motion and the time advances to time (t1), the coordinate position of the right ankle joint of the user U is higher than the time (t0). It is located on the positive side of the y-axis. However, the coordinate position of the right ankle joint of the user U at time (t1) is located on the negative side of the y-axis with respect to the fourth threshold value L4.

As shown in (c) of FIG. 18D, when the user U performs further rehabilitation training and the time advances to time (t2), the coordinate position of the joint of the right ankle of the user U increases from the fourth threshold value L4. is also located on the positive side of the y-axis. That is, since the coordinate positions of the multiple joints (here, the right ankle) exceeded the threshold (here, the second threshold) by the user U performing the rehabilitation training motion, the second evaluation unit 262 determines that the rehabilitation training motion is judged to have been achieved.

This case, that is, the case where step S131 is not performed will be described. For example, if the distance between the user U and the photographing device 300 is short, the user U will be large on the coordinate position, and if the distance between the user U and the photographing device 300 is long, the user U will be small on the coordinate position. Become. Even in such a case, the thresholds (the third threshold L3 and the fourth threshold L4) corresponding to the size of the user U on the coordinate position are used, so that the second evaluation unit 262 is not standardized. Based on multiple joint positions, the degree of rehabilitation exercise movement can be evaluated.

Subsequently, the second output unit 252 outputs the evaluation result of the rehabilitation training motion performed by the user U evaluated by the second evaluation unit 262 to the display device 400 .

Furthermore, the display device 400 displays the result of evaluating the degree of the rehabilitation training motion of the user U evaluated by the rehabilitation motion evaluation device 200 .

The evaluation result of the rehabilitation training motion performed by the user U evaluated by the second evaluation unit 262 may be stored in the second storage unit 242 . The evaluation result may be output to the rehabilitation support device 10 described above. In addition, using the same processing, the rehabilitation motion evaluation device 200 evaluates the degree of the exercise motion, and the result is output to the rehabilitation support device 10 as objective exercise evaluation information.

[Example of evaluation of rehabilitation training motion]
Here, an example of evaluation of a rehabilitation training motion according to the present embodiment will be shown. Specifically, step climbing training is used as the rehabilitation training motion.

The reception device 500 receives an operation for starting the step climbing training and an operation for determining the name of the user U who performs the step climbing training and the training time of the step climbing training.

When the rehabilitation motion evaluation device 200 acquires the two operations, the second output unit 252 acquires the screen data corresponding to the step climbing training from the second storage unit 242, and transmits the acquired screen data to the display device 400. . The display device 400 displays a screen corresponding to the acquired screen data.

After that, when receiving device 500 receives a predetermined operation, the same processing as described above is performed, and display device 400 displays a screen corresponding to the predetermined operation.

FIG. 19A is a diagram showing an example of a screen for accepting an operation indicating that settings related to rehabilitation training actions have been completed. As shown in FIG. 19A , the display device 400 may display the user U photographed by the photographing device 300 .

For example, the instructor who instructs the rehabilitation movement follows the instruction shown in FIG. 19A, acts so that the person to be trained (user U) enters the screen, and presses the "setting complete" button to indicate that the setting is completed. Perform the indicated operation. When accepting device 500 accepts the operation, display device 400 displays a screen for accepting an operation for starting a rehabilitation training action.

FIG. 19B is a diagram illustrating an example of a screen for receiving an operation for starting a rehabilitation training action; As shown in FIG. 19B, the determined name of the user U (for example, Mr. A) and the user U before the rehabilitation training motion photographed by the photographing device 300 are displayed on the display device 400 .

For example, the instructor follows the instructions shown in FIG. 19B and presses the "start" button to perform an operation for starting rehabilitation training. When accepting device 500 accepts the operation, display device 400 displays a screen for evaluating the degree of rehabilitation training motion.

FIG. 19C is a diagram showing an example of a screen for evaluating the degree of user U's rehabilitation training motion.

At this time, as described in [Processing Procedure of Rehabilitation Movement Evaluation Method], the rehabilitation movement evaluation device 200 acquires moving image data from the photographing device 300, and performs rehabilitation training movements performed by the user U from the acquired moving image data. Evaluate the degree of

For example, the rehabilitation motion evaluation device 200 may count the number of times the user U has ascended/descended steps to evaluate the degree of the rehabilitation training motion. At this time, the rehabilitation motion evaluation device 200 may measure the time required for the user U to ascend/descend the step a predetermined number of times (for example, 20 times).

In addition, although "remaining time" is displayed in FIG. 19C, the elapsed time from the time when the rehabilitation training was started may be displayed. Furthermore, as shown in FIG. 19C, a “training stop” button for accepting an operation for stopping rehabilitation training may be displayed.

Furthermore, when the determined training time elapses, a screen notifying that the training has ended is displayed. FIG. 19D is a diagram showing an example of a screen for notifying that user U's rehabilitation training has ended.

19A to 19D, the rehabilitation motion evaluation device 200 evaluates the degree of rehabilitation training motion of one user U, but the present invention is not limited to this. The rehabilitation motion evaluation device 200 may evaluate the degree of rehabilitation training motion of a plurality of users U, for example.

In the present embodiment, as shown in FIGS. 16A and 16B, only the user U is displayed on the display device 400, but the present invention is not limited to this. For example, a care worker who accompanies the user U may be displayed on the display device 400 .

Further, as shown in FIGS. 19A and 19B, the display device 400 displays a "change training time" button for accepting an operation to change the training time. This makes it possible to change the once-determined training time. Also, a button for accepting an operation to change other setting items, not limited to the training time, may be displayed.

Although the reception device 500 has received an operation for determining the name of the user U, the operation is not limited to this. For example, when the accepting device 500 does not accept the above operation, the name of the user U may be determined using face recognition technology or the like for the user U shown in FIG. 19A. In this case, once the name of user U is determined, the name of user U may be associated with the skeleton information of user U displayed on display device 400 and displayed on display device 400. .

[Effects, etc.]
As described above, the rehabilitation motion evaluation method according to the present embodiment is a method using a rehabilitation motion evaluation device. The rehabilitation motion evaluation method includes an acquisition step S110 of acquiring two-dimensional video data, which is video data of a user undergoing rehabilitation training and does not include distance information. The rehabilitation motion evaluation method further includes an estimation step S120 of estimating skeleton information indicating the user's skeleton in the two-dimensional video data based on the two-dimensional video data acquired in the acquisition step S110. The rehabilitation motion evaluation method further includes an evaluation step S130 of evaluating the degree of the rehabilitation training motion related to the rehabilitation training performed by the user based on the skeleton information estimated in the estimation step S120.

Thus, the rehabilitation motion evaluation method according to the present embodiment can evaluate whether or not the rehabilitation training motion is performed correctly based on the two-dimensional moving image data that does not include the distance information. That is, in the rehabilitation motion evaluation method, it is not essential to obtain information from a dedicated device having a distance measuring function. Therefore, the rehabilitation motion evaluation method can easily evaluate whether or not the rehabilitation training motion is performed correctly.

Also, the skeleton information includes information on a plurality of joint positions of one user in each of the two-dimensional moving image data. In the evaluation step S130, the distance between a first joint position and a second joint position different from the first joint position among the plurality of joint positions is set as a reference value, and a standard for standardizing the plurality of joint positions using the reference value. including a conversion step S131. The evaluation step S130 further includes a motion evaluation step S132 of evaluating the rehabilitation training motion based on the multiple joint positions standardized in the standardization step S131.

By providing the normalization step S131 in this way, a plurality of joint positions normalized to the same length can be obtained. That is, a plurality of joint positions having the same distance between the first joint position and the second joint position are obtained. Therefore, even when the distance between the user U and the imaging device is short and long, the rehabilitation motion evaluation method uses a common threshold to evaluate the degree of the rehabilitation training motion performed by the user U. be able to.

Therefore, the rehabilitation motion evaluation method can more easily evaluate whether or not the rehabilitation training motion is performed correctly.

In addition, the normalization step S131 further determines and outputs the first joint position and the second joint position based on the initial posture of the rehabilitation training motion performed by the user.

Thereby, a plurality of joint positions that can be obtained in the normalization step S131 can be determined as the first joint position and the second joint position.

Therefore, since a plurality of joint positions can be standardized more easily, the rehabilitation motion evaluation method can more easily evaluate whether or not the rehabilitation training motion is performed correctly.

The first joint position is the joint position of the user's neck, and the second joint position is the joint position of the user's waist.

Among multiple joint positions in the upper body, the neck and hips are located in the center of the upper body compared to the shoulders, elbows or neck. Therefore, the estimation unit 280 can easily estimate the skeleton information of the joint positions of the neck and the waist regardless of the rehabilitation exercise performed by the user U.

As a result, multiple joint positions can be standardized more easily, so that the rehabilitation motion evaluation method can more easily evaluate whether or not the rehabilitation training motion is performed correctly.

Further, the present invention may be implemented as a program for causing a computer to execute the rehabilitation motion evaluation method.

Such a program can easily evaluate whether or not the rehabilitation training motion is being performed correctly by causing the computer to evaluate whether or not the rehabilitation training motion is being performed correctly.

Further, the rehabilitation motion evaluation apparatus 200 according to the present embodiment includes an acquisition unit ( A third acquisition unit 223) is provided. Furthermore, the rehabilitation motion evaluation apparatus 200 includes an estimation unit that estimates skeleton information indicating the skeleton of the user U in the two-dimensional video data based on the two-dimensional video data acquired by the acquisition unit (third acquisition unit 223). 280. Furthermore, the rehabilitation motion evaluation device 200 includes an evaluation unit (second evaluation unit 262 ) that evaluates the degree of rehabilitation training motion related to the rehabilitation training performed by the user U based on the skeleton information estimated by the estimation unit 280 .

Accordingly, rehabilitation motion evaluation apparatus 200 according to the present embodiment can evaluate whether or not rehabilitation training motions are performed correctly based on two-dimensional moving image data that does not include distance information. That is, in the rehabilitation motion evaluation device 200, it is not essential to obtain information from a dedicated device having a distance measuring function. Therefore, the rehabilitation motion evaluation device 200 can easily evaluate whether or not the rehabilitation training motion is performed correctly.

(Modification of Embodiment 1)
In Embodiment 1, the example in which the motion evaluation unit 2622 evaluates the rehabilitation training motion has been described. In the modification of Embodiment 1 described below, an example is shown in which a determination unit 2623 and a posture motion evaluation unit 2624 included in a motion evaluation unit 2622b each determine a posture and evaluate a rehabilitation training motion. In addition, in this modification, the same code|symbol is attached|subjected about the component which is common in Embodiment 1, and the overlapping description is abbreviate|omitted.

[Configuration of Rehabilitation Motion Evaluation Device]
FIG. 19E is a block diagram showing a characteristic functional configuration of a rehabilitation motion evaluation device 200b according to this modification.

An information processing apparatus 100b according to this modification has the same configuration as the information processing apparatus 100 of Embodiment 1, except for a rehabilitation motion evaluation apparatus 200b.

Further, rehabilitation motion evaluation device 200b has the same configuration as rehabilitation motion evaluation device 200 of Embodiment 1, except mainly for second storage unit 242b and motion evaluation unit 2622b included in second evaluation unit 262b. Prepare. In this modification, the motion evaluation unit 2622b includes a determination unit 2623 and a posture/motion evaluation unit 2624. FIG.

In this modified example as well, normalization section 2621 normalizes a plurality of joint positions using the same processing as in the first embodiment.

The determination unit 2623 is a processing unit that determines the posture of the user U based on the multiple joint positions standardized by the standardization unit 2621 . More specifically, the determination unit 2623 determines, from among the plurality of predetermined postures, one posture having a plurality of joint positions closest to the above-described standardized plurality of joint positions as the posture of the user U. It is determined that In this case, the determination unit 2623 compares the joint positions standardized by the standardization unit 2621 with the reference data 246b stored in the second storage unit 242b, and determines the posture of the user U.

Here, an example of the posture determination procedure performed by the determination unit 2623 will be described.

In this modified example, the determination unit 2623 determines the posture using the Recognition Taguchi (RT) method, which is one of the Maharanobis Taguchi methods. The RT method is a method of determining an unknown pattern by deriving a feature space from a group of reference patterns (known postures) and evaluating feature quantities of unknown patterns (unknown postures) in the feature space.

Here, a standing posture and a one-leg standing posture in one-leg standing training, which are rehabilitation training motions, will be described as an example.

First, the determination unit 2623 derives a feature space from a reference pattern group. Specifically, the determination unit 2623 derives a feature space from a plurality of joint positions of known postures standardized by the standardization unit 2621 . Note that the standing posture is the known posture here.

First, the determination unit 2623 calculates the average value m _j and the effective divisor r in the feature space. If there are n feature space reference patterns, and each of the x and y coordinate positions of the joint positions in the i-th pattern is a _ij (j=1, 2, . . . k), then the feature space The average value m _j in and effective divisor r are obtained from equations (1) and (2).

Subsequently, the determination unit 2623 calculates feature amounts Y ₁ (i) and Y ₂ (i) in the i-th pattern. The feature quantities Y ₁ (i) and Y ₂ (i) are obtained by using the mean value m _j in the feature space and the effective divisor r using formulas (3), (4), (5) and (6). ) is required.

The feature quantity _Y1 is a feature quantity proportional to the sensitivity of the feature space, and the feature quantity _Y2 is a feature quantity inversely proportional to the S(signal)/N(noise) ratio of the feature space.

Here, the determination unit 2623 derives a feature space based on the standing posture based on the feature amounts _Y1 and _Y2 . Specifically, it will be described with reference to FIG. 19F.

FIG. 19F is a diagram showing an example of the feature amount calculated by the determination unit 2623 according to this modification. FIG. 19F shows the feature amounts _Y1 and _Y2 of the reference pattern (standing posture), and in FIG. 19F, the feature space based on the standing posture is indicated by an ellipse. The ellipse indicates a variation within 2σ from the center of the feature space. Note that the center of the feature space based on the standing posture is, for example, the coordinates indicated by the arithmetic mean of the calculated n feature values _Y1 and the arithmetic mean of the n feature values _Y2 . position.

Next, the feature quantity of the unknown pattern shown in FIG. 19F will be described. Here, it is assumed that the one-legged posture is the unknown posture.

A determination unit 2623 calculates the feature amount of the unknown pattern. In this modification, the determination unit 2623 calculates the feature amount of the unknown pattern from the joint positions of the unknown posture standardized by the standardization unit 2621 (see FIG. 19G).

FIG. 19G is a diagram showing a plurality of joint positions in unknown postures standardized by the standardization unit 2621 according to this modification. FIG. 19G is a diagram corresponding to (c) of FIG. 18B. (a), (b) and (c) of FIG. 19G show a one-leg standing posture with the right leg raised, and (d) of FIG. 19G shows a one-leg standing posture with the left leg raised. there is In addition, in this modification, normalization section 2621 corrects and normalizes the coordinate positions of a plurality of joints in the same manner as in the first embodiment.

The determining unit 2623 uses the plurality of joint positions of the unknown posture shown in FIG. Calculate the quantities Y ₁ and Y ₂ .

FIG. 19F illustrates the calculated feature amount of the unknown pattern. As described above, the one-leg standing posture is the unknown posture, and one-leg standing (a), (b), (c), and (d) shown in FIG. ) and (d) correspond to the one-leg standing posture.

Furthermore, the determination unit 2623 determines an unknown pattern from the calculated feature amount of the unknown pattern.

As shown in FIG. 19F, the distribution position of the feature amount of the unknown pattern is far from the feature space based on the standing posture. Here, if the feature amount of the unknown pattern is within a predetermined index (for example, within 2σ (i.e., within the ellipse in FIG. 19F)) from the center of the feature space based on the standing posture, the unknown posture is the known posture. is determined to be In this modified example, the feature amount of the unknown pattern is outside the range of 2σ from the center of the feature space based on the standing posture. Accordingly, the determination unit 2623 can easily determine that the unknown orientation is not the known orientation. In this modified example, the standing posture is the known posture and the one-leg standing posture is the unknown posture, so the above determination is valid.

Note that the index used by the determination unit 2623 to determine the unknown orientation is not limited to 2σ. For example, the index may be σ or 3σ.

Here, another example of the posture determination procedure performed by the determination unit 2623 will be described. For example, in the following description, the one-leg standing posture with the right leg raised (hereinafter referred to as the right leg raised posture) is the known posture, and the one leg standing posture with the left leg raised (hereinafter referred to as the left leg raised posture) is the unknown posture. .

FIG. 19H is a diagram showing another example of the feature amount calculated by the determination unit 2623 according to this modification.

In FIG. 19H, feature amounts are calculated based on a plurality of joint positions of the one-leg standing posture shown in (a), (b), (c), and (d) of FIG. 19G. In FIG. 19H, the feature space based on the right leg raised posture is indicated by an ellipse. The ellipse indicates a variation within 2σ from the center of the feature space.

As shown in FIG. 19H, the distribution position of the feature amount (left leg raised posture) of the unknown pattern is away from the feature space based on the right leg raised posture and is outside the range of 2σ from the center of the feature space. Accordingly, the determination unit 2623 can easily determine that the unknown posture (left leg raised posture) is not the known posture (right leg raised posture).

As described above, by using the RT method, the determination unit 2623 can determine the posture based on the multiple joint positions standardized by the standardization unit 2621 .

Furthermore, posture motion evaluation section 2624 will be described.

The posture motion evaluation unit 2624 is a processing unit that evaluates the rehabilitation training motion based on the time-series change in the posture of the user U determined by the determination unit 2623 . The posture motion evaluation unit 2624 compares the time-series change in the posture of the user U with the reference data 246b stored in the second storage unit 242b, and evaluates the rehabilitation training motion.

In addition, in this modification, the second storage unit 242b is a storage device in which the reference data 246b is stored. The reference data 246b indicates the relationship between the motion name of the rehabilitation training motion and the feature space based on the known posture, and the relationship between the motion name of the rehabilitation training motion and the posture information related to the rehabilitation training motion. there is The plurality of predetermined postures are, for example, the known postures described above, and the posture information related to the rehabilitation training motion is, for example, the order of correct postures when the rehabilitation training motion is performed correctly. . In the rehabilitation training, a pre-selected rehabilitation training motion is presented to the user U, and the user U repeats the rehabilitation training motion to maintain or improve motor function. Therefore, it is possible to predetermine a plurality of postures included in the presented rehabilitation training motion or a correct posture permutation. The reference data 246b is referred to by the determination unit 2623 when the posture of the user U is determined, and by the posture motion evaluation unit 2624 when the rehabilitation training motion is evaluated.

Specifically, the second evaluation unit 262b, like the second evaluation unit 262 according to Embodiment 1,
It is implemented by a processor, microcomputer, or dedicated circuitry. The second storage unit 242b also stores a program executed by the second evaluation unit 262b, and screen data showing the evaluation result used when outputting the evaluation result of the degree of rehabilitation training movement of the user U. It is

[Processing procedure of rehabilitation motion evaluation method]
Next, a specific processing procedure in the rehabilitation motion evaluation method executed by the rehabilitation motion evaluation device 200b will be described. FIG. 19I is a flowchart showing a processing procedure for evaluating the degree of rehabilitation training motion of the user U by the rehabilitation motion evaluation device 200b according to the present modification. More specifically, FIG. 19I is a more detailed flowchart of step S132 shown in FIG. Here, as a rehabilitation training motion, trousers raising and lowering training is taken as an example. The trousers up and down training is training in which the user U puts on trousers and then takes off the trousers in order.

Note that the determination unit 2623 derives the feature space from the reference pattern group before the processing of the flowchart shown in FIG. 19I is performed. Specifically, the determining unit 2623 derives a feature space from a plurality of joint positions of known postures related to the pants raising and lowering training standardized by the standardizing unit 2621 . A plurality of joint positions shown in FIG. 19J are obtained by normalization by the normalization unit 2621 .

FIG. 19J is a diagram showing a plurality of joint positions of the trousers raising and lowering training posture standardized by the standardizing unit 2621 according to this modification. (a), (e) and (i) of FIG. 19J show the sitting posture, (b) and (g) of FIG. 19J show the right leg raised posture, and (c) and (h) of FIG. ) shows the posture with the left leg raised, and (d) and (f) of FIG. 19J show the half-bent posture. Also, (a), (b), (c), (d) and (e) of FIG. 19J show the action of putting on pants, and (e), (f), (g) and (g) of FIG. 19J. In (h) and (i), the action of taking off pants is shown.

Here, the known postures are a sitting posture, a posture with the right leg raised, a posture with the left leg raised, and a kneeling posture, which are representative postures of the trousers raising and lowering training. That is, four known orientations are used in this modified example. Therefore, the determination unit 2623 derives the feature space of the sitting posture, the feature space of the right leg raised posture, the feature space of the left leg raised posture, and the feature space of the half-crouched posture.

As described above, in this modification, before the processing of the flowchart shown in FIG. Reference data 246b is stored that indicates the relationship with the raising and lowering training).

Subsequently, in the present modification, as in the first embodiment, the process of step S131 of steps S110, S120, and S130 is performed, and the standardization unit 2621 uses the standardized joint positions to perform motion evaluation. Output to the unit 2622b (see FIG. 17). It should be noted that the third acquisition unit 223 acquires the motion name of the rehabilitation training motion performed by the user U (trousers raising and lowering training) via the reception device 500 .

The determination unit 2623 determines the posture of the user U based on the multiple joint positions standardized by the standardization unit 2621 (step S133). More specifically, the determination unit 2623 selects one posture having a plurality of joint positions closest to the joint positions standardized by the standardization unit 2621 from among the plurality of predetermined postures for the user U. (step S134). In this modification, the determination unit 2623 determines which of the above four known postures the unknown posture of the user U corresponds to, based on a plurality of joint positions of the standardized unknown postures of the trousers raising and lowering training. do.

First, the determination unit 2623 calculates the feature amount of the unknown pattern. In the description of steps S133 and S134, an example of one frame included in the two-dimensional moving image data of the user U who is undergoing training in raising and lowering pants will be given. FIG. 19K is a diagram showing a plurality of joint positions of an unknown posture in the pants raising and lowering training standardized by the standardization unit 2621 according to this modification.

The determining unit 2623 uses the plurality of joint positions of the unknown posture shown in FIG. Feature quantities _Y1 and _Y2 are calculated. The determination unit 2623 refers to the reference data 246b and calculates feature amounts _Y1 and _Y2 of each of the unknown patterns based on the feature spaces of each of the four known orientations.

Subsequently, the discrimination unit 2623 discriminates an unknown pattern from the calculated feature amounts _Y1 and _Y2 .

Here, the discrimination unit 2623 discriminates an unknown pattern by the Mahalanobis distance ^D2 calculated from the feature amounts _Y1 and _Y2 using the RT method. The Mahalanobis distance ^D2 represents the distance from the center of one feature space to the unknown pattern to be evaluated. The smaller the Mahalanobis distance ^D2 , the closer to the reference posture of the feature space.

The determination unit 2623 calculates each Mahalanobis distance D ₀ ² defined by a variation of 2σ from the center of each feature space of the four derived known postures. Note that each Mahalanobis distance D ₀ ² may be stored in advance in the second storage unit 242b. Further, the determination unit 2623 calculates the Mahalanobis distance D ₁ ² from the center of the feature space of each of the four known postures for ^the feature amount of the unknown pattern shown in _FIG . /D ₀ ² ). Table 1 is a table showing the Mahalanobis distance ^D2 according to this modification.

The normalized distance (D ₁ ² /D ₀ ² ) shown in Table 1 is a numerical value obtained by dividing the Mahalanobis distance D ₁ ² by the Mahalanobis distance D ₀ ² . The smaller the normalized distance (D ₁ ² /D ₀ ² ) is, the closer the unknown pattern to be evaluated is to the known posture. Therefore, from Table 1, the determination unit 2623 determines that the unknown posture is the right leg raised posture.

Based on the above, the determination unit 2623 determines the positions of the joints (normalized distance (D ₁ ² /D ₀ ² ) is the smallest) is determined to be the posture of the user U.

In other words, the determination unit 2623 can easily determine to which of a plurality of predetermined postures (known postures) the unknown posture of the user U corresponds. Accordingly, it is possible to evaluate whether or not the user U correctly performs the motions (the motion of putting on the pants and the motion of taking off the pants) that constitute the trousers lifting and lowering training. That is, the rehabilitation motion evaluation method can easily evaluate whether or not the rehabilitation training motion is performed correctly.

Note that when the determination unit 2623 determines the posture, as described above, if the feature amount of the unknown pattern is within 2σ from the center of the feature space based on the standing posture, the unknown posture is the known posture. A method may be used that determines that

Also, here, one frame included in the two-dimensional moving image data has been described, but in this modified example, the determination unit 2623 performs the same processing for a plurality of time-series-changing frames included in the two-dimensional moving image data. I do. In other words, the determination unit 2623 determines the time-series change in the posture of the user U and outputs it to the posture/motion evaluation unit 2624 .

The posture motion evaluation unit 2624 evaluates the rehabilitation training motion based on the time-series change in the posture of the user U determined by the determination unit 2623 (step S135).

For example, the posture motion evaluation unit 2624 uses the reference data 246b indicating the relationship between the motion name of the rehabilitation training motion and the posture information related to the rehabilitation training motion, and evaluates the rehabilitation motion training performed correctly by the user U. count the number of times Thereby, posture motion evaluation section 2624 evaluates the degree of rehabilitation motion training.

For example, if the trousers lifting and lowering training is performed correctly, the action of putting on the trousers is followed by the action of taking off the trousers. The order of the correct postures for putting on the pants is the sitting posture, one of the right leg raised posture and the left leg raised posture, the other of the right leg raised posture and the left leg raised posture, the crouching posture, and the sitting posture. In addition, the order of the correct postures for taking off the trousers is the sitting posture, half-assed posture, one of the right leg raised posture and the left leg raised posture, the other of the right leg raised posture and the left leg raised posture, and the sitting posture.

In this modified example, the posture motion evaluation unit 2624 counts the number of times the trousers raising and lowering training is performed in the correct order of postures, thereby evaluating the degree of the rehabilitation motion training. FIG. 19L shows an example of the result of evaluation by posture/motion evaluation section 2624 .

FIG. 19L is a diagram showing time-series changes in the posture of the user U in the trousers raising and lowering exercise according to this modification. In FIG. 19L, the vertical axis corresponds to the posture of the user U, and the numerical values on the vertical axis are 1: sitting posture, 2: left leg raised posture, 3: right leg raised posture, and 4: crouching posture. handle. The horizontal axis corresponds to the action execution time during which the rehabilitation training action is performed.

For example, in the interval 1.9 to 4.8 [sec], the posture of the user U changes from the sitting posture to the left leg raised posture, the right leg raised posture, the crouching posture, and the sitting posture. The posture action evaluation unit 2624 evaluates that the user U was able to correctly put on the trousers in the section. Further, for example, in a section from 6.4 to 10.1 [sec], the posture of the user U changes from a sitting posture to a crouching posture, a left leg raised posture, a right leg raised posture, and a sitting posture. The posture action evaluation unit 2624 evaluates that the user U was able to correctly take off the pants in the section. Further, for example, in both the 12.1 to 15.6 [sec] section and the 24.1 to 27.5 [sec] section, the posture of the user U changes from the sitting posture to the right leg raised posture and the left leg raised posture. , with the right leg raised, half-assed, and sitting. The posture action evaluation unit 2624 evaluates that the user U was able to correctly put on the trousers in the two sections. Similarly, in the 17.7 to 22.1 [sec] section and the 28.8 to 34.2 [sec] section, the posture/motion evaluation unit 2624 determines that the user U It is evaluated that the action of taking off the trousers was performed correctly.

Therefore, in the trousers raising and lowering exercise shown in FIG. 19L, the posture action evaluation unit 2624 evaluates that the user U has performed the trousers raising and lowering exercise three times. Further, the posture motion evaluation unit 2624 may evaluate that the average implementation time of the motion of putting on the pants is 3.2 [sec] and the average implementation time of the motion of taking off the pants is 3.9 [sec].

In this way, the posture motion evaluation unit 2624 counts the number of rehabilitation motion training performed in the correct posture order based on the time-series change in the posture of the user U, thereby evaluating the degree of the rehabilitation training motion. . For example, compared with the case where one posture of the user U is used, it is possible to more easily evaluate whether or not the user U is performing the rehabilitation motion training correctly. That is, the rehabilitation motion evaluation method can easily evaluate whether or not the rehabilitation training motion is performed correctly.

The posture/motion evaluation unit 2624 outputs the evaluation result of the rehabilitation motion training performed by the user U to the second output unit 252 .

Subsequently, the second output unit 252 outputs to the display device 400 the evaluation result of the rehabilitation training motion performed by the user U evaluated by the second evaluation unit 262b.

Furthermore, the display device 400 displays the result of evaluating the degree of the rehabilitation training motion of the user U evaluated by the rehabilitation motion evaluation device 200b.

The accuracy of the operation performance times obtained from FIG. 19L will now be further explained. FIG. 19M is a diagram showing the measured values and calculated values of the action execution time in the pants raising and lowering training according to this modification.

The measured value is a value obtained by measuring the time required for the rehabilitation movement training by the instructor who guides the rehabilitation movement performed by the user U using a measuring device (for example, a stopwatch). The calculated value is the value of the time required for rehabilitation motion training obtained from the evaluation result evaluated by the second evaluation unit 262 .

As shown in FIG. 19M, the measured values and calculated values have a high positive correlation (correlation coefficient R>0.98). Moreover, the error of the calculated value was ±0.34 [sec] at 2σ from the comparison with the measured value. It is reported in the following document that even a skilled measurer has a deviation of about 0.3 [sec] in the measured value using a stopwatch (non-patent document: Daisuke Toto et al., "Stop Quantification of systematic and random errors in manual measurement of 50m running time using a watch,” Physical Education Measurement Evaluation Research, Vol. 18, p27-33, 2018). Therefore, it can be judged that the calculated value of the operation execution time according to the present technology is about the same as that of a skilled measurer. Therefore, evaluation based on human motion estimation enables stable evaluation without depending on skill differences among functional training instructors.

It should be noted that in this modified example, the determining unit 2623 determines the posture using the RT method, but the present invention is not limited to this. The determination unit 2623 may determine the posture using, for example, an ANN (artificial neural network) method.

(Embodiment 2)
In rehabilitation movement evaluation apparatus 200 according to Embodiment 1, second evaluation section 262 includes normalization section 2621 and movement evaluation section 2622, but is not limited to this. In the present embodiment, the second evaluation unit 262a does not include the normalization unit and the motion evaluation unit, and the rehabilitation motion evaluation device 200a includes the imaging control unit 290a and the display control unit 291a. is different. In addition, in the present embodiment, the same reference numerals are assigned to the same constituent elements as those in the first embodiment, and overlapping explanations will be omitted.

[Configuration of Rehabilitation Motion Evaluation Device]
FIG. 20 is a block diagram showing a characteristic functional configuration of rehabilitation motion evaluation apparatus 200a according to the present embodiment.

The information processing device 100a may include a rehabilitation motion evaluation device 200a, an imaging device 300a, a display device 400, and a reception device 500.

The photographing device 300a is a device for photographing the user U who is undergoing rehabilitation training. The photographing device 300a may be any device, such as a camera or a video camera, as long as it is a device capable of photographing moving images. The imaging device 300a also has a display unit 301a that displays a moving image of the user U who is undergoing rehabilitation training.

The imaging device 300a has a display section 301a. The display unit 301a is specifically a monitor device configured by a liquid crystal panel, an organic EL panel, or the like. When the information processing device 100a is a smart phone or a tablet, the display unit 301a may be the same as the display device 400. FIG.

Note that, hereinafter, the display unit 301a and the display device 400 are the same components, and a screen or an instruction displayed on one of the display unit 301a and the display device 400 is a screen or an instruction displayed on the other. can be regarded as

The moving image data obtained by photographing the user U undergoing rehabilitation training is two-dimensional moving image data that does not include distance information. Distance information is distance information between the imaging device 300a and the user U. FIG. In other words, the imaging device 300a may be a device that does not have a ranging function. Note that the imaging device 300a may be a separate device independent from the information processing device 100a.

The imaging device 300a outputs the moving image data to the rehabilitation motion evaluation device 200a.

As shown in FIG. 20, the rehabilitation motion evaluation device 200a includes an acquisition unit, an estimation unit 280, an evaluation unit, a second output unit 252, a second storage unit 242a, an imaging control unit 290a, and a display control unit. 291a.

In order to distinguish from the acquisition unit 20 and the first evaluation unit 61 included in the rehabilitation support device 10 according to Embodiment 1 shown in FIG. They are described as a part 223 and a second evaluation part 262a.

The imaging control unit 290a is a processing unit that controls the imaging device 300a to capture a two-dimensional moving image that does not include distance information about the user U undergoing rehabilitation training. The imaging control unit 290a is specifically implemented by a processor, microcomputer, or dedicated circuit.

For example, upon receiving an operation for photographing the user U who is undergoing rehabilitation training, the reception device 500 outputs the operation to the photographing control unit 290a. When acquiring the operation, the shooting control unit 290a controls the shooting device 300a to shoot a two-dimensional moving image. Further, the imaging control unit 290a may acquire the motion name of the rehabilitation training motion performed by the user U via the reception device 500 . Note that the imaging control unit 290a may output the action name of the operation and the rehabilitation training action to the display control unit 291a.

The display control unit 291a is a processing unit that controls the display unit 301a to display an instruction to keep the distance between the imaging device 300a and the user U at a predetermined distance. The display control unit 291a may acquire an operation for capturing an image of the user U who is undergoing rehabilitation training from the image capturing control unit 290a, and may control to display the instruction. That is, the instruction may be displayed on the display unit 301a at the same time when the imaging device 300a starts imaging.

Further, the display control unit 291a collates the motion name of the rehabilitation training motion acquired from the imaging control unit 290a with the reference data 246a stored in the second storage unit 242a, and determines the relationship between the imaging device 300a and the user U. Instructions may be determined to keep the distance at a predetermined distance.

The instruction displayed by the display unit 301a under the control of the display control unit 291a may be displayed so as to overlap the user U who is undergoing rehabilitation training. The instruction may be, for example, a frame-shaped line, and may be displayed such that the user U undergoing rehabilitation training is positioned inside the frame-shaped line. Further, for example, the instruction is two lines, one of which overlaps with the user U, and the other of which overlaps with a predetermined mark related to rehabilitation training. may be displayed in Note that the shape of the instruction is not limited to the above.

By providing such a display control unit 291a, moving image data acquired by the rehabilitation movement evaluation device 200a keeps the distance between the photographing device 300a and the user U at a predetermined distance and includes distance information. 2D moving image data.

The second storage unit 242a is a storage device that stores reference data 246a. The reference data 45 is, for example, data indicating the relationship between the motion name of the rehabilitation training motion and the instruction displayed by the display unit 301a under the control of the display control unit 291a.

Second evaluation section 262a is the same as second evaluation section 262 of Embodiment 1 except that normalization section 2621 and motion evaluation section 2622 are not provided.

[Processing procedure of rehabilitation motion evaluation method]
Next, a specific processing procedure in the rehabilitation motion evaluation method executed by the rehabilitation motion evaluation device 200a will be described. FIG. 21 is a flowchart showing a processing procedure for evaluating the degree of rehabilitation training motion of user U by rehabilitation motion evaluation device 200a according to the present embodiment. Here, TUG (Timed Up and Go Test) is taken as an example of the rehabilitation training motion. TUG is measured, for example, as follows. First, the user U sits comfortably on a chair with armrests and stands up. Next, the user U walks to a mark (for example, a triangular cone) 3m ahead, turns back, and sits deeply again. In the TUG, the time required from standing up to sitting down is measured. 22A to 22G, which are examples of screens displayed by the display device 400, will be described based on actual examples.

First, the imaging control unit 290a controls the imaging device 300a to capture a two-dimensional moving image based on the operation for capturing an image of the user U undergoing rehabilitation training acquired from the reception device 500 (step S240). ). Further, the imaging control unit 290a may acquire the motion name (TUG) of the rehabilitation training motion performed by the user U via the reception device 500 . At this time, the imaging control unit 290a may output the action name of the operation and the rehabilitation training action to the display control unit 291a.

As in the first embodiment, the reception device 500a receives an operation for starting a rehabilitation training motion and an operation for determining the name of the user U who performs the rehabilitation training motion. When the rehabilitation motion evaluation device 200a acquires the operation, the second output unit 252 acquires the screen data corresponding to the TUG from the second storage unit 242a and transmits the acquired screen data to the display device 400. displays the screen corresponding to the acquired screen data.

Further, the display control unit 291a acquires an operation for capturing an image of the user U who is undergoing rehabilitation training and a motion name of the rehabilitation training motion from the imaging control unit 290a. Then, the display control unit 291a controls the display unit 301a to display an instruction to keep the distance between the photographing device 300a and the user U at a predetermined distance (step S250).

The instructions displayed by the display unit 301a under the control of the display control unit 291a are, for example, two lines as shown in FIG. 22A.

FIG. 22A is a diagram showing an example of a screen for accepting an operation indicating that settings related to rehabilitation training actions have been completed. In the present embodiment, the two lines are displayed as vertical dotted lines on display section 301a. Further, the instruction displayed by the display unit 301a may be used as a threshold for the second evaluation unit 262a to evaluate the degree of the rehabilitation training motion. Therefore, in FIG. 22A, the two lines are the fifth threshold L5 and the sixth threshold L6, respectively. For example, when the coordinate positions of the joints of the user U included in the skeleton information of the user U estimated by the estimation unit 280 exceed a threshold value, the second evaluation unit 262a evaluates the degree of rehabilitation training motion. may Details will be described later.

Here, for example, the leader follows the instructions shown in FIG. 22A and acts so that the distance between the two vertical dotted lines is 3 m. The distance between the chair on which the user U sits and the mark (triangular cone) is set to 3 m in advance. This makes it possible to keep the distance between the photographing device 300a and the user U at a predetermined distance.

The evaluation performed by the rehabilitation motion evaluation device 200a may be performed in real time. That is, the moving image data captured by the imaging device 300a is sequentially output to the rehabilitation motion evaluation device 200a, and the rehabilitation motion evaluation device 200a evaluates the degree of the rehabilitation training motion performed by the user U. In other words, the imaging of the moving image by the imaging device 300a and the evaluation by the rehabilitation motion evaluation device 200a proceed almost simultaneously.

Therefore, as shown below, in FIGS. 22B to 22G (steps S110 to S130) as well, the display unit 301a displays an instruction to keep the distance between the photographing device 300a and the user U at a predetermined distance. be.

Here, for example, the instructor follows the instruction shown in FIG. 22A and performs an operation indicating that the setting is completed by pressing a "setting complete" button. When accepting device 500 accepts the operation, display device 400 displays a screen for accepting an operation for starting a rehabilitation training action.

FIG. 22B is a diagram showing an example of a screen for accepting an operation for starting a rehabilitation training action. As shown in FIG. 22B, the rehabilitation training motion (TUG), the determined name of the user U (for example, Mr. B), and the user U before performing the rehabilitation training motion are displayed on the display device 400. there is

For example, the instructor follows the instruction shown in FIG. 22B and presses the "start" button to perform an operation for starting rehabilitation training. When accepting device 500 accepts the operation, display device 400 displays a screen for evaluating the degree of rehabilitation training motion.

FIG. 22C is a diagram showing an example of a screen for evaluating the degree of user U's rehabilitation training motion. FIG. 22D is a diagram showing another example of the screen for evaluating the degree of the user U's rehabilitation training motion. FIG. 22E is a diagram showing another example of a screen for evaluating the degree of rehabilitation training action of the user U. FIG. FIG. 22F is a diagram showing another example of the screen for evaluating the degree of the user U's rehabilitation training motion.

22C to 22F, the rehabilitation motion evaluation device 200a acquires moving image data from the imaging device 300a, and evaluates the degree of rehabilitation training motion performed by the user U from the acquired moving image data. 22C to 22F are diagrams showing the sequential passage of time.

Specifically, the third acquisition unit 223 acquires moving image data (two-dimensional moving image data) of the user U undergoing rehabilitation training through the imaging device 300a (step S110). Next, the estimation unit 280 estimates skeleton information of the user U based on the two-dimensional video data (step S120). Furthermore, the second evaluation unit 262a evaluates the degree of the rehabilitation training action performed by the user U based on the skeleton information estimated in step S120 (step S130). At this time, the second output unit 252 sequentially outputs to the display device 400 the evaluation results of the rehabilitation training actions performed by the user U evaluated by the second evaluation unit 262a. Therefore, the display device 400 displays the evaluation result of the rehabilitation training motion (time shown in FIGS. 22C to 22F) even while the user U is performing the rehabilitation motion training. That is, the rehabilitation motion evaluation device 200a can evaluate the rehabilitation training motion in real time.

Note that the start time of the time required from standing up to sitting down in the TUG may be, for example, the time when the "start" button is pressed, and the coordinate position of one joint of the user U included in the skeleton information is the threshold. It can be when it crosses a certain vertical dotted line.

In this embodiment, the start time of the time required from standing up to sitting down in the TUG is when the coordinate position of the ankle joint of the user U exceeds the fifth threshold value L5 (see FIG. 22C). In addition, the time required for the outward trip in TUG is the time until the coordinate position of the ankle joint of the user U exceeds the fifth threshold value L5 and the coordinate position of the ankle joint of the user U reaches the sixth threshold value L6. (See Figures 22D and 22E). The time required for the turn is that the coordinate position of the ankle joint of the user U exceeds the sixth threshold L6, the coordinate position of the ankle joint of the user U turns around the mark (triangular cone), and reaches the sixth threshold L6 again. (see Figures 22E and 22F). The time required for the return trip is the time from when the coordinate position of the ankle joint of the user U exceeds the sixth threshold value L6 to when the coordinate position of the ankle joint of the user U reaches the fifth threshold value L5 (Fig. 22F and See Figure 22G). Furthermore, when the coordinate position of the ankle joint of the user U exceeds the fifth threshold value L5 again, the rehabilitation motion evaluation device 200a determines that the rehabilitation training motion has been achieved.

As a result, the second output unit 252 acquires from the second storage unit 242a the screen data notifying that the training has ended, transmits the acquired screen data to the display device 400, and the display device 400 Display the screen corresponding to the screen data. FIG. 22G is a diagram showing an example of a screen for notifying that user U's rehabilitation training has ended.

Further, for example, the instructor may perform an operation for restarting rehabilitation training by pressing a "restart" button as shown in FIG. 22G. When accepting device 500 accepts the operation, display device 400 displays again the screen for evaluating the degree of rehabilitation training motion.

At this time, the second output unit 252 further outputs the evaluation result of the rehabilitation training motion performed by the user U evaluated by the second evaluation unit 262a to the display device 400, and the display device 400 displays the degree of the rehabilitation training motion. may be displayed (measurement results shown in FIG. 22G).

[Effects, etc.]
As described above, the rehabilitation motion evaluation method further includes the imaging control step S240 and the display control step S250. In the imaging control step S240, a two-dimensional moving image that does not include distance information about the user undergoing rehabilitation training is displayed on an imaging device having a display unit that displays a moving image of the user undergoing rehabilitation training. control to take an image. A display control step S250 controls the display unit to display an instruction to keep the distance between the imaging device and the user at a predetermined distance.

As a result, the moving image data acquired by the rehabilitation motion evaluation method is two-dimensional moving image data in which the distance between the photographing device 300a and the user U is kept at a predetermined distance and which does not include distance information. The rehabilitation motion evaluation method can evaluate whether or not the rehabilitation training motion is performed correctly based on such two-dimensional moving image data. That is, in the rehabilitation motion evaluation method, it is not essential to obtain information from a dedicated device having a distance measuring function. Therefore, the rehabilitation motion evaluation method can easily evaluate whether or not the rehabilitation training motion is performed correctly.

(Other embodiments)
Although the rehabilitation motion evaluation method and the like according to Embodiments 1 and 2 have been described above, the present invention is not limited to the above embodiments.

The information processing device of Embodiment 1 is a device that includes a display device, a rehabilitation motion evaluation device, and a reception device, but is not limited to this, and each device may be an independent device. good. Similarly, the information processing apparatus of Embodiment 2 is a device that includes a display device, a rehabilitation motion evaluation device, a reception device, and a photographing device. It may be a separate device.

Also, in the above embodiments and modifications, each component may be realized by executing a software program suitable for each component. Each component may be realized by reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory by a program execution unit such as a CPU or processor.

Also, each component may be realized by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits. These circuits may be general-purpose circuits or dedicated circuits.

Also, general or specific aspects of the present invention may be implemented in a system, apparatus, method, integrated circuit, computer program or recording medium such as a computer-readable CD-ROM. Also, any combination of systems, devices, methods, integrated circuits, computer programs and recording media may be implemented.

For example, the present invention may be realized as a control method executed by a computer such as a control system, or as a program for causing a computer to execute such a control method. The present invention may also be implemented as a computer-readable non-temporary recording medium in which such a program is recorded.

In addition, forms obtained by applying various modifications to each embodiment and modifications that a person skilled in the art can think of, or arbitrarily changing the constituent elements and functions of each embodiment and modifications without departing from the spirit of the present invention The present invention also includes a form realized by combining with.

Reference Signs List 1 rehabilitation support system 10 rehabilitation support device 20 acquisition unit 30 determination unit 200, 200a, 200b rehabilitation motion evaluation device U user

Claims (6)

Daily life information, which is information about daily life based on a report of a user undergoing rehabilitation training, and objective exercise evaluation information obtained by evaluating the degree of exercise performed by the user with a rehabilitation movement evaluation device. an acquisition unit that acquires
Based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit, guidance and training content performed by the user under an instructor in a rehabilitation facility and self-training content voluntarily performed by the user. a determination unit that determines
an output unit that outputs the content of guidance and training determined by the determination unit and the content of voluntary training;
A rehabilitation support device. The acquisition unit acquires equipment information indicating training equipment installed in the rehabilitation facility,
The rehabilitation support device according to claim 1, wherein the determination unit determines, as the self-training content, first training content using the training equipment indicated by the equipment information acquired by the acquisition unit. The decision unit further
The rehabilitation support apparatus according to claim 2, wherein a second training content that does not include the user's physical function element to be strengthened is determined as the self-training content. The rehabilitation support device according to claim 3, wherein the determination unit determines the self-training content as training content having a higher priority than the second training content. A rehabilitation support method using a rehabilitation support device,
Daily life information, which is information about daily life based on a report of a user undergoing rehabilitation training, and objective exercise evaluation information obtained by evaluating the degree of exercise performed by the user with a rehabilitation movement evaluation device. an obtaining step to obtain;
Based on the daily life information and the objective exercise evaluation information acquired in the acquiring step, guidance and training content performed by the user under an instructor in a rehabilitation facility and self-training content voluntarily performed by the user. a decision step of determining
and an output step of outputting the content of guidance and training determined by the determination step, and the content of self-training. A rehabilitation support system comprising the rehabilitation support device according to any one of claims 1 to 4.

Images