JP2021049319A - Rehabilitation operation evaluation method and rehabilitation operation evaluation device - Google Patents

Abstract

To provide a rehabilitation operation evaluation method further easily evaluating whether or not a rehabilitation training motion is properly performed.SOLUTION: A rehabilitation operation evaluation method comprises: an acquisition step S110 of acquiring two-dimensional moving image data which are moving image data where a user receiving rehabilitation training is photographed and contain no distance information; an estimation step S120 of estimating skeletal information showing the skeleton of the user in the two-dimensional moving image data on the basis of the two-dimensional moving image data acquired in the acquisition step S110; and an evaluation step S130 of evaluating the degree of the rehabilitation training motion related to rehabilitation training the user receives on the basis of the skeletal information estimated in the estimation step S120.SELECTED DRAWING: Figure 21

Description

The present invention relates to a rehabilitation motion evaluation method and a rehabilitation motion evaluation device.

Conventionally, a program for evaluating whether or not the rehabilitation training operation is correctly performed according to the rules has been known from the skeletal information of the user who performs the rehabilitation training operation.

In the program disclosed in Patent Document 1, when collecting operation information representing a rehabilitation operation performed by a user, for example, information in which the distance between the distance image collecting unit and the user is measured by the distance image collecting unit. Distance image information is collected. In the program, based on this distance image information, motion information including information on the skeleton of the user in the coordinate system of the three-dimensional space is obtained, and based on the motion information, the rehabilitation training motion is performed according to the rules. It is evaluated whether it is done correctly.

Japanese Unexamined Patent Publication No. 2014-155693

However, in the program disclosed in Patent Document 1, it is essential to collect distance image information from a device having a distance measuring function. Therefore, in order to collect the distance image information, a dedicated device is required, and it is not easy to evaluate whether or not the rehabilitation training operation is correctly performed in the program.

Therefore, the present invention provides a rehabilitation motion evaluation method and the like for easily evaluating whether or not the rehabilitation training motion is correctly performed.

The rehabilitation motion evaluation method according to one aspect of the present invention is a rehabilitation motion evaluation method using a rehabilitation motion evaluation device, which is moving image data obtained by photographing a user undergoing rehabilitation training and does not include distance information2. An acquisition step for acquiring dimensional moving image data, and an estimation step for estimating skeleton information indicating the skeleton of the user in the two-dimensional moving image data based on the two-dimensional moving image data acquired in the acquisition step. An evaluation step for evaluating the degree of rehabilitation training operation related to the rehabilitation training performed by the user based on the skeletal information estimated in the estimation step is included.

Further, the present invention may be realized as a program for causing a computer to execute the rehabilitation operation evaluation method.

Further, the rehabilitation motion evaluation device according to one aspect of the present invention includes an acquisition unit that acquires two-dimensional moving image data that is moving image data taken by a user undergoing rehabilitation training and does not include distance information. Based on the two-dimensional moving image data acquired by the acquisition unit, an estimation unit that estimates skeleton information indicating the skeleton of the user in the two-dimensional moving image data, and an estimation unit that estimates the skeleton information estimated by the estimation unit. Further, it is provided with an evaluation unit for evaluating the rehabilitation training operation related to the rehabilitation training performed by the user.

According to the rehabilitation motion evaluation method of the present invention, it is possible to easily evaluate whether or not the rehabilitation training motion is correctly performed.

FIG. 1 is a diagram showing a configuration of a rehabilitation support system according to the first embodiment. FIG. 2 is a block diagram showing a characteristic functional configuration of the rehabilitation support device according to the first embodiment. FIG. 3 is a flowchart showing a processing procedure in which the rehabilitation support device according to the first embodiment determines the content of rehabilitation training for the user. FIG. 4A is a diagram showing an example of a screen corresponding to a blank table of daily life information according to the first embodiment. FIG. 4B is a diagram showing an example of a screen corresponding to a table of daily life information obtained by the user's response according to the first embodiment. FIG. 5 is a diagram showing an example of a screen showing activities of daily living that need improvement. FIG. 6 is a diagram showing an example of a screen that accepts the selection of detailed activities of daily living that the user is most troubled with. FIG. 7 is a diagram showing an example of a screen that accepts the selection of information related to detailed activities of daily living that the user is most troubled with. FIG. 8 is a diagram showing an example of a screen of a table for determining an exercise motion performed by a user. FIG. 9 is a flowchart showing a processing procedure in which the second determination unit according to the first embodiment determines a short-term goal. FIG. 10 is a diagram showing an example of a screen corresponding to the user's short-term goal information, training content information, and long-term goal information. FIG. 11 is a diagram showing another example of the screen corresponding to the user's short-term goal information, training content information, and long-term goal information. FIG. 12 is a diagram showing an example of a screen in which a user accepts an operation for changing a long-term goal. FIG. 13 is a diagram showing an example of a screen corresponding to the evaluation result. FIG. 14 is a diagram showing an example of a screen showing schedule management information. FIG. 15 is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation device according to the first embodiment. FIG. 16A is a diagram showing one frame of moving image data taken of a user undergoing rehabilitation training according to the first embodiment. FIG. 16B is a diagram in which the skeletal information of the user shown in FIG. 16A is estimated. FIG. 17 is a flowchart showing a processing procedure in which the rehabilitation motion evaluation device according to the first embodiment evaluates the degree of the rehabilitation training motion of the user. FIG. 18A is a diagram showing an example of a screen corresponding to the skeleton information of the user estimated by the estimation unit according to the first embodiment. FIG. 18B is a diagram showing a process in which a plurality of joint positions in the skeletal information of FIG. 18A are standardized. FIG. 18C is a diagram showing an example of evaluating the degree of rehabilitation training motion based on the plurality of standardized joint positions shown in FIG. 18B. FIG. 18D is a diagram showing an example of evaluating the degree of rehabilitation training movement based on a plurality of unstandardized joint positions in the skeletal information shown in FIG. 18A. FIG. 19A is a diagram showing an example of a screen for accepting an operation indicating that the setting related to the rehabilitation training operation is completed. FIG. 19B is a diagram showing an example of a screen that accepts an operation for starting a rehabilitation training operation. FIG. 19C is a diagram showing an example of a screen for evaluating the degree of rehabilitation training operation of the user. FIG. 19D is a diagram showing an example of a screen for notifying that the rehabilitation training of the user has been completed. FIG. 19E is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation device according to the modified example of the first embodiment. FIG. 19F is a diagram showing an example of the feature amount calculated by the discriminating unit according to the modified example of the first embodiment. FIG. 19G is a diagram showing a plurality of joint positions in an unknown posture standardized by the standardization unit according to the modified example of the first embodiment. FIG. 19H is a diagram showing another example of the feature amount calculated by the discriminating unit according to the modified example of the first embodiment. FIG. 19I is a flowchart showing a processing procedure in which the rehabilitation motion evaluation device according to the modified example of the first embodiment evaluates the degree of the rehabilitation training motion of the user. FIG. 19J is a diagram showing a plurality of joint positions of the posture of the trouser raising / lowering training standardized by the standardization unit according to the modified example of the first embodiment. FIG. 19K is a diagram showing a plurality of joint positions of unknown postures in the trouser raising / lowering training standardized by the standardization unit according to the modified example of the first embodiment. FIG. 19L is a diagram showing a time-series change in the posture of the user U in the trouser raising / lowering training according to the modified example of the first embodiment. FIG. 19M is a diagram showing measured values and calculated values of the operation execution time in the trouser raising / lowering training according to the modified example of the first embodiment. FIG. 20 is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation device according to the second embodiment. FIG. 21 is a flowchart showing a processing procedure in which the rehabilitation motion evaluation device according to the second embodiment evaluates the degree of the rehabilitation training motion of the user. FIG. 22A is a diagram showing an example of a screen for accepting an operation indicating that the setting related to the rehabilitation training operation is completed. FIG. 22B is a diagram showing an example of a screen for accepting an operation for starting a rehabilitation training operation. FIG. 22C is a diagram showing an example of a screen for evaluating the degree of rehabilitation training operation of the user. FIG. 22D is a diagram showing another example of a screen for evaluating the degree of rehabilitation training operation of the user. FIG. 22E is a diagram showing another example of a screen for evaluating the degree of rehabilitation training operation of the user. FIG. 22F is a diagram showing another example of a screen for evaluating the degree of rehabilitation training operation of the user. FIG. 22G is a diagram showing an example of a screen for notifying that the rehabilitation training of the user has been completed.

Hereinafter, embodiments will be specifically described with reference to the drawings. It should be noted that all of the embodiments described below show comprehensive or specific examples. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, etc. shown in the following embodiments are examples, and are not intended to limit the present invention. Further, among the components in the following embodiments, the components not described in the independent claims will be described as arbitrary components.

It should be noted that each figure is a schematic view and is not necessarily exactly shown. Further, in each figure, substantially the same configuration may be designated by the same reference numerals, and duplicate description may be omitted or simplified.

(Embodiment 1)
[Configuration of rehabilitation support device]
The configuration of the rehabilitation support system 1 according to the present embodiment will be described. FIG. 1 is a diagram showing a configuration of a rehabilitation support system 1 according to the present embodiment.

The rehabilitation support system 1 determines the training content of the rehabilitation training based on the daily life information of the user U and the exercise movement performed by the user U, and evaluates the effect obtained by the user U performing the training content. It is a system for doing. The rehabilitation training is, for example, training aimed at improving the activities of daily living of the user U. In addition, the activity of daily living refers to, for example, the ability of a person to carry out daily life. As a specific example, the rehabilitation support system 1 determines the content of the rehabilitation training of the user U whose activity of daily living has deteriorated due to aging, illness, or injury, and evaluates the effect of the rehabilitation training conducted by the user U.

Such a rehabilitation support system 1 is a system operated in a nursing care facility, a medical facility, or the like. A long-term care facility or a medical facility is, for example, a rehabilitation facility where outpatient rehabilitation is carried out. The rehabilitation support system 1 supports the work performed by care workers (life counselors, functional training instructors (therapists, nurses, etc.), care helpers, managers of the facilities, etc.) at the above facilities.

As shown in FIG. 1, the rehabilitation support system 1 includes a rehabilitation support device 10 and an information processing device 100.

The rehabilitation support device 10 rehabilitates based on the above-mentioned daily life information and objective movement evaluation information obtained by evaluating the degree of movement movement performed by the user U by the rehabilitation movement evaluation device (details will be described later). Determine the training content of the training. Further, the rehabilitation support device 10 evaluates the effect obtained by the user U performing the determined training content. The rehabilitation support device 10 is, for example, a computer, but is not limited to this, and may be a server device.

The information processing device 100 may be a device including a display device, a rehabilitation operation evaluation device, and a reception device. As the information processing device 100, for example, an information terminal such as a smartphone or a tablet terminal may be used, but the information processing device 100 is not limited to this.

The information processing device 100 may display the training content and the evaluation result of the effect of the rehabilitation training as a display device. Further, the information processing device 100 may display a screen based on the screen data output from the rehabilitation support device 10 as a display device.

Specifically, the display device is a monitor device composed of a liquid crystal panel, an organic EL panel, or the like. The display device may be a separate device independent of the information processing device 100.

The rehabilitation motion evaluation device is a device that evaluates the degree of training motion related to the rehabilitation training performed by the user U. Further, the rehabilitation motion evaluation device may be a device that obtains objective motion evaluation information by evaluating the degree of motion motion performed by the user U.

In this specification, first, the rehabilitation motion evaluation device will be described as a device for evaluating the degree of motion motion.

The rehabilitation motion evaluation device evaluates the degree of the motion motion (for example, the performance or failure of the motion motion) depending on whether or not the motion motion performed by the user U satisfies a predetermined motion condition. Here, the exercise motion is an motion for evaluating the activity of daily living of the user U. The motor movement may be a movement for a person to carry out daily life. Further, for example, the exercise motion may be an motion performed at a rehabilitation facility on a regular basis (for example, once every three months). Specifically, the rehabilitation motion evaluation device determines whether or not the "walking" (exercise motion) performed by the user U satisfies "a 4 m walk is possible with the assistance of a caregiver" (predetermined exercise condition). evaluate. That is, the rehabilitation motion evaluation device evaluates whether or not the motion motion is correctly performed by the user U, and outputs the result as objective motion evaluation information to the rehabilitation support device 10. The details of the rehabilitation operation evaluation device will be described with reference to FIGS. 15 and 15.

Here, the prior art of the device for determining the service content for the user who uses the rehabilitation facility will be described. The following patent document discloses an apparatus for determining a service content based on information such as a user's activity of daily living input by the user (Japanese Unexamined Patent Publication No. 2019-46474). Further, the patent document discloses that, for example, improvement of the user's activity of daily living is expected by providing the user with the service content determined by the device.

However, the above information is the information input by the user, that is, the subjective information of the user. Therefore, the above information may not be accurate information, and the determined service content may not be appropriate for the user. In such a case, even if the service content determined by the device is provided, the user's ability to perform activities of daily living may not be sufficiently improved and the rehabilitation effect may not be obtained. Therefore, it is required to provide such users with service contents (for example, rehabilitation training contents) that can obtain a higher rehabilitation effect.

Therefore, for example, in the present embodiment, the degree of exercise motion for evaluating the activity of daily living of the user U is evaluated by the rehabilitation motion evaluation device. As a result, the activity of daily living of the user U can be evaluated more accurately than the case where the activity of daily living of the user U is evaluated by the subjectivity of the user U as shown in the prior art. Further, by being evaluated by the rehabilitation motion evaluation device in this way, for example, the exercise motion satisfies a predetermined condition rather than being visually evaluated by a person (for example, a care worker). It is possible to accurately evaluate whether or not it is operating. That is, the rehabilitation support device 10 can acquire objective exercise evaluation information which is the result of more accurately evaluating the activity of daily living of the user U.

The reception device may be a touch panel or a hardware button. The reception device may, for example, accept an operation for inputting daily life information. The reception device outputs daily life information to the rehabilitation support device 10 based on the received operation. The reception device may, for example, receive an operation related to rehabilitation support from a care worker and output it to the rehabilitation support device 10.

Here, the daily life information is information related to daily life based on the declaration of the user U. The activities of daily living information may include, for example, personal information of the user U and information on activities of daily living. (Details will be described in FIGS. 4A and 4B). Further, since the daily life information is information based on the declaration of the user U, it can be said that the daily life information is the subjective information of the user U regarding the daily life. The daily life information may be information based on the declaration of the user U's family.

The rehabilitation support device 10 and the information processing device 100 may be connected by wire as long as they can transmit and receive information such as objective exercise evaluation information and daily life information, and as shown in FIG. It may be connected so that wireless communication is possible.

The rehabilitation support device 10 determines the training content of the rehabilitation training based on the daily life information and the objective exercise evaluation information obtained by the rehabilitation motion evaluation device, and the effect obtained by the user U performing the training content. To evaluate. Further, the rehabilitation support device 10 outputs the determined training content and the evaluation result of evaluating the effect obtained by the user U performing the training content to the information processing device 100 which is a display device.

Therefore, in the rehabilitation support system 1, whether the degree of the exercise motion for evaluating the activity of daily living of the user U is evaluated by the rehabilitation motion evaluation device, and the motion motion satisfies a predetermined condition. Whether or not it can be evaluated accurately. The rehabilitation support system 1 can determine the training content of the rehabilitation training based on such an accurately evaluated activity of daily living ability of the user U.

In addition, the rehabilitation support system 1 can evaluate the effect obtained by the user U performing the training content.

FIG. 2 is a block diagram showing a characteristic functional configuration of the rehabilitation support device 10 according to the present embodiment. The rehabilitation support device 10 includes an acquisition unit 20, a determination unit 30, a first output unit 51, a first storage unit 41, a first evaluation unit 61, a reception unit 70, and a transmission unit 71.

The acquisition unit 20 acquires daily life information and objective exercise evaluation information. More specifically, the acquisition unit 20 acquires daily life information and objective exercise evaluation information from the information processing device 100. The acquisition unit 20 is, for example, a communication interface for performing wired communication or wireless communication.

The acquisition unit 20 may have a first acquisition unit 21 and a second acquisition unit 22. The first acquisition unit 21 may acquire daily life information, and the second acquisition unit 22 may acquire objective exercise evaluation information. In addition, the second acquisition unit 22 further acquires subjective exercise independence degree information. The subjective exercise independence degree information is information on the independence degree of the exercise movement actually performed by the user U at the user U's home. That is, the subjective exercise independence degree information is a result showing the independence degree of the exercise movement actually performed by the user U himself / herself at home. Specifically, the subjective exercise independence information means that when the user U himself "moves from the living room to the toilet", the "walking" (exercise movement) actually performed by the user U is "independence". It is information indicating whether it corresponds to "watching", "partial assistance", or "total assistance". The degree of independence of motor movement decreases in the order of independence, watching, partial assistance, and total assistance. Further, when the user U is fully assisted (for example, in a bedridden state), the caregiver of the user U (for example, the family of the user U) performs an exercise motion. That is, the exercise motion may be an motion performed by the user U, or may be an motion performed by the user U and the caregiver of the user U. Further, as will be described later, the subjective exercise independence degree information is information based on a predetermined question and an answer to the question (details are shown in FIG. 7). Since the second acquisition unit 22 may acquire the subjective movement independence degree information from the user U via the information processing device 100 which is the reception device, the user may use the subjective movement independence degree information. Information based on U's guess may be included to some extent.

The determination unit 30 is a processing unit that the user U performs to determine the training content of the rehabilitation training based on the daily life information acquired by the acquisition unit 20 and the objective exercise evaluation information. Specifically, the determination unit 30 is realized by a processor, a microcomputer, or a dedicated circuit. The content determined by the determination unit 30 may be output to the first output unit 51.

The determination unit 30 may include a first determination unit 31 and a second determination unit 32. The first determination unit 31 may determine the exercise motion based on the daily life information acquired by the first acquisition unit 21. The second determination unit 32 may determine the training content based on the objective exercise evaluation information acquired by the second acquisition unit 22. The second determination unit 32 may determine a short-term goal, which is a predetermined short-term rehabilitation goal of the user U, based on the difference between the subjective exercise independence degree information and the objective exercise evaluation information. The short-term goal may be a goal that the user U aims at after a predetermined period (for example, 3 months) from the start time of the rehabilitation training by receiving the rehabilitation training. The period is not limited to 3 months. The second determination unit 32 may determine a long-term goal, which is a predetermined long-term rehabilitation goal of the user U, based on the short-term goal. The long-term goal is a goal for a period longer than the short-term goal, and may be, for example, a goal that the user U aims at 6 months after a predetermined time. As with the determination unit 30, the content determined by the first determination unit 31 and the second determination unit 32 may be output to the first output unit 51.

The determination unit 30 (more specifically, the first determination unit 31) collates the daily life information acquired by the first acquisition unit 21 with the reference data 45 stored in the first storage unit 41 and uses it. Determines the movements performed by the person U.

The determination unit 30 (more specifically, the second determination unit 32) collates the objective motion evaluation information acquired by the second acquisition unit 22 with the reference data 45 stored in the first storage unit 41. , Determine the training content to be performed by user U. Further, the determination unit 30 (more specifically, the second determination unit 32) stores the difference between the subjective movement independence degree information and the objective movement evaluation information acquired by the second acquisition unit 22 and the first storage unit 41. The short-term goal to be performed by the user U may be determined based on the stored information related to the user U.

The first storage unit 41 is a storage device in which the reference data 45 is stored. The details of the reference data 45 will be described later with reference to FIG. 8, but the reference data 45 shows, for example, the relationship between the daily life information and the exercise motion used for determining the exercise motion performed by the user U. It is data. The first storage unit 41 is realized by, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a semiconductor memory, an HDD (Hard Disk Drive), or the like.

Further, the first storage unit 41 is used when outputting information on the program executed by the determination unit 30, the first evaluation unit 61, the reception unit 70, and the transmission unit 71, and the motion motion of the user U. Screen data indicating information is also stored.

Further, the information related to the user U acquired by the acquisition unit 20 may be stored in the first storage unit 41 in association with each user U. Information related to user U includes activities of daily living information, subjective exercise independence information, objective exercise evaluation information, information on detailed living movements that user U is most troubled with, and user. Includes information related to activities of daily living, exercise movement information, etc. (details will be described later), which U is most troubled with.

The first evaluation unit 61 is a processing unit that evaluates the effect obtained by the user U performing the training content. Specifically, the first evaluation unit 61 is realized by a processor, a microcomputer, or a dedicated circuit.

The first evaluation unit 61 evaluates the effect obtained by performing the training content by comparing the objective exercise evaluation information before and after the user U performs the training content of the rehabilitation training, for example. May be good. Specifically, the objective exercise evaluation information before the user U performs the training content may be the objective exercise evaluation information on the day when the user U starts the rehabilitation training. Further, the objective exercise evaluation information after the user U has performed the training content may be the objective exercise evaluation information on the day when three months have passed from the day when the user U started the rehabilitation training. In this way, the first evaluation unit 61 evaluates the effect obtained by the user U performing the training content for a certain period (for example, 3 months). In the first evaluation unit 61, the objective exercise evaluation information after the user U acquired by the acquisition unit 20 performs the training content of the rehabilitation training and the user U stored in the first storage unit 41 perform the rehabilitation training. The effect may be evaluated by comparing with the objective exercise evaluation information before the training content is performed. The evaluation result evaluated by the first evaluation unit 61 may be output to the first output unit 51.

The first output unit 51 outputs the training content determined by the determination unit 30 and the evaluation result evaluated by the first evaluation unit 61 to the information processing device 100 which is a display device. The first output unit 51 is, for example, a communication interface for performing wired communication or wireless communication.

The reception unit 70 is a processing unit that receives an evaluation of the rehabilitation support device 10 from a user who uses the rehabilitation support device 10. The reception unit 70 receives an evaluation from a user, for example, via an information processing device 100 which is a reception device.

The user is a person who uses the rehabilitation support device 10 to instruct the rehabilitation training received by the user U, and may be, for example, a physical therapist or an occupational therapist. Moreover, the user may be a care worker. Further, the user may be a person who assists a physical therapist, an occupational therapist, or a care worker. The evaluation is a score indicating the degree of excellence such as ease of use of the rehabilitation support system 1, and the evaluation may be, for example, the number of stars indicating the degree of goodness, and is "GOOD" or "GOOD". It may be an opinion such as "BAD".

The transmission unit 71 is a processing unit that transmits the evaluation received by the reception unit 70 to the administrator of the rehabilitation support device 10.

Specifically, the transmitter 71 is realized by a processor, a microcomputer, or a dedicated circuit. When the transmission unit 71 transmits the evaluation to the administrator, the communication used may be wired communication or wireless communication.

The manager of the rehabilitation support device 10 is a natural person or a corporation that manages the rehabilitation support device 10 and provides it as a service. The administrator is, for example, a developer of the rehabilitation support device 10, and the administrator uses the transmitted evaluation from the user to improve the usability of the rehabilitation support device 10.

By such a reception unit 70 and a transmission unit 71, the manager of the rehabilitation support device 10 can obtain an evaluation of the rehabilitation support device from the user who uses the rehabilitation support device 10.

The determination unit 30, the first evaluation unit 61, the reception unit 70, and the transmission unit 71 may be realized by one processor, a microcomputer, or a dedicated circuit having their respective functions. Further, the determination unit 30, the first evaluation unit 61, the reception unit 70, and the transmission unit 71 may be realized by a combination of two or more of a processor, a microcomputer, or a dedicated circuit.

[Processing procedure of rehabilitation support method]
Subsequently, a specific processing procedure in the rehabilitation support method executed by the rehabilitation support device 10 will be described.

FIG. 3 is a flowchart showing a processing procedure in which the rehabilitation support device 10 according to the present embodiment determines the rehabilitation training content of the user U. More specifically, it is a flowchart showing a processing procedure in which the rehabilitation support device 10 determines the short-term goal, the training content, and the long-term goal of the user U, and the user U evaluates the effect obtained by performing the training content. ..

First, the acquisition unit 20 (more specifically, the first acquisition unit 21) acquires the daily life information of the user U via the information processing device 100 (step S10). FIG. 4A is a diagram showing an example of a screen corresponding to a table in which daily life information according to the present embodiment is unanswered. FIG. 4B is a diagram showing an example of a screen corresponding to a table of daily life information obtained by the answer of the user U according to the present embodiment.

The rehabilitation support device 10 acquires screen data of a screen corresponding to FIG. 4A stored in the first storage unit 41, and displays the screen data via the first output unit 51 as an information processing device 100. It may be output to. Then, the display device displays a screen for receiving the daily life information of the user U. As a result, the information processing device 100, which is a reception device, may be able to receive daily life information.

At this time, the information processing device 100 accepts an operation for inputting daily life information, which is information based on the declaration of the user U, as a reception device. The reception device outputs daily life information to the acquisition unit 20 based on the received operation. The person who operates the reception device may be the user U or the family of the user U. Further, the person who operates the reception device may be a care worker, and the care worker visits the home of the user U, obtains daily life information from the user U and the family of the user U, and uses the reception device. By operating the information processing device 100, the information processing device 100 may receive daily life information. In addition, up to step S22, which will be described later, may be a processing procedure performed when a care worker (for example, a life counselor) in charge of the user U visits the home of the user U.

As shown in FIGS. 4A and 4B, the activities of daily living information may include personal information of the user U and information on activities of daily living. The personal information of the user U includes the name of the user U, the date of birth, the gender, the degree of care, and the name of the care worker in charge of the user U. Although not shown in FIGS. 4A and 4B, the personal information of the user U may include the medical history information of the user U. The medical history information is information on the medical history of the user U, for example, information on the past and present morbidity and health condition of the user U.

Further, the information on activities of daily living is the information on activities of daily living described below. Activities of daily living include activities of daily living (ADL (Activities of Daily Living)), means of daily living (IADL (Instrumental Activities of Daily Living)), and movements such as moving up.

Activities of daily living include eating, excreting, bathing, changing clothes, dressing and transferring. Means daily life movements include indoor movements, outdoor movements, stair climbing, cooking, washing and cleaning movements. Getting up includes the movements of getting up, sitting, standing up and standing up.

The information on activities of daily living includes information on the degree of independence, which is information on the degree of independence of the activities of daily living of the user U, information on tasks, and information on situations and activities of daily living. In addition, information on activities of daily living and activities of daily living related to means of daily living further includes information on the environment (place of implementation / auxiliary equipment).

The degree of independence of the user U decreases in the order of independence, watching, partial assistance, and total assistance, for example. Information on issues of daily living in which the degree of independence of user U is less than or equal to watching includes information that there is an issue. Information on the environment (implementation status / auxiliary equipment) includes information on the type or usage status of the auxiliary equipment, the person who assists, and the implementation status at home.

Information on situations and life tasks includes information summarizing each of activities of daily living, activities of daily living, and wake-up.

As described above, the acquisition unit 20 acquires the daily life information and outputs the acquired daily life information to the determination unit 30.

The determination unit 30 (more specifically, the first determination unit 31) determines an activity of daily living that needs improvement based on the activities of daily living output by the acquisition unit 20 (step S11). Specifically, the determination unit 30 extracts the activities of daily living that have a problem in the information of the activities of daily living included in the activities of daily living. For example, as shown in FIG. 4B, the determination unit 30 extracts changing clothes, transfer, indoor movement, and outdoor movement as activities of daily living with problems. The determination unit 30 determines the activities of daily living that need improvement from the activities of daily living that have the extracted problems.

The determination unit 30 may determine activities of daily living that need improvement based on the degree of independence information. That is, the determination unit 30 may determine an activity of daily living having a low degree of independence and an activity of daily living that needs improvement. Further, the determination unit 30 may preferentially determine a more basic movement in the daily living as a daily living that needs improvement. The determination unit 30 has higher priority in the order of, for example, cleaning, washing, cooking, outdoor movement, dressing, bathing, changing clothes, meals, excretion, stair climbing, indoor movement, transfer, standing, standing, sitting, and getting up (standing). It may be judged as a more basic movement) and determined as a daily movement that needs improvement.

Specifically, the determination unit 30 may determine the indoor movement and the outdoor movement, which have the lowest degree of independence among the activities of daily living having the extracted problems, as the activities of daily living that need improvement. Further, the determination unit 30 may determine indoor movement, which is a more basic operation among indoor movement and outdoor movement, as an activity of daily living that requires improvement.

In this way, the determination unit 30 (more specifically, the first determination unit 31) determines the activities of daily living that need improvement based on the degree of independence information, thereby preferentially improving the more basic activities. Can be determined as a necessary activity of daily living.

The determination unit 30 may output the information of the activity of daily living including the activity of daily living that needs to be improved to the first output unit 51.

The first output unit 51 outputs information on activities of daily living determined by the determination unit 30 (step S12). In step S12, for example, the first output unit 51 acquires screen data of the screen corresponding to the activity of daily living determined by the determination unit 30 in step S11 from the first storage unit 41 and acquires it to the display device. Send the screen data. FIG. 5 is a diagram showing an example of a screen showing activities of daily living that need improvement.

The information processing device 100, which is a display device, displays a screen showing activities of daily living that need improvement. As shown in FIG. 5, the activities of daily living determined by the determination unit 30 that require improvement may be prioritized and displayed on the screen. In the example shown in FIG. 5, indoor movement, outdoor movement, and dressing are shown in descending order of priority. Further, as shown in FIG. 5, independence degree information may be displayed. The degree of independence of each activity of daily living may be displayed according to four stages of independence, watching, partial assistance, and total assistance. Specifically, a bar indicating the degree of independence may be displayed at the bottom of each activity of daily living surrounded by a circle, and the higher the degree of independence, the more the bar may be displayed so as to be filled with dots.

At this time, the information processing device 100 may accept from the user U an operation of selecting whether or not the activity of daily living that requires improvement, which is determined by the determination unit 30 in step S11, is appropriate as the reception device. For example, the activities of daily living determined by the determination unit 30 that require improvement may be changed by the user U if it is determined to be inappropriate. As shown in FIG. 5, characters such as "Please select the activity of daily living that you want to maintain / improve most" may be displayed. When the user U determines that the activities of daily living that require improvement determined by the determination unit 30 are appropriate, the process proceeds to the next step.

Subsequently, the acquisition unit 20 (more specifically, the first acquisition unit 21) acquires detailed information on activities of daily living that the user U is most troubled with (step S20). Further, the acquisition unit 20 (more specifically, the first acquisition unit 21) acquires the subjective movement independence degree information (step S20).

Here, as a reception device, the information processing device 100 accepts an operation from the user U for inputting the detailed activities of daily living that the user U is most troubled with. For simplification, "detailed activities of daily living" are also described as "detailed activities of daily living". The reception device outputs information on the detailed activities of daily living that the user U is most troubled with to the acquisition unit 20 based on the received operation. Detailed activities of daily living are movements that are subdivided into activities of daily living. For example, in indoor movement, which is an activity of daily living, there are specific examples such as "movement in the living room", "movement from the living room to the toilet", and "movement from the living room to the kitchen".

The detailed activities of daily living that the user U is most troubled with are the most difficult and specific activities of daily living for the user U in the activities of daily living that need improvement. FIG. 6 is a diagram showing an example of a screen that accepts the selection of detailed activities of daily living that the user U is most troubled with. As described above, when it is determined that the detailed activity of daily living that needs improvement is indoor movement, the information processing apparatus 100 displays the screen shown in FIG. As described above, the detailed activities of daily living that the user U is most troubled with are determined by the activities of daily living that need improvement, and the activities of daily living that need improvement are determined by the independence degree information. Furthermore, the daily life information includes the independence degree information. Therefore, the detailed information on activities of daily living that the user U is most troubled with is information based on activities of daily living.

The user U or the care worker selects the detailed activities of daily living that the user U is most troubled with. For example, as shown in FIG. 6, "movement from the living room to the toilet" is selected, and the information processing device 100 informs the acquisition unit 20 of the information for which the selection has been made (that is, the details that the user U is most troubled with). Information on daily activities) is output.

Next, the acquisition unit 20 (more specifically, the first acquisition unit 21) acquires information on the detailed activities of daily living that the user U is most troubled with. The acquisition unit 20 outputs information on detailed activities of daily living that the acquired user U is most troubled with to the determination unit 30.

Subsequently, the determination unit 30 determines the question content of the information related to the detailed activities of daily living that the user U is most troubled with, based on the information of the detailed activities of daily living that the user U is most troubled with. For example, if the activity of daily living that User U is most troubled with is "moving from the living room to the toilet", the question is "Are you going to the toilet alone?" (Details are shown in Fig. 7). .. For example, the determination unit 30 collates the information of the detailed activities of daily living that the user U is most troubled with with the data stored in the first storage unit 41, and determines the detailed activities of daily living that the user U is most troubled with. Determine the question content of the relevant information. At this time, in the data stored in the first storage unit 41, the question contents of the detailed activities of daily living that the user U is most troubled with and the information related to the detailed activities of daily living that the user U is most troubled with. Is associated and memorized.

At this time, the first storage unit 41 may store detailed information on activities of daily living that the user U is most troubled with in association with the user U.

The determination unit 30 outputs the determined question content to the first output unit 51.

The first output unit 51 outputs the question content determined by the determination unit 30. At this time, the first output unit 51 acquires, for example, the screen data of the screen showing the obtained question contents from the first storage unit 41, and transmits the acquired screen data to the display device.

Here, further, the information processing device 100, as a reception device, accepts an operation for inputting information related to the detailed activities of daily living that the user U is most troubled with. FIG. 7 is a diagram showing an example of a screen that accepts the selection of information related to the detailed activities of daily living that the user U is most troubled with. The information includes, for example, information on the implementation environment of the detailed activities of daily living that the user U is most troubled with, and information on the level of the current detailed activities of daily living.

The information on the implementation environment includes information on the degree of independence of a series of movements for the detailed activities of daily living that the user U is most troubled with, and information on the home environment of the user U for the detailed activities of daily living.

The information on the degree of independence of a series of movements regarding the detailed activities of daily living that the user U is most troubled with indicates, for example, the necessity of assistance and the necessity of assistive devices when the user U performs the detailed activities of daily living. Information. The information on the degree of independence of a series of movements about the detailed activities of daily living that the user U is most troubled with is, specifically, "1) Do you go to the toilet by yourself?" ) -4) ”and the answers to the questions.

Here, the subjective movement independence degree information will be described. The subjective exercise independence degree information is information based on the questions "1) to 3)" and the answers to the questions about the detailed activities of daily living shown by the user U in FIG. 7. Specifically, when the answer of 1) is "doing alone" and the answer of 2) is "no", the degree of subjective exercise independence is independent. If the answer to 1) is "I am doing it alone" and the answer to 2) is "Yes", the degree of subjective exercise independence is watching. When the answer of 1) is "someone is helping" and the answer of 3) is "only some movements", the degree of subjective exercise independence is partially assisted. If the answer in 1) is "someone is helping me" and the answer in 3) is "all the time on the move", the degree of subjective exercise independence is full assistance. The subjective motor independence degree obtained in this way is included in the subjective motor independence degree information. In addition, the degree of subjective movement independence may be associated with the score. For example, in terms of subjective motor independence, total assistance is 1 point, partial assistance is 2 points, watching is 3 points, and independence is 4 points. The degree of subjective movement independence is also referred to as the degree of subjective movement independence by being linked to the score.

The home environment information is information on the home environment of the user U. The information on the home environment is, for example, information on the moving distance, the step, or the stairs when the user U performs the detailed activities of daily living. The information on the home environment is specifically a question such as “5) Home environment” shown in FIG. 7 and an answer to the question. As described above, when the care worker in charge of the user U visits the home of the user U and obtains information on the home environment of the user U, the care worker does not visit the home. In comparison, the rehabilitation support device 10 can acquire more accurate information on the home environment of the user U.

The information on the level of detailed activities of daily living is information summarizing the information of the implementation environment, and as shown in FIG. 7, the detailed activities of daily living that can be performed by the current user U is shown. Specifically, the levels of detailed activities of daily living are the detailed activities of daily living (“from living room to toilet”) that user U is most troubled with, the degree of independence of a series of activities (“partial assistance”), and assistive devices (“partial assistance”). It is composed of a "handrail") and a home environment (which can move over a "step" over a distance of "5m"). Here, the auxiliary tools are, in descending order of difficulty, none, cane, handrail / support, walker, and wheelchair.

As a reception device, the information processing device 100 outputs to the acquisition unit 20 the information on the detailed activities of daily living that the received user U is most troubled with and the information related to the detailed activities of daily living that the user U is most troubled with. ..

As described above, the acquisition unit 20 (more specifically, the first acquisition unit 21) is included in the information related to the detailed activities of daily living that the user U is most troubled with and the information related to the detailed activities of daily living. Obtain information on the home environment and information on the degree of independence of subjective exercise. The first acquisition unit 21 determines the information related to the detailed activities of daily living that the user U is most troubled with, the information on the home environment included in the information related to the detailed activities of daily living, and the subjective exercise independence degree information. Output to unit 30.

The determination unit 30 (more specifically, the first determination unit 31) determines the exercise motion based on the daily life information (step S21). More specifically, the first decision unit 31 has a configuration in which each movement of the daily living is subdivided based on the detailed information of the daily living that the user U is most troubled with and the information of the home environment. The movement may be determined as a movement movement.

As described above, the information related to the detailed activities of daily living that the user U is most troubled with includes the information on the home environment. The information related to the detailed activities of daily living that the user U is most troubled with is the information based on the information of the detailed activities of daily living that the user U is most troubled with, and the information of the detailed activities of daily living that the user U is most troubled with. Information based on is information based on information on activities of daily living that need improvement. Further, the information on activities of daily living that needs improvement is information based on activities of daily living including information on the degree of independence. The information related to the detailed activities of daily living that the user U is most troubled with may include activities of daily living that need improvement.

The first determination unit 31 collates the daily life information with the reference data 45 stored in the first storage unit 41, and determines the exercise motion performed by the user U. More specifically, the first determination unit 31 collates the detailed information on the activities of daily living and the home environment information that the user U is most troubled with with the reference data 45 stored in the first storage unit 41. Then, the exercise motion (here, the constituent motion) performed by the user U is determined.

Here, the configuration operation will be described with reference to FIG. FIG. 8 is a diagram showing an example of a screen of a table for determining an exercise motion performed by the user U. More specifically, in the table shown in FIG. 8, activities of daily living, detailed activities of daily living, constituent movements, criteria for determining the degree of independence of the constituent movements, and training contents are described in a state of being linked to each other. ing. The constituent movements are movements in which each movement of daily living is subdivided. More specifically, the constituent movement is a movement in which each movement of the detailed life movement associated with the life movement is subdivided. The criteria for determining the degree of independence of the configuration operation and the training content will be described in steps S30 and subsequent steps described later.

The first determination unit 31 determines the constituent movements associated with the detailed activities of daily living that the user U is most troubled with as the movement movements that are the movements for evaluating the activities of daily living of the user U. For example, if the activity of daily living that needs improvement is "indoor movement" and the detailed activity of daily living is "movement from the living room to the toilet", the constituent actions are "walking", "turning", "straddling", and "straddling". "Stairs (steps) ascending and descending", but are not limited to these. Although not shown in FIG. 8, when the detailed activity of daily living is "movement from the living room to the toilet", the configuration operation further includes operations such as "opening and closing the sliding door" and "opening and closing the hinged door". You may. Further, the table may include other activities of daily living and constituent movements (not shown in FIG. 8). For example, when the activity of daily living is "bathing", the associated constituent actions may be "washing the front of the body", "washing the hair with shampoo", and the like.

In this way, since the first determination unit 31 determines the exercise movement based on the activities of daily living information, the first determination unit 31 performs a more suitable exercise movement in order to evaluate the life movement ability of the user U. Can be decided.

In addition, the rehabilitation support device 10 determines the motor function of the user U by the first determination unit 31 determining the constituent movements in which each movement of daily living is subdivided as the movement movement and evaluating the constituent movement. It can be evaluated more accurately.

When the first determination unit 31 determines an exercise motion, the first determination unit 31 performs a predetermined motion among the constituent motions based on the information related to the detailed activities of daily living or the medical history information that the user U is most troubled with. Exclude and determine the constituent movement as a motor movement. The predetermined action is, for example, an action for which repellent is recommended based on the medical history. Further, the predetermined operation is an operation that the user U does not need to perform from the home environment of the user U.

Specifically, as shown in FIG. 7, in the home environment of the user U, when there is no stairs in the "movement from the living room to the toilet", the constituent operation "stairs (steps) ascending / descending" is excluded. Then, the constituent movements of "walking", "direction change", and "straddling" are determined as movement movements. In addition, when there is an action to be avoided based on the medical history information, the exercise action is determined by excluding the predetermined action from the constituent actions. Further, when a predetermined motion is excluded, an alternative motion may be determined as a motion motion.

As a result, the rehabilitation support device 10 can determine the configuration operation excluding unnecessary operations based on the home environment or medical history. That is, since the rehabilitation support device 10 can determine the exercise motion (constructive motion) that does not harm the health of the user U, the activity of daily living of the user U can be evaluated more accurately.

Further, in step S21, the first storage unit 41 may store the subjective movement independence degree information in association with the user U.

The determination unit 30 (more specifically, the first determination unit 31) outputs the exercise motion information, which is the information of the determined motion motion, to the first output unit 51.

The first output unit 51 outputs the motion motion information determined by the determination unit 30 (step S22). In step S22, the first output unit 51 acquires, for example, screen data of the screen showing the configuration operation included in the motion motion information determined by the determination unit 30 in step S21 from the first storage unit 41 and displays it. The acquired screen data is transmitted to the device. Further, at this time, the first output unit 51 stores the screen data of the screen for receiving the subjective movement independence degree information from the user U with respect to the constituent movement included in the movement movement information determined by the determination unit 30 in the first storage unit 41. The acquired screen data may be transmitted to the display device by acquiring from.

The information processing device 100, which is a display device, displays a screen showing a motion motion. On the screen showing the motion motion, for example, the content in which the three constituent motions of "walking", "direction change", and "straddling" are determined as the motion motion is displayed.

As described above, the above processing may be performed when the care worker in charge of the user U visits the home of the user U. Further, the following processing may be performed, for example, when the user U visits the rehabilitation facility.

Next, the acquisition unit 20 (more specifically, the second acquisition unit 22) acquires objective exercise evaluation information (step S30). More specifically, the second acquisition unit 22 acquires objective motion evaluation information via the information processing device 100.

As a rehabilitation motion evaluation device, the information processing device 100 evaluates the configuration motion performed by the user U and obtains objective motion evaluation information. More specifically, the information processing device 100 evaluates whether or not each of the constituent actions of "walking", "direction change", and "straddling" performed by the user U satisfies a predetermined motion condition. For example, the information processing device 100 performs image processing on the moving image data obtained by photographing the user U performing the configuration operation, and the configuration operation performed by the user U sets a criterion for determining the degree of independence of the configuration operation (described in FIG. 8). The degree of independence of the constituent operation may be determined by evaluating whether or not the condition is satisfied. That is, the above-mentioned predetermined exercise condition is the condition shown in the independence degree determination standard of the constituent motion shown in FIG. Further, as a specific example, the following will be described. The information processing device 100 does not satisfy "the walking speed is 40 cm or less per second, or 40 cm or more per second, but the balance function test is watched over" for the constituent operation "walking", and "can walk 4 m with the assistance of a caregiver". If it is satisfied, it is evaluated that the degree of independence of the constituent operation is 2 points. The evaluation method performed by the information processing apparatus 100 is not limited to the above, but details will be described with reference to FIGS. 15 and 15.

Here, the objective motion evaluation information is the result of evaluating the degree of independence of the constituent motion according to the criterion for determining the degree of independence of the constituent motion shown in FIG. The degree of independence of the constituent motion is also referred to as an objective motion evaluation point.

The objective movement evaluation information includes information on the objective movement evaluation points for all the constituent movements performed by the user U.

The information processing device 100 outputs the evaluated objective motion evaluation information to the acquisition unit 20 of the rehabilitation support device 10.

The same assistive device may be used in both the subjective exercise independence degree information and the objective exercise evaluation information. At this time, the auxiliary tool may be an auxiliary tool (for example, a handrail / support) included in the information related to the detailed activities of daily living that the user U is most troubled with, as shown in FIG. Further, the information processing device 100 may accept from the user U an operation of selecting whether or not the auxiliary tool is appropriate as a receiving device. For example, the assistive device may be changed if it is determined by the user U to be inappropriate.

As described above, the second acquisition unit 22 acquires the objective exercise evaluation information. The second acquisition unit 22 outputs the acquired objective exercise evaluation information to the determination unit 30.

The determination unit 30 (more specifically, the second determination unit 32) determines the training content based on the objective exercise evaluation information acquired by the second acquisition unit 22 (step S31). Here, the process procedure for determining the short-term goal, the training content, and the long-term goal by the determination unit 30 will be described.

First, the second determination unit 32 determines a short-term goal, which is a predetermined short-term rehabilitation goal of the user U, based on the difference between the objective exercise evaluation information and the subjective exercise independence degree information. More specifically, the second determination unit 32 has a difference between the subjective movement independence degree information stored in the first storage unit 41 and the objective movement evaluation information acquired by the second acquisition unit 22, and the first storage. The short-term goal may be determined based on the information related to the user U stored in the section 41. Here, as information related to the user U, information on the level of detailed activities of daily living that the user U is most troubled with may be used. FIG. 9 is a flowchart showing a processing procedure in which the second determination unit 32 according to the present embodiment determines a short-term goal.

The second determination unit 32 compares the objective exercise evaluation information and the subjective exercise independence degree information (step S311). Specifically, the second determination unit 32 compares the objective motor evaluation score and the subjective motor independence score. The second determination unit 32 compares the objective movement evaluation points and the subjective movement independence points with respect to, for example, one of the constituent movements, “walking”, “direction change”, and “straddling”. As described above, the subjective movement independence information includes the subjective movement independence points for the detailed activities of daily living that the user U is most troubled with, and includes the points for the individual constituent movements. Not. Therefore, here, the subjective movement independence point in each constituent movement is the same as the subjective movement independence point for the detailed activities of daily living that the user U is most troubled with. Specifically, when the user U has two points of subjective movement independence for detailed activities of daily living, which is the most troublesome, the subjective movements of "walking", "direction change", and "straddling" are subjective. The points of independence of target movement are "walking": 2 points, "direction change": 2 points, and "straddling": 2 points.

Next, the second determination unit 32 determines whether or not the objective movement evaluation point is equal to or higher than the subjective movement independence point in all the constituent movements (step S312).

First, the case where the objective motion evaluation score is equal to or higher than the subjective motion independence score in all the constituent motions (Yes in step S312) will be described. In this case, the second determination unit 32 determines as a short-term goal a level at which the degree of independence of the detailed activities of daily living is increased by one level at the level of the activities of daily living that the user U is most troubled with (step S313).

Specifically, in the case of "Yes in step S312", as shown in FIG. 9, the objective motion evaluation points are "walking": 3 points, "direction change": 2 points, and "straddling": 2 points. This is the case where the subjective movement independence points are "walking": 2 points, "direction change": 2 points, and "straddling": 2 points.

As shown in FIG. 9, the objective motion evaluation point and the subjective motion independence point of the user U may be processed into a graph such as a radar chart and displayed on the display device. In the graph, the outermost triangle represents independence (4 points), and as the triangle moves inward, each triangle represents watching (3 points) and partial assistance (2 points), and the center point of the triangle. May represent total assistance (1 point).

In this case, the second determination unit 32 determines as a short-term goal a level at which the degree of independence of the detailed activities of daily living is increased by one level at the level of the activities of daily living that the user U is most troubled with. As shown in FIG. 7, the level of detailed activities of daily living that the current user U is most troubled with is, for example, "from" living room to toilet "using" handrail "with" partial assistance "and a distance of" 5 m ". Can be moved beyond the "step". " Therefore, the second decision unit 32 decides as a short-term goal that "it is possible to move from the" living room to the toilet "by using the" handrail "as a" watch "and over a distance of" 5 m "beyond the" step "."

On the other hand, the case where the objective motion evaluation score is not equal to or higher than the subjective motion independence score in all the constituent motions (No in step S312) will be described. That is, at least one of the objective motor evaluation points is less than the subjective motor independence score. In this case, the second determination unit 32 determines the level at which the independence of the detailed activities of daily living is maintained as a short-term goal at the level of the activities of daily living that the user U is most troubled with (step S314).

Specifically, as shown in FIG. 9, the objective motion evaluation points of "No in step S312" are "walking": 3 points, "direction change": 1 point, and "straddling": 2 points. It is a point, and the subjective movement independence points are "walking": 2 points, "direction change": 2 points, and "straddling": 2 points.

In this case, the second determination unit 32 determines the level at which the independence of the detailed activities of daily living is maintained as a short-term goal at the level of the activities of daily living that the user U is most troubled with. In other words, the second decision unit 32 uses the "handrail" with "partial assistance" from "living room to the toilet", which is the level of detailed activities of daily living that the current user U is most troubled with, and has a distance of "5 m". Can move beyond the "step" ”is determined as a short-term goal.

In this way, the rehabilitation support device 10 is the difference between the activity of daily living of the user U based on the exercise motion performed by the user U at home and the activity of daily living accurately evaluated by the rehabilitation motion evaluation device. After clarifying, determine short-term goals.

In all the constituent movements, when the objective movement evaluation point is equal to or higher than the subjective movement independence point (Yes in step S312), the short-term goal is not limited to the above. For example, the second determination unit 32 may determine a level at which the difficulty level of the assistive device is increased by one level as a short-term goal at the level of detailed activities of daily living that the user U is most troubled with.

Subsequently, the second determination unit 32 determines the training content based on the objective exercise evaluation information acquired by the second acquisition unit 22. More specifically, the second determination unit 32 collates the objective exercise evaluation points included in the objective exercise evaluation information with the reference data 45 stored in the first storage unit 41, and determines the training content. ..

The second determination unit 32 may determine the training associated with the objective exercise evaluation point as the training content. At this time, as shown in the training content column of FIG. 8, the objective exercise evaluation points and the training are stored in association with each other. For example, when the constituent movement is "walking", if the objective exercise evaluation point is 1 point, the training is low-intensity walking training, and if the objective exercise evaluation point is 2 points, the training is medium-intensity walking training, objective. If the exercise evaluation score is 3, the training is stored as high-intensity walking training in association with the training content. Therefore, specifically, when the constituent motion is "walking" and the objective movement evaluation points are two points, the second determination unit 32 has the objective movement evaluation points (2 points) as shown in FIG. "Medium-strength walking training" linked to is determined as the training content.

The second determination unit 32 may determine the training for the compositional motion having a lower objective motion evaluation point among all the constituent motions as the training content having a higher priority. Here, as a specific example, as shown in the case of Yes in step S312 of FIG. 9, the objective motion evaluation points are "walking": 3 points, "direction change": 2 points, and "straddling": 2 points. The case will be described. In this case, the second determination unit 32 may determine the training regarding the constituent movements of the “direction change” and the “straddling” as the training content having a higher priority.

In this way, the second determination unit 32 determines the training content based on the objective exercise evaluation information acquired by the second acquisition unit 22. The objective motion evaluation information is information obtained by the rehabilitation motion evaluation device evaluating the degree of motion motion (that is, constituent motion) performed by the user U. Further, the constituent movements are movements in which each movement of the activities of daily living is subdivided based on the independence degree information included in the activities of daily living.

Therefore, it can be said that this step S31 is a determination step performed by the user U to determine the training content of the rehabilitation training based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20.

Further, the second determination unit 32 may determine a long-term goal, which is a predetermined long-term rehabilitation goal of the user U, based on the short-term goal. Specifically, the second determination unit 32 collates the short-term target with the information related to the user U stored in the first storage unit 41, and determines the long-term target. The long-term goal may be, for example, a level at which the degree of independence of the detailed activities of daily living is raised by one step from the short-term goal at the level of the activities of daily living that the user U is most troubled with. For example, if the short-term goal is "to watch over from the room to the toilet" and use the "handrail" to move over a "step" over a distance of "5m", the long-term goal is "from the room to the toilet". "Alone" can move over a "step" over a distance of "5m" using a "toilet". "

In this way, the rehabilitation support device 10 can determine a long-term goal that is reasonable for the user U by determining a long-term goal linked to the short-term goal.

The determination unit 30 outputs the short-term target information, the training content information, and the long-term target information, which are information on the short-term goal, the training content, and the long-term goal determined as described above, to the first output unit 51.

The first output unit 51 outputs short-term target information, training content information, and long-term target information determined by the determination unit 30 (step S32). In step S32, the first output unit 51 acquires, for example, screen data of a screen showing the short-term target information, training content information, and long-term target information determined by the determination unit 30 in step S31 from the first storage unit 41. Then, the acquired screen data is transmitted to the display device.

The information processing device 100, which is a display device, displays a screen showing short-term goal information, training content information, and long-term goal information. FIG. 10 is a diagram showing an example of a screen corresponding to the short-term goal information, the training content information, and the long-term goal information of the user U.

Further, FIG. 11 is a diagram showing another example of the screen corresponding to the short-term target information, the training content information, and the long-term target information of the user U. The information processing device 100 displays the screen shown in FIG. 10 or 11 as a display device. For example, as shown in FIG. 11, the objective exercise evaluation information may be displayed as a measurement result. Further, when the degree of independence of the constituent operation is less than the short-term target, a mark such as "!" May be displayed.

By displaying the screen showing the short-term goal information, the training content information, and the long-term goal information in this way, the user U can easily understand the user U's own short-term goal, training content, and long-term goal. be able to.

In step S32, the information processing device 100 may accept from the user U an operation of selecting whether or not the short-term goal and the long-term goal determined by the determination unit 30 in step S31 are appropriate as the reception device. For example, the short-term goal and the long-term goal may be changed by the decision-making unit 30 when the user U determines that the goal is inappropriate. FIG. 12 is a diagram showing an example of a screen in which the user U accepts an operation for changing a long-term goal. The information processing device 100 displays the screen shown in FIG. 12 as a display device. In this way, it may be changeable.

Here, in steps S10 to S32 described so far, the processing procedure before the user U receives the rehabilitation training has been described.

In steps S40 to S42 described below, a processing procedure after the user U has undergone rehabilitation training will be described. For example, here, it is assumed that the user U has undergone rehabilitation training for three months. In addition, for the sake of explanation, in the following, the objective exercise evaluation information and the subjective exercise independence degree information before the user U undergoes rehabilitation training are the pre-training objective exercise evaluation information and the pre-training subjective exercise independence degree information. Notated as. Similarly, in the following, the objective exercise evaluation information and the subjective exercise independence degree information after the user U has undergone rehabilitation training will be referred to as the post-training objective exercise evaluation information and the post-training subjective exercise independence degree information. ..

Next, the acquisition unit 20 acquires objective exercise evaluation information after training (step S40). More specifically, the acquisition unit 20 acquires post-training subjective exercise independence degree information and post-training objective exercise evaluation information via the information processing device 100.

The acquisition unit 20 acquires through the pre-training subjective exercise independence degree information and the pre-training post-training objective exercise evaluation information in the same process as those shown in steps S20 and S30.

The first evaluation unit 61 evaluates the effect obtained by the user U performing the training content (step S41). The first evaluation unit 61 may evaluate the effect by, for example, comparing the objective exercise evaluation information before and after the user U acquired the training content by the acquisition unit 20. That is, the first evaluation unit 61 may evaluate the effect by comparing the pre-training objective exercise evaluation information with the post-training objective exercise evaluation information. In the first evaluation unit 61, for example, the objective exercise evaluation information after the training after the user U acquired by the acquisition unit 20 performs the training content and the user U stored in the first storage unit 41 are used. The effect may be evaluated by comparing with the objective evaluation information before the training before the training content is performed.

The first evaluation unit 61 outputs the evaluation result of the effect to the first output unit 51.

The first output unit 51 outputs an evaluation result, which is the result of evaluation by the first evaluation unit 61 (step S42). In step S42, for example, the first output unit 51 acquires the screen data of the screen showing the evaluation result obtained in step S41 from the first storage unit 41, and transmits the acquired screen data to the display device. ..

The information processing device 100, which is a display device, displays a screen showing an evaluation result in which the user U evaluates the effect obtained by performing the training content. FIG. 13 is a diagram showing an example of a screen corresponding to the evaluation result.

As a result, the effect obtained by the user U performing the training content is quantitatively compared with the pre-training objective exercise evaluation information and the post-training objective exercise evaluation information obtained by the rehabilitation motion evaluation device. Can be done.

Further, the first evaluation unit 61 may evaluate the effect by, for example, comparing the subjective exercise independence degree information before and after the user U acquired by the acquisition unit 20 performs the training content. .. That is, the first evaluation unit 61 may evaluate the effect by comparing the pre-training subjective exercise independence degree information and the post-training subjective exercise independence degree information.

At this time, the second decision unit 32 further sets a short-term goal, a long-term goal, and training content based on the post-training objective exercise evaluation information and the post-training subjective exercise independence degree information acquired by the acquisition unit 20. It may be updated and decided again.

In steps S10 to S42, the processing procedure before and after the user U receives the rehabilitation training has been described, but the rehabilitation support device 10 is used during the rehabilitation training. It may be a device.

Specifically, the rehabilitation support device 10 may further include a schedule management unit.

The schedule management unit is a processing unit that generates schedule management information including the date and time, the training content of the rehabilitation training, and the names of a plurality of users U who perform the training content, based on the date and time information and the rehabilitation training information.

The acquisition unit 20 includes, for example, date and time information including a predetermined date and time (for example, the day when the rehabilitation support device 10 is used) and an operation name of the rehabilitation training operation via the information processing device 100 which is a reception device. The rehabilitation training information is output to the schedule management unit.

The schedule management unit collates the date and time information and the rehabilitation training information with the reference data stored in the first storage unit 41, and generates the schedule management information. In this case, the reference data is data in which the date and time information and the rehabilitation training information are associated with the name of the user U who plans to perform the training content on the predetermined date and time. The schedule management unit outputs the generated schedule management information to the first output unit 51.

The first output unit 51 outputs the generated schedule information. For example, the first output unit 51 acquires the screen data of the screen showing the schedule information from the first storage unit 41, and transmits the acquired screen data to the display device.

The information processing device 100, which is a display device, displays a screen showing schedule information. FIG. 14 is a diagram showing an example of a screen showing schedule management information.

As shown in FIG. 14, the information processing device 100, which is a display device, has a predetermined date, an operation name of the rehabilitation training operation, and a plurality of users U (Mr. A to Mr. E) who perform the training content. It is displayed.

As a reception device, the information processing device 100 receives operations of each user U regarding vital signs (pulse, blood pressure, etc.), attendance, and training progress (intermediate or completed, etc.). The information processing device 100 outputs the result of the received operation to the rehabilitation support device 10. The rehabilitation support device updates the screen data output by the first output unit 51 based on the result of the above operation.

By providing the schedule management unit in this way, the user of the rehabilitation support device 10 can easily understand the person who performs the training content on a predetermined date and time.

[Effects, etc.]
As described above, the rehabilitation support device 10 according to the present embodiment includes an acquisition unit 20, a determination unit 30, and a first evaluation unit 61. The acquisition unit 20 is obtained by the rehabilitation motion evaluation device evaluating the daily life information which is the information about the daily life based on the declaration of the user U who receives the rehabilitation training and the degree of the exercise motion performed by the user U. Acquire objective exercise evaluation information. The determination unit 30 determines the training content of the rehabilitation training performed by the user U based on the daily life information and the objective exercise evaluation information acquired by the acquisition unit 20. The first evaluation unit 61 evaluates the effect obtained by the user U performing the training content determined by the determination unit 30.

As a result, in the rehabilitation support device 10, the degree of the exercise motion for evaluating the activity of daily living of the user U is evaluated by the rehabilitation motion evaluation device, so that the motion motion satisfies a predetermined condition. It is possible to accurately evaluate whether or not it is present. The rehabilitation support device 10 can determine the training content of the rehabilitation training based on such an accurately evaluated activity of daily living ability of the user U.

Therefore, the rehabilitation support device 10 capable of determining the rehabilitation training content that can obtain a high rehabilitation effect is realized.

In addition, the rehabilitation support system 1 can evaluate the effect obtained by the user U performing the training content.

Further, the acquisition unit 20 has a first acquisition unit 21 for acquiring daily life information and a second acquisition unit 22 for acquiring objective exercise evaluation information. The decision unit 30 determines the training content based on the first decision unit 31 that determines the exercise movement based on the daily life information acquired by the first acquisition unit 21 and the objective exercise evaluation information acquired by the second acquisition unit 22. It has a second determination unit 32 for determining.

As a result, the first determination unit 31 determines the exercise movement based on the activities of daily living information, and the first determination unit 31 determines a more suitable exercise movement in order to evaluate the life movement ability of the user U. can do.

Therefore, the rehabilitation support device 10 capable of determining the rehabilitation training content that can obtain a high rehabilitation effect is realized.

In addition, the second acquisition unit 22 further acquires subjective exercise independence degree information, which is information on the independence degree of the exercise motion actually performed by the user U at the user U's home. The second determination unit 32 further determines and outputs a short-term goal, which is a predetermined short-term rehabilitation goal of the user U, based on the difference between the subjective exercise independence degree information and the objective exercise evaluation information. To do.

As a result, the rehabilitation support device 10 determines the difference between the activity of daily living of the user U based on the exercise motion performed by the user U at home and the activity of daily living accurately evaluated by the rehabilitation motion evaluation device. After clarifying, determine short-term goals.

Therefore, the rehabilitation support device 10 can determine a more appropriate short-term goal for the user U.

Further, the second determination unit 32 determines and outputs a long-term goal, which is a predetermined long-term rehabilitation goal of the user U, based on the short-term goal.

As a result, the rehabilitation support device 10 can determine a long-term goal that is reasonable for the user U by determining a long-term goal linked to the short-term goal.

Therefore, the rehabilitation support device 10 can determine a more appropriate long-term goal for the user U.

In addition, the first acquisition unit 21 further provides information on detailed living activities that user U is most troubled with, which is information based on activities of daily living, and home environment, which is information on the home environment of user U. Get information and. The first determination unit 31 determines the constituent movements in which each movement of the daily living is subdivided as the movement movement based on the detailed information of the daily living movement that the user U is most troubled with and the home environment information. And output.

In this way, the first determination unit 31 determines the constituent movements in which each movement of the daily living is subdivided as the movement movement, and the constituent movement is evaluated, so that the rehabilitation support device 10 can use the movement of the user U. The function can be evaluated more accurately.

Therefore, the rehabilitation support device 10 capable of determining the rehabilitation training content that can obtain a high rehabilitation effect is realized.

In addition, the daily life information further includes medical history information which is information on the medical history of the user U. When determining the constituent motion as an exercise motion, the first determination unit 31 excludes a predetermined motion from the constituent motions based on the medical history information, determines the constituent motion as the motion motion, and outputs the determined motion.

As a result, the rehabilitation support device 10 can determine the constituent movements based on the medical history, excluding unnecessary movements. That is, since the rehabilitation support device 10 can determine the exercise motion (constructive motion) that does not harm the health of the user U, the activity of daily living of the user U can be evaluated more accurately.

Therefore, the rehabilitation support device 10 capable of determining the rehabilitation training content that can obtain a high rehabilitation effect is realized.

In addition, the first evaluation unit 61 evaluates and outputs the effect by comparing the objective exercise evaluation information before and after the user U performs the training content.

As a result, the effect obtained by the user U performing the training content is quantitatively compared with the pre-training objective exercise evaluation information and the post-training objective exercise evaluation information obtained by the rehabilitation motion evaluation device. Can be done.

That is, the rehabilitation support device 10 can output an evaluation result so that the user U can easily realize the effect.

Further, the rehabilitation support device 10 according to the present embodiment further includes a reception unit 70 that receives an evaluation of the rehabilitation support device 10 from a user who uses the rehabilitation support device 10, and a rehabilitation support unit 70 that receives the evaluation received by the reception unit 70. A transmission unit 71 for transmitting to the administrator of the device 10 is provided.

Thereby, the manager of the rehabilitation support device 10 can obtain the evaluation of the rehabilitation support device from the user who uses the rehabilitation support device 10 by the reception unit 70 and the transmission unit 71.

Therefore, the rehabilitation support device 10 becomes a device that is easier for the user to use.

Further, the rehabilitation support system 1 according to the present embodiment includes the rehabilitation support device 10 described above and a display device for displaying the training content determined by the determination unit 30.

As a result, in the rehabilitation support system 1, the degree of the exercise motion for evaluating the activity of daily living of the user U is evaluated by the rehabilitation motion evaluation device, so that the motion motion satisfies a predetermined condition. It is possible to accurately evaluate whether or not it is present. The rehabilitation support system 1 can determine the training content of the rehabilitation training based on such an accurately evaluated activity of daily living ability of the user U.

Therefore, the rehabilitation support system 1 capable of determining the rehabilitation training content that can obtain a high rehabilitation effect is realized.

Further, the rehabilitation support system 1 is provided with a display device, so that the user U can display the evaluation result of evaluating the effect obtained by performing the training content. That is, the rehabilitation support system 1 can display the evaluation result so that the user U can easily realize the effect.

The rehabilitation support method is a method performed by the rehabilitation support device 10. The rehabilitation support method includes daily life information which is information on daily life based on the declaration of the user U who receives rehabilitation training, and acquisition steps S10 and S30 for acquiring objective exercise evaluation information. The objective motion evaluation information is information obtained by the rehabilitation motion evaluation device evaluating the degree of motion motion performed by the user U. Further, the rehabilitation support method includes determination steps S21 and S31 for determining the training content of the rehabilitation training performed by the user U based on the daily life information and the objective exercise evaluation information acquired in the acquisition steps S10 and S30. Further, the rehabilitation support method includes a first evaluation step S41 for evaluating the effect obtained by the user U performing the training contents determined in the determination steps S21 and S31.

As a result, in the rehabilitation support method, the degree of the exercise motion for evaluating the activity of daily living of the user U is evaluated by the rehabilitation motion evaluation device, and whether the motion motion satisfies a predetermined condition. Whether or not it can be evaluated accurately. The rehabilitation support method can determine the training content of the rehabilitation training based on the activities of daily living ability of the user U, which is accurately evaluated.

Therefore, a rehabilitation support method that can determine the content of rehabilitation training that can obtain a high rehabilitation effect is realized.

In addition, the rehabilitation support system 1 can evaluate the effect obtained by the user U performing the training content.

Further, the present invention may be realized as a program for causing a computer to execute the above rehabilitation support method.

Such a program can determine the training content of the rehabilitation training based on the activity of daily living ability of the user U accurately evaluated by the computer. Therefore, it is possible to determine the content of rehabilitation training that can obtain a high rehabilitation effect.

[Configuration of rehabilitation operation evaluation device]
Subsequently, the configuration of the rehabilitation operation evaluation device 200 according to the present embodiment will be described. FIG. 15 is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation device 200 according to the present embodiment. More specifically, FIG. 15 describes the rehabilitation operation evaluation device 200 and the like included in the information processing device 100.

As described above, the rehabilitation motion evaluation device 200 is a device that evaluates the degree of exercise motion related to the rehabilitation training performed by the user U, but is not limited to this. As shown in FIG. 15, the rehabilitation motion evaluation device 200 may be a device for evaluating the degree of the rehabilitation training motion from the moving image data obtained by photographing the user U undergoing the rehabilitation training. The rehabilitation training operation is an operation performed by the user U in the rehabilitation training for improving the activity of daily living of the user U. Further, for example, the rehabilitation training operation may be an operation that is performed on a daily basis in a rehabilitation facility. The training content shown in FIG. 8 may include a rehabilitation training operation. In this case, the training content may include the rehabilitation training operation and the time or number of times the rehabilitation training operation is performed. As a specific example, the rehabilitation motion evaluation device 200 is a device for evaluating whether or not the rehabilitation training motion is performed in a correct motion, or a device for counting and evaluating the number of times the rehabilitation training motion is performed. Is.

Such a rehabilitation motion evaluation device 200 is a device used in a nursing care facility, a medical facility, or the like. The rehabilitation motion evaluation device 200 supports the work performed by an instructor (for example, a physiotherapist) who guides the rehabilitation motion performed by the user U at the above facility.

In the following, the rehabilitation motion evaluation device 200 will be described as a device for evaluating the degree of the rehabilitation training motion.

As described above, the information processing device 100 includes a reception device 500, a rehabilitation operation evaluation device 200, and a display device 400. Further, as shown in FIG. 15, the information processing device 100 may further include a photographing device 300.

The rehabilitation motion evaluation device 200 acquires moving image data obtained by photographing the user U undergoing rehabilitation training via the photographing device 300, and evaluates the degree of the rehabilitation training motion performed by the user U from the acquired moving image data. It is a device to do. The rehabilitation operation evaluation device 200 may be, for example, a device composed of a CPU (Central Processing Unit), a memory, and a program, or may be a server.

The photographing device 300 is a device for photographing a user U who has undergone rehabilitation training. The photographing device 300 may be any device as long as it can capture a moving image, and is, for example, a camera or a video camera. Further, when the information processing device 100 is a smartphone or a tablet terminal as described above, it may be an attached camera or a video camera.

The moving image data obtained by photographing the user U undergoing rehabilitation training is two-dimensional moving image data that does not include distance information. The distance information is the distance information between the photographing device 300 and the user U. That is, the photographing device 300 may be a device that does not have a distance measuring function. The photographing device 300 may be a separate device independent of the information processing device 100.

The photographing device 300 outputs the moving image data to the rehabilitation motion evaluation device 200.

The display device 400 displays a screen based on the screen data output from the rehabilitation operation evaluation device 200. The display device 400 may display, for example, the result of evaluating the degree of the rehabilitation training operation of the user U evaluated by the rehabilitation operation evaluation device 200. As described above, the display device 400 is a monitor device specifically composed of a liquid crystal panel, an organic EL panel, or the like. The display device 400 may be a separate device independent of the information processing device 100.

In the present embodiment, the information processing device 100 is a smartphone or a tablet, and when the photographing device 300 photographs the user U who has undergone rehabilitation training, the display device 400 captures the photographed user. U may be displayed.

The reception device 500 may be a touch panel or a hardware button. The reception device 500 receives, for example, an operation related to the evaluation of the rehabilitation training operation from the care worker, and outputs the received operation to the rehabilitation operation evaluation device 200.

The rehabilitation motion evaluation device 200, the photographing device 300, the display device 400, and the reception device 500 may be connected by wire as long as they can transmit and receive the received operation result, moving image data, or screen data. It may be connected so that wireless communication is possible.

As shown in FIG. 15, the rehabilitation operation evaluation device 200 includes an acquisition unit, an estimation unit 280, an evaluation unit, a second output unit 252, and a second storage unit 242.

In order to distinguish from the acquisition unit 20 and the first evaluation unit 61 included in the rehabilitation support device 10 shown in FIG. 2, the acquisition unit and the evaluation unit included in the rehabilitation operation evaluation device 200 are the third acquisition unit 223 and the second evaluation unit. It is described as part 262.

The acquisition unit (that is, the third acquisition unit 223) included in the rehabilitation motion evaluation device 200 is moving image data obtained by the photographing device 300 and photographing the user U undergoing rehabilitation training, and obtains distance information. Acquire 2D moving image data that is not included. The third acquisition unit 223 is, for example, a communication interface for performing wired communication or wireless communication.

The estimation unit 280 is a processing unit that estimates skeleton information indicating the skeleton of the user U in the two-dimensional moving image data based on the two-dimensional moving image data acquired by the third acquisition unit 223. Specifically, the estimation unit 280 is realized by a processor, a microcomputer, or a dedicated circuit.

Here, the skeleton information will be described with reference to FIGS. 16A and 16B. FIG. 16A is a diagram showing one frame of moving image data obtained by photographing a user U who has undergone rehabilitation training according to the present embodiment. FIG. 16B is a diagram in which the skeleton information of the user U shown in FIG. 16A is estimated. In FIG. 16B, the circular portion corresponds to a body part such as a joint, nose, eyes or ears of the user U, and the body parts are connected to each other by a rod portion. That is, when the estimation unit 280 performs the estimation process on the user U shown in FIG. 16A, the skeleton information of the user U shown in FIG. 16B can be obtained.

As shown in FIG. 16B, the skeletal information includes information on the joint position where the bones of the user U are connected to each other. The skeleton information may include, for example, information on a plurality of joint positions of one user U in each of the two-dimensional moving image data. Further, each of the two-dimensional moving image data may be each frame included in the two-dimensional moving image data. That is, the skeleton information includes information on a plurality of joint positions of one user U for each frame of the two-dimensional moving image data in the two-dimensional moving image data captured by one user U. ing. The information on the plurality of joint positions may include information on the coordinate positions of the plurality of joints corresponding to the xy plane coordinates for each joint position.

The skeletal information may also include information on the positions of the nose, eyes, and ears of the user U. Therefore, the skeleton information is information on the positions of the nose, eyes, and ears of one user U for each frame of the two-dimensional moving image data in the two-dimensional moving image data taken by one user U. May be included. Further, the information on the positions of the nose, eyes and ears may include information on the coordinate positions of the nose, eyes and ears corresponding to the xy plane coordinates for each position.

For the estimation of the skeleton information, for example, a technique such as OpenPose shown in the following document may be used (Non-patent document: Zhe Cao et al .: Realtime Multi-Person 2D Human Pose Estimation Part Affinity Fields, CPR. 2017).

The evaluation unit will be described again with reference to FIG.

The evaluation unit (that is, the second evaluation unit 262) included in the rehabilitation motion evaluation device 200 is the degree of the rehabilitation training motion (for example, rehabilitation training) related to the rehabilitation training performed by the user U based on the skeletal information estimated by the estimation unit 280. Evaluate the performance or failure of the movement. Specifically, the second evaluation unit 262 stores the skeleton information estimated by the estimation unit 280 and the reference data 246 stored in the storage unit (that is, the second storage unit 242) included in the rehabilitation motion evaluation device 200. Collate and evaluate the degree of rehabilitation training movements. Specifically, the second evaluation unit 262 is realized by a processor, a microcomputer, or a dedicated circuit.

Further, the second evaluation unit 262 may have a standardization unit 2621 and an operation evaluation unit 2622. The standardization unit 2621 uses the distance between the first joint position and the second joint position, which is different from the first joint position, as a reference value among the plurality of joint positions, and uses the reference value to standardize the plurality of joint positions. It is a processing unit to be converted. The motion evaluation unit 2622 is a processing unit that evaluates the degree of rehabilitation training motion based on a plurality of joint positions standardized by the standardization unit 2621. In this case, the motion evaluation unit 2622 collates the plurality of joint positions standardized by the standardization unit 2621 with the reference data 246 stored in the second storage unit 242, and evaluates the degree of the rehabilitation training motion.

The second output unit 252 outputs the evaluation result of the rehabilitation training operation performed by the user U evaluated by the second evaluation unit 262 to the display device 400. The second output unit 252 is, for example, a communication interface for performing wired communication or wireless communication.

The second storage unit 242 is a storage device that stores reference data 246 indicating the relationship between the operation name of the rehabilitation training operation and the predetermined threshold value. The reference data 246 is referred to by the second evaluation unit 262 when the degree of the rehabilitation training operation of the user U is evaluated. The second storage unit 242 is realized by, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a semiconductor memory, an HDD (Hard Disk Drive), or the like.

Further, the second storage unit 242 shows the program executed by the estimation unit 280 and the second evaluation unit 262, and the evaluation result used when outputting the evaluation result of the degree of the rehabilitation training operation of the user U. Screen data is also stored.

The estimation unit 280 and the second evaluation unit 262 may be realized by one processor, a microcomputer, or a dedicated circuit having their respective functions. Further, the estimation unit 280 and the second evaluation unit 262 may be realized by a combination of two or more of a processor, a microcomputer, or a dedicated circuit.

[Processing procedure of rehabilitation operation evaluation method]
Subsequently, a specific processing procedure in the rehabilitation motion evaluation method executed by the rehabilitation motion evaluation device 200 will be described. FIG. 17 is a flowchart showing a processing procedure in which the rehabilitation motion evaluation device 200 according to the present embodiment evaluates the degree of the rehabilitation training motion of the user U. Here, as an example of the rehabilitation training operation, one-leg standing training is given.

First, the third acquisition unit 223 acquires moving image data (two-dimensional moving image data) of the user U undergoing rehabilitation training via the photographing device 300 (step S110). The two-dimensional moving image data acquired by the third acquisition unit 223 may be moving image data in which the figure shown in FIG. 16A is one frame. The two-dimensional moving image data may include a plurality of frames. Further, the third acquisition unit 223 may obtain the operation name (one-leg standing training) of the rehabilitation training operation performed by the user U via the reception device 500.

Next, the estimation unit 280 estimates the skeleton information of the user U based on the two-dimensional moving image data (step S120). More specifically, the estimation unit 280 estimates the skeleton information of the user U including the information of the plurality of joint positions and outputs it to the second evaluation unit 262. Further, the estimation unit 280 may output the operation name (one-leg standing training) of the rehabilitation training operation performed by the user U to the second evaluation unit 262.

Further, the second evaluation unit 262 evaluates the degree of the rehabilitation training operation performed by the user U based on the skeletal information estimated in step S120 (step S130). Here, the details of step S130 will be described.

FIG. 18A is a diagram showing an example of a screen corresponding to the skeleton information of the user U estimated by the estimation unit 280 according to the present embodiment.

The skeleton information of the user U acquired from the estimation unit 280 is, for example, information on a plurality of joint positions of one user U in each frame of the two-dimensional moving image data shown in FIG. 18A.

The information on the plurality of joint positions may include information on the coordinate positions of the plurality of joints corresponding to the xy plane coordinates for each joint position. Here, the xy plane coordinates may be, for example, the coordinates corresponding to the pixels of the display device 400.

FIG. 18B is a diagram showing a process in which a plurality of joint positions in the skeletal information of FIG. 18A are standardized. FIG. 18B (a) is a diagram showing the coordinate positions of a plurality of joints, and FIG. 18B (b) is a diagram in which the coordinate positions of FIG. 18B (a) are corrected. (C) is a standardized view of FIG. 18B (b). For example, the coordinate positions of the plurality of joints may be the coordinate positions shown in FIG. 18B (a).

First, the second evaluation unit 262 has a plurality of joints so that the coordinate position of a predetermined joint in a predetermined frame is the origin among the coordinate positions of the plurality of joints included in the skeletal information estimated by the estimation unit 280. Correct the coordinate position of. For example, the predetermined frame is the time (t0) when the user U starts the rehabilitation training operation, and the predetermined joint may be the neck joint. Further, the second evaluation unit 262 corrects the coordinate position of each joint by subtracting the coordinates of the neck joint from the coordinates of each joint. For example, as shown in FIG. 18B (b), the coordinate positions of a plurality of joints are set so that the coordinate positions of the neck joints at a predetermined frame (t0) are the origins (x = 0, y = 0). It will be corrected.

Further, the standardization unit 2621 uses the distance between the first joint position and the second joint position different from the first joint position as a reference value among the plurality of joint positions, and uses the reference value to set the plurality of joint positions. Is standardized (step S131). The standardized unit 2621 may output a plurality of standardized joint positions to the motion evaluation unit 2622.

At this time, the corrected coordinate positions of the plurality of joints may be used as the first joint position and the second joint position. The standardization unit 2621 uses the distance between the first joint position and the second joint position as a reference value, and divides the coordinate positions of the corrected plurality of joints shown in FIG. 18B (b) by the reference value.

Further, the first joint position and the second joint position may be the joint positions shown in FIG. 18A. The first joint position may be the neck joint position of the user U, and the second joint position may be the waist joint position of the user U. Further, the first joint position and the second joint position are not limited to the joint positions shown in FIG. 18A. For example, the first joint position and the second joint position may be virtual joint positions obtained from the coordinate positions of a plurality of joints. The virtual joint position is, for example, a central position between the right hip joint position and the left hip joint position shown in FIG. 18A, and may be the central waist joint position. Similarly, the virtual joint position may be a position between the joint position of the right knee and the joint position of the left knee, and is a position between the joint position of the right ankle and the joint position of the left ankle. There may be.

In the present embodiment, the first joint position is the neck joint position, and the second joint position is the central waist joint position, which is a virtual joint position.

The standardization unit 2621 uses the distance between the joint position of the neck and the joint position of the central waist as a reference value, and divides the coordinate positions of a plurality of joints by the reference value. As a result, as shown in FIG. 18B (c), the coordinate positions of the plurality of joints are standardized. That is, a plurality of joint positions are standardized.

In the process of correcting and standardizing the coordinate positions of a plurality of joints, the coordinate positions at a predetermined frame (for example, time (t0)) may always be used. That is, the coordinate positions of the plurality of joints at the time (for example, t1) after the time (t0) when the user U starts the rehabilitation training operation may be corrected by the coordinate positions of the neck joints at the time (t0). .. Further, the coordinate positions of the plurality of joints at the time (for example, t1) may be standardized with the distance between the joint position of the neck and the joint position of the central waist at the time (t0) as a reference value.

By providing the standardization unit 2621 in this way, for example, a plurality of joints standardized to the same length are used regardless of whether the distance between the user U and the photographing device 300 is short or long. The position is obtained. That is, a plurality of joint positions having the same distance between the first joint position and the second joint position can be obtained. Similarly, in both the case where the tall user U is evaluated and the case where the short user U is evaluated, the distance between the first joint position and the second joint position is the same length. Multiple joint positions can be obtained.

The distance between the first joint position and the second joint position was used as the reference value, but the reference value is not limited to this. For example, the reference value may be determined by two points selected from the coordinate positions of the joint, nose, eyes and ears.

The standardization unit 2621 may further determine the first joint position and the second joint position based on the initial posture of the rehabilitation training operation performed by the user U.

That is, the standardization unit 2621 determines a plurality of joint positions available to the standardization unit 2621 as the first joint position and the second joint position in the posture at the time when the user U starts the rehabilitation training operation. You may. For example, a case where there is a tool (desk or the like) used in the rehabilitation training operation performed by the user U will be described. In the above initial posture, if the plurality of joint positions corresponding to the lower body of the user U are shielded by the tool, the normalization unit 2621 cannot obtain the plurality of joint positions corresponding to the lower body. In this case, the standardization unit 2621 may determine a plurality of available joint positions (for example, the right shoulder and the left shoulder) as the first joint position and the second joint position.

Thereby, a plurality of joint positions available to the normalization unit 2621 can be determined as the first joint position and the second joint position.

Subsequently, the motion evaluation unit 2622 evaluates the degree of the rehabilitation training motion based on the plurality of joint positions standardized by the standardization unit 2621 (step S132).

The motion evaluation unit 2622 collates the acquired motion name (one-leg standing training) of the rehabilitation training motion with the reference data 246 stored in the second storage unit 242, and acquires a predetermined threshold value. When the coordinate position of a predetermined joint exceeds the threshold value by the user U performing the rehabilitation training operation, the motion evaluation unit 2622 determines that the rehabilitation training motion has been achieved.

A specific example will be described with reference to FIG. 18C.

FIG. 18C is a diagram showing an example of evaluating the degree of rehabilitation training motion based on the plurality of standardized joint positions shown in FIG. 18B. More specifically, FIG. 18C (a) is a diagram showing an example of the time (t0) when the user U started the rehabilitation training operation. FIG. 18C (b) is a diagram showing an example of the time (t1) when time has passed from FIG. 18C (a). FIG. 18C (c) is a diagram showing an example of a time (t2) when a further time has passed from FIG. 18C (b).

Here, the predetermined threshold includes, for example, a first threshold L1 and a second threshold L2. For example, in FIG. 18C, the first threshold value L1 has the same y-axis value as the central position between the coordinate position of the right ankle joint and the coordinate position of the left ankle joint at time (t0). Further, the second threshold value L2 has a y-axis value larger on the positive side than the first threshold value L1. For example, the second threshold value L2 may be a value larger than the first threshold value L1 by 1 in the standardized coordinates.

As shown in FIG. 18C (a), at the time (t0), the coordinate positions of the joints of both ankles of the user U are located on the negative side of the y-axis with respect to the second threshold value L2.

As shown in FIG. 18C (b), when the user U performs the rehabilitation training operation and the time advances to the time (t1), the coordinate position of the right ankle joint of the user U is higher than the time (t0). It is located on the positive side of the y-axis. However, the coordinate position of the joint of the right ankle of the user U at the time (t1) is located on the negative side of the y-axis with respect to the second threshold value L2.

As shown in FIG. 18C (c), when the user U further performs the rehabilitation training operation and the time advances to the time (t2), the coordinate position of the right ankle joint of the user U is from the second threshold value L2. Is also located on the positive side of the y-axis. That is, since the coordinate position of the predetermined joint (here, the right ankle) exceeds the threshold value (here, the second threshold value) by the user U performing the rehabilitation training operation, the motion evaluation unit 2622 achieves the rehabilitation training operation. Judge that it was done.

By providing the standardized unit 2621 in this way, a plurality of joint positions standardized to the same length can be obtained. That is, a plurality of joint positions having the same distance between the first joint position and the second joint position can be obtained. Therefore, the rehabilitation motion evaluation device 200 evaluates the degree of the rehabilitation training motion performed by the user U using a common threshold value both when the distance between the user U and the photographing device is short and long. can do.

On the other hand, here, a case where standardization is not performed by the standardization unit 2621, that is, a case where step S131 is not performed will be described. In this case, the second evaluation unit 262 evaluates the degree of rehabilitation movement based on a plurality of unstandardized joint positions.

FIG. 18D is a diagram showing an example of evaluating the degree of rehabilitation training movement based on a plurality of unstandardized joint positions in the skeletal information shown in FIG. 18A. FIG. 18D (a) is a diagram showing an example of the time (t0) when the user U started the rehabilitation training operation. FIG. 18D (b) is a diagram showing an example of the time (t1) when time has passed from FIG. 18D (a). FIG. 18D (c) is a diagram showing an example of a time (t2) when a further time has passed from FIG. 18D (b).

In this case, the predetermined threshold includes, for example, a third threshold L3 and a fourth threshold L4. For example, in FIG. 18D, the third threshold L3 has the same y-axis value as the central position between the coordinate position of the right ankle joint and the coordinate position of the left ankle joint at time (t0). Further, the fourth threshold value L4 has a y-axis value larger on the positive side than the third threshold value L3.

As shown in FIG. 18D (a), at the time (t0), the coordinate positions of the joints of both ankles of the user U are located on the negative side of the y-axis with respect to the fourth threshold value L4.

As shown in FIG. 18D (b), when the user U performs the rehabilitation training operation and the time advances to the time (t1), the coordinate position of the right ankle joint of the user U is higher than the time (t0). It is located on the positive side of the y-axis. However, the coordinate position of the joint of the right ankle of the user U at the time (t1) is located on the negative side of the y-axis with respect to the fourth threshold value L4.

As shown in FIG. 18D (c), when the user U further performs the rehabilitation training operation and the time advances to the time (t2), the coordinate position of the right ankle joint of the user U is from the fourth threshold value L4. Is also located on the positive side of the y-axis. That is, since the coordinate positions of the plurality of joints (here, the right ankle) exceed the threshold value (here, the second threshold value) due to the user U performing the rehabilitation training operation, the second evaluation unit 262 performs the rehabilitation training operation. Judge that it has been achieved.

In this case, that is, the case where step S131 is not performed will be described. For example, if the distance between the user U and the photographing device 300 is short, the user U becomes large in the coordinate position, and if the distance between the user U and the photographing device 300 is long, the user U becomes small in the coordinate position. Become. Even in such a case, the second evaluation unit 262 is not standardized because the threshold values (third threshold value L3 and fourth threshold value L4) according to the size of the user U on the coordinate position are used. The degree of rehabilitation movement can be evaluated based on a plurality of joint positions.

Subsequently, the second output unit 252 outputs the evaluation result of the rehabilitation training operation performed by the user U evaluated by the second evaluation unit 262 to the display device 400.

Further, the display device 400 displays the result of evaluating the degree of the rehabilitation training operation of the user U evaluated by the rehabilitation operation evaluation device 200.

The evaluation result of the rehabilitation training operation performed by the user U evaluated by the second evaluation unit 262 may be stored in the second storage unit 242. The evaluation result may be output to the above-mentioned rehabilitation support device 10. Further, the result of the rehabilitation motion evaluation device 200 evaluating the degree of the above motion motion using the same process is output to the rehabilitation support device 10 as objective motion evaluation information.

[Example of evaluation of rehabilitation training movement]
Here, an example of evaluation of the rehabilitation training operation according to the present embodiment is shown. Specifically, step elevating training is used as a rehabilitation training operation.

The reception device 500 receives an operation for starting the step elevating training and an operation for determining the name of the user U who performs the step elevating training and the training time for the step elevating training.

When the rehabilitation motion evaluation device 200 acquires the two operations, the second output unit 252 acquires the screen data corresponding to the step elevating training from the second storage unit 242 and transmits the acquired screen data to the display device 400. .. The display device 400 displays a screen corresponding to the acquired screen data.

Even after that, when the reception device 500 receives the predetermined operation, the same processing as described above is performed, and the display device 400 displays the screen corresponding to the predetermined operation.

FIG. 19A is a diagram showing an example of a screen for accepting an operation indicating that the setting related to the rehabilitation training operation is completed. As shown in FIG. 19A, the display device 400 may display the user U photographed by the photographing device 300.

For example, the instructor who instructes the rehabilitation operation follows the instruction shown in FIG. 19A so that the trainee (user U) enters the screen, and presses the "setting complete" button to complete the setting. Perform the operation shown. When the reception device 500 accepts the operation, the display device 400 displays a screen for accepting the operation for starting the rehabilitation training operation.

FIG. 19B is a diagram showing an example of a screen that accepts an operation for starting a rehabilitation training operation. As shown in FIG. 19B, the name of the determined user U (for example, Mr. A) and the user U before performing the rehabilitation training operation photographed by the photographing device 300 are displayed on the display device 400.

For example, the instructor presses the "start" button according to the instruction shown in FIG. 19B to perform an operation for starting the rehabilitation training. When the reception device 500 accepts the operation, the display device 400 displays a screen for evaluating the degree of the rehabilitation training operation.

FIG. 19C is a diagram showing an example of a screen for evaluating the degree of rehabilitation training operation of the user U.

At this time, as shown in [Processing procedure of the rehabilitation motion evaluation method], the rehabilitation motion evaluation device 200 acquires moving image data from the photographing device 300, and the rehabilitation training operation performed by the user U from the acquired moving image data. Evaluate the degree of.

For example, the rehabilitation motion evaluation device 200 may evaluate the degree of the rehabilitation training motion by counting the number of times the user U goes up and down the step. At this time, the rehabilitation motion evaluation device 200 may measure the time required for the user U to move up and down the step a predetermined number of times (for example, 20 times).

Further, although the "remaining time" is displayed in FIG. 19C, the time elapsed from the time when the rehabilitation training is started may be displayed. Further, as shown in FIG. 19C, a "training stop" button for accepting an operation for stopping the rehabilitation training may be displayed.

Further, when the determined training time elapses, a screen notifying that the training is completed is displayed. FIG. 19D is a diagram showing an example of a screen for notifying that the rehabilitation training of the user U has been completed.

In FIGS. 19A to 19D, the rehabilitation motion evaluation device 200 evaluated the degree of the rehabilitation training motion of one user U, but the present invention is not limited to this. The rehabilitation motion evaluation device 200 may evaluate, for example, the degree of rehabilitation training motion of a plurality of users U.

In the present embodiment, as shown in FIGS. 16A and 16B, only the user U is displayed on the display device 400, but the present invention is not limited to this. For example, the care worker accompanying the user U may be displayed on the display device 400.

Further, as shown in FIGS. 19A and 19B, the display device 400 displays a "training time change" button for accepting an operation of changing the training time. This makes it possible to change the training time once determined. Further, not limited to the training time, a button for accepting an operation for changing other setting items may be displayed.

The reception device 500 has received an operation for determining the name of the user U, but the present invention is not limited to this. For example, when the reception device 500 does not accept the above operation, the name of the user U may be determined for the user U shown in FIG. 19A by using a face recognition technique or the like. In this case, once the name of the user U is determined, the name of the user U may be displayed on the display device 400 in association with the skeleton information of the user U displayed on the display device 400. ..

[Effects, etc.]
As described above, the rehabilitation motion evaluation method according to the present embodiment is a method using a rehabilitation motion evaluation device. The rehabilitation motion evaluation method includes acquisition step S110 for acquiring two-dimensional moving image data which is moving image data obtained by photographing a user who has undergone rehabilitation training and does not include distance information. The rehabilitation motion evaluation method further includes an estimation step S120 for estimating skeleton information indicating the user's skeleton in the two-dimensional moving image data based on the two-dimensional moving image data acquired in the acquisition step S110. The rehabilitation motion evaluation method further includes an evaluation step S130 for evaluating the degree of the rehabilitation training motion related to the rehabilitation training performed by the user based on the skeletal information estimated in the estimation step S120.

Thereby, the rehabilitation motion evaluation method according to the present embodiment can evaluate whether or not the rehabilitation training motion is performed in the correct motion based on the two-dimensional moving image data that does not include the distance information. That is, in the rehabilitation motion evaluation method, it is not essential to obtain information from a dedicated device having a distance measuring function. Therefore, the rehabilitation motion evaluation method can easily evaluate whether or not the rehabilitation training motion is correctly performed.

Further, the skeleton information includes information on a plurality of joint positions of one user in each of the two-dimensional moving image data. The evaluation step S130 is a standard in which the distance between the first joint position and the second joint position different from the first joint position among the plurality of joint positions is used as a reference value, and the plurality of joint positions are standardized using the reference value. The conversion step S131 is included. The evaluation step S130 further includes a motion evaluation step S132 for evaluating the rehabilitation training motion based on the plurality of joint positions standardized in the standardization step S131.

By providing the standardization step S131 in this way, a plurality of joint positions standardized to the same length can be obtained. That is, a plurality of joint positions having the same distance between the first joint position and the second joint position can be obtained. Therefore, the rehabilitation motion evaluation method evaluates the degree of the rehabilitation training motion performed by the user U using a common threshold value both when the distance between the user U and the photographing device is short and long. be able to.

Therefore, the rehabilitation motion evaluation method can more easily evaluate whether or not the rehabilitation training motion is performed correctly.

Further, the standardization step S131 further determines and outputs the first joint position and the second joint position based on the initial posture of the rehabilitation training operation performed by the user.

Thereby, the plurality of joint positions available in the standardization step S131 can be determined as the first joint position and the second joint position.

Therefore, since a plurality of joint positions can be standardized more easily, the rehabilitation motion evaluation method can more easily evaluate whether or not the rehabilitation training motion is performed correctly.

The first joint position is the joint position of the user's neck, and the second joint position is the joint position of the user's waist.

Of the multiple joint positions in the upper body, the neck and hips are located in the center of the upper body compared to the shoulders, elbows or neck. Therefore, the estimation unit 280 can easily estimate the skeletal information of the joint positions between the neck and the waist regardless of the rehabilitation motion performed by the user U.

As a result, a plurality of joint positions can be standardized more easily, so that the rehabilitation motion evaluation method can more easily evaluate whether or not the rehabilitation training motion is performed correctly.

Further, the present invention may be realized as a program for causing a computer to execute the above-mentioned rehabilitation operation evaluation method.

Such a program can easily evaluate whether or not the rehabilitation training operation is performed correctly by having the computer evaluate whether or not the rehabilitation training operation is performed correctly.

Further, the rehabilitation motion evaluation device 200 according to the present embodiment is an acquisition unit (acquiring a two-dimensional moving image data which is moving image data obtained by photographing a user U who has undergone rehabilitation training and does not include distance information. A third acquisition unit 223) is provided. Further, the rehabilitation motion evaluation device 200 is an estimation unit that estimates skeleton information indicating the skeleton of the user U in the two-dimensional video data based on the two-dimensional video data acquired by the acquisition unit (third acquisition unit 223). 280 is provided. Further, the rehabilitation motion evaluation device 200 includes an evaluation unit (second evaluation unit 262) that evaluates the degree of the rehabilitation training motion related to the rehabilitation training performed by the user U based on the skeleton information estimated by the estimation unit 280.

Thereby, the rehabilitation motion evaluation device 200 according to the present embodiment can evaluate whether or not the rehabilitation training motion is performed in the correct motion based on the two-dimensional moving image data that does not include the distance information. That is, in the rehabilitation motion evaluation device 200, it is not essential to obtain information from a dedicated device having a distance measuring function. Therefore, the rehabilitation motion evaluation device 200 can easily evaluate whether or not the rehabilitation training motion is correctly performed.

(Modified Example of Embodiment 1)
In the first embodiment, an example is shown in which the motion evaluation unit 2622 evaluates the rehabilitation training motion. In the following modification of the first embodiment, an example is shown in which the discrimination unit 2623 and the posture motion evaluation unit 2624 of the motion evaluation unit 2622b discriminate the postures and evaluate the rehabilitation training motion. In this modification, the components common to those in the first embodiment are designated by the same reference numerals, and duplicate description will be omitted.

[Configuration of rehabilitation operation evaluation device]
FIG. 19E is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation device 200b according to the present modification.

The information processing device 100b according to this modification has the same configuration as the information processing device 100 of the first embodiment except for the rehabilitation operation evaluation device 200b.

Further, the rehabilitation motion evaluation device 200b has the same configuration as the rehabilitation motion evaluation device 200 of the first embodiment except mainly for the second storage unit 242b and the motion evaluation unit 2622b included in the second evaluation unit 262b. Be prepared. In this modification, the motion evaluation unit 2622b includes a discrimination unit 2623 and a posture motion evaluation unit 2624.

Also in this modification, the standardization unit 2621 standardizes a plurality of joint positions by using the same processing as in the first embodiment.

The discrimination unit 2623 is a processing unit that discriminates the posture of the user U based on a plurality of joint positions standardized by the standardization unit 2621. More specifically, the discriminating unit 2623 sets the posture of the user U as one posture having a plurality of joint positions closest to the above-mentioned normalized plurality of joint positions among the plurality of predetermined postures. It is determined that. In this case, the discrimination unit 2623 collates the plurality of joint positions standardized by the standardization unit 2621 with the reference data 246b stored in the second storage unit 242b, and determines the posture of the user U.

Here, an example of the procedure for determining the posture performed by the discrimination unit 2623 is shown.

In this modification, the discriminating unit 2623 discriminates the posture by using the Recognition Tagucci (hereinafter referred to as RT) method, which is one of the Maharanobis Tagucci methods. The RT method is a method for discriminating an unknown pattern by deriving a feature space from a reference pattern (known posture) group and evaluating the feature amount of the unknown pattern (unknown posture) in the feature space.

Here, the standing posture and the one-leg standing posture in the one-leg standing training, which is a rehabilitation training operation, will be described as an example.

First, the discrimination unit 2623 derives the feature space from the reference pattern group. Specifically, the discrimination unit 2623 derives a feature space from a plurality of joint positions in a known posture standardized by the standardization unit 2621. Here, the standing posture is a known posture.

First, the determination unit 2623, the average value _{m j} in the feature space, and to calculate the effective divisor r. When there are n reference patterns of the feature space and each of the x and y coordinate positions of the plurality of joint positions in the i-th pattern is _aij (j = 1, 2, ... k), the feature space. The mean value m _j and the effective divisor r in are obtained from the equations (1) and (2).

Subsequently, the discrimination unit 2623 _{calculates the feature quantities Y 1} (i) and Y ₂ (i) in the i-th pattern. The features Y ₁ (i) and Y ₂ (i) are the equations (3), (4), (5) and (6) using the _{mean value m j in the feature space and the effective divisor r.} ) Is required.

The feature amount Y ₁ is a feature amount proportional to the sensitivity of the feature space, and the feature amount Y ₂ is a feature amount inversely proportional to the S (signal) / N (noise) ratio of the feature space.

Here, the discrimination unit 2623 derives a feature space based on the standing posture based on _{the feature quantities Y 1} and Y _2. Specifically, it will be described with reference to FIG. 19F.

FIG. 19F is a diagram showing an example of the feature amount calculated by the discriminating unit 2623 according to this modified example. In FIG. 19F, the feature quantities Y ₁ and Y ₂ of the reference pattern (standing posture) are shown, and in FIG. 19F, the feature space based on the standing posture is indicated by an ellipse. The ellipse shows a variation within 2σ from the center of the feature space. The center of the feature space relative to the standing position, for example, calculated n feature amounts Y ₁ of the arithmetic mean and the calculated n pieces of coordinates indicated the arithmetic mean of the feature quantity Y ₂ The position.

Subsequently, the feature amount of the unknown pattern shown in FIG. 19F will be described. Here, it is assumed that the one-leg standing posture is an unknown posture.

The discrimination unit 2623 calculates the feature amount of the unknown pattern. In this modification, the discrimination unit 2623 calculates the feature amount of the unknown pattern from the plurality of joint positions (see FIG. 19G) in the unknown posture standardized by the standardization unit 2621.

FIG. 19G is a diagram showing a plurality of joint positions in an unknown posture standardized by the standardization unit 2621 according to this modification. FIG. 19G is a diagram corresponding to FIG. 18B (c). 19G (a), (b) and (c) show a one-leg standing posture with the right foot raised, and FIG. 19G (d) shows a one-leg standing posture with the left foot raised. There is. Further, in the present modification, the standardization unit 2621 corrects and standardizes the coordinate positions of the plurality of joints by the same method as in the first embodiment.

The discriminating unit 2623 uses the plurality of joint positions in the unknown posture shown in FIG. 19G and the above equations (3), (4), (5) and (6) to feature each of the unknown patterns. Calculate the quantities Y ₁ and Y _2.

FIG. 19F shows the calculated feature amount of the unknown pattern. As described above, the one-leg standing posture is an unknown posture, and the one-leg standing (a), (b), (c) and (d) shown in FIG. 19F are shown in FIGS. 19G (a), (b) and (c). ) And (d) correspond to the one-leg standing posture.

Further, the discrimination unit 2623 discriminates the unknown pattern from the calculated feature amount of the unknown pattern.

As shown in FIG. 19F, the distribution position of the feature amount of the unknown pattern is separated from the feature space based on the standing posture. Here, if the feature amount of the unknown pattern is within a predetermined index from the center of the feature space based on the standing posture (for example, within 2σ (that is, within the ellipse of FIG. 19F)), the unknown posture is a known posture. Is determined to be. In this modification, the feature amount of the unknown pattern is outside the range of 2σ from the center of the feature space based on the standing posture. As a result, the discriminating unit 2623 can easily discriminate that the unknown posture is not a known posture. In this modified example, the standing posture is a known posture and the one-leg standing posture is an unknown posture, so that the above determination is valid.

The index used by the discriminating unit 2623 to discriminate the unknown posture is not limited to 2σ. For example, the index may be σ or 3σ.

Here, another example of the procedure for determining the posture performed by the discrimination unit 2623 will be shown. For example, in the following description, it is assumed that the one-leg standing posture in which the right foot is raised (hereinafter, right foot raising posture) is a known posture, and the one-leg standing posture in which the left foot is raised (hereinafter, left foot raising posture) is an unknown posture. ..

FIG. 19H is a diagram showing another example of the feature amount calculated by the discriminating unit 2623 according to this modified example.

In FIG. 19H, the feature amount is calculated based on the plurality of joint positions of the one-leg standing posture shown in FIGS. 19G (a), (b), (c) and (d). In FIG. 19H, the feature space based on the right foot raising posture is indicated by an ellipse. The ellipse shows a variation within 2σ from the center of the feature space.

As shown in FIG. 19H, the distribution position of the feature amount (left foot raising posture) of the unknown pattern is away from the feature space based on the right foot raising posture, and is outside the range of 2σ from the center of the feature space. As a result, the discrimination unit 2623 can easily determine that the unknown posture (left foot raising posture) is not the known posture (right foot raising posture).

As described above, by using the RT method, the discriminating unit 2623 can discriminate the posture based on the plurality of joint positions standardized by the standardized unit 2621.

Further, the posture motion evaluation unit 2624 will be described.

The posture motion evaluation unit 2624 is a processing unit that evaluates the rehabilitation training motion based on the time-series change of the posture of the user U determined by the discrimination unit 2623. The posture motion evaluation unit 2624 collates the time-series change in the posture of the user U with the reference data 246b stored in the second storage unit 242b, and evaluates the rehabilitation training motion.

In this modification, the second storage unit 242b is a storage device in which reference data 246b is stored. Reference data 246b shows the relationship between the motion name of the rehabilitation training motion and the feature space based on the known posture, and the relationship between the motion name of the rehabilitation training motion and the posture information related to the rehabilitation training motion. There is. The plurality of predetermined postures are, for example, the above-mentioned known postures, and the posture information related to the rehabilitation training motion is, for example, the order of the correct postures when the rehabilitation training motion is performed correctly. .. In the rehabilitation training, a preselected rehabilitation training motion is presented to the user U, and the user U repeatedly performs the rehabilitation training motion to maintain or improve the motor function. Therefore, it is possible to predetermine a plurality of postures included in the presented rehabilitation training movements or a permutation of correct postures. The reference data 246b is referred to by the discriminating unit 2623 when the posture of the user U is determined, and by the posture motion evaluation unit 2624 when the rehabilitation training motion is evaluated.

The second evaluation unit 262b is specifically realized by a processor, a microcomputer, or a dedicated circuit, like the second evaluation unit 262 according to the first embodiment. In addition, the second storage unit 242b also stores the program executed by the second evaluation unit 262b and the screen data showing the evaluation result used when outputting the evaluation result of the degree of the rehabilitation training operation of the user U. Has been done.

[Processing procedure of rehabilitation operation evaluation method]
Subsequently, a specific processing procedure in the rehabilitation motion evaluation method executed by the rehabilitation motion evaluation device 200b will be described. FIG. 19I is a flowchart showing a processing procedure in which the rehabilitation motion evaluation device 200b according to the present modification evaluates the degree of the rehabilitation training motion of the user U. More specifically, FIG. 19I is a more detailed flowchart of step S132 shown in FIG. Here, as a rehabilitation training operation, trouser raising / lowering training is taken as an example. The trouser raising / lowering training is a training in which the user U performs the action of putting on the trousers and the action of taking off the trousers in order.

Before the processing of the flowchart shown in FIG. 19I is performed, the discrimination unit 2623 derives the feature space from the reference pattern group. Specifically, the discrimination unit 2623 derives a feature space from a plurality of joint positions in a known posture related to the trouser raising / lowering training standardized by the standardization unit 2621. By standardizing by the standardization unit 2621, a plurality of joint positions shown in FIG. 19J can be obtained.

FIG. 19J is a diagram showing a plurality of joint positions of the posture of the trouser raising / lowering training standardized by the standardization unit 2621 according to the present modification. 19J (a), (e) and (i) show a sitting posture, FIGS. 19J (b) and (g) show a right foot raising posture, and FIGS. 19J (c) and (h) show a sitting posture. ) Shows the left leg raising posture, and FIGS. 19J (d) and (f) show the mid-waist posture. Further, (a), (b), (c), (d) and (e) of FIG. 19J show the operation of wearing trousers, and (e), (f), (g) of FIG. 19J, In (h) and (i), the action of taking off the pants is shown.

Here, the sitting posture, the right foot raising posture, the left foot raising posture, and the middle waist posture, which are typical postures of the trouser raising and lowering training, are known postures. That is, in this modification, four known postures are used. Therefore, the discriminating unit 2623 derives the feature space of the sitting posture, the feature space of the right foot raising posture, the feature space of the left foot raising posture, and the feature space of the middle waist posture.

As described above, in the present modification, before the processing of the flowchart shown in FIG. 19I is performed, the feature space of each of the four known postures derived and the training name of the rehabilitation operation (trousers) are stored in the second storage unit 242b. Reference data 246b showing the relationship with the raising / lowering training) is stored.

Subsequently, in the present modification as well, the process of step S131 of steps S110, S120, and S130 is performed as in the first embodiment, and the standardization unit 2621 evaluates the motion of the normalized plurality of joint positions. Output to unit 2622b (see FIG. 17). The third acquisition unit 223 obtains the operation name (trouser raising / lowering training) of the rehabilitation training operation performed by the user U via the reception device 500.

The determination unit 2623 determines the posture of the user U based on the plurality of joint positions standardized by the standardization unit 2621 (step S133). More specifically, the discriminating unit 2623 sets one posture having a plurality of joint positions closest to the plurality of joint positions standardized by the standardized unit 2621 among the plurality of predetermined postures. It is determined that the posture is (step S134). In this modification, the discriminating unit 2623 determines which of the above four known postures the unknown posture of the user U corresponds to based on the plurality of joint positions of the unknown postures of the standardized trouser raising / lowering training. To do.

First, the discrimination unit 2623 calculates the feature amount of the unknown pattern. In the description of steps S133 and S134, an example of one frame including the two-dimensional moving image data of the user U who has been trained to raise and lower the trousers will be given. FIG. 19K is a diagram showing a plurality of joint positions of unknown postures in the trouser raising / lowering training standardized by the standardization unit 2621 according to this modified example.

The discriminating unit 2623 uses the plurality of joint positions in the unknown posture shown in FIG. 19K and the above equations (3), (4), (5) and (6) to each of the unknown patterns. The feature quantities Y ₁ and Y ₂ are calculated. The determination unit 2623 calculates _{the feature quantities Y 1} and Y ₂ of the unknown pattern based on the feature spaces of the four known postures with reference to the reference data 246b.

Subsequently, the discrimination unit 2623 discriminates an unknown pattern from the _{calculated feature quantities Y 1} and Y _2.

Here, the discrimination unit 2623 discriminates an unknown pattern by the Mahalanobis distance D ² _{calculated from the feature quantities Y 1} and Y _{2 by using the RT method.} The Mahalanobis distance D ² represents the distance from the center of one feature space to an unknown pattern to be evaluated. The smaller the Mahalanobis distance D ² , the closer to the reference posture of the feature space.

Discrimination unit 2623 calculates each of the Mahalanobis distance D ₀ ² from the center of each of the feature space defined by the variation in 2σ of the derived four known position. Incidentally, each of the Mahalanobis distance _D ^{0 2} in advance, may be stored by the second storage unit 242b. Further, the determination unit 2623, the feature amount of an unknown pattern shown in FIG. 19K, calculates the Mahalanobis distance D ₁ ² from the center of each of the feature space of four known position, further, the normalized distance (D ₁ ² / _D ^{0 2)} is calculated. Table 1 is a table Mahalanobis distance D ² of the present modification is shown.

Normalized distance that Table 1 indicates _{^{(D 1 2 / D 0 2}} ) is a numerical value Mahalanobis distance _D ^{1 2} is divided by the Mahalanobis distance _D ^{0 2.} More normalized distance _{^{(D 1 2 / D 0 2}} ) is less known posture, unknown pattern to be evaluated is the attitude closer to the known position. Therefore, from Table 1, the discriminating unit 2623 determines that the unknown posture is the right foot raising posture.

As described above, the determination unit 2623, among the known orientation of a plurality of posture predetermined nearest multiple joint positions normalization unit 2621 is normalized (normalized distance _{^{(D 1 2 / D 0 2}} ) One posture having a plurality of joint positions (which is the smallest) is determined to be the posture of the user U.

In other words, the discrimination unit 2623 can easily determine which of the plurality of predetermined postures (known postures) the unknown posture of the user U corresponds to. Thereby, it is possible to evaluate whether or not the movements constituting the trouser raising / lowering training (the movement of putting on the trousers and the movement of taking off the trousers) are correctly performed by the user U. That is, the rehabilitation motion evaluation method can easily evaluate whether or not the rehabilitation training motion is correctly performed.

When the discrimination unit 2623 discriminates the posture, as described above, if the feature amount of the unknown pattern is within 2σ from the center of the feature space based on the standing posture, the unknown posture is a known posture. A method determined to be may be used.

Further, although the description has been given here with one frame including the two-dimensional moving image data, in this modification, the discriminating unit 2623 performs the same processing for a plurality of frames that change in time series included in the two-dimensional moving image data. Do. That is, the discrimination unit 2623 discriminates the time-series change in the posture of the user U and outputs it to the posture motion evaluation unit 2624.

The posture motion evaluation unit 2624 evaluates the rehabilitation training motion based on the time-series change of the posture of the user U determined by the discrimination unit 2623 (step S135).

For example, the posture motion evaluation unit 2624 uses the reference data 246b showing the relationship between the motion name of the rehabilitation training motion and the posture information related to the rehabilitation training motion, and the rehabilitation motion training correctly performed by the user U. Count the number of times. As a result, the posture motion evaluation unit 2624 evaluates the degree of rehabilitation motion training.

For example, if the trouser raising and lowering training is performed correctly, the trousers are put on and then the trousers are taken off. The correct order of the postures for wearing the trousers is one of the sitting posture, the right foot raising posture and the left foot raising posture, the right foot raising posture and the left foot raising posture, the middle waist posture, and the sitting posture. The correct order of the postures for taking off the pants is the sitting posture, the middle waist posture, the right foot raising posture and the left foot raising posture, the right foot raising posture and the left foot raising posture, and the sitting posture.

In this modified example, the posture motion evaluation unit 2624 evaluates the degree of rehabilitation motion training by counting the number of times the pants raising and lowering training is performed in the order of the correct posture. Here, an example of the result evaluated by the posture motion evaluation unit 2624 is shown in FIG. 19L.

FIG. 19L is a diagram showing a time-series change in the posture of the user U in the trouser raising / lowering training according to this modified example. In FIG. 19L, the vertical axis corresponds to the posture of the user U, and the numerical values on the vertical axis are 1: sitting posture, 2: left foot raising posture, 3: right foot raising posture, and 4: middle waist posture. Correspond. The horizontal axis corresponds to the operation execution time when the rehabilitation training operation is performed.

For example, in the 1.9 to 4.8 [sec] section, the posture of the user U changes from the sitting posture to the left foot raising posture, the right foot raising posture, the middle waist posture, and the sitting posture. The posture motion evaluation unit 2624 evaluates that the user U was able to correctly put on the trousers in the section. Further, for example, in the section of 6.4 to 10.1 [sec], the posture of the user U changes from the sitting posture to the middle waist posture, the left foot raising posture, the right foot raising posture, and the sitting posture. The posture motion evaluation unit 2624 evaluates that the user U was able to correctly take off his pants in the section. Further, for example, in the 12.1 to 15.6 [sec] section and the 24.1 to 27.5 [sec] section, the posture of the user U changes from the sitting posture to the right foot raising posture and the left foot raising posture. , Right leg up posture, mid-waist posture, and sitting posture. The posture motion evaluation unit 2624 evaluates that the user U was able to correctly put on the trousers in the two sections. Further, also in the 17.7 to 22.1 [sec] section and the 28.8 to 34.2 [sec] section, the posture motion evaluation unit 2624 similarly has the user U in the two sections. It is evaluated that he was able to take off his pants correctly.

Therefore, in the trouser raising / lowering training shown in FIG. 19L, the posture motion evaluation unit 2624 evaluates that the trouser raising / lowering training has been performed by the user U three times. Further, the posture motion evaluation unit 2624 may evaluate that the average execution time of the action of putting on the pants is 3.2 [sec] and the average execution time of the action of taking off the pants is 3.9 [sec].

In this way, the posture motion evaluation unit 2624 evaluates the degree of the rehabilitation training motion by counting the number of rehabilitation motion trainings performed in the correct posture order based on the time-series change of the posture of the user U. .. For example, it is possible to more easily evaluate whether or not the rehabilitation motion training is correctly performed by the user U as compared with the case where one posture of the user U is used. That is, the rehabilitation motion evaluation method can easily evaluate whether or not the rehabilitation training motion is correctly performed.

The posture motion evaluation unit 2624 outputs the evaluation result of the rehabilitation motion training performed by the user U to the second output unit 252.

Subsequently, the second output unit 252 outputs the evaluation result of the rehabilitation training operation performed by the user U evaluated by the second evaluation unit 262b to the display device 400.

Further, the display device 400 displays the result of evaluating the degree of the rehabilitation training operation of the user U evaluated by the rehabilitation operation evaluation device 200b.

Here, the accuracy of the operation execution time obtained from FIG. 19L will be further described. FIG. 19M is a diagram showing measured values and calculated values of the operation execution time in the trouser raising / lowering training according to this modified example.

The measured value is a value obtained by measuring the time required for the rehabilitation movement training by the instructor himself who guides the rehabilitation movement performed by the user U using a measuring instrument (for example, a stopwatch). The calculated value is a value of the time required for the rehabilitation motion training obtained from the evaluation result evaluated by the second evaluation unit 262.

As shown in FIG. 19M, the measured value and the calculated value have a high positive correlation (correlation coefficient r> 0.98). Moreover, the error of the calculated value was ± 0.34 [sec] in 2σ by comparison with the measured value. It is reported in the following documents that there is a deviation of about 0.3 [sec] in the measured values using a stopwatch even for a skilled measurer (Non-patent document: Daisuke Toto et al., "Stopwatch". Quantification of systematic error and random error in manual measurement of 50m running time using "Physical Education Measurement Evaluation Study, Vol. 18, p27-33, 2018). Therefore, it can be judged that the calculated value of the operation execution time by this technology is about the same as that of a skilled measurer. Therefore, the evaluation based on the human motion estimation enables stable evaluation without depending on the skill difference for each functional training instructor.

In this modified example, the discriminating unit 2623 discriminates the posture by using the RT method, but the present invention is not limited to this. The discrimination unit 2623 may discriminate the posture by using, for example, an ANN (artificial neural network) method.

(Embodiment 2)
In the rehabilitation operation evaluation device 200 according to the first embodiment, the second evaluation unit 262 includes a standardization unit 2621 and an operation evaluation unit 2622, but the present invention is not limited to this. In the present embodiment, the second evaluation unit 262a does not include a standardization unit and an motion evaluation unit, and the rehabilitation motion evaluation device 200a includes a photographing control unit 290a and a display control unit 291a. Is different. In the present embodiment, the same components as those in the first embodiment are designated by the same reference numerals, and redundant description will be omitted.

[Configuration of rehabilitation operation evaluation device]
FIG. 20 is a block diagram showing a characteristic functional configuration of the rehabilitation motion evaluation device 200a according to the present embodiment.

The information processing device 100a may include a rehabilitation motion evaluation device 200a, a photographing device 300a, a display device 400, and a reception device 500.

The photographing device 300a is a device for photographing a user U who has undergone rehabilitation training. The photographing device 300a may be any device as long as it can capture a moving image, and is, for example, a camera or a video camera. In addition, the photographing device 300a has a display unit 301a for displaying a moving image in which the user U undergoing rehabilitation training is being photographed.

The photographing device 300a has a display unit 301a. Specifically, the display unit 301a is a monitoring device composed of a liquid crystal panel, an organic EL panel, or the like. When the information processing device 100a is a smartphone or a tablet, the display unit 301a may be the same as the display device 400.

In the following, the display unit 301a and the display device 400 are the same components, and the screen or instruction displayed on either the display unit 301a or the display device 400 is the screen or instruction displayed on the other. Can be regarded as.

The moving image data obtained by photographing the user U undergoing rehabilitation training is two-dimensional moving image data that does not include distance information. The distance information is the distance information between the photographing device 300a and the user U. That is, the photographing device 300a may be a device that does not have a distance measuring function. The photographing device 300a may be a separate device independent of the information processing device 100a.

The photographing device 300a outputs the moving image data to the rehabilitation motion evaluation device 200a.

As shown in FIG. 20, the rehabilitation motion evaluation device 200a includes an acquisition unit, an estimation unit 280, an evaluation unit, a second output unit 252, a second storage unit 242a, an imaging control unit 290a, and a display control unit. It includes 291a.

In order to distinguish from the acquisition unit 20 and the first evaluation unit 61 included in the rehabilitation support device 10 according to the first embodiment shown in FIG. 2, the acquisition unit and the evaluation unit included in the rehabilitation motion evaluation device 200a are the third acquisition units. It is described as a part 223 and a second evaluation part 262a.

The shooting control unit 290a is a processing unit that controls the shooting device 300a to shoot a two-dimensional moving image that does not include distance information about the user U who has undergone rehabilitation training. Specifically, the photographing control unit 290a is realized by a processor, a microcomputer, or a dedicated circuit.

For example, when the reception device 500 receives an operation for photographing the user U who has undergone rehabilitation training, the reception device 500 outputs the operation to the imaging control unit 290a. When the shooting control unit 290a acquires the operation, the shooting control unit 290a controls the shooting device 300a to shoot a two-dimensional moving image. Further, the photographing control unit 290a may obtain the operation name of the rehabilitation training operation performed by the user U via the reception device 500. The imaging control unit 290a may output the operation name of the operation and the rehabilitation training operation to the display control unit 291a.

The display control unit 291a is a processing unit that controls the display unit 301a to display an instruction for keeping the distance between the photographing device 300a and the user U at a predetermined distance. The display control unit 291a may control to display the instruction by acquiring an operation for photographing the user U who has undergone rehabilitation training from the imaging control unit 290a. That is, the instruction may be displayed on the display unit 301a at the same time when the photographing device 300a starts photographing.

Further, the display control unit 291a collates the operation name of the rehabilitation training operation acquired from the photographing control unit 290a with the reference data 246a stored in the second storage unit 242a, and causes the photographing device 300a and the user U to collate with each other. Instructions for keeping the distance at a predetermined distance may be determined.

The instruction displayed by the display unit 301a under the control of the display control unit 291a may be displayed so as to overlap with the user U who has undergone rehabilitation training. The instruction may be, for example, a frame-shaped line and may be displayed so that the user U undergoing rehabilitation training is located inside the frame-shaped line. Further, for example, the instruction is two lines, one of the two lines superimposes on the user U, and the other one superimposes on a predetermined mark related to the rehabilitation training. It may be displayed in. The shape of the instruction is not limited to the above.

By providing such a display control unit 291a, the moving image data acquired by the rehabilitation motion evaluation device 200a keeps the distance between the photographing device 300a and the user U at a predetermined distance and includes the distance information. There is no 2D moving image data.

The second storage unit 242a is a storage device in which reference data 246a is stored. The reference data 45 is data showing, for example, the relationship between the operation name of the rehabilitation training operation and the instruction displayed by the display unit 301a under the control of the display control unit 291a.

The second evaluation unit 262a is the same as the second evaluation unit 262 of the first embodiment except that it does not have the standardization unit 2621 and the operation evaluation unit 2622.

[Processing procedure of rehabilitation operation evaluation method]
Subsequently, a specific processing procedure in the rehabilitation motion evaluation method executed by the rehabilitation motion evaluation device 200a will be described. FIG. 21 is a flowchart showing a processing procedure in which the rehabilitation motion evaluation device 200a according to the present embodiment evaluates the degree of the rehabilitation training motion of the user U. Here, TUG (Timed Up and Go Test) is taken as an example of the rehabilitation training operation. TUG is measured, for example, as follows. First, the user U stands up from a state of sitting comfortably on a chair with an armrest. Next, the user U walks to a mark (for example, a traffic cone) 3 m ahead, turns back, and then sits deeply again. In TUG, the time required from standing up to sitting is measured. Here, FIGS. 22A to 22G, which are examples of screens displayed by the display device 400, will be described with reference to actual examples.

First, the photographing control unit 290a controls the photographing device 300a to capture a two-dimensional moving image based on the operation for photographing the user U undergoing rehabilitation training acquired from the reception device 500 (step S240). ). Further, the photographing control unit 290a may obtain the operation name (TUG) of the rehabilitation training operation performed by the user U via the reception device 500. At this time, the photographing control unit 290a may output the operation name of the operation and the rehabilitation training operation to the display control unit 291a.

As in the first embodiment, the reception device 500a accepts an operation for starting the rehabilitation training operation and an operation for determining the name of the user U who performs the rehabilitation training operation. When the rehabilitation operation evaluation device 200a acquires the operation, the second output unit 252 acquires the screen data corresponding to the TUG from the second storage unit 242a, transmits the acquired screen data to the display device 400, and transmits the acquired screen data to the display device 400. Displays the screen corresponding to the acquired screen data.

Further, the display control unit 291a acquires the operation name of the operation for photographing the user U undergoing the rehabilitation training and the rehabilitation training operation from the imaging control unit 290a. Then, the display control unit 291a controls the display unit 301a to display an instruction for keeping the distance between the photographing device 300a and the user U at a predetermined distance (step S250).

The instruction displayed by the display unit 301a under the control of the display control unit 291a is, for example, two lines as shown in FIG. 22A.

FIG. 22A is a diagram showing an example of a screen for accepting an operation indicating that the setting related to the rehabilitation training operation is completed. In the present embodiment, the two lines are displayed as vertical dotted lines on the display unit 301a. Further, the instruction displayed by the display unit 301a may be used as a threshold value for the second evaluation unit 262a to evaluate the degree of the rehabilitation training operation. Therefore, in FIG. 22A, the two lines have a fifth threshold value L5 and a sixth threshold value L6, respectively. For example, when the coordinate positions of the plurality of joints of the user U included in the skeletal information of the user U estimated by the estimation unit 280 exceed the threshold value, the second evaluation unit 262a evaluates the degree of the rehabilitation training operation. You may. Details will be described later.

Here, for example, the instructor acts so that the distance between the two vertical dotted lines is 3 m according to the instruction shown in FIG. 22A. The distance between the chair on which the user U sits and the mark (triangular cone) is set to 3 m in advance. This makes it possible to keep the distance between the photographing device 300a and the user U at a predetermined distance.

The evaluation performed by the rehabilitation motion evaluation device 200a may be performed in real time. That is, the moving image data captured by the photographing device 300a is sequentially output to the rehabilitation motion evaluation device 200a, and the rehabilitation motion evaluation device 200a evaluates the degree of the rehabilitation training motion performed by the user U. In other words, the photographing of the moving image by the photographing device 300a and the evaluation by the rehabilitation motion evaluation device 200a proceed almost at the same time.

Therefore, as shown below, also in FIGS. 22B to 22G (steps S110 to S130), the display unit 301a displays an instruction for keeping the distance between the photographing device 300a and the user U at a predetermined distance. To.

Here, for example, the instructor performs an operation indicating that the setting is completed by pressing the "setting completed" button in accordance with the instruction shown in FIG. 22A. When the reception device 500 accepts the operation, the display device 400 displays a screen for accepting the operation for starting the rehabilitation training operation.

FIG. 22B is a diagram showing an example of a screen for accepting an operation for starting a rehabilitation training operation. As shown in FIG. 22B, the rehabilitation training operation (TUG), the determined name of the user U (for example, Mr. B), and the user U before performing the rehabilitation training operation are displayed on the display device 400. There is.

For example, the instructor presses the "start" button according to the instruction shown in FIG. 22B to perform an operation for starting the rehabilitation training. When the reception device 500 accepts the operation, the display device 400 displays a screen for evaluating the degree of the rehabilitation training operation.

FIG. 22C is a diagram showing an example of a screen for evaluating the degree of rehabilitation training operation of the user U. FIG. 22D is a diagram showing another example of the screen for evaluating the degree of the rehabilitation training operation of the user U. FIG. 22E is a diagram showing another example of the screen for evaluating the degree of the rehabilitation training operation of the user U. FIG. 22F is a diagram showing another example of the screen for evaluating the degree of the rehabilitation training operation of the user U.

In FIGS. 22C to 22F, the rehabilitation motion evaluation device 200a acquires moving image data from the photographing device 300a, and evaluates the degree of the rehabilitation training motion performed by the user U from the acquired moving image data. Further, FIGS. 22C to 22F are diagrams showing that time has elapsed in order.

Specifically, the third acquisition unit 223 acquires moving image data (two-dimensional moving image data) of the user U undergoing rehabilitation training via the photographing device 300a (step S110). Next, the estimation unit 280 estimates the skeleton information of the user U based on the two-dimensional moving image data (step S120). Further, the second evaluation unit 262a evaluates the degree of the rehabilitation training operation performed by the user U based on the skeletal information estimated in step S120 (step S130). At this time, the second output unit 252 sequentially outputs the evaluation result of the rehabilitation training operation performed by the user U evaluated by the second evaluation unit 262a to the display device 400. Therefore, the display device 400 displays the evaluation result of the rehabilitation training operation (time shown in FIGS. 22C to 22F) even while the user U is performing the rehabilitation operation training. That is, the rehabilitation motion evaluation device 200a can evaluate the rehabilitation training motion in real time.

The start time of the time required from standing up to sitting in TUG may be, for example, the time when the "start" button is pressed, and the coordinate position of one joint of the user U included in the skeleton information is a threshold value. It may be when a certain vertical dotted line is crossed.

In the present embodiment, the start time of the time required from standing up to sitting in the TUG is when the coordinate position of the ankle joint of the user U exceeds the fifth threshold value L5 (see FIG. 22C). Further, the time required for the outward route in the TUG is the time until the coordinate position of the ankle joint of the user U exceeds the fifth threshold value L5 and the coordinate position of the ankle joint of the user U reaches the sixth threshold value L6. (See FIGS. 22D and 22E). The time required for the turn is such that the coordinate position of the ankle joint of the user U exceeds the sixth threshold L6, the coordinate position of the ankle joint of the user U goes around the mark (triangular cone), and reaches the sixth threshold L6 again. Time to (see FIGS. 22E and 22F). The time required for the return trip is the time until the coordinate position of the ankle joint of the user U exceeds the sixth threshold value L6 and the coordinate position of the ankle joint of the user U reaches the fifth threshold value L5 (FIGS. 22F and 22F). See FIG. 22G). Further, when the coordinate position of the ankle joint of the user U exceeds the fifth threshold value L5 again, the rehabilitation motion evaluation device 200a determines that the rehabilitation training motion has been achieved.

As a result, the second output unit 252 acquires the screen data notifying that the training has been completed from the second storage unit 242a, transmits the acquired screen data to the display device 400, and the display device 400 receives the acquired screen. Display the screen corresponding to the data. FIG. 22G is a diagram showing an example of a screen for notifying that the rehabilitation training of the user U has been completed.

Further, for example, the instructor may press the "restart" button as shown in FIG. 22G to perform an operation for restarting the rehabilitation training. When the reception device 500 accepts the operation, the display device 400 displays the screen for evaluating the degree of the rehabilitation training operation again.

At this time, the second output unit 252 further outputs the evaluation result of the rehabilitation training operation performed by the user U evaluated by the second evaluation unit 262a to the display device 400, and the display device 400 outputs the evaluation result of the rehabilitation training operation to the display device 400. The result of evaluation (measurement result shown in FIG. 22G) may be displayed.

[Effects, etc.]
As described above, the rehabilitation operation evaluation method further includes an imaging control step S240 and a display control step S250. In the shooting control step S240, a two-dimensional moving image that does not include distance information about a user undergoing rehabilitation training in a shooting device including a display unit that displays a moving image taken by a user undergoing rehabilitation training. Control to take an image. The display control step S250 controls the display unit to display an instruction for keeping the distance between the photographing device and the user at a predetermined distance.

As a result, the moving image data acquired by the rehabilitation motion evaluation method becomes two-dimensional moving image data in which the distance between the photographing device 300a and the user U is maintained at a predetermined distance and does not include the distance information. The rehabilitation motion evaluation method can evaluate whether or not the rehabilitation training motion is performed in the correct motion based on such two-dimensional moving image data. That is, in the rehabilitation motion evaluation method, it is not essential to obtain information from a dedicated device having a distance measuring function. Therefore, the rehabilitation motion evaluation method can easily evaluate whether or not the rehabilitation training motion is correctly performed.

(Other embodiments)
Although the rehabilitation operation evaluation method and the like according to the first and second embodiments have been described above, the present invention is not limited to the above-described embodiment.

The information processing device of the first embodiment is a device including a display device, a rehabilitation operation evaluation device, and a reception device, but the present invention is not limited to this, and each device may be an independent and separate device. Good. Similarly, the information processing device of the second embodiment is a device including a display device, a rehabilitation operation evaluation device, a reception device, and a photographing device, but the present invention is not limited to this, and each device is independent. It may be a separate device.

Further, in the above-described embodiment and modification, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

In addition, each component may be realized by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits from each other. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.

In addition, general or specific embodiments of the present invention may be realized in recording media such as systems, devices, methods, integrated circuits, computer programs or computer-readable CD-ROMs. Further, it may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program and a recording medium.

For example, the present invention may be realized as a control method executed by a computer such as a control system, or may be realized as a program for causing a computer to execute such a control method. The present invention may also be realized as a computer-readable non-temporary recording medium in which such a program is recorded.

In addition, any of the components and functions in each embodiment and modification can be obtained by subjecting various modifications that can be thought of by those skilled in the art to each embodiment and modification, or within the range not deviating from the gist of the present invention. A form realized by combining with is also included in the present invention.

200, 200a, 200b Rehabilitation motion evaluation device 280 Estimator 300, 300a Imaging device

Claims (9)

It is a rehabilitation motion evaluation method using a rehabilitation motion evaluation device.
Acquisition step to acquire 2D moving image data that is moving image data taken by a user undergoing rehabilitation training and does not include distance information,
Based on the two-dimensional moving image data acquired in the acquisition step, an estimation step for estimating skeleton information indicating the skeleton of the user in the two-dimensional moving image data, and an estimation step.
A rehabilitation motion evaluation method including an evaluation step for evaluating the degree of rehabilitation training motion related to the rehabilitation training performed by the user based on the skeleton information estimated in the estimation step. The skeleton information includes information on a plurality of joint positions of one user in each of the two-dimensional moving image data.
The evaluation step
Of the plurality of joint positions, a standardization in which the distance between the first joint position and the second joint position different from the first joint position is used as a reference value, and the plurality of joint positions are standardized using the reference value. Steps and
The rehabilitation motion evaluation method according to claim 1, further comprising a motion evaluation step for evaluating the rehabilitation training motion based on the plurality of joint positions standardized in the standardization step. The rehabilitation motion evaluation according to claim 2, wherein the standardization step further determines and outputs the first joint position and the second joint position based on the initial posture of the rehabilitation training motion performed by the user. Method. The first joint position is the joint position of the user's neck.
The rehabilitation motion evaluation method according to claim 2 or 3, wherein the second joint position is the position of the hip joint of the user. The operation evaluation step is
A determination step for determining the posture of the user based on the plurality of joint positions standardized in the standardization step, and a determination step.
The rehabilitation motion evaluation method according to claim 2, further comprising a posture motion evaluation step for evaluating the rehabilitation training motion based on the time-series change of the posture of the user determined in the discrimination step. In the determination step, one of the plurality of predetermined postures having a plurality of joint positions closest to the plurality of joint positions standardized in the standardization step is the posture of the user. The rehabilitation operation evaluation method according to claim 5. Further, a two-dimensional moving image that does not include distance information about the user undergoing rehabilitation training in a photographing device provided with a display unit that displays a moving image taken by the user undergoing rehabilitation training. A shooting control step that controls the shooting of an image, and
The rehabilitation operation evaluation method according to claim 1, further comprising a display control step for controlling the display unit to display an instruction for keeping the distance between the photographing device and the user at a predetermined distance. A computer program for causing a computer to execute the rehabilitation operation evaluation method according to any one of claims 1 to 7. An acquisition unit that acquires 2D video data that is video data of a user undergoing rehabilitation training and does not include distance information.
Based on the two-dimensional moving image data acquired by the acquiring unit, an estimation unit that estimates skeleton information indicating the skeleton of the user in the two-dimensional moving image data, and an estimation unit.
A rehabilitation motion evaluation device including an evaluation section for evaluating a rehabilitation training motion related to the rehabilitation training performed by the user based on the skeleton information estimated by the estimation unit.

Images