JP2015089412A - Rehabilitation support picture formation device, rehabilitation support system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user interface for making it easy to grasp motion in accompany with a specific recovery measurement test in rehabilitation.SOLUTION: A rehabilitation support picture formation device comprises an acquisition unit and a creation unit. The acquisition unit acquires joint position information which is created on the basis of an imaged picture obtained by imaging a patient and shows each joint position of the patient. The creation unit creates a rehabilitation support picture to be used for a specific recovery measurement test in rehabilitation, on the basis of the joint position information. Specifically, the creation unit creates virtual human images HM1, HM2 corresponding to the patient on the basis of the joint position information, and creates guide images GM1, GM2 showing a range of a specific part (right arm) to be moved as a target of the specific recovery measurement test. The creation unit creates a picture including the human images HM1, HM2 and guide images GM1, GM2 as a rehabilitation support picture.

Description

The present invention relates to a rehabilitation support image generation apparatus and a technology related thereto.

  Conventionally, the measurement of the degree of recovery in rehabilitation has been performed by the visual observation of medical staff, and there has been considerable variation.

  In order to solve such a problem, a system capable of automatically measuring a patient's range of motion (joint range of motion inspection training system) has been proposed. (For example, refer to Patent Document 1). In such a system, the joint movable region is automatically calculated based on the photographed image photographed by the video camera. In this system, the subject image (182) is displayed on the display placed in front of the subject's eyes, and the ball (181) is displayed as a target when the subject lifts his arm.

  With such a system, it is possible to prompt the patient to lift the arm to the position of the ball (181) when performing a test to lift the arm.

JP 2002-584 A

  By the way, since there are various recovery measurement tests in rehabilitation, it is difficult for the patient to accurately grasp all the movements. Therefore, in rehabilitation, it is required to provide a user interface that makes it easier to grasp the operation associated with the recovery measurement test.

  However, the technique described in Patent Document 1 merely presents a target for lifting an arm, and a target region (such as an arm or a leg) in a specific recovery measurement test may be moved in any range. This is not to inform the patient. Thus, the technique described in Patent Document 1 cannot be said to provide a user interface that makes it easy to grasp the operation associated with the recovery measurement test.

  Accordingly, an object of the present invention is to provide a user interface that makes it easy to grasp an operation associated with a specific recovery measurement test in rehabilitation.

  In order to achieve the above object, the present invention provides an acquisition means for acquiring joint position information generated based on a photographed image of a patient and indicating each joint position of the patient, and the joint Generating means for generating a rehabilitation support image used for a specific recovery measurement test in rehabilitation based on position information, and the generating means is a virtual person image corresponding to the patient based on the joint position information Generating a guide image indicating a range in which the specific part to be moved in the specific recovery measurement test is to be moved, and generating an image including the person image and the guide image as the rehabilitation support image. A featured rehabilitation support image generation apparatus is provided.

  Moreover, it is preferable that the said person image is an image which displays the 1st part corresponding to the said specific site | part by the display format different from the display format of 2nd parts other than the said 1st part.

  In addition, it further includes a determination unit that determines whether or not the specific part has exceeded a boundary set in the specific recovery measurement test, and the generation unit determines that the specific part has exceeded the boundary by the determination unit. If determined, it is preferable to generate an image in which the display format of the first portion is changed as the person image.

  The guide image is preferably an image that displays the first area from the initial position of the specific part to the current position in a display format different from the display format of the second area other than the first area.

  Further, it is preferable that the guide image is an image that further displays an index indicating a point where the specific part has moved most greatly from the initial position in the specific recovery test.

  Further, it is preferable that the guide image moves following the movement of the person image.

  Further, the specific recovery measurement test is a test accompanied by an operation of rotating the specific part, and the guide image is formed in a semicircular shape or a fan shape centering on a fulcrum of the specific part. preferable.

  The rehabilitation support image includes a first person image and a first guide image when the patient is viewed from a first direction, and a second image when the patient is viewed from a second direction different from the first direction. The image preferably includes a person image and a second guide image.

  In addition, the present invention provides a computer with a) obtaining joint position information generated based on a photographed image of a patient and indicating each joint position of the patient; b) the joint A program for executing a step of generating a rehabilitation support image used for a specific recovery measurement test in rehabilitation based on position information, wherein step b) is based on b-1) the joint position information. Generating a virtual human image corresponding to the patient, and generating a guide image indicating a range in which the specific part to be moved in the specific recovery measurement test is to be moved; b-2) the human image And a step of generating an image including the guide image as the rehabilitation support image.

Further, the present invention is a rehabilitation support system, wherein a detection device that detects joint position information indicating each joint position of the patient based on a captured image obtained by photographing the patient, and a rehabilitation support based on the joint position information A rehabilitation support image generation device that generates an image; and a display device that displays the rehabilitation support image, wherein the rehabilitation support image generation device acquires the joint position information detected by the detection device; Generating means for generating a rehabilitation support image for use in a specific recovery measurement test in rehabilitation based on the joint position information;
And the generation means generates a virtual human image corresponding to the patient based on the joint position information, and indicates a range in which a specific region to be moved in the specific recovery measurement test is to be moved. There is also provided a rehabilitation support system that generates a guide image and generates an image including the person image and the guide image as the rehabilitation support image.

  According to the rehabilitation support image generation apparatus according to claim 1, since the guide image indicating the range to be moved of the specific part that is the target in the specific recovery measurement test is displayed, the patient operates according to the specific recovery measurement test. Can be easily grasped. In other words, in rehabilitation, it is possible to provide a user interface that makes it easy to grasp the action associated with a specific recovery measurement test.

  According to the rehabilitation support image generation device according to claim 2, since the first part corresponding to the specific part is displayed in a display format different from the display form of the second part other than the first part, the specific recovery measurement is performed. It is possible to easily recognize a specific part to be tested.

  According to the rehabilitation support image generation apparatus of the third aspect, it is possible to make the patient recognize that the specific part has exceeded the boundary set in the specific recovery test.

  According to the rehabilitation support image generation device of the fourth aspect, it is possible to make the patient recognize the current position of the specific part in the specific recovery measurement test.

  According to the rehabilitation support image generation apparatus according to the fifth aspect, in the specific recovery measurement test, it is possible to make the patient recognize the point where the specific part has moved the most.

  According to the rehabilitation support image generation device of the sixth aspect, it is possible to provide a guide image corresponding to the patient's posture.

  According to the rehabilitation support image generation device of the seventh aspect, it is possible to notify the patient that the test involves a rotation operation through a semicircular or fan-shaped guide image.

  According to the rehabilitation support image generation apparatus according to claim 8, since the rehabilitation support image includes a human image and a guide image viewed from two directions, the patient can more easily grasp the operation associated with the specific recovery measurement test. Is possible.

  According to the program of the ninth aspect, similarly to the first aspect, in rehabilitation, it is possible to provide a user interface that makes it easy to grasp an operation associated with a specific recovery measurement test.

  According to the rehabilitation support system of the tenth aspect, similarly to the first and ninth aspects, in the rehabilitation, it is possible to provide a user interface that makes it easy to grasp the operation associated with the specific recovery measurement test.

Schematic which shows the rehabilitation assistance system by embodiment of this invention. The figure which shows the structure of a rehabilitation assistance image generation apparatus. The figure which shows the screen for selection of a recovery measurement test. The figure which shows a rehabilitation assistance image. The figure which shows a person image and a guide image when a patient's posture leans. The figure which shows a rehabilitation assistance image.

<1. Embodiment>
<1-1. Configuration>
A rehabilitation support system 1 according to an embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a schematic diagram showing a rehabilitation support system 1. As shown in FIG. 1, the rehabilitation support system 1 includes a rehabilitation support image generation device 10, a joint position information detection device 30, and a display device 50.

  The rehabilitation support image generation apparatus 10 is an apparatus that generates an image (hereinafter referred to as a rehabilitation support image) used for a recovery measurement test in rehabilitation based on patient joint position information (described later).

  The joint position information detection device 30 is a device that detects information (hereinafter referred to as joint position information) indicating each joint position of the patient based on a captured image obtained by photographing the patient. In the present embodiment, it is assumed that the joint position information detection device 30 is configured as Kinect (registered trademark) of Microsoft Corporation. Kinect (registered trademark) is a so-called motion capture device and can recognize the movement of the subject.

  The display device 50 has the same configuration as a known display (liquid crystal display or the like), and can display an image (video) based on various image data.

  As shown in FIG. 1, the rehabilitation support image generation device 10 is wired to a joint position information detection device 30 and receives data (specifically, joint position information data) from the joint position information detection device 30. It is possible.

  The display device 50 is wired to the rehabilitation support image generation device 10 and can receive data (specifically, rehabilitation support image data or the like) from the rehabilitation support image generation device 10.

  FIG. 2 is a diagram illustrating a configuration of the rehabilitation support image generation apparatus 10. The rehabilitation support image generation apparatus 10 has the same configuration as a known computer, and includes a CPU 11, a RAM 12, a ROM 13, a storage unit (HDD) 14, and the like, which are connected to each other via a bus 15.

  The CPU 11 is a central processing unit, and executes various processes described later in cooperation with the RAM 12, the ROM 13, and the like. That is, the CPU 11 functions as a control unit that comprehensively controls the operation of the rehabilitation support image generation apparatus 10. Specifically, the CPU 11 implements various processing units including an acquisition unit 21, an image generation unit 22, and a determination unit 23 described later by executing a predetermined program stored in the ROM 13.

  The RAM 12 temporarily stores data when the CPU 11 performs calculations, and the ROM 13 is a read-only memory in which a program such as BIOS is stored.

  The storage unit 14 includes a hard disk (HDD) and stores various data.

<1-2. Operation>
Next, the operation of the rehabilitation support system 1 will be described with reference to FIGS.

  The operation of the rehabilitation support system 1 will be described below assuming a situation in which one of the hemiplegic function tests, “arm up with the arm forward and upward” is performed.

  First, when the rehabilitation support system 1 is activated, an image shown in FIG. 3 (hereinafter also referred to as a selection image) is displayed on the display 50. This selection image is a screen image for selecting a hemiplegia function test to be performed.

  As shown in FIG. 3, “selection name”, “icon”, “diagnosis / measurement progress” and the like corresponding to the plurality of hemiplegia function tests are displayed in the selection image.

  Here, an icon corresponding to the test name “(9) fist up with arms forward” is selected, and the image shown in FIG. 4 (hereinafter also referred to as a rehabilitation support image) is displayed on the display 50. “(9) Fist up the arm forward” is a test in which the arm is lifted upward via the front from the state where the arm is lowered directly, as shown in the picture drawn in the dialog DL of FIG. .

  As shown in FIG. 4, virtual person images HM1 and HM2 corresponding to the patient are displayed in the rehabilitation support image. The person image HM1 is configured as a mirror image when the patient is viewed from the front, and is displayed on the right side of the rehabilitation support image. The person image HM2 is configured as a real image when the patient is viewed from the right side, and is displayed on the left side of the rehabilitation support image.

  As shown in FIG. 4, the part corresponding to the specific part (here, the right arm) that is the target of the hemiplegic function test “arm up forward and upward” is the part other than the part (specifically, the left arm and both legs) Etc.) is displayed in a display color different from the display color.

  The person images HM1 and HM2 are generated by the rehabilitation support image generation apparatus 10. Specifically, the rehabilitation support image generation device 10 causes the acquisition unit 21 to function, and acquires joint position information detected by the joint position information detection device 30. Thereafter, the rehabilitation support image generation apparatus 10 causes the image generation unit 22 to function, and generates person images HM1 and HM2 based on the joint position information.

  More specifically, the rehabilitation support image generation device 10 appropriately corrects the joint position information detected by the joint position information detection device 30 (Kinect (registered trademark)) based on the actual measurement value of each part of the patient. Then, the rehabilitation support image generation device 10 generates person images HM1 and HM2 using values obtained by correcting the joint position information.

  As shown in FIG. 4, in the rehabilitation support image, guide images GM1 and GM2 are also displayed together with the above-described person images HM1 and HM2. The guide images GM1 and GM2 are images showing a range in which a specific part (in this case, the right arm) to be moved is to be moved in the hemiplegia function test “arm up forward and upward”. The guide image GM1 is displayed around the person image HM1, and the guide image GM2 is displayed around the person image HM2.

  The guide images GM1 and GM2 are also generated by the rehabilitation support image generation device 10 in the same manner as the person images HM1 and HM2. Specifically, the rehabilitation support image generation device 10 specifies the position of the patient's right arm from the joint position information, calculates the coordinate value of the range in which the right arm should be moved from the specified position, and guide images GM1, GM2. Is generated.

  Further, the guide images GM1 and GM2 move following the person images HM1 and HM2 (that is, movement of the patient). Specifically, as shown in FIG. 5, for example, when the person image HM1 tilts to the left, the guide image GM1 tilts to the left accordingly. On the other hand, although not shown, if the person image HM1 tilts to the right, the guide image GM1 tilts to the right accordingly.

  In the present embodiment, as described above, the hemiplegia function test “arm up forward and upward” is performed. In such a test, an operation of rotating a specific part (here, the right arm) about 180 degrees forward and upward is performed. Therefore, as shown in FIG. 4, the guide image GM2 has a substantially semicircular shape centered on a fulcrum (near the shoulder) of a specific part (here, the right arm).

  4 and 6, in the guide images GM1 and GM2, the area AR1 from the initial position of the specific part (right arm) to the current position is different from the display color of the area AR2 other than the area AR1. Displayed in display color.

  Further, as shown in FIG. 4, an operation dialog DL is also displayed in the rehabilitation support image. This dialog DL is provided with an “angle measurement start” button, and when the “angle measurement start” button is pressed, measurement of an operation in the hemiplegia function test “arm up forward and upward” is started. . The measurement of the operation is continuously performed for a predetermined period (for example, 1 minute).

  During the measurement of the motion, the point where the specific part (here, the right arm) has moved most greatly from the initial position is sequentially recorded. As shown in FIG. 6, in the guide images GM1 and GM2, in the hemiplegia function test “arm up forward and upward”, an index MX indicating a point where the specific portion (right arm) has moved most greatly from the initial position is Is displayed.

  In addition, during the movement measurement, the rehabilitation support image generation apparatus 10 causes the determination unit 23 to function, and the boundary BD (with the specific part (right arm) set in the hemiplegia function test “arm up forward and upward”) ( It is determined whether or not (see FIG. 6) is exceeded. Specifically, the determination unit 23 determines whether or not the coordinates of the specific part (right arm) exceed preset boundary coordinates based on joint position information detected by Kinect (registered trademark). When the coordinates of the specific part (right arm) exceed the boundary coordinates, the specific part (right arm) exceeds the boundary BD (see FIG. 6) set in the hemiplegic function test “arm up forward and upward”. It is determined that

  If the determination unit 23 determines that the specific part (right arm) has crossed the boundary, as shown in FIG. 6, an image in which the display color of the part corresponding to the specific part (right arm) is changed is a new person image HM1, HM2. And displayed on the display 50.

  When a predetermined period has elapsed and the measurement of movement in the hemiplegia function test “arm up fist upward” ends, the value of the right arm maximum angle is input to the input box in the dialog DL.

  According to the above operation, as shown in FIG. 4 and FIG. 6, a guide image GM1 indicating the range in which the specific part (here, the right arm) to be moved in the hemiplegia function test “arm up fist upward” is to be moved. , GM2 are displayed in the rehabilitation support image. Therefore, the patient can easily grasp the action (many-year-old action) associated with the hemiplegia function test “fist up the arm forward and upward”. In other words, in rehabilitation, it is possible to provide a user interface that makes it easy to grasp the action associated with the hemiplegia function test “arm up forward and upward”.

  In addition, as shown in FIG. 4, the part corresponding to the specific part (right arm) is displayed in a display color different from the display color of the part other than the part (part corresponding to the left arm, both legs, etc.). It is possible to easily recognize a specific part (right arm) that is a target in the function test.

  Further, when the specific part (right arm) crosses the boundary set by the hemiplegia function test “arm up forward and upward”, as shown in FIG. 6, the part corresponding to the specific part (right arm) is displayed. Since the color is changed, it is possible to make the patient recognize that the specific part has crossed the boundary.

  Also, as shown in FIGS. 4 and 6, the area AR1 from the initial position of the specific part (right arm) to the current position is displayed in a display color different from the area AR2 other than the area AR1, so It is possible to make the patient recognize the current position.

  Further, as shown in FIG. 5, the guide image GM1 moves following the person image HM1, so that it is possible to provide the guide image GM1 corresponding to the patient's posture.

  Also, as shown in FIGS. 4 and 6, the guide image GM2 is formed in a semicircular shape centered on the fulcrum (near the shoulder) of the specific part (right arm), and therefore is accompanied by a rotation operation through the guide image GM2. It is possible to inform the patient that it is a test.

  Also, as shown in FIGS. 4 and 6, the rehabilitation support image includes human images HM1 and HM2 and guide images GM1 and GM2 viewed from two directions, and thus includes a human image and a guide image viewed from one direction. Compared to the rehabilitation support image to be performed, it is possible to more easily grasp the action associated with the hemiplegic function test “arm up forward and upward”.

<2. Modification>
The rehabilitation support system 1 according to the present invention is not limited to the above-described embodiment, and various modifications and improvements can be made within the scope described in the claims.

  In the above embodiment, the case where the part corresponding to the specific part (right arm) is displayed in a display color different from the display color of the part other than the part (part corresponding to the left arm, both legs, etc.) is exemplified. It is not limited. For example, only the part corresponding to the specific part (right arm) may be hatched and displayed. That is, as long as the part corresponding to the specific part can be distinguished from the part other than the part, the part may be displayed in various display formats.

  Moreover, in the said embodiment, as shown in FIG.4 and FIG.6, although the case where the person image HM1 at the time of seeing from the front was represented with the virtual image corresponding to a patient was illustrated, it is not limited to this. For example, the patient's real image may be displayed in a superimposed manner on the human image HM1 when viewed from the front.

  In the above embodiment, as shown in FIGS. 4 and 6, the hemiplegic function test “arm up forward and upward” involves an operation of rotating a specific part by about 180 degrees. Although the case where it comprised by the substantially semicircle shape was illustrated, it is not limited to this. For example, in a test in which a specific part is rotated by about 90 degrees, the guide image GM may be configured in a substantially fan shape with the fulcrum of the specific part as the center.

  Moreover, although the case where the rehabilitation support image generation device 10 and the display device 50 are configured as different devices is illustrated in the above embodiment, the present invention is not limited to this, and an integrated device (for example, a notebook personal computer) ).

  As described above, the rehabilitation support image generation apparatus according to the present invention is suitable for supporting a specific recovery measurement test in rehabilitation.

10 rehabilitation support image generation device, 14 storage unit, 21 acquisition unit, 22 image generation unit,
23 determination unit, 30 joint position information detection device, 50 display device, DL dialog,
GM1, GM2 guide image, HM1, HM2 person image, MX index

Claims (10)

A rehabilitation support image generation device,
Acquisition means for acquiring joint position information indicating each joint position of the patient, which is joint position information generated based on a photographed image of the patient;
Generating means for generating a rehabilitation support image for use in a specific recovery measurement test in rehabilitation based on the joint position information;
With
The generating means includes
Based on the joint position information, a virtual person image corresponding to the patient is generated, and a guide image indicating a range in which the specific part to be moved in the specific recovery measurement test is to be moved is generated.
A rehabilitation support image generation apparatus that generates an image including the person image and the guide image as the rehabilitation support image. The rehabilitation support image generation device according to claim 1,
The rehabilitation support image generation apparatus, wherein the person image is an image that displays a first portion corresponding to the specific part in a display format different from a display format of a second portion other than the first portion. The rehabilitation support image generation device according to claim 2,
A determination means for determining whether or not the specific part exceeds a boundary set in the specific recovery measurement test;
The generation unit generates a rehabilitation support image generation by generating, as the person image, an image in which the display format of the first part is changed when the determination unit determines that the specific part has exceeded the boundary. apparatus. In the rehabilitation assistance image generation device according to any one of claims 1 to 3,
The rehabilitation support characterized in that the guide image is an image that displays the first area from the initial position of the specific part to the current position in a display format different from the display format of the second area other than the first area. Image generation device. The rehabilitation support image generation device according to claim 4,
The rehabilitation support image generation apparatus according to claim 1, wherein the guide image is an image further displaying an index indicating a point where the specific portion has moved most greatly from the initial position in the specific recovery test. In the rehabilitation support image generation device according to any one of claims 1 to 5,
The rehabilitation support image generation apparatus, wherein the guide image moves following the movement of the person image. The rehabilitation support image generation apparatus according to any one of claims 1 to 6,
The specific recovery measurement test is a test involving an operation of rotating the specific part,
The rehabilitation support image generation apparatus, wherein the guide image is formed in a semicircular shape or a fan shape centering on a fulcrum of the specific part. In the rehabilitation support image generation device according to any one of claims 1 to 7,
The rehabilitation support image includes a first person image and a first guide image when the patient is viewed from a first direction, and a second person image when the patient is viewed from a second direction different from the first direction. And a second guide image. A rehabilitation support image generation apparatus characterized in that the image includes a second guide image. On the computer,
a) acquiring joint position information indicating joint position information of the patient, which is joint position information generated based on a photographed image of the patient;
b) generating a rehabilitation support image used for a specific recovery measurement test in rehabilitation based on the joint position information;
A program for executing
Said step b)
b-1) Based on the joint position information, a virtual person image corresponding to the patient is generated, and a guide image indicating a range in which a specific part to be moved in the specific recovery measurement test is to be moved is generated. Steps,
b-2) generating an image including the person image and the guide image as the rehabilitation support image;
A program comprising A rehabilitation support system,
A detection device that detects joint position information indicating each joint position of the patient based on a captured image of the patient;
A rehabilitation support image generation device that generates a rehabilitation support image based on the joint position information;
A display device for displaying the rehabilitation support image;
With
The rehabilitation support image generation device includes:
Obtaining means for obtaining the joint position information detected by the detection device;
Generating means for generating a rehabilitation support image for use in a specific recovery measurement test in rehabilitation based on the joint position information;
Have
The generating means includes
Based on the joint position information, a virtual person image corresponding to the patient is generated, and a guide image indicating a range in which the specific part to be moved in the specific recovery measurement test is to be moved is generated.
A rehabilitation support system that generates an image including the person image and the guide image as the rehabilitation support image.