JPWO2012039467A1 - Exercise support system - Google Patents

Abstract

The exercise support system is stored in a display device having a display surface for displaying an image to a user, a comparison image storage unit that stores a comparison image that is an image of an exerciser performing a predetermined exercise, and the comparison image storage unit. A comparison image display unit for displaying the comparison image on the display surface, a mirror image display means for displaying a mirror image of the user on the comparison image, and detecting a position of a predetermined sample point on the body of the user. A feature amount extraction unit for obtaining a feature amount representing the posture of the user based on the position of the sample point, and comparing the feature amount obtained by the feature amount extraction unit with a reference amount representing the posture of the exerciser And a posture evaluation unit that evaluates a deviation of the posture of the user from the posture of the exerciser, and a presentation unit that presents a result of the evaluation by the posture evaluation unit.

Description

  The present invention relates to an exercise support system that supports user exercise.

  For example, in the field of rehabilitation, it is a common practice to restore the function of the limbs by causing a patient whose limbs remain damaged due to illness or injury to perform predetermined exercises. However, the patient may not be able to obtain a sufficient rehabilitation effect because the patient does not know how to move the body unless the sample posture is shown, and cannot perform appropriate exercise.

  Therefore, when a patient exercises alone, it is also common that a video showing a sample posture recorded on a DVD or video tape is displayed on a monitor, and the patient moves his body according to the video. (For example, refer to Document 1 [Japanese Published Patent Publication No. 9-56697]).

  Further, even when a healthy person exercises, for example, yoga or dance, a video showing a sample posture is projected on a monitor and the body is moved in accordance with the video.

  However, as described above, just by displaying a sample image on the monitor, it is impossible to determine whether the patient is moving the body correctly, and the posture of the patient and the posture in the image displayed on the monitor are not. I can't recognize how much the difference is. Therefore, even if the patient takes a posture that deviates significantly from the displayed image, he / she does not notice this, so he continues to exercise without improving his / her posture during exercise. The effect of may not be sufficiently obtained.

  The present invention has been made in view of the above reasons, and allows the user to visually recognize his / her posture and how much the difference between his / her posture and the posture in the displayed image is. It is an object to provide an exercise support system that can be used.

  A first form of the exercise support system of the present invention includes a display device having a display surface for displaying an image to a user, a comparison image storage unit that stores a comparison image that is an image of an exerciser performing a predetermined exercise, A comparison image display unit that displays the comparison image stored in the comparison image storage unit on the display surface, a mirror image display unit that displays a mirror image of the user over the comparison image, and a body image of the user A feature amount extraction unit that detects a position of a predetermined sample point and obtains a feature amount representing the posture of the user based on the position of the sample point; and the feature amount obtained by the feature amount extraction unit A posture evaluation unit that evaluates a deviation of the posture of the user from the posture of the exerciser, and a presentation unit that presents a result of the evaluation by the posture evaluation unit, Is provided.

  According to a second aspect of the exercise support system of the present invention, in the first aspect, the mirror image display means is a half mirror disposed on the front surface of the display device.

  According to a third aspect of the exercise support system of the present invention, in the first aspect, the mirror image display means is generated by an imaging device that shoots the user and generates an image of the user, and the imaging device. A reversal processing unit that generates a horizontally reversed image by horizontally reversing the user image, and a reversed image display unit that displays the horizontally reversed image generated by the reversal processing unit on the display surface.

In a fourth aspect of the exercise support system of the present invention, in any one of the first to third aspects, the predetermined exercise is an exercise that serves as an example of an exercise performed by the user.
According to a fifth aspect of the exercise support system of the present invention, in any one of the first to third aspects, the user who performs the predetermined exercise is further photographed to perform the predetermined exercise. An imaging apparatus that generates a recorded image that is a user image and a reference amount extraction unit are provided. The comparative image display unit is configured to display the recorded image generated by the imaging device on the display surface as the comparative image. The reference amount extraction unit detects a position of the predetermined sample point on the user's body from the recorded image, and obtains a feature amount representing the posture of the user as the reference amount based on the position of the sample point. Configured as follows.

  According to a sixth aspect of the exercise support system of the present invention, in any one of the first to fifth aspects, the feature amount extraction unit detects the positions of the plurality of sample points in the user's body. A body model indicating the user's body is created based on the positions of the plurality of sample points, and the feature amount is obtained based on the body model.

  According to a seventh aspect of the exercise support system of the present invention, in the sixth aspect, the feature amount is a line connecting two sample points selected from the plurality of sample points and a predetermined reference line. Is the angle between.

  In an eighth aspect of the exercise support system of the present invention, in any one of the first to fifth aspects, the feature amount is an inclination of the user's body.

  According to a ninth form of the exercise support system of the present invention, in the eighth form, the inclination of the user's body is the inclination of the user's shoulder, and the feature amount extraction unit is connected to the right side of the user. An upper limb sample point and a left upper limb sample point are detected, and an angle between a straight line connecting the sample point of the upper right limb and the sample point of the left upper limb and a horizontal line is determined as the inclination of the shoulder of the user It is comprised so that it may calculate as.

  According to a tenth aspect of the exercise support system of the present invention, in the eighth aspect, the inclination of the user's body is an inclination of the trunk of the user, and the feature amount extraction unit Detecting the sample point of the head and the sample point of the waist, and the angle between a straight line connecting the sample point of the head and the sample point of the waist and a vertical line is determined on the trunk of the user It is comprised so that it may calculate as inclination.

  In an eleventh aspect of the exercise support system of the present invention, in any one of the first to fifth aspects, the feature amount is a movable range of a specific part of the user's body.

  According to a twelfth aspect of the exercise support system of the present invention, in the eleventh aspect, the specific part is the upper limb of the user, and the feature amount extraction unit includes the sample point of the upper limb of the user and the Detecting a shoulder sample point corresponding to the upper limb, and calculating an angle between a straight line connecting the sample point of the upper limb and the sample point of the shoulder and a vertical line as a movable range of the upper limb Is done.

  In a thirteenth aspect of the exercise support system of the present invention, in the sixth aspect, the number of the sample points is at least three, and the feature amount is an area defined by the plurality of the sample points. It is an area.

  In a fourteenth aspect of the exercise support system of the present invention, in any one of the first to thirteenth aspects, the comparison image display unit is configured so that the comparison image overlaps a mirror image of the user. The position and size of the comparison image on the display surface are adjusted.

  According to a fifteenth aspect of the exercise support system of the present invention, in the first aspect, the posture evaluation unit is configured to obtain a numerical value indicating a difference between the feature amount and the reference amount. The presenting unit is configured to present the numerical value obtained by the posture evaluating unit.

  According to a sixteenth aspect of the exercise support system of the present invention, in the first aspect, a position detection unit that detects a position of a specific part of the user's body and the position detected by the position detection unit. An index setting unit that determines a position of the index on the display surface; a determination unit that determines whether the index is located at a predetermined position on the display surface; and the determination unit is positioned at the predetermined position. If it is determined that the event has occurred, an event image display unit that displays a predetermined event image at the predetermined position, and evaluation data indicating a movable range of the specific part are created based on the position detected by the position detection unit And a movable range evaluating unit that evaluates the movable range of the specific part based on a comparison between the evaluation data created by the evaluation data creating unit and reference data. The presenting unit is configured to present a result of the evaluation by the range of motion evaluation unit.

  According to a seventeenth aspect of the exercise support system of the present invention, in the sixteenth aspect, the range of motion evaluation unit employs the evaluation data used for the previous evaluation of the range of motion of the specific part as the reference data. Configured to do.

  In an eighteenth aspect of the exercise support system of the present invention according to the sixteenth aspect, the reference data is data indicating a range of motion of the standard specific part of a healthy person.

  According to a nineteenth aspect of the exercise support system of the present invention, in any one of the sixteenth to eighteenth aspects, the evaluation data is a region in which the specific part has passed in a plane parallel to the display surface. Includes data showing area.

  According to a twentieth aspect of the exercise support system of the present invention, in any one of the sixteenth to nineteenth aspects, the evaluation data includes data indicating a movable range of the specific part in a predetermined direction.

  According to a twenty-first aspect of the exercise support system of the present invention, in any one of the sixteenth to twentieth aspects, the evaluation data is required for the user to perform a predetermined operation at the specific part. Contains data indicating time.

  According to a twenty-second aspect of the exercise support system of the present invention, in any one of the sixteenth to twenty-first aspects, the position detection unit detects the position of the specific part from the output of the three-dimensional sensor. The evaluation data includes data indicating a volume of a region through which the specific part has passed.

  According to a twenty-third aspect of the exercise support system of the present invention, in any one of the sixteenth to twenty-second aspects, the evaluation data includes data indicating a locus of the specific part.

  According to a twenty-fourth aspect of the exercise support system of the present invention, in any one of the sixteenth to twenty-third aspects, the mirror image display means is a half mirror disposed on the front surface of the display device, The index setting unit is configured to determine the position of the index so that the position of the index corresponds to the position of the display surface that overlaps the specific part reflected on the half mirror.

  According to a twenty-fifth aspect of the exercise support system of the present invention, in any one of the sixteenth to twenty-third aspects, the mirror image display means captures the user and generates an image of the user. An image processing apparatus, an inversion processing unit that inverts the user's image generated by the imaging device to generate a horizontally inverted image, and the horizontally inverted image generated by the inversion processing unit is displayed on the display surface. A reverse image display unit. The index setting unit is configured to determine the position of the index so that the position of the index corresponds to the position of the specific part in the horizontally reversed image.

  According to a twenty-sixth aspect of the exercise support system of the present invention, in the first aspect, there is provided a measuring device having a working surface that receives a load from the user and measuring the distribution of the load on the working surface, and the measuring device. A calculation unit that calculates a balance value representing a ratio of a load at a predetermined location in the working surface based on the measured distribution of the load; and a balance value storage unit that stores the balance value calculated by the calculation unit; A balance value display unit that displays the balance value calculated by the calculation unit on the display surface, a setting data storage unit that stores setting data indicating a temporal change in the target value of the balance value, and the setting data A target value display unit for displaying the target value on the display surface based on the setting data stored in the storage unit, and the balance from the balance value stored in the balance value storage unit A center-of-gravity movement evaluation unit that obtains a temporal change of the value and evaluates the center-of-gravity movement of the user based on the temporal change of the balance value and the temporal change of the target value indicated by the setting data. . The presenting unit is configured to present the result of the evaluation by the gravity center movement evaluating unit.

  According to a twenty-seventh aspect of the exercise support system of the present invention, in the twenty-sixth aspect, the gravity center movement evaluation unit evaluates the gravity center movement using a difference between the balance value and the target value at a predetermined time point. Configured as follows.

  According to a twenty-eighth aspect of the exercise support system of the present invention, in the twenty-sixth or twenty-seventh aspect, the setting data stored in the setting data storage unit according to a result of the evaluation by the gravity center movement evaluation unit indicates A setting update unit for changing the temporal change of the target value is provided.

  According to a twenty-ninth aspect of the exercise support system of the present invention, in any one of the twenty-sixth to twenty-eighth aspects, the mirror image display means is a half mirror disposed in front of the display surface.

1 is a schematic diagram illustrating a system configuration of an exercise support system according to a first embodiment. It is explanatory drawing of operation | movement of the exercise | movement assistance system of the said Embodiment 1. FIG. It is explanatory drawing which shows the production | generation method of the body model used with the exercise | movement assistance system of the said Embodiment 1. FIG. It is explanatory drawing which shows the production | generation method of the body model used with the exercise | movement assistance system of the said Embodiment 1. FIG. It is explanatory drawing which shows the shift | offset | difference of the attitude | position of the body model used with the exercise | movement assistance system of the said Embodiment 1. FIG. It is explanatory drawing which shows the shift | offset | difference of the attitude | position of the body model used with the exercise | movement assistance system of the said Embodiment 1. FIG. It is explanatory drawing of the calculation method of the inclination of the shoulder in the exercise | movement assistance system of the said Embodiment 1. FIG. It is explanatory drawing of the calculation method of the inclination of the trunk in the exercise assistance system of the said Embodiment 1. FIG. It is explanatory drawing of the calculation method of the range of motion of the upper limb in the exercise assistance system of the said Embodiment 1. FIG. It is the schematic which shows the system configuration | structure of the exercise assistance system of Embodiment 2. It is the schematic which shows the system configuration | structure of the exercise assistance system of Embodiment 3. It is a block diagram of the image | video production | generation part of the exercise assistance system of the said Embodiment 3. It is explanatory drawing which shows the example of a display of the display apparatus of the exercise assistance system of the said Embodiment 3. It is explanatory drawing which shows the example of a display of the display apparatus of the exercise assistance system of the said Embodiment 3. It is explanatory drawing which shows the example of a display of the display apparatus of the exercise assistance system of the said Embodiment 3. It is a block diagram of the control apparatus of the exercise assistance system of Embodiment 4. It is the schematic which shows the system configuration | structure of the exercise assistance system of Embodiment 5. It is a block diagram of the control apparatus of the exercise assistance system of the said Embodiment 5. FIG. It is explanatory drawing which shows the example of a display of the display apparatus in the exercise assistance system of the said Embodiment 5. It is a block diagram of the control apparatus of the exercise assistance system of Embodiment 6.

(Embodiment 1)
The exercise support system 1 of the present embodiment is used for rehabilitation aimed at restoring the function of the limbs by causing a patient whose limbs remain damaged due to illness or injury to perform predetermined exercises. However, the description of the following embodiment is not intended to limit the use of the exercise support system, and for example, a healthy person may use the exercise support system for exercise such as yoga or dance. In the following, an example in which the exercise support system is used in a posture in which the user stands is shown, but the present invention is not limited to this, and the user may use the exercise support system in a posture sitting on a chair or the like.

  As shown in FIG. 1, the exercise support system 1 according to the present embodiment generates a distance image and a display device 3 that displays an image on a display surface 30 that is arranged in front of a user (patient) 2 and faces the user 2. A distance image sensor 4 and a control device 5 for controlling the operation of the display device 3 and the like are provided. Both the display device 3 and the distance image sensor 4 are connected to the control device 5.

  The exercise support system 1 further includes a half mirror 6 disposed in front of the display surface 30 of the display device 3 (on the user 2 side). The half mirror 6 is vertically arranged between the display device 3 and the user 2 so that the front surface (mirror surface) of the half mirror faces the user 2, and the image displayed on the display device 3 behind is displayed. Permeate to the user 2 side.

  The display device 3 has a display surface 30 that displays an image to the user 2. The display device 3 is a plasma display here, and is attached to the back side of the half mirror 6. In FIG. 1, the structure for supporting the half mirror 6 and the mounting structure for the display device 3 are not shown. However, the half mirror 6 and the display device 3 are positioned in a fixed position with sufficient strength. Fixed. The display device 3 is not limited to a plasma display, and may be another display device such as a liquid crystal display. Further, instead of the display device, a diffusion sheet (not shown) attached to the back surface of the half mirror 6 and a projection device that projects an image on the diffusion sheet from the back of the half mirror 6 (the side opposite to the user 2). It is also conceivable to use a display device (not shown).

  In the present embodiment, the half mirror 6 has a vertically long rectangular front surface and is formed in a size that functions as an appearance of the user 2. The transmittance of the half mirror 6 is designed so that the half mirror 6 can be used as a mirror and the user 2 can visually recognize the image displayed on the display device 3 through the half mirror 6. The half mirror 6 is formed by applying a mirror surface coating with a metal film or the like on at least one surface of a transparent base material made of glass or synthetic resin.

  Here, the display device 3 is arranged so that the display surface 30 is in contact with the back surface of the half mirror 6. The height position of the display device 3 is determined such that the lower end edge is located at a predetermined interval from the lower end of the half mirror 6 and the upper end edge is located at a predetermined interval from the upper end of the half mirror 6. Yes. Here, the display device 3 is disposed slightly above the center of the half mirror 6. A transparent material that adjusts the refractive index and prevents reflection is provided between the half mirror 6 and the display surface 30 so that the image displayed on the display device 3 can be displayed on the front surface of the half mirror 6 with high luminance. It may be filled.

  According to the above configuration, the front surface of the half mirror 6 functions to project a mirror image of the user 2 as a mirror and to display an image displayed on the display surface 30 of the display device 3. That is, if the user 2 is in front of the half mirror 6, a mirror image of the user 2 is reflected on the front surface of the half mirror 6, and an image displayed on the display device 3 passes through the half mirror 6 and passes through the half mirror 6. It will be projected on the front. As will be described in detail later, the video displayed on the display device 3 is generated by the control device 5.

  The distance image sensor 4 generates a distance image whose pixel value is a distance value based on the principle of time-of-flight method using intensity-modulated light. However, the distance image sensor 4 may be configured to generate a distance image, and is not limited to the distance image sensor using the time-of-flight method. The distance image sensor 4 detects the distance to the detection target existing in the sensing area, and detects the position of the detection target in the three-dimensional space as a distance image.

  Here, the distance image sensor 4 is disposed above the display device 3 so as not to overlap the display device 3, and generates a distance image of the user 2 who is in front of the half mirror 6. The distance image sensor 4 is positioned at the approximate center in the left-right direction above the display device 3, and the vertical direction (tilt angle) is determined so that the user 2 is looked down from diagonally upward and forward.

  Further, the distance image sensor 4 includes the whole body of the user 2 in the field of view, and the center line in the left-right direction of the body of the user 2 in a state where the user 2 is upright is the center line in the left-right direction of the distance image. The horizontal direction (pan angle) is adjusted to match

  The distance image sensor 4 is not limited to the above-described arrangement, and may be installed at the level of the eyes of the user 2 on the front side (user 2 side) of the half mirror 6 using, for example, a camera stand or the like. .

  The adjustment of the position and orientation of the distance image sensor 4 as described above is performed as an initial setting after the position and orientation of the user 2 are determined. As a result, the distance image sensor 4 generates a moving image of the distance image that reflects the whole body of the user 2.

  By the way, the exercise support system 1 according to the present embodiment compares the comparison target image that performs the same exercise as the exercise to be performed by the user 2 as a comparison image and the display device 3 when the user 2 exercises. The control device 5 includes a display control unit 52 that displays video. In other words, the exercise support system 1 of the present embodiment includes a comparison image storage unit (storage unit) 51 that stores a comparison image (comparison video) that is an image of an exerciser performing a predetermined exercise, and a comparison image storage unit 51. A comparison image display unit (display control unit) 52 that displays the comparison image stored in the display screen 30.

  In the present embodiment, a comparison target image indicating an example of exercise to be performed by the user 2 is used as a comparison image. That is, the predetermined exercise is an exercise that serves as an example of the exercise performed by the user 2. Specifically, an instructor as a comparison target actually performs the exercise to be performed by the user 2 is imaged from the front of the instructor so that the entire body of the instructor can enter with an imaging device (not shown). The moving image obtained by this is used as a comparative video. The comparison video obtained in this way is stored in advance in the storage unit 51. In the present embodiment, the comparison image may be a still image. In this case, the comparison image shows the posture of the exerciser that the user 2 should use as a model. That is, the comparison image may be a still image of an exerciser who performs a predetermined exercise, or a moving image of an exerciser who performs a predetermined exercise.

  The display control unit 52 adjusts the size of the comparison image on the display surface 30 so that the mirror image reflected on the half mirror 6 when viewed from the user 2 overlaps the comparison target in the comparison image (see FIG. (Not shown) and a position adjusting unit (not shown) for adjusting the position. That is, the display control unit (comparison image display unit) 52 is configured to adjust the position and size of the comparison image on the display surface 30 so that the comparison image overlaps the mirror image of the user 2.

  Here, since the mirror image of the self reflected in the half mirror 6 seen from the viewpoint of the user 2 is half the size of the real one, the size adjusting unit sets the comparison target of the comparison video to one half of the real size. The display size is adjusted so that the size is displayed on the display surface 30 of the display device 3. In addition, when there is a difference in the physique (mainly height) between the comparison target (instructor) and the user 2, the size adjustment unit adjusts the comparison video so that the size of the comparison target matches the mirror image of the user 2. The display size is adjusted. However, even if the comparison target of the comparison video is not a half of the actual size, for example, it is displayed in a larger size or a smaller size, there is no problem in terms of showing a sample of the body movement to the user 2. .

  The position adjustment unit has an alignment function that can freely adjust the display position of the comparison video on the display surface 30, and the mirror image of itself and the image of the comparison target (instructor) are seen from the viewpoint of the user 2. The display position of the comparison video is adjusted so that the comparison video is displayed at the overlapping position. Specifically, the position of the comparison video on the display surface 30 is adjusted according to the positional relationship between the half mirror 6 and the user 2. The positional relationship between the half mirror 6 and the user 2 may be determined in advance so that the user 2 stands at the front center of the half mirror 6. Alternatively, a pressure sensor (not shown) that detects the position of the center of gravity of the user 2 may be added, and the positional relationship between the half mirror 6 and the user 2 may be obtained from the detection result of the pressure sensor.

  Next, a method for simply adjusting the display position of the comparison video will be described. The control device 5 includes a height registration unit (not shown) in which a uniform value (for example, 170 cm) is registered in advance as the height of the user 2. The height registered in the height registration unit may be directly input by the user 2.

  If the positional relationship between the half mirror 6 and the user 2 is specified, the display control unit 52 displays the comparison video at a position based on the height of the user 2 so that it can be viewed from the viewpoint of the user 2. It is possible to display the comparison object at a position overlapping with its own mirror image.

  Still another method will be described. Even if the height of the user 2 is not registered in the height registration unit, the half mirror 6 can be obtained from the position and orientation of the distance image sensor 4 and the standing position and the top position of the user 2 detected from the distance image. The position of a specific part (for example, the head) of the mirror image shown in FIG. Therefore, the display control unit 52 can display the comparison target at a position overlapping the mirror image of the user 2 from the viewpoint of the user 2.

  Note that the adjustment of the display size and display position of the comparison video may be performed manually at the time of initial setting or may be automated.

  As a result, a mirror image 20 of the user 2 is shown on the front surface of the half mirror 6 as shown in FIG. 2, and a video (comparison video) of a comparison target (instructor) 31 showing a sample posture is shown in the half mirror 6. Will be projected through. That is, the half mirror 6 disposed in front of the display device 3 functions as a mirror image display unit that displays a mirror image of the user 2 on the comparison image. Therefore, the user 2 can exercise while comparing his / her mirror image 20 reflected on the half mirror 6 with the comparison target 31 in the comparison video displayed on the display surface 30. In FIG. 2, the mirror image 20 of the user 2 is indicated by a broken line, and the comparison target 31 in the comparison video displayed on the display surface 30 is indicated by a solid line.

  In addition, since the comparison video is displayed so that the mirror image 20 of the user 2 and the comparison target 31 in the comparison video overlap, the user 2 can easily grasp how to move the body from the comparison video. There is also an advantage. That is, when the user 2 sees the mirror image 20 of the user, the image of the comparison target 31 falls within the field of view of the user 2, so that the user 2 is in the comparison image with the mirror image 20 of the user 2 even if the user hardly moves the line of sight. The comparison object 31 can be compared. Further, since the right half of the comparison target 31 is displayed on the right half of the user 2 and the left half of the comparison target 31 is displayed on the mirror image of the left half of the user 2, the user 2 performs the operation of the comparison target 31. It is easy to distinguish between right and left, and it is easy to grasp how to move the body.

  Here, the user 2 displays the mirror image 20 reflected on the half mirror 6 and the display device 3 by switching the focal length of the eye (focal length of the comparison image: focal length of the mirror image = 1: 2). You can pay attention to either the comparison video. Therefore, the user 2 can exercise his / her posture to match the posture of the comparison target 31 while distinguishing the mirror image 20 of the user 2 from the comparison target 31 in the comparison video.

  It should be noted that when using the exercise support system 1, the display device 3 of the display device 3 is viewed so as not to cause a large difference in the appearance of the mirror image 20 reflected on the half mirror 6 and the comparison image displayed on the display device 3 when viewed from the user 2. It is desirable that brightness and indoor brightness are adjusted appropriately.

  In addition, a moving image obtained by capturing the comparison target (instructor) from a direction other than the front (for example, from the side) is further stored as a reference image in the storage unit 51, and the display control unit 52 displays the reference image together with the comparison image on the display device 3. It may be configured to be displayed. In this case, for example, it is desirable that the reference video is displayed on the side of the comparative video on the display surface 30 so as not to overlap the comparative video. Since the reference video is displayed on the display device 3, the user 2 can refer to the reference video to understand the body movement in the front-rear direction, for example, so that the user 2 matches the comparison target 31 in the comparison video. Makes it easier to move the body.

  Note that the display control unit 52 is not limited to the configuration in which the comparison target 31 in the comparison video is displayed at a position overlapping the mirror image 20 of the user 2, but on the display surface 30 sideward or above or below the mirror image 20 of the user 2. The comparison target 31 may be displayed at a position where Even when the comparison target 31 is displayed at a position overlapping the mirror image 20 of the user 2, the mirror image 20 of the user 2 and the comparison target 31 in the comparison video do not need to be completely overlapped. It suffices if the parts to be overlapped.

  By the way, in the exercise support system 1 of the present embodiment, the distance image of the user 2 generated by the distance image sensor 4 is output to the control device 5 and used for processing for recognizing the posture of the user 2. More specifically, the control device 5 includes a computer, and acquires an acquisition unit 53 that acquires a distance image from the distance image sensor 4 and extracts a first feature amount that represents the posture of the user 2 using the acquired distance image. A first extraction unit (feature amount extraction unit) 54. Further, the control device 5 evaluates a posture deviation between the user 2 and the comparison target 31, and a second extraction unit (reference amount extraction unit) 55 that extracts a second feature amount representing the posture of the comparison target 31. An evaluation unit (posture evaluation unit) 56 and a presentation unit 57 that presents the evaluation result of the evaluation unit 56 are provided.

  The first extraction unit 54 detects the position of the specific point of the user 2 in the distance image by the image recognition technique, and extracts a first feature amount representing the posture of the user 2 based on the position of the specific point. To do. That is, the first extraction unit (feature amount extraction unit) 54 detects the position of a predetermined sample point (specific point) 22 on the body of the user 2 and determines the posture of the user 2 based on the position of the sample point 22. A feature amount (first feature amount) to be expressed is configured to be obtained. Here, a case where a plurality of points respectively set at positions such as the center line of the trunk of the user 2, the top of the head, the shoulder, the elbow, the hand, the waist, the knee, and the ankle are used as specific points. Although illustrated, it is not restricted to this example, The specific point should just be set to specific positions, such as the user's 2 fingertip in a distance image. The first extraction unit 54 extracts a first feature amount representing the posture of the user 2 based on the position of the specific point detected in this way.

  The second extraction unit 55 detects the position of the specific point of the comparison target 31, and extracts a second feature amount representing the posture of the comparison target 31 based on the position of the specific point. That is, the second extraction unit (reference amount extraction unit) 55 detects the position of a predetermined sample point (specific point) 33 on the body of the comparison target (exercise person) 31, and moves the athlete based on the position of the sample point 33. A reference amount (second feature amount) representing 31 postures is obtained. The position of the specific point of the comparison target 31 is detected from the distance image obtained by the distance image sensor 4 when the comparison video is captured.

  The evaluation unit 56 evaluates the posture deviation between the user 2 and the comparison target 31 by comparing the first feature value and the second feature value. That is, the evaluation unit (posture evaluation unit) 56 uses the feature amount (first feature amount) obtained by the first extraction unit (feature amount extraction unit) 54 as a reference amount (the comparison target) representing the posture of the athlete (comparison target). Compared to the second feature amount), the user 2 is configured to evaluate the deviation of the posture of the user from the posture of the exerciser.

  The presenting unit 57 presents to the user 2 the posture deviation between the user 2 and the comparison target 31 evaluated by the evaluation unit 56. That is, the presentation unit 57 is configured to present the result of evaluation by the evaluation unit (posture evaluation unit) 56. Specifically, the presentation unit 57 presents the evaluation result of the evaluation unit 56 to the user 2 by voice or light. Alternatively, the evaluation result of the evaluation unit 56 may be displayed on the display device 3 according to an instruction from the display control unit 52, and the display device 3 may also be used as the presentation unit 57.

  Below, operation | movement of the 1st extraction part 54, the 2nd extraction part 55, the evaluation part 56, and the presentation part 57 is demonstrated in detail.

  In the present embodiment, the first extraction unit 54 detects the positions of a plurality of specific points 22 from the entire body of the user 2 as shown in FIGS. A body model (hereinafter referred to as “first body model”) 21 representing the posture of the user 2 in the space is generated. That is, in the 1st extraction part 54, the 1st body model 21 as shown in FIG. 4 is produced | generated from the distance image of the user 2 of a posture as shown in FIG. That is, the first extraction unit (feature amount extraction unit) 54 detects the positions of the plurality of sample points 22 in the body of the user 2 and shows the body model of the user 2 based on the positions of the plurality of sample points. A (first body model) 21 is created, and a feature amount (first feature amount) is obtained based on the body model 21. In the present embodiment, the plurality of sample points 22 on the body of the user 2 are the sample point 22 (22a) on the head of the user 2, the sample point 22 (22b) on the right shoulder of the user 2, and the user. 2 left shoulder sample point 22 (22c), user 2 right elbow sample point 22 (22d), user 2 left elbow sample point 22 (22e), and user 2 right hand sample point 22 (22f), sample point 22 (22g) of user 2's left hand, sample point 22 (22h) of user 2's waist, sample point 22 (22i) of user 2's right knee, and use It includes the sample point 22 (22j) of the left knee of the user 2, the sample point 22 (22k) of the right foot of the user 2, and the sample point 22 (221) of the left foot of the user 2. The 1st extraction part 54 produces | generates the 1st body model 21 based on 12 sample points 22a-22l (refer FIG. 4).

  Since the distance image of the user 2 generated by the distance image sensor 4 is a moving image that changes as the user 2 moves, the first body model 21 generated from each frame of the distance image is The movement of the user 2 is represented in real time.

  The distance image sensor 4 is installed above the user 2 as shown in FIG. Therefore, the image (distance image) of the user 2 obtained from the distance image sensor 4 is an image obtained by photographing the user 2 from obliquely upward. That is, the distance image is an image distorted by the user 2. For this reason, an error may occur in the feature amount due to the depression angle of the camera of the distance image sensor 4. Therefore, the first extraction unit 54 corrects the distance image obtained from the distance image sensor 4 as a distance image obtained by photographing the user 2 from the front as preprocessing for detecting the sample point (specific point) 22. It is comprised so that the correction process to perform may be performed. Such correction processing can be performed by converting the coordinates of the image using a matrix obtained in advance. After performing the correction process, the first extraction unit 54 detects the position of the sample point 22 from the distance image. When the error due to the depression angle is small, the correction process may be omitted. The distance image sensor 4 may be installed below the eye level of the user 2. For example, the distance image sensor 4 may be installed at the center of the lower end of the front surface of the half mirror 6. Also in this case, the first extraction unit 54 is configured to perform a correction process for correcting the distance image obtained from the distance image sensor 4 into a distance image obtained by photographing the user 2 from the front. Further, the distance image sensor 4 may be installed on the right side or the left side of the user 2, and in this case, the correction process similar to the above is performed to capture the user 2 from the front. Similar distance images are obtained.

  Further, when the first extraction unit 54 generates the first body model 21, the position of the specific point 22 detected from the distance image is in an imaging coordinate system defined for the distance image obtained by the distance image sensor 4. Coordinate conversion is performed from the coordinate position to the coordinate position of the display coordinate system defined in the virtual space. The virtual space here corresponds to a rectangular parallelepiped space including the standing position of the user 2 in front of the display device 3, and is a three-dimensional coordinate having the front-rear direction, the left-right direction, and the up-down direction of the user 2 as coordinate axes. It is a space of Cartesian coordinate system. That is, the first extraction unit 54 converts the position of the specific point 22 from the polar coordinate system on which the distance image sensor 4 is a reference to the three-dimensional orthogonal coordinate system defined in the virtual space, using a predetermined conversion formula. After that, the first body model 21 is generated.

  On the other hand, the second extraction unit 55 generates a body model (hereinafter referred to as “second body model”) 32 (see FIG. 6) representing the posture of the comparison target 31 in the comparison video. That is, the second extraction unit (reference amount extraction unit) 55 detects the positions of the plurality of sample points 33 in the body of the comparison target (exercise person) 31, and based on the positions of the plurality of sample points, the body of the comparison target 31 Is created, and a reference quantity (second feature quantity) is obtained based on the body model 32. In the present embodiment, the plurality of sample points 33 in the body of the comparison target (exercise person) 31 are the sample point 33 (33a) of the head of the comparison target 31 and the sample point 33 (33b) of the right shoulder of the comparison target 31. A sample point 33 (33c) on the left shoulder of the comparison target 31, a sample point 33 (33d) on the right elbow of the comparison target 31, a sample point 33 (33e) on the left elbow of the comparison target 31, and Sample point 33 (33f) for the right hand, sample point 33 (33g) for the left hand of comparison object 31, sample point 33 (33h) for the waist of comparison object 31, and sample point 33 (33i) for right knee of comparison object 31 ), The sample point 33 (33j) of the left knee of the comparison target 31, the sample point 33 (33k) of the right foot of the comparison target 31, and the sample point 33 (33l) of the left foot of the comparison target 31. The 2nd extraction part 55 produces | generates the 2nd body model 32 based on 12 sample points 33a-331 (refer FIG. 6).

  The second body model 32 representing the posture of the comparison target 31 is generated from the distance image obtained by the distance image sensor 4 in the same manner as the first body model 21 when the comparison image is captured. Similar to the first extraction unit 54, the second extraction unit 55 performs the distance image obtained from the distance image sensor 4 as the preprocessing for detecting the sample point (specific point) 33, and the comparison target 31 from the front. A correction process is performed to correct the distance image obtained by photographing. That is, the second extraction unit 55 generates the second body model 32 by connecting a plurality of specific points 22 in the distance image obtained at the time of capturing the comparison video with a straight line. Similar to the first body model 21, the second body model 32 is generated on a three-dimensional orthogonal coordinate system (display coordinate system) defined in the virtual space. The second body model 32 generated in this way may be stored in advance in the storage unit 51 together with the comparison video. If the reference amount is stored in the storage unit 41 in advance, the second extraction unit 55 can be omitted.

  The generated first body model 21 is displayed by the display control unit 52 at a position overlapping the mirror image 20 of the user 2 on the display surface 30, or on the side or above or below the mirror image 20 of the user 2 on the display surface 30. May be displayed at a position. Similarly, the second body model 32 is also displayed by the display control unit 52 at a position that overlaps the comparison target 31 in the comparison video, or at a position that is lateral or above or below the comparison target 31 on the display surface 30. May be. When both the first body model 21 and the second body model 32 are displayed, the user 2 can exercise while comparing both body models displayed on the display surface 30, so It becomes easy to grasp whether the movement of the part is deviated from the comparison target 31.

  Here, the 1st extraction part 54 calculates | requires the angle with respect to the predetermined | prescribed reference line of the straight line which connects the some specific points 22 from the 1st body model 21, and makes this angle a 1st feature-value. That is, the feature amount (first feature amount) is an angle between a straight line connecting two sample points 22 selected from a plurality of sample points 22 and a predetermined reference line with respect to the first body model 21. is there. For example, focusing on the specific point 22 (22c) corresponding to the right shoulder in the first body model 21 shown in FIG. 5, a straight line connecting the right shoulder and the left shoulder (a straight line connecting the sample point 22c and the sample point 22b). ) As a reference line, an angle α with respect to a reference line of a straight line connecting the right shoulder and the right elbow (a straight line connecting the sample point 22c and the sample point 22b), that is, an angle α of the right shoulder joint is obtained. Further, when focusing on the specific point 22 (22e) corresponding to the right elbow in the first body model 21, a straight line connecting the right shoulder and the right elbow (a straight line connecting the sample point 22c and the sample point 22e) is used as a reference. As a line, an angle β with respect to a reference line of a straight line connecting the right elbow and the right hand (a straight line connecting the sample point 22e and the sample point 22g), that is, an angle β of the right elbow joint is obtained.

  Similarly, the 2nd extraction part 55 calculates | requires the angle with respect to the predetermined | prescribed reference line of the straight line which connects several specific points 33 from the 2nd body model 32, and makes this angle a 2nd feature-value. That is, the reference amount (second feature amount) is an angle between a straight line connecting two sample points 33 selected from a plurality of sample points 33 and a predetermined reference line with respect to the second body model 32. is there. For example, from the second body model 32 as shown in FIG. 6, the angle α of the right shoulder joint and the angle β of the right elbow joint are obtained.

  In short, the first extraction unit 54 extracts an angle about a certain joint obtained from the first body model 21 as a first feature amount, and the second extraction unit 55 about a certain joint obtained from the second body model 32. Are extracted as the second feature amount.

  Further, the feature amount (first feature amount) may be the inclination of the body of the user 2. The inclination of the body of the user 2 is, for example, the inclination of the shoulder of the user 2 (see FIG. 7). In this case, the first extraction unit (feature amount extraction unit) 54 is configured to detect the positions of the sample point 22 on the upper right limb and the sample point 22 on the left upper limb of the user 2. In the example shown in FIG. 7, the sample point 22 of the upper right limb is the sample point 22e of the right elbow, and the sample point 22 of the left upper limb is the sample point 22d of the left elbow. The sample point 22 on the upper right limb may be the sample point 22c on the right shoulder, and the sample point 22 on the left upper limb may be the sample point 22b on the left shoulder. The first extraction unit 54 is configured to calculate the angle between the straight line L100 connecting the sample point 22 of the upper right limb and the sample point 22 of the left upper limb and the horizontal line L200 as the shoulder inclination of the user 2. . In the example shown in FIG. 7, the inclination of the shoulder of the user 2 is −20 °. The inclination of the shoulder of the user 2 is expressed so as to be negative if the inclination of the straight line L100 is positive and positive if the inclination of the straight line L100 is negative.

  Further, the inclination of the body of the user 2 may be, for example, the inclination of the trunk of the user 2 (see FIG. 8). In this case, the first extraction unit (feature amount extraction unit) 54 detects the positions of the sample point 22a on the head of the user 2 and the sample point 22h on the waist, and the sample point 22a on the head and the sample point on the waist. The angle between the straight line L110 connecting the line 22h and the vertical line L210 is calculated as the inclination of the trunk of the user 2. In the example shown in FIG. 8, the inclination of the trunk of the user 2 is −30 °. The inclination of the trunk of the user 2 is represented so as to be positive if the inclination of the straight line L110 is positive and negative if the inclination of the straight line L110 is negative.

  In a similar manner, the reference amount extraction unit 55 can obtain the body inclination (shoulder or trunk inclination) of the comparison target 31 as the reference amount (second feature amount).

  Further, the feature amount (first feature amount) may be a range of motion of a specific part of the body of the user 2. In particular, the specific part is the upper limb of the user 2 (see FIG. 9). In the example shown in FIG. 9, the specific part is the upper right limb. In this example, the first extraction unit (feature amount extraction unit) 54 includes the sample point 22 of the upper limb of the user 2 (sample point 22g of the right hand) and the sample point 22 of the shoulder corresponding to the upper limb (sample point 22c of the right shoulder). ) And position. The sample point 22 of the upper limb of the user 2 may be the sample point 22e of the right elbow. Then, the first extraction unit 54 calculates the angle between the straight line L120 and the vertical line L210 connecting the upper limb sample point 22 (22g) and the shoulder sample point 22 (22c) as the range of motion of the upper limb. Composed. In the example illustrated in FIG. 9, the first extraction unit 54 obtains the range of motion of the upper right limb of the user 2 and the value is 70 °.

  The specific part may be the left upper limb. In this case, the first extraction unit (feature amount extraction unit) 54 samples the upper limb sample point 22 (the left hand sample point 22f and the left elbow sample point 22d) of the user 2 and the shoulder sample point 22 corresponding to the upper limb. What is necessary is just to detect the position with (sample point 22b of the left shoulder).

  Further, the specific part may be the lower limb (right leg or left leg). In this case, the first extraction unit 54 connects the lower limb sample points 22 (for example, the left knee, left foot, right knee, right foot sample points 22i, 22k, 22j, 22l) and the waist sample point 22h (see FIG. The angle between the vertical line L210 and the vertical line L210 is calculated as the range of motion of the lower limb.

  In the same manner, the reference amount extraction unit 55 can obtain the range of motion of a specific part (upper limb or lower limb) of the body of the comparison target 31 as the reference amount (second feature amount).

  The first body model 21 is not limited to a body model generated from a distance image capturing the user 2 from the front, but is a body model generated from a distance image capturing the user 2 from the side. Also good. For example, if the pressure sensor installed at the feet of the user 2 detects the positions of both feet and the center of gravity of the user 2, the body of the user 2 faces the front of the distance image sensor 4 based on the result. You can determine whether you are facing or sideways. From this determination result, the first extraction unit 54 generates the first body model 21 in front view when the user 2 is facing front, and the front view when the user 2 is facing sideways. A lateral first body model 21 is generated by rotating the body model 90 degrees around the vertical axis.

  According to the first horizontal body model 21 generated in this way, the movement of the body in the front-rear direction (for example, the forward / backward inclination of the straight line connecting the shoulder and the waist) is also the first feature. It can be extracted as a quantity. Similarly, for the second body model 32, a lateral body model may be generated. When these horizontal body models are displayed on the display surface 30 by the display control unit 52, the user 2 can check the body movement in the front-rear direction of the user from the body model.

  The evaluation unit 56 compares the joint angle extracted from the first body model 21 as the first feature amount and the joint angle extracted from the second body model 32 as the second feature amount. Thus, the deviation of the posture between the user 2 and the comparison target 31 is evaluated. The evaluation unit 56 can objectively evaluate the posture deviation between the user 2 and the comparison target 31 by comparing the angles of the joints and ignoring the difference in arm length and the like. The evaluation unit 56 may compare the angles of a plurality of joints between both body models, or may compare the angles while paying attention to only a specific joint.

  Here, the evaluation unit 56 calculates a difference between the first feature value and the second feature value. The evaluation unit 56 may digitize the degree of deviation of the posture between the user 2 and the comparison target 31 according to the calculated difference value, and may determine whether the difference value exceeds a predetermined threshold. It may be determined whether or not there is a misalignment with the comparison target 31. Here, the evaluation unit 56 performs the evaluation using the feature amounts extracted from the first body model 21 and the second body model 32, which are three-dimensional models. Not only the deviation but also the deviation in the depth direction (direction orthogonal to the display surface 30) can be evaluated.

  The content presented by the presentation unit 57 may simply be a determination result as to whether or not the posture is shifted between the user 2 and the comparison target 31, or may be content indicating the degree of shift. Further, when the evaluation unit 56 makes a detailed determination as to which part of the body is displaced in which direction by comparing the first feature value and the second feature value, the presentation unit 57. May present advice for reducing the deviation. If the right elbow joint of the user 2 is bent during the exercise of widening the right arm to the side, the presentation unit 57 presents advice such as “Extend your arm”.

  Further, when the display device 3 is also used as the presentation unit 57, the display control unit 52 performs highlighting by changing the color of a part where the deviation amount of the posture of the user 2 is large in the comparison video. Thus, it is possible to make the user 2 recognize which part is not correctly moved. For example, when the right arm of the user 2 is not sufficiently raised and deviates from the right arm of the comparison target 31 during the exercise of widening the right arm to the side, the display control unit 52 displays the comparison target 31 in the comparison video. The right arm portion is highlighted and the deviation of the right arm portion is presented to the user 2. Accordingly, the user 2 can exercise while paying attention to a portion that is deviated from the comparison target 31, and can easily exercise according to the comparison target 31 in the comparison video.

  In this way, the presentation unit 57 feeds back information to the user 2 such as which part of the body of the user 2 is deviated from the comparison target 31 and in which direction, so that the user 2 Can learn the right exercise.

  Furthermore, when the evaluation unit 56 quantifies the degree of the posture deviation between the user 2 and the comparison target 31 according to the difference value between the first feature amount and the second feature amount, the presentation unit 57. May present this numerical value representing the degree of deviation. That is, the evaluation unit (posture evaluation unit) 56 is configured to obtain a numerical value indicating a difference between the feature amount (first feature amount) and the reference amount (second feature amount), and the presentation unit 57 is configured to perform posture evaluation. The numerical value obtained by the unit 56 may be presented. Specifically, the presentation unit 57 presents the difference value between the first feature amount and the second feature amount as it is, or matches the postures of the user 2 and the comparison target 31 obtained according to the difference value. By presenting a score indicating the degree, the degree of deviation and the degree of coincidence can be presented.

  Thus, by quantifying and presenting the degree of degree of deviation and the degree of coincidence between the user 2 and the comparison target 31, the user 2 can use the presented numerical value as a measure of the proficiency level of exercise. The effect of exercise can be easily evaluated. Note that the presentation unit 57 may divide a numerical value representing the degree of coincidence between the postures of the user 2 and the comparison target 31 into a plurality of stages, rank them, and present them.

  As another example, the first extraction unit 54 obtains the area of a region surrounded by a straight line connecting a plurality of specific points 22 from the first body model 21 and uses this area as a first feature amount. Good. That is, the number of sample points in the first body model 21 may be at least three, and the feature amount (first feature amount) may be an area of a region defined by a plurality of sample points. For example, when focusing on the right shoulder, right elbow, right hand, trunk, right knee, and right ankle in the first body model 21 shown in FIG. 5, a region surrounded by a straight line connecting these specific points 22 (FIG. 5). The area of (hatched area) is obtained. Similarly, the second extraction unit 55 includes an area surrounded by a straight line connecting the right shoulder, the right elbow, the right hand, the trunk, the right knee, and the right ankle from the second body model 32 shown in FIG. Part), and this area is set as the second feature amount. That is, the number of sample points in the second body model 32 may be at least three, and the reference amount (second feature amount) may be an area of a region defined by a plurality of sample points.

  In this case, the evaluation unit 56 compares the area extracted from the first body model 21 as the first feature quantity with the area extracted from the second body model 32 as the second feature quantity. The deviation of the posture between the user 2 and the comparison target 31 is evaluated. Since the area thus obtained represents a tendency of posture (such as the degree of opening of the body), the evaluation unit 56 roughly evaluates the posture deviation between the user 2 and the comparison target 31 by comparing the above areas. can do. In the evaluation unit 56, the areas of a plurality of regions may be compared between both body models, or the areas of a single region may be compared.

  As described above, the exercise support system 1 according to this embodiment includes the display device 3 that displays an image on the display surface 30 that is disposed in front of the user 2 and faces the user 2, and the user with respect to the display surface 30. Compared to the display device 3 when the user 2 exercises, the half mirror 6 arranged on the second side, the storage unit 51 that stores the image of the comparison object 31 that performs the same exercise as the exercise performed by the user 2 as a comparison image And a display control unit 52 for displaying video. Furthermore, the exercise support system 1 detects the position of a specific point on the body of the user 2 and extracts a first feature value representing the posture of the user 2 based on the position of the specific point; A second extraction unit 55 that detects the position of the specific point of the comparison target 31 and extracts a second feature amount representing the posture of the comparison target 31 based on the position of the specific point; a first feature amount and a second feature amount; The evaluation part 56 which compares the feature-value of this and evaluates the attitude | position shift | offset | difference of the user 2 and the comparison object 31, and the presentation part 57 which presents the evaluation result of the evaluation part 56 are provided.

  That is, the exercise support system 1 according to the present embodiment stores a display device 3 having a display surface 30 that displays an image on the user 2 and a comparison image that is an image of an exerciser (comparison target 31) performing a predetermined exercise. Storage unit (comparison image storage unit) 51, a display control unit (comparison image display unit) 52 for displaying the comparison image stored in the comparison image storage unit 51 on the display surface 30, and a mirror image of the user 2 as a comparison image And a mirror image display means for displaying in a superimposed manner, and a feature amount (first feature amount) representing the posture of the user 2 based on the position of the sample point detected on the body of the user 2 The first extraction unit (feature amount extraction unit) 54 to be obtained and the feature amount obtained by the feature amount extraction unit 54 are compared with a reference amount (second feature amount) representing the posture of the exerciser. Evaluation unit (posture evaluation unit) that evaluates the deviation of the posture from the posture of the athlete It includes a 56, a presentation unit 57 for presenting the results of the evaluation by the posture evaluation unit 56, a.

  In the exercise support system 1 of the present embodiment, the mirror image display means is the half mirror 6 disposed on the front surface of the display device 3.

  In addition, the exercise support system 1 of this embodiment includes a reference amount extraction unit (second extraction unit) 55. The reference amount extraction unit 55 detects the position of a predetermined sample point (specific point) in the body of the exerciser (comparison target 31) in the comparison image, and indicates the reference amount (the amount of the exerciser's posture based on the position of the sample point). The second feature amount is determined.

  According to the exercise support system 1 having the configuration described above, the user 2 can exercise while comparing his / her mirror image 20 reflected in the half mirror 6 and the comparison target 31 in the comparison image reflected in the display surface 30. Therefore, it becomes easy to exercise according to the comparison target 31. As a result, the user 2 has an advantage that it becomes easy to learn the correct posture (movement) during exercise, and the effect of exercise can be sufficiently obtained.

  In addition, the evaluation unit 56 compares the first feature amount representing the posture of the user 2 with the second feature amount representing the posture of the comparison target 32, and determines the posture deviation between the user 2 and the comparison target 31. Evaluate and present the evaluation result to the presentation unit 57. Therefore, the user 2 can recognize the deviation of the posture from the comparison target 31. That is, the user 2 can recognize how much the user 2 is different from the posture of the comparison target 31 in the comparison video. Therefore, when the user 2 is exercising greatly deviating from the posture of the comparison target 31, the user 2 can be made aware of this, so the user 2 can improve the movement. This makes it easier to learn the correct posture during exercise.

  In the exercise support system 1 of the present embodiment, the comparison video is a video of the comparison target 31 that shows an example of exercise to be performed by the user 2. That is, the predetermined exercise is an exercise that serves as an example of the exercise performed by the user 2.

  In the exercise support system 1 of the present embodiment, the first extraction unit 54 and the second extraction unit 55 each detect the position of a plurality of specific points and connect the specific points to generate a body model, Extract features from the model. That is, the feature amount extraction unit (first extraction unit) 54 detects the positions of a plurality of sample points (specific points) in the body of the user 2 and determines the body of the user 2 based on the positions of the plurality of sample points. A body model (first body model) 21 to be shown is created, and a feature amount (first feature amount) is obtained based on the body model 21. The reference amount extraction unit (second extraction unit) 55 detects the positions of a plurality of sample points (specific points) in the body of the comparison target 31 of the comparison image, and compares the comparison target 31 based on the positions of the plurality of sample points. A body model (second body model) 32 indicating the body of the user is created, and a reference amount (second feature amount) is obtained based on the body model 32.

  In the exercise support system 1 of the present embodiment, the first extraction unit 54 and the second extraction unit 55 use the angle of a straight line connecting a plurality of specific points with respect to a predetermined reference line as a feature amount. That is, the feature amount is an angle between a straight line connecting two sample points selected from a plurality of sample points and a predetermined reference line.

  In the exercise support system 1 of the present embodiment, the feature amount (first feature amount) may be the inclination of the body of the user 2. In particular, the inclination of the body of the user 2 may be the inclination of the shoulder of the user 2. In this case, the feature quantity extraction unit 54 detects the positions of the sample point 22 of the upper right limb and the sample point 22 of the upper left limb of the user 2 and connects the sample point 22 of the upper right limb and the sample point 22 of the left upper limb. The angle between the straight line L100 and the horizontal line L200 is calculated as the shoulder inclination of the user 2. Further, the inclination of the body of the user 2 may be the inclination of the trunk of the user 2. In this case, the feature amount extraction unit 54 detects the positions of the sample point 22 on the head of the user 2 and the sample point 22 on the waist, and connects the sample point 22 on the head and the sample point 22 on the waist with a straight line L110. And an angle between the vertical line L210 and the trunk 2 of the user 2 is calculated as the inclination of the trunk of the user 2. Similarly, in the exercise support system 1 of the present embodiment, the reference amount extraction unit 55 may obtain the body inclination (shoulder or trunk inclination) of the comparison target 31 as the reference amount (second feature amount). Good.

  In the exercise support system 1 of the present embodiment, the feature amount (first feature amount) may be a movable range of a specific part of the body of the user 2. In particular, the specific part may be the upper limb of the user 2. In this case, the feature amount extraction unit 54 detects the position of the sample point 22 of the upper limb of the user 2 and the sample point 22 of the shoulder corresponding to the upper limb, and connects the sample point 22 of the upper limb and the sample point 22 of the shoulder. An angle between the straight line L120 and the vertical line L210 is configured to be calculated as the range of motion of the upper limb. Similarly, in the exercise support system 1 of the present embodiment, the reference amount extraction unit 55 may obtain a movable range of a specific part (for example, an upper limb) of the comparison target 31 as a reference amount (second feature amount). .

  In the exercise support system 1 of the present embodiment, the first extraction unit 54 and the second extraction unit 55 use the area of a region surrounded by a straight line connecting a plurality of specific points as a feature amount. That is, the number of sample points is at least three or more, and the feature amount is an area of a region defined by a plurality of sample points.

  In the exercise support system 1 of the present embodiment, the display control unit 52 positions the comparison video 31 on the display surface 30 so that the user 2 can see the image of the user 2 and the image of the comparison target 31 overlapping. And adjust the size. That is, the comparison image display unit (display control unit) 52 is configured to adjust the position and size of the comparison image on the display surface 30 so that the comparison image overlaps the mirror image of the user.

  In the exercise support system 1 of the present embodiment, the evaluation unit 56 digitizes the difference between the first feature value and the second feature value and causes the presentation unit 57 to present the difference. That is, the posture evaluation unit (evaluation unit) 56 is configured to obtain a numerical value indicating a difference between the feature amount (first feature amount) and the reference amount (second feature amount), and the presentation unit 57 is configured to perform posture evaluation. It is comprised so that the numerical value calculated | required in the part 56 may be shown.

  By the way, in this embodiment, the 1st extraction part 54 and the 2nd extraction part 55 detect the position of the specific point 22 from the user 2 or the whole body of the comparison object 31, and respond to the user 2 or the whole body of the comparison object 31 Although the example which extracts the feature-value using the body model to show was shown, it is not restricted to this structure. For example, the first extraction unit 54 sets the coordinate position of the specific point 22 of the user 2 as the first feature amount, and the second extraction unit 55 sets the coordinate position of the specific point 22 of the comparison target 31 as the second feature amount. It may be configured as follows.

  In this case, the evaluation unit 56 compares the first feature quantity with the second feature quantity, thereby shifting the specific point 22 corresponding to the same part of the body between the user 2 and the comparison target 31. To evaluate. For example, when the positions of the trunks of the user 2 and the comparison target 31 are matched and the coordinate position of the specific point 22 corresponding to the right hand is used as the first and second feature quantities, the evaluation unit 56 determines both feature quantities. Of the right hand between the user 2 and the comparison target 31 is evaluated. That is, the evaluation unit 56 obtains the relative distance between the specific points 22 corresponding to the same part of the body between the user 2 and the comparison target 31, so that the posture between the user 2 and the comparison target 31 is obtained. Evaluate deviations.

  In addition, for example, the evaluation unit 56 determines whether the specific point 22 corresponding to the right hand is higher than the specific point 22 corresponding to the right shoulder. Based on the relative positional relationship between the user 2 and the comparison object 31, the deviation of the posture may be evaluated. In this case, when the specific point 22 corresponding to the right hand is located at a position lower than the specific point 22 corresponding to the right shoulder of the user 2 in the exercise of spreading the right arm largely sideways, for example, Please raise it higher. "

  Furthermore, by installing two distance image sensors 4 on the front side (half mirror 6 side) and the side of the user 2, the acquisition unit 53 captures the user 2 from the front. And a distance image captured from the side may be acquired at the same time. In this case, the left-right inclination of the body is extracted as a feature amount from the distance image capturing the user 2 from the front, and the front-rear inclination of the body is extracted as the feature amount from the distance image capturing the user 2 from the side. can do. As a result, there is an advantage that it can be measured with higher accuracy than the configuration in which the feature amount representing the tilt (posture) of the front, rear, left and right bodies is extracted from only the distance image obtained by one distance image sensor 4.

  Moreover, the 1st extraction part 54 is not restricted to the structure which detects the position of the specific point of the user 2 using the distance image obtained with the distance image sensor 4 as mentioned above. For example, the first extraction unit 54 may be a two-dimensional image of the user 2 taken by a two-dimensional camera such as a CCD (Charge Coupled Device) camera, a gyro sensor type motion capture attached to the user 2, or the like. The position of the specific point of the user 2 may be detected using the sensor output. Similarly, the second extraction unit 55 may be configured to detect the position of the specific point of the comparison target 31 from other than the distance image.

(Embodiment 2)
The exercise support system 1A of this embodiment is different from the exercise support system 1 of Embodiment 1 in that the half mirror 6 is not provided. In addition, in the exercise support system 1A of the present embodiment, as shown in FIG. 10, an imaging device 7 is provided that is arranged in front of the user 2 and has a lens directed in a direction to image the user 2 from the front. .

  The imaging device 7 is configured to capture the user 2 and generate an image of the user 2. The imaging device 7 is installed at the eye level of the user 2 on the front side (user 2 side) of the display device 3 using, for example, a camera stand. Further, the imaging device 7 includes the whole body of the user 2 in the field of view, and the center line in the left-right direction of the body of the user 2 in a state where the user 2 is standing upright is the center line in the left-right direction of the captured image. The tilt angle and pan angle are adjusted so as to coincide with.

  The adjustment of the position and orientation of the imaging device 7 as described above is performed as an initial setting after the standing position of the user 2, the height of the line of sight, etc. are determined. As a result, the imaging device 7 captures a moving image (hereinafter referred to as “whole body image”) showing the whole body of the user 2.

  The control device 5 </ b> A is connected to both the display device 3 and the imaging device 7, and has a function of processing an image captured by the imaging device 7 and displaying the processed image on the display device 3. Specifically, the control device 5A includes a reversal processing unit 58 that obtains a whole body video from the imaging device 7 by the obtaining unit 53, and generates a reversed video by reversing the obtained whole body video left and right. That is, the inversion processing unit 58 is configured to generate a horizontally inverted image by horizontally inverting the image of the user 2 generated by the imaging device 7. Further, the control device 5A causes the display device 52A to display the reverse video on the display device 3 so that the horizontal center line of the reverse video matches the horizontal center line of the display surface 30. That is, the display control unit 52 </ b> A functions as an inverted image display unit that displays the horizontally inverted image generated by the inversion processing unit 58 on the display surface 30. As a result, the image of the whole body of the user 2 is displayed on the display surface 30 of the display device 3 so as to be horizontally reversed like a mirror image reflected in the mirror.

  That is, the image picked up by the image pickup apparatus 7 is not reversed left and right like a mirror image unless any processing is performed, and the right and left viewed from the user 2 facing the display surface 30 and the display are displayed. This is opposite to the left and right in the image displayed on the surface 30. In short, when the whole body image of the user 2 imaged by the imaging device 7 is displayed on the display surface 30 of the display device 3 facing the user 2 without any processing, the image on the display surface 30 is displayed. Then, the left half of the user 2 is shown on the right side, and the right half of the user 2 is shown on the left side.

  On the other hand, since the inverted image is an image obtained by horizontally inverting the whole body image, the display device 3 shows the right half of the user 2 on the right side and the left half of the user 2 on the left side on the display surface 30. Display the reverse video so that it appears. As a result, the display device 3 can cause the user 2 to visually recognize the inverted video image displayed on the display surface 30 so that the user 2 can have the illusion of the inverted video image as a mirror image of his / her whole body.

  Here, the control device 5A processes (inverts) the video input from the imaging device 7 in real time (about 15 to 30 frames per second), and outputs a video signal to the display device 3. The display device 3 receives the video signal from the control device 5A and displays a reverse video in real time. Therefore, a moving image that moves in accordance with the actual movement of the user 2 is displayed on the display surface 30 of the display device 3 as a reverse video. For example, when the user 2 raises his right arm, the right arm as seen from the user 2 also rises in the reverse video displayed on the display surface 30 in accordance with the movement.

  That is, the exercise support system 1A of the present embodiment does not present a mirror image that is optically formed, causes the user 2 to visually recognize the reverse video displayed on the display device 3, and The reverse video can be illusioned with its own mirror image.

  Furthermore, the display control unit 52 </ b> A causes the display device 3 to display a comparison image indicating the comparison target 31 that performs the same exercise as the exercise to be performed by the user 2 together with the inverted image generated by the inversion processing unit 58. The display control unit 52A uses the size adjustment unit and the position adjustment unit so that the image of the user 2 in the inverted image and the image of the comparison target (instructor) 31 in the comparison image overlap on the display surface 30. 30 adjust the size and position of the comparison video. Here, the display control unit 52A displays one of the inverted video and the comparative video as a semi-transparent video (for example, a transmittance of 50%) so that the inverted video and the comparative video can be easily distinguished.

  The exercise support system 1A of the present embodiment described above includes the display device 3 that displays an image on the display surface 30 that is disposed in front of the user 2 and faces the user 2, and the user 2 that is disposed in front of the user 2. An imaging device 7 that captures an image, an inversion processing unit 58 that generates an inverted image by horizontally inverting the image of the user 2 captured by the imaging device 7, and an image of the comparison target 31 that performs the same exercise as the user 2 Is stored as a comparison image, and a display control unit 52A is displayed that causes the display device 3 to display the comparison image together with the inverted image when the user 2 exercises. Furthermore, the exercise support system 1 detects the position of a specific point on the body of the user 2 and extracts a first feature value representing the posture of the user 2 based on the position of the specific point; A second extraction unit 55 that detects the position of the specific point of the comparison target 31 and extracts a second feature amount representing the posture of the comparison target 31 based on the position of the specific point; a first feature amount and a second feature amount; The evaluation part 56 which compares the feature-value of this and evaluates the attitude | position shift | offset | difference of the user 2 and the comparison object 31, and the presentation part 57 which presents the evaluation result of the evaluation part 56 are provided.

  That is, the exercise support system 1A of the present embodiment stores a comparison image that is an image of the display device 3 having the display surface 30 that displays an image on the user 2 and an exerciser (comparison target 31) that performs a predetermined exercise. Storage unit (comparison image storage unit) 51, a display control unit (comparison image display unit) 52A for displaying the comparison image stored in the comparison image storage unit 51 on the display surface 30, and a mirror image of the user 2 as a comparison image And a mirror image display means for displaying in a superimposed manner, and a feature amount (first feature amount) representing the posture of the user 2 based on the position of the sample point detected on the body of the user 2 The first extraction unit (feature amount extraction unit) 54 to be obtained and the feature amount obtained by the feature amount extraction unit 54 are compared with a reference amount (second feature amount) representing the posture of the exerciser. An evaluation unit that evaluates the deviation of the posture from the posture of the athlete (posture evaluation It comprises a section) 56, a presentation unit 57 for presenting the results of the evaluation by the posture evaluation unit 56, a.

  In the exercise support system 1 according to the present embodiment, the mirror image display means captures the user 2 and generates an image of the user, and horizontally inverts the image of the user 2 generated by the imaging device 7. An inversion processing unit 58 that generates a horizontally inverted image, and an inverted image display unit (display control unit) 52A that displays the horizontally inverted image generated by the inversion processing unit 58 on the display surface 30.

  According to the exercise support system 1A of the present embodiment described above, there is an advantage that the configuration can be simplified compared to the exercise support system 1 of the first embodiment by the amount that the half mirror 6 is omitted. In addition, in the configuration of the present embodiment, if a display having a relatively large screen is provided in advance, an existing display can be used as the display device 3 without newly installing a dedicated display. The cost of introducing an exercise support system can be reduced.

  Other configurations and functions of the exercise support system 1A of the present embodiment are the same as those of the exercise support system 1 of the first embodiment.

  By the way, in the said Embodiment 1, 2, although the example which uses the image | video of the instructor which shows the example of the exercise | movement which the user 2 performs as a comparison image was shown, not only this example but a comparison image is performed to the user 2. It is only necessary to be a comparison target image that performs the same exercise as the exercise to be performed. In other words, the comparison video may be a video that compares, for example, computer graphics representing a human body or the second body model described above. In this case, the user 2 exercises in accordance with the movement of the computer graphics or the second body model in the comparison video instead of the instructor video as described above.

  In addition, the control device 5A stores, in the storage unit 51, an image of the user 2 at the time of exercise captured by an imaging device arranged in front of the user 2, and displays this image as a comparison image at the next exercise. You may make it display on the display apparatus 3 in the control part 52. FIG. In other words, the exercise support system 1A according to the present embodiment includes the imaging device 7 that is arranged in front of the user 2 and captures the video of the user 2, and the comparison video is the image of the user captured by the imaging device 7 in the past. It may be a video. In other words, the exercise support system 1 </ b> A according to the present embodiment captures the user 2 who performs a predetermined exercise and generates an image of the user 2 who performs the predetermined exercise, and the reference amount. An extraction unit (second extraction unit) 55. The comparison image display unit (display control unit) 52A is configured to display the recorded image generated by the imaging device 7 on the display surface 30 as a comparison image. The reference amount extraction unit 55 is configured to detect the position of a predetermined sample point on the body of the user 2 from the recorded image and obtain a feature amount representing the posture of the user as a reference amount based on the position of the sample point. The In this example, when the user 2 exercises, the video of the user 2 captured by the imaging device during the past (previous) exercise is displayed on the display surface 30 as a comparative video.

  In this configuration, the user 2 can exercise while comparing the present self with the past self. Therefore, the user 2 can exercise using a comparison object having the same physique (arm length, etc.) as himself as a sample, so that the posture of the user 2 is higher than when the instructor image is used as a comparison image. It becomes easy to match (movement) to the comparison target.

  In this case, the evaluation unit 56 compares the first feature value representing the posture of the user 2 and the second feature value representing the posture of the comparison target, thereby comparing the current user 2 and the comparison target. As a result, the deviation of the posture is evaluated with the past video of the user 2. Therefore, the evaluation unit 56 can evaluate how the posture of the user 2 during exercise has changed compared to the conventional one, and can evaluate the progress of rehabilitation.

(Embodiment 3)
The exercise support system 1B of the present embodiment has a side surface as a range of motion training system. The range-of-motion training system is used for range-of-motion training for returning the range of motion of a specific part of the body, such as the extremity, to the normal range or maintaining it within the normal range.

  For example, in the field of rehabilitation, range-of-motion training is generally adopted to prevent or improve the movement range (range of motion) of patients' limbs due to illness or injury. Yes. Range of motion training is to move the specific area of the patient's training target continuously (for example, every day) to return the normal range of movement of the specific area of the body, such as the limbs, to the normal range. Done.

  In the range-of-motion training, usually, the range of motion of a specific part of the patient is measured, and the measurement result is used for determining the degree of failure and the effect (degree of recovery) of the training. As a method of measuring the range of motion of a specific part, for example, the height of the arm when the patient raises the arm, the relative angle between the upper arm and the forearm when the elbow joint is bent, The method of using and measuring is common.

  As an angle measuring instrument used for this type of measurement, an angle measuring instrument equipped with an inclination angle meter that identifies the direction of gravity with respect to the arm and configured to allow the measurer to derive the inclination angle of the upper arm and the forearm relative to the vertical direction has been proposed. (For example, refer to Document 2 [Japanese Patent Publication No. 4445468]). According to the angle measuring device described in Document 2, for example, the relative angle between the entire human body and the upper arm or the forearm is further defined when measuring the relative angle between the upper arm and the forearm. This makes it possible to make detailed judgments.

  However, in the range-of-motion training as described above, the patient can only know the measurement result (angle, etc.) of the range of motion, and the specialist such as a therapist evaluates the range of motion of the specific part from the measurement result. Without it, you will not be able to fully understand what the measurement results mean. For example, if a measurement result indicating how many centimeters the arm has been raised is obtained, the patient can understand how much the range of motion has recovered or deteriorated from the measurement result. Therefore, the necessity and effect of range of motion training cannot be fully understood.

  Therefore, it is preferable that the range of motion training system can present the evaluation result of the range of motion of a specific part of the body to the user.

  The exercise support system 1B of the present embodiment is used as a range of motion training system. The range-of-motion training system is used for rehabilitation aimed at preventing or improving the limitation of the range of movement of the patient's limbs (range of motion) due to illness or injury. However, the description of the following embodiment is not intended to limit the use of the range of motion training system, for example, training for expanding the range of motion of the limbs for healthy people, and the range of motion of the limbs will be limited over time A range of motion training system may be used to prevent this. In the following, an example of using the range-of-motion training system in a posture where the user stands is shown, but the present invention is not limited thereto, and the user may use the range-of-motion training system in a posture sitting on a chair or the like.

  The exercise support system 1B of this embodiment is different from the exercise support system 1 of Embodiment 1 in a control device 5B as shown in FIG. The exercise support system 1B according to the present embodiment includes a display device 3 that displays an image on a display surface 30 that is disposed in front of a user (patient) 2 and faces the user 2, a distance image sensor 4 that generates a distance image, and a display. And a control device 5B for controlling the operation of the device 3 and the like. The display device 3 and the distance image sensor 4 are both connected to the control device 5B. Further, the exercise support system 1B of the present embodiment includes a half mirror 6 which is a mirror image display means.

  In the range-of-motion training system 1B of the present embodiment, the distance image of the user 2 generated by the distance image sensor 4 is output to the control device 5B and used for processing for detecting the position of a specific part of the body of the user 2. It is done.

  Specifically, the control device 5B includes a computer, and includes an acquisition unit 53 that acquires a distance image from the distance image sensor 4, and a position detection unit 152 that detects the position of a specific part using the acquired distance image. doing. Further, the range-of-motion training system 1B of the present embodiment includes an index setting unit 153 that sets an index at a position on the display surface 30 corresponding to the position of the specific part of the body of the user 2 detected by the position detection unit 152. The control device 5B includes a video generation unit 154 that generates a graphic image and displays it on the display device 3.

  That is, as shown in FIG. 11, the control device 5B includes a storage unit 51, an acquisition unit 53, a first extraction unit 54, a second extraction unit 55, an evaluation unit 56, a presentation unit 57B, and a position detection unit. Unit 152, index setting unit 153, video generation unit 154, and evaluation unit 155. When the exercise support system 1B is used only as a range of motion training system, the first extraction unit 54, the second extraction unit 55, and the evaluation unit (posture evaluation unit) 56 are not necessarily provided.

  The position detection unit 152 is configured to detect the position of a specific part of the body of the user 2. In the present embodiment, the position detection unit 152 detects the position of a specific part of the body of the user 2 in the distance image by image recognition technology. Here, the case where the arm part of the user 2 is set as the specific part is illustrated, but the specific part may be a specific part of the body of the user 2, and may be a leg part, a head, or the like, for example. Since the distance image of the user 2 generated by the distance image sensor 4 is a moving image that changes as the user 2 moves, the position detection unit 152 detects the position of a specific part from each frame of the distance image. Thus, the position of the specific part that changes as needed can be detected in real time.

  In the present embodiment, the position detection unit 152 detects the position of the joint of the user 2 and generates a body model that represents the position of the specific part in the three-dimensional space by connecting the joints with straight lines. That is, for example, when the position detection unit 152 detects the position of the right arm of the user 2 as a specific part, the position detection unit 152 detects the position of the user's right shoulder joint, right elbow joint, and right wrist, respectively. The body model corresponding to the right arm of the user 2 is generated. By using such a body model, the position detection unit 152 detects the position of the specific part of the user 2 in the three-dimensional space from the output of the distance image sensor 4 as a three-dimensional sensor.

  The index setting unit 153 is configured to determine the position of the index on the display surface 30 based on the position detected by the position detection unit 152. In the present embodiment, the index setting unit 153 displays at least a part of the specific part on the display surface 30 from the coordinate position of the imaging coordinate system defined for the distance image obtained by the distance image sensor 4. An index is set at a position obtained by coordinate conversion to a coordinate position in the coordinate system. The display coordinate system here is a two-dimensional orthogonal coordinate system in which the horizontal and vertical directions of the display surface 30 of the display device 3 are coordinate axes.

  In other words, the index setting unit 153 uses a predetermined conversion formula to obtain a display obtained by performing coordinate conversion of at least a part of a specific part from the polar coordinate system on which the distance image sensor 4 is a reference to a two-dimensional orthogonal coordinate system. An index is set at a position on the surface 30. Thereby, an index is set at a position on the display surface 30 corresponding to the position of the specific part detected by the position detection unit 152.

  In the present embodiment, the specific site is the entire arm, whereas the index setting unit 153 sets the index on the display surface 30 corresponding to the position of the wrist that is a part of the specific site (arm). Is the position. However, the index setting unit 153 may be configured to set an index at a position on the display surface 30 corresponding to at least a part of the specific part, and the index is set at a position on the display surface 30 corresponding to the entire specific part. The configuration may be set.

  That is, when the specific part is the entire arm as in the present embodiment, the index setting unit 153 may set the index at a position on the display surface 30 corresponding to the position of the entire arm. In this case, since the arm portion as the specific part has a certain size, the index is set within a certain range on the display surface 30.

  In addition, the index setting unit 153 in the present embodiment calibrates the position of the index so that the index is set at a position that overlaps the mirror image of the specific part of the mirror image of the user 2 reflected on the half mirror 6 on the display surface 30. It has a function. In other words, the position of the mirror image reflected on the half mirror 6 as viewed from the user 2 changes depending on the positional relationship between the half mirror 6 and the user 2, so that the index setting unit 153 appropriately sets the position determined by the coordinate conversion described above. The position of the index is calibrated by giving an offset of.

  Specifically, the position of the index on the display surface 30 is calibrated according to the positional relationship between the half mirror 6 and the user 2. The positional relationship between the half mirror 6 and the user 2 may be determined in advance so that the user 2 stands at the front center of the half mirror 6. Alternatively, a pressure sensor (not shown) that detects the position of the center of gravity of the user 2 may be added, and the positional relationship between the half mirror 6 and the user 2 may be obtained from the detection result of the pressure sensor.

  Next, a simple method for calibrating the position of the index will be described. The control device 5B includes a height registration unit (not shown) in which a uniform value (for example, 170 cm) is registered in advance as the height of the user 2. The height registered in the height registration unit may be directly input by the user 2.

  If the positional relationship between the half mirror 6 and the user 2 is specified, the index setting unit 153 calibrates the index to a position based on the height of the user 2, so that the index setting unit 153 calibrates itself from the viewpoint of the user 2. It is possible to set an index at a position overlapping a specific part of the mirror image.

  Still another method will be described. Even if the height of the user 2 is not registered in the height registration unit, the half mirror 6 can be obtained from the position and orientation of the distance image camera 4 and the standing position and the top position of the user 2 detected from the distance image. The position of a specific part (for example, the head) of the mirror image shown in FIG. Accordingly, the index setting unit 153 can calibrate the position of the index to a position overlapping with a specific part of its own mirror image as viewed from the viewpoint of the user 2.

  The calibration of the index position may be performed manually at the time of initial setting or may be automated.

  As shown in FIG. 12, the video generation unit 154 includes a determination unit 1541 and a display control unit 52B. The determination unit 1541 is configured to determine whether or not the index is located at a predetermined position on the display surface 30. The display control unit 52B functions as an event image display unit that displays a predetermined event image at a predetermined position when the determination unit 1541 determines that the index is positioned at a predetermined position. The video generation unit 154 generates a graphic image associated with the process and displays it on the display device 3 so as to execute a predetermined process when the position of the index set by the index setting unit 153 overlaps. That is, the video generation unit 154 displays an appropriate icon on the display device 3 and associates the process to be executed with the icon, so that the index position specified by the index setting unit 153 is associated with the icon. When they overlap, the process associated with the icon can be executed.

  Specifically, as shown in FIG. 13, the video generation unit 154 displays a large number of images 131 representing balloon designs within a predetermined range on the display surface 30 at substantially equal intervals. As a result, the mirror image of the user 2 is reflected on the front surface of the half mirror 6, and the graphic image 131 generated by the video generation unit 154 is displayed through the half mirror 6.

  Here, the image 131 is not a still image of a balloon, but a moving image of a balloon that swings as if it is floating in the air. The icon 131 is associated with a process of erasing the balloon pattern with an animation that causes the balloon to burst when the positions of the indices overlap. Further, the graphic 131 is associated with a process for generating a sound corresponding to a change in the pattern from a speaker (not shown) of the control device 5B, for example, a bursting sound of a balloon bursting when the positions of the indices overlap. It may be done. Note that the icon 131 may be associated with a process for randomly changing the color of the balloon to a rainbow color.

  In addition, when using the exercise support system 1B, the brightness of the display device 3 is set so that there is no great difference in the appearance of the mirror image reflected on the half mirror 6 and the image 131 displayed on the display device 3 when viewed from the user 2. It is desirable that the brightness of the room or the room is appropriately adjusted.

  Here, the position of the index set by the index setting unit 153 may be used only in the internal processing of the control device 5B (processing of the graphic image 131), and it is indispensable that the display itself is displayed on the display device 3. Absent. However, the video generation unit 154 may display a mark 132 of an appropriate shape (for example, a circle) on the display device 3 at the position where the index is set as shown in FIG. Can reliably recognize the position of the index.

  Using the exercise support system 1B having the above-described configuration, the user 2 moves an index on the display surface 30 by moving a specific part (here, an arm part) while looking at the mirror image of the user 2 reflected on the half mirror 6. be able to. When the index moves on the display surface 30, the balloon 2 is ruptured by the icon 131 that overlaps with the position of the index. Therefore, the user 2 looks at the icon 131 displayed on the display surface 30. The moved range of the specific part can be visually recognized. In this embodiment, since the specific part is an arm part, the user 2 can visually recognize how much his / her arm is raised.

  That is, the user 2 moves the specific part while the image generation unit 154 displays the icon 131 on the display device 3 to prevent the range of motion of the specific part of the body such as the limb from being limited. Range of motion training can be performed. During a period in which the image generation unit 154 displays the icon 131 on the display device 3, a timer (not shown) is displayed after a predetermined operation for starting the range of motion training is performed on the input interface (not shown) of the control device 5B. ) During the predetermined training time counted. Here, it is desirable that the remaining training time is presented to the user 2 by being displayed on the display surface 30 of the display device 3 by the video generation unit 154.

  By the way, the exercise support system 1B of the present embodiment includes an evaluation unit (second evaluation unit) 155 that evaluates the range of motion of the specific part by comparing the evaluation target obtained from the change of the position of the specific part with a predetermined evaluation criterion. The control device 5B further includes a presentation unit 57 that presents the evaluation result of the evaluation unit 155.

  The evaluation unit 155 includes an evaluation data creation unit 1551 that creates evaluation data indicating the range of motion of the specific part based on the position detected by the position detection unit 152, and the evaluation data and reference data created by the evaluation data creation unit 1551. And a range of motion evaluation unit 1552 that evaluates the range of motion of the specific part based on the comparison. The evaluation unit 155 is based on the range in which the specific part of the user 2 detected by the position detection unit 152 actually moves during the period (training time) in which the image generation unit 154 displays the icon 131 on the display device 3. The movable range (movable range) of a specific part is evaluated. That is, the evaluation data includes data indicating the movable range of the specific part in the predetermined direction. More specifically, a score is associated with the icon 131 displayed on the display surface 30 in advance, and the evaluation unit 155 corresponds to the icon 131 in which the process of bursting the balloon due to the overlapping of the index positions is performed. The score is calculated, and this score is evaluated as the range of motion of the arm (specific part).

  Here, the height at which the arm of the user 2 rises is directly related to the range of motion of the arm, and it can be evaluated that the range of motion of the arm is wider as the arm is raised higher. Therefore, in the present embodiment, the score is assigned according to the position of the icon 131 on the display surface 30 so that the icon 131 having a higher display position on the display surface 30 has a higher score, and the highest score among the acquired scores. The score is the score of user 2. Thereby, the score which can be acquired becomes high, so that the user 2 raises the front-end | tip part of an arm part (specific site | part) from a floor surface. In other words, the evaluation unit 155 evaluates the range of motion of the arm part in the form of a score, with the height of the arm part from the floor as an evaluation target.

  The score assignment for each icon 131 is stored in the storage unit 51 of the control device 5B, and the evaluation unit 155 calculates the score of each icon 131 according to the score assignment read from the memory unit 51. Here, 100 points are assigned to the image 131 displayed at the highest position on the display surface 30 so that the standard score that a healthy person can acquire is 100 points, and displayed at the lowest position on the display surface 30. 20 points are assigned to the image 131 to be displayed. That is, in the storage unit 51 as the standard storage unit, the assignment of the score to the image 31 is stored as standard information indicating the standard of the evaluation target (arm height) of the evaluation unit 155, and the evaluation unit 155 Is compared with the standard information to evaluate the range of motion of the arm relative to the standard.

  The storage unit 51 may store standard information for each age, sex, and height, for example. In this case, the evaluation unit 155 sets the standard information to be compared with the evaluation target to the age, sex, and height of the user 2. Select accordingly. That is, the assignment of points to the icon 131 varies depending on the age, sex, and height of the user 2.

  As a method in which the evaluation unit 155 evaluates the movable range (movable range) of the specific part in a predetermined direction, as described above, a score corresponding to the height of the specific part of the user 2 from the floor is given. For example, there is a method of measuring the moving distance of the specific part of the user 2 in a certain direction. Specifically, if the specific part is the arm part, the evaluation unit 155 raises the arm part from the position (initial position) of the tip part of the arm part when the user 2 lowers the arm part. The distance in the vertical direction to the position of the tip of the arm portion may be measured, and this distance may be the evaluation target. In this case, the evaluation unit 155 can evaluate that the movable range of the arm portion is wider as the measured distance increases, and therefore, the score is assigned so that the score is higher as the graphic 131 is farther from the initial position. It only has to be. Furthermore, the distance in the horizontal direction (left-right direction) from the center line of the trunk to the tip of a specific part (for example, the right arm) may be considered as an evaluation target.

  As another example, the evaluation unit 155 is configured to evaluate the movable range of the specific part, with the area of the region through which the specific part passes in the plane (two-dimensional space) along the display surface 30 as an evaluation target. Also good. That is, the evaluation data may include data indicating the area of a region through which a specific part has passed in a plane parallel to the display surface 30. Specifically, the index setting unit 153 sets an index at a position on the display surface 30 corresponding to the entire specific part (arm portion), and the evaluation unit 155 passes the index in a plane along the display surface 30. The area of the region is to be evaluated. In short, the evaluation unit 155 calculates the total score of the icon 131 in which the process of bursting the balloon due to the overlapping of the index positions is performed, and this score is evaluated as the range of motion of the specific part. Even in this case, a score is assigned to each icon 131 so that the standard score that a healthy person can acquire is 100, and the evaluation unit 155 moves the arm by comparing the evaluation object with the standard information. The range is evaluated relative to the standard.

  Alternatively, in the configuration in which the position detection unit 152 detects the position of the specific part in the three-dimensional space from the output of the distance image sensor 4 that is a three-dimensional sensor, the evaluation unit 155 passes the specific part in the three-dimensional space. The volume of the selected area may be included in the evaluation target. That is, the evaluation data may include data indicating the volume of the region through which the specific part has passed. That is, the evaluation unit 155 evaluates that the movable range of the specific part is wider as the volume is larger, based on the volume that is quantified in the three-dimensional space. In this case, the evaluation unit 155 converts the volume into, for example, a score of 100 points based on the standard information in the storage unit 51, and evaluates the standard score that can be obtained by a healthy person to 100 points. Is compared with the standard information to evaluate the range of motion relative to the standard relative to the standard.

  Furthermore, the evaluation unit 155 may include, as an evaluation target, the time required for the specific part to perform a predetermined operation, for example, an operation in which the arm part as the specific part reciprocates once in the vertical direction. That is, the evaluation data may include data indicating the time required for the user 2 to perform a predetermined operation at the specific part. In other words, the distance from the initial position (for example, the tip position with the arm lowered) to a target position (for example, the position of the tip with the arm raised to the maximum) is divided by the movement time. The operation speed of the part can be obtained, and this operation speed can be used as an index of the degree of recovery. Therefore, the evaluation unit 155 evaluates that the movable range of the specific part is wider as the time is shorter, based on the time required for the specific part to perform the predetermined operation. In this case, the evaluation unit 155 converts the time into, for example, a score of 100 points based on the standard information in the storage unit 51, so that the standard score that can be obtained by a healthy person is 100 points. Is compared with the standard information to evaluate the range of motion relative to the standard relative to the standard.

  In addition, the evaluation unit 155 may include the trajectory (including both the two-dimensional space and the three-dimensional space) of the movement of the arm as the specific part in the evaluation target. That is, the evaluation data may include data indicating the locus of the specific part. In this case, the storage unit 51 stores a plurality of patterns of standard arm movement paths of healthy persons as standard information, and the evaluation unit 155 sets the deviation from the standard information to be evaluated to a score of 100 points, for example. Convert.

  The presenting unit 57B presents to the user 2 the evaluation result of the range of motion of the specific part made by the evaluating unit 155 in this way. That is, the presentation unit 57B is configured to present the result of evaluation by the evaluation unit (range of motion evaluation unit) 155. Specifically, the presentation unit 57B presents the evaluation result of the evaluation unit 155 to the user 2 by voice or light. Or it is set as the structure which displays the evaluation result of the evaluation part 155 on the display apparatus 3 by the instruction | indication from the image | video production | generation part 154, and the display apparatus 3 may be combined as the presentation part 57B. When the display device 3 is also used as the presentation unit 57B, a message 133 indicating the evaluation result is displayed on the display surface 30 as shown in FIG.

  The content presented by the presenting unit 57B may be only the evaluation result of the range of motion of the specific part, or in addition to the evaluation result, the height (distance), area, volume, time, trajectory, etc. that are the evaluation target The numerical value shown quantitatively may be included. For example, when the evaluation unit 155 gives a score according to the height of the arm of the user 2 from the floor by the balloon image 131 as described above, the presentation unit 57B presents only the acquired score. Alternatively, a numerical value indicating the height of the arm of the user 2 or the number of balloons that have been ruptured may be presented together.

  In addition, the presentation unit 57B may present the evaluation target and the evaluation criteria (standard information) used for the evaluation by the evaluation unit 155 together, or may present a deviation between the two. As a result, the user 2 can know not only the evaluation result but also the standard value of the evaluation object and the deviation from the standard value, which can be the target of future range of motion training.

  The exercise support system (range of motion training system) 1B according to the present embodiment described above includes the display device 3 that displays an image on the display surface 30 that is disposed in front of the user 2 and faces the user 2, and the operation of the user 2. A position detection unit 152 that detects the position of a specific part of the body of the user 2 that changes with the index, and an index setting unit 153 that sets an index at a position on the display surface 30 corresponding to at least a part of the position of the specific part. And an image generation unit 154 that generates a graphic image associated with the process and displays it on the display device 3 so as to execute a predetermined process when the positions of the indices overlap, and a specific part detected by the position detection unit 152 An evaluation unit 155 that evaluates a range of motion of a specific part by comparing an evaluation object obtained from a change in position with a predetermined evaluation criterion, and a presentation unit 57B that presents an evaluation result in the evaluation unit 155 are provided.

  That is, the exercise support system 1B includes a position detection unit 152 that detects the position of a specific part of the body of the user 2, and an index that determines the position of the index on the display surface 30 based on the position detected by the position detection unit 152. A setting unit 153, a determination unit 1541 that determines whether or not the index is positioned at a predetermined position on the display surface 30, and a determination unit 1541 that determines that the index is positioned at a predetermined position An event image display unit (display control unit) 52B that displays an event image, an evaluation data creation unit 1551 that creates evaluation data indicating a movable range of a specific part based on the position detected by the position detection unit 152, and an evaluation A range of motion evaluation unit 1552 that evaluates the range of motion of a specific part based on a comparison between the evaluation data created by the data creation unit 1551 and the reference data. Part 57B is configured to present the results of evaluation by the movable range evaluation unit 155.

  This exercise support system 1 </ b> B further includes a half mirror 6 that is disposed on the user 2 side with respect to the display surface 30 and transmits the image displayed on the display device 3. The index setting unit 153 is configured to set an index at a position that overlaps a mirror image of a specific part of the mirror image of the user 2 reflected on the half mirror 6 on the display surface 30. In other words, in the present embodiment, the mirror image display means is the half mirror 6 disposed on the front surface of the display device 3. The index setting unit 153 is configured to determine the position of the index so that the position of the index corresponds to the position of the display surface 30 that overlaps the specific part reflected on the half mirror 6.

  According to the exercise support system 1 </ b> B of the present embodiment described above, the evaluation result of the range of motion of the specific part of the body can be presented to the user 2. Further, according to the exercise support system 1B, the evaluation unit 155 evaluates the range of motion of the specific part by comparing the evaluation target obtained from the change in the position of the specific part with a predetermined evaluation standard, and the evaluation result is the presentation unit. Feedback is made to user 2 from 57B. Therefore, the user 2 can not only know the measurement result of the movable range of his / her specific part, but also understand what the measurement result means. That is, the user 2 can know not only the measurement result of how many centimeters the arm has raised, but also the number of points that the range of motion is evaluated out of 100 points. And fully understand the effects.

  Moreover, by aiming for a high score, the user 2 moves the specific part as much as possible within the range of motion without being particularly conscious, so the user 2 moves the body as if enjoying a game. Can enjoy the effect of sufficient range of motion training. In addition, when the specific part is an arm part, if the user 2 tilts the trunk, for example, the movable range of the arm part cannot be accurately evaluated. Therefore, a part other than the specific part (for example, the trunk) moves. In such a case, processing such as invalidating the evaluation may be performed.

  The exercise support system 1B further includes a standard storage unit 51 that stores standard information indicating a standard to be evaluated, and the evaluation unit 155 is configured to evaluate the range of motion using the standard information as an evaluation criterion. That is, the reference data is data indicating the range of motion of a standard specific part of a healthy person.

  That is, in this embodiment, the evaluation unit 155 uses the standard information indicating the evaluation target standard as an evaluation criterion and evaluates the range of motion of the specific region by comparing the evaluation object with the evaluation criterion. The range of motion can be evaluated relative to the standard range of motion. Therefore, in the user 2 whose range of motion is limited due to illness or injury, the range of motion training can be performed with the standard range of motion as a target.

  In the exercise support system 1B, the evaluation unit 155 includes the area of the region through which the specific part passes in the plane along the display surface 30 as the evaluation target. That is, the evaluation data includes data indicating the area of a region through which the specific part has passed in a plane parallel to the display surface 30.

  In the exercise support system 1B, the evaluation unit 155 includes the movable range of the specific part in one predetermined direction as an evaluation target. That is, the evaluation data includes data indicating the movable range of the specific part in the predetermined direction.

  That is, in the configuration in which the evaluation unit 155 evaluates the movable range of the specific part in a predetermined direction or the area of the moving region on the plane, it is not necessary to specify the position of the specific part three-dimensionally. Therefore, a two-dimensional camera such as a CCD (Charge Coupled Device) camera can be used in place of the distance image sensor 4, and there is an advantage that the processing speed of the position detection unit 152 is improved. Furthermore, if only a one-dimensional distance or the like is measured, an object detection sensor using a laser, an ultrasonic wave, or the like can be used instead of the distance image sensor 4.

  In the exercise support system 1B, the position detection unit 152 detects the position of the specific part in the three-dimensional space from the output of the three-dimensional sensor, and the evaluation unit 155 determines the volume of the region through which the specific part passes in the three-dimensional space. Is included in the evaluation target. That is, the position detection unit 152 is configured to detect the position of the specific part from the output of the three-dimensional sensor. The evaluation data includes data indicating the volume of the region through which the specific part has passed.

  In the exercise support system 1B, the evaluation unit 155 includes the locus of the specific part as an evaluation target. That is, the evaluation data includes data indicating the locus of the specific part.

  That is, in the configuration in which the evaluation unit 155 includes the volume or movement locus of the moving region of the specific part as the evaluation target, the movable range of the specific part of the user 2 including the movement in the front-rear direction can be evaluated in detail. .

  Further, in the exercise support system 1B, the evaluation unit 155 includes the time required for the specific part for a predetermined operation as an evaluation target. That is, the evaluation data includes data indicating the time required for the user 2 to perform a predetermined operation at the specific part.

  That is, in the configuration in which the evaluation unit 155 includes the time required for the specific part for the predetermined operation as an evaluation target, there is an advantage that it is possible to evaluate how smoothly the specific part moves.

  By the way, in this embodiment, although the memory | storage part 51 is used as a standard memory | storage part which memorize | stores the evaluation object standard (standard information), not only this structure but the log | history which memorize | stores the log | history of evaluation object as log | history information The storage unit 51 may be used as the storage unit. In the history information here, the comparison targets such as the height (distance), area, volume, time, and trajectory obtained from the change in the position of the specific part of the user 2 are collected in time series for each user 2. Information. That is, the exercise support system 1B may further include a history storage unit 51 that stores the history of the evaluation target as history information in time series, and the evaluation unit 155 may evaluate the range of motion using the history information as an evaluation criterion. In other words, the movable range evaluation unit (evaluation unit 155) may be configured to adopt the evaluation data used for the previous evaluation of the movable range of the specific part as the reference data.

  In this case, the evaluation unit 155 uses the history information stored in the storage unit 51 as an evaluation criterion, and evaluates the range of motion of the specific part by comparing the evaluation object with the evaluation criterion. That is, the evaluation unit 155 specifies the comparison target when the user 2 has performed the range-of-motion training in the past as an evaluation criterion and compares it with the evaluation target in the range-of-motion training currently performed by the user 2. Evaluate range of motion. Thereby, in the evaluation part 155, about the same user 2, it can evaluate how the movable range of the specific site | part changed compared with the past, and can evaluate the progress of a movable range training.

(Embodiment 4)
As shown in FIG. 16, the exercise support system (range of motion training system) 1C of the present embodiment is different from the exercise support system (range of motion training system) 1B of the third embodiment in that the half mirror 6 is not provided. In the exercise support system 1 </ b> C of the present embodiment, an imaging device 7 is provided that is disposed in front of the user 2 and has a lens oriented in a direction in which the user 2 is imaged from the front.

  Furthermore, the exercise support system 1C of the present embodiment is different from the exercise support system 1B of the third embodiment in a control device 5C. As illustrated in FIG. 16, the control device 5 </ b> C includes a storage unit 51, an acquisition unit 53, a first extraction unit (feature amount extraction unit) 54, a second extraction unit (reference amount extraction unit) 55, and an evaluation unit. In addition to the (posture evaluation unit) 56, the presentation unit 57B, the position detection unit 152, the index setting unit 153, the evaluation unit (second evaluation unit) 155, and the video generation unit 154, an inversion processing unit 58 is provided. I have.

  The video generation unit 154 includes a determination unit 1541 and a display control unit 52B. The display control unit 52 </ b> B functions as an inverted image display unit that displays the horizontally inverted image generated by the inversion processing unit 58 on the display surface 30.

  In the present embodiment, the index setting unit 153 is configured to determine the position of the index so that the position of the index corresponds to the position of the specific part in the horizontally reversed image.

  That is, the exercise support system (range of motion training system) 1C according to the present embodiment does not present a mirror image that is optically formed, and allows the user 2 to visually recognize and use the reverse video displayed on the display device 3. The person 2 can make the inverted image an illusion of his own mirror image.

  Further, the video generation unit 154 displays the graphic image 131 on the display device 3 together with the reverse video generated by the reverse processing unit 58. The index setting unit 153 sets the position of the index so that it overlaps the video of the specific part of the inverted video on the display surface 30. Here, since the specific part is the entire arm part and the index is set at a position corresponding to the position of the wrist which is a part of the arm part, the index setting unit 153 displays the arm in the reverse video on the display surface 30. An index is set at a position overlapping the video of the wrist of the department.

  As described above, the exercise support system 1 </ b> C of the present embodiment further includes the imaging device 7 that is disposed in front of the user 2 and captures an image of the user 2. The video generation unit 154 is configured to cause the display device 3 to display an inverted video obtained by horizontally inverting the user's video captured by the imaging device 7 together with a graphic image. The index setting unit 153 is configured to set an index at a position on the display surface 30 that overlaps the video of the specific part of the inverted video.

  That is, the mirror image display means of the exercise support system 1C of this embodiment captures the user 2 and generates an image of the user 2, and the image of the user 2 generated by the imaging device 7 is shifted left and right. An inversion processing unit 58 that generates a horizontally inverted image by inversion, and a display control unit (inverted image display unit) 52B that displays the horizontally inverted image generated by the inversion processing unit 58 on the display surface 30 are configured.

  According to the exercise support system 1C of the present embodiment described above, there is an advantage that the configuration can be simplified as compared with the exercise support system 1B of the third embodiment, as much as the half mirror 6 is omitted. In addition, in the configuration of the present embodiment, if a display having a relatively large screen is provided in advance, an existing display can be used as the display device 3 without newly installing a dedicated display. System introduction costs can be reduced.

  Other configurations and functions of the exercise support system 1C of the present embodiment are the same as those of the exercise support system 1B of the third embodiment.

(Embodiment 5)
The exercise support system 1D of the present embodiment has a side as a center-of-gravity movement training system. The center-of-gravity movement training system is used for training of a user's center-of-gravity movement.

  One of the important motor functions of humans is the function of shifting the center of gravity. For example, the function of shifting the center of gravity may be impaired in patients or elderly people who have a physical movement disorder due to illness or injury. . People who have insufficient function of center of gravity movement may not be able to move the center of gravity smoothly so that, for example, the weight is alternately applied to the left and right legs, which may interfere with basic exercise such as walking. . Therefore, center-of-gravity movement training for smoothly moving the center of gravity is widely adopted, for example, in the field of rehabilitation.

  On the other hand, it is equipped with a measuring device (balance detection device) that is placed at the user's feet and measures the load ratio in front, back, left, and right of the user, and displays an image showing the position of the user's center of gravity obtained from the output of the measuring device on the display device A system has been proposed (see, for example, Document 3 [Japan Published Patent Publication No. 2009-277195]). By using the system described in Literature 3, the user can learn the correct posture when the center of gravity is located at the center by correcting the posture so that the position of the center of gravity matches the target position.

  However, in the system described in Document 3, although the center of gravity position is fed back to the user, training to reduce the fluctuation of the center of gravity position from the correct posture can be performed, but smooth center of gravity movement necessary for walking and the like is given to the user. Training to learn is difficult. In other words, the system described in Document 3 can also display the movement locus of the center of gravity position, etc., but it is difficult to evaluate whether or not the center of gravity can be moved smoothly from the movement locus of the center of gravity, so that the smooth movement of the center of gravity is acquired. Is not enough to use for training.

  Therefore, it is preferable that the center-of-gravity movement training system can perform training for allowing the user to learn smooth center-of-gravity movement.

  The exercise support system 1D of the present embodiment is used as a center-of-gravity movement training system. The center-of-gravity movement training system is used for rehabilitation for smoothly moving the center of gravity of a patient whose function of center-of-gravity movement has declined due to illness or injury. However, the description of the following embodiment is not intended to limit the use of the center of gravity movement training system.For example, the center of gravity can be used for normal exercises, training for acquiring the sense of center of gravity movement necessary for various sports, etc. A mobile training system may be used.

  As shown in FIG. 17, the exercise support system (center of gravity movement training system) 1D of the present embodiment includes a display device 3 that is arranged in front of a user (patient) 2 and displays an image on a display surface 30, and a horizontal plane. A measuring device 8 for measuring the load distribution of the user 2 and a control device 5D for controlling the operation of the display device 3 and the like are provided. Both the display device 3 and the measuring device 8 are connected to the control device 5D. Further, the exercise support system 1D of the present embodiment includes a half mirror 6 that is a mirror image display means.

  The measuring device 8 is disposed on the floor in front of the half mirror 6 and at the feet of the user 2. The measuring device 8 includes a boarding board 80 on which the user 2 is boarded, and a load sensor (not shown) that measures a load applied to each of the left and right legs of the user 2 on the boarding board 80. Yes. At least one load sensor is provided corresponding to each of the right leg side boarding base 80 and the left leg side boarding base 80. That is, the measuring device 8 has a working surface that receives a load from the user, and is configured to measure a load distribution on the working surface. In the present embodiment, the action surface is the upper surface of the boarding base 80.

  In the present embodiment, the measuring device 8 measures the load distribution in the horizontal plane of the user 2 standing on the boarding table 80 by measuring the load with each load sensor. In other words, the measuring device 8 measures the load applied to the left region and the load applied to the right region with respect to the center line in the left-right direction of the boarding base 80, respectively, and the load applied to each of the left leg and the left leg is measured. Measure distribution in real time.

  Thus, the measuring device 8 measures the load distribution of the user 2 in the horizontal plane in real time, and outputs the measurement result to the control device 5D. The measurement result of the measurement device 8 output to the control device 5D may be a value representing the load distribution of the user 2 in the horizontal plane. In the present embodiment, the measurement device 8 detects the left leg and the right of the user 2. The load applied to each of the legs is output to the control device 5D.

  Here, the measuring device 8 may be configured to measure a load applied to only one of the left leg and the right leg of the user 2 by a load sensor. In other words, if the weight of the user 2 is given in advance as a known value, the measuring device 8 measures the load on the left leg, for example, thereby calculating the distribution of the load on the user 2 from the ratio of the load to the weight. Can be requested.

  By the way, exercise support system 1D of this embodiment has calculation part 251 which calculates the balance value showing the ratio of the load of right and left of user 2 based on the measurement result of measuring device 8 in control device 5D. Further, the control device 5D generates an index image 252 for generating an index image indicating a change in the balance value accompanying the movement of the center of gravity of the user 2, and an exemplary image indicating a periodic change in the balance value serving as an example of the center of gravity movement. It has a model generation unit 253 to generate, and a storage unit 254 in which various setting values and the like are stored. The index generation unit 252 and the model generation unit 253 cause the display device 3 to display the generated index video and model video, respectively.

  In the present embodiment, as illustrated in FIG. 18, the control device 5D includes a first extraction unit (feature amount extraction unit) 54, a second extraction unit (reference amount extraction unit) 55, an evaluation unit 56, and a presentation unit. 57D, storage unit 51, display control unit 52D, calculation unit 251, storage unit (second storage unit) 254, balance value display unit 2521, target value display unit 2531, and center of gravity movement evaluation unit 255 . In addition, when using exercise support system 1D only as a gravity center movement training system, the 1st extraction part 54, the 2nd extraction part 55, and the evaluation part (posture evaluation part) 56 do not necessarily need to be provided.

  The calculation unit 251 is configured to calculate a balance value that represents the ratio of the load at a predetermined location in the working surface based on the distribution of the load measured by the measurement device 8. For example, the calculation unit 251 determines, based on the measurement result of the measurement device 8, the load applied to the left side region (the load applied to the left leg) and the load applied to the right region (applied to the right leg) from the center line in the horizontal direction of the boarding base 80. A balance value representing a ratio to (load) is calculated in real time. Specifically, the calculation unit 251 calculates the ratio of the left and right loads based on the sum (that is, the weight of the user 2) based on the loads applied to the left leg and the right leg of the user 2 respectively. The balance value is calculated in real time.

  The second storage unit 254 includes a balance value storage unit 2541 and a setting data storage unit 2542. The balance value storage unit 2541 is configured to store the balance value calculated by the calculation unit 251. The setting data storage unit 2542 is configured to store setting data indicating a temporal change in the target value of the balance value. The setting data is defined by, for example, a sine wave having a predetermined period. The setting data includes a period and an amplitude value as values defining the sine wave. The setting data includes an exercise time that defines the length of the sine wave. In the present embodiment, the amplitude value is represented by exercise intensity. The exercise intensity indicates a ratio (percentage) of an amplitude value with respect to a preset reference value. That is, if the exercise intensity is 50%, the amplitude value is half of the reference value.

  For example, in the case of a user 2 having a weight of 50 kg, if the load applied to the left leg is 30 kg and the load applied to the right leg is 20 kg, the calculation unit 251 calculates the left = 60% (= 0.6) and the right = 40. A balance value of% (= 0.4) is calculated. The sum of the ratio of the load applied to the left leg and the ratio of the load applied to the right leg indicated by the balance value is always 100% (= 1).

  The index generation unit 252 generates an index video based on the balance value calculated by the calculation unit 251 and causes the display device 3 to display the index video. In the present embodiment, the index generation unit 252 includes a balance value display unit 2521 and a display control unit 52D. The balance value display unit 2521 is configured to display the balance value calculated by the calculation unit 251 on the display surface 30. In the present embodiment, the balance value display unit 2521 generates an index video (index image) based on the balance value, and controls the display control unit 52D so that the index video is displayed on the display surface 30.

  On the other hand, the model generation unit 253 generates a model video according to the setting value stored in the storage unit 254 and causes the display device 3 to display the model video. In the present embodiment, the model generation unit 253 includes a target value display unit 2531 and a display control unit 52D. The target value display unit 2531 is configured to display the target value on the display surface 30 based on the setting data stored in the setting data storage unit 2542. In the present embodiment, the target value display unit 2521 generates a model video (model image) based on the target value (set value), and controls the display control unit 52D so that the model video is displayed on the display surface 30. .

  The index image and the model image here are both moving image images representing the balance value in real time. In this embodiment, as illustrated in FIG. 19, the ratio of the load applied to the left leg and the load applied to the right leg. It is the image | video of the bar graph which represents the ratio of and with height. In the example of FIG. 19, four bar graphs are displayed side by side in the left-right direction of the display surface 30, of which the two outer bar graphs are index images 231 and the two inner graphs are model images 232. . Here, for example, the bar graph of the index video 231 is displayed in white and the bar graph of the model video 232 is displayed in orange so that the user 2 can easily distinguish the index video 231 and the model video 232.

  That is, the index image 231 and the model image 232 include a pair of bar graphs corresponding to the left leg and the right leg, respectively, and 100% depending on the height of the bar graph displayed in the vertically long rectangular frame. The upper limit indicates the ratio of the load applied to the left and right legs to the total weight. In the present embodiment, the bar graph displayed at the left end of the display surface 30 corresponds to the left leg, and the bar graph displayed at the right end corresponds to the right leg, and the index image 231 and the model image 232 indicate the load applied to the left and right legs. The percentage is reflected in the height of each bar graph in 1% increments.

  Therefore, for example, when the user 2 moves the center of gravity so that the center of gravity moves from the left leg to the right leg, the bar graph corresponding to the left leg gradually decreases in the index image 231 as the center of gravity moves. The bar graph to be changed gradually increases. On the other hand, the model image 232 is a balance that serves as an example of the movement of the center of gravity of the user 2 by changing so that the left and right bar graphs alternately become higher at a predetermined cycle regardless of the movement of the user 2. Represents a periodic change in value.

  In the storage unit 254 (setting data storage unit 2542), a cycle, exercise intensity, and exercise time are stored in advance as set values for determining the movement of the model video 232. The period here represents the period of change of the balance value, the exercise intensity represents the maximum value of the load applied to the left and right legs (that is, the maximum value of the bar graph), and the exercise time represents the user 2 It represents the time to exercise. These set values are arbitrarily set from the outside using an input interface (keyboard or the like) serving as an input unit of the control device 5D, and stored in the storage unit 254 in advance. Here, the exercise intensity may be set to different values for the left leg and the right leg.

  The model generation unit 253 generates a model video 232 showing a pattern of change in the balance value determined by the period and exercise intensity stored in the storage unit 254, and displays the model video 232 over the exercise time. 3 is displayed. In the present embodiment, the model generation unit 253 generates a model video 232 that changes in a pattern such that the temporal change in the height of the bar graph is a sine wave.

  In the example of FIG. 19, the exercise intensity 233, the period (frequency) 234, and the exercise time 235 are displayed above the index video 231 and the model video 232 on the display surface 30, respectively, and the remaining time 236 is the index video 231 and the model video. It is displayed below 232. The remaining time here is the time obtained by subtracting the elapsed time from the exercise time. By displaying these pieces of information, the user 2 can quantitatively recognize the movement pattern indicated by the change in the bar graph in the model video 232.

  As described above, the index video 231 and the model video 232 are displayed on the display device 3, so that the user 2 can follow the movement of the bar graph in the model video 232 with the index video 231. The center of gravity can be moved to change the ratio of the load applied to each leg. That is, the user 2 can move the center of gravity so as to change the ratio of the load applied to the left and right legs in accordance with the movement of the bar graph in the model video 232. Here, when the balance value calculated by the calculation unit 251 falls within a predetermined allowable range (for example, ± 3%) centered on the balance value represented by the model video 232, the model generation unit 253 changes the display color of the bar graph, for example. You may make it notify to the user 2 by making it change.

  By the way, the exercise support 1D according to the present embodiment includes an evaluation unit (center-of-gravity movement evaluation unit) 255 that evaluates a shift in timing at which the balance value changes between the model image 232 and the index image 231, and an evaluation result of the evaluation unit 255. Is further provided in the control device 5D.

  The center-of-gravity movement evaluation unit 255 obtains a temporal change in the balance value from the balance value stored in the balance value storage unit 2541 and uses it based on the temporal change in the balance value and the temporal change in the target value indicated by the setting data. It is configured to evaluate the movement of the center of gravity of the person 2. That is, the evaluation unit (gravity center movement evaluation) 255 includes an index image 231 that shows a change in the balance value associated with the user 2's movement of the center of gravity, and an exemplary image 232 that shows a periodic change in the balance value that serves as an example of the movement of the center of gravity. In contrast, the timing deviation of the change in the balance value is evaluated between the two. This evaluation result represents the followability of the center of gravity movement of the actual user 2 indicated by the index image 231 with respect to the exemplary center of gravity movement indicated by the example image 232. The smaller the deviation, the higher the followability. Represents.

  More specifically, the evaluation unit 255 determines the value indicated by the model video 232 and the index video 231 with respect to the ratio of the load applied to one leg (for example, the right leg) in the predetermined sampling period (for example, 100 msec). The difference from the value indicated by is calculated. The difference calculated in this way is assigned a score corresponding to its size in advance, and the evaluation unit 255 adds the score corresponding to the difference every time the difference is calculated, and finally The total score obtained in is taken as the evaluation score. The evaluation points obtained in this way are assigned such that the smaller the difference (that is, the smaller the deviation), the higher the score.

  In short, in the present embodiment, the evaluation unit 255 includes a difference in the balance value at the same timing between the model video 232 and the index video 231 as an evaluation target, and evaluates a deviation between the model video 232 and the index video 231. That is, the center-of-gravity movement evaluation unit 255 is configured to evaluate the center-of-gravity movement using the difference between the balance value and the target value at a predetermined time point. As a result, the evaluation unit 255, for example, in the case of the model image 232 and the index image 231 only matches the balance value change timing, but the magnitude of the balance value is shifted. Deviation can also be evaluated. As a result, the evaluation unit 255 has an advantage that it is possible to strictly evaluate a deviation between the exemplary center of gravity movement indicated by the exemplary image 232 and the actual center of gravity movement of the user 2 indicated by the index image 231. is there.

  However, the evaluation method performed by the evaluation unit 255 is not limited to the method described above, and may be any method that can evaluate a shift in timing at which the balance value changes between the model image 232 and the index image 231. For example, the evaluation unit 255 may obtain an evaluation score by obtaining a cumulative total of differences calculated for each predetermined sampling period and converting the obtained cumulative value into a score.

  Further, even when the difference between the balance values at the same timing is not included in the evaluation target, the evaluation unit 255 can evaluate a shift in timing at which the balance value changes between the model image 232 and the index image 231. That is, the evaluation unit 255 extracts, for example, a local maximum point (or local minimum point) of the ratio of the total weight of the load applied to one leg (for example, the right leg) from each of the model image 232 and the index image 231, and the time axis It can be evaluated by quantifying the deviation of the maximum point (or minimum point) in the direction.

  The presentation unit 57D is configured to present the result of evaluation by the gravity center movement evaluation unit 255. For example, the presentation unit 57D presents to the user 2 the evaluation result of the timing shift between the model video 232 and the index video 231 performed by the evaluation unit 255. Specifically, the presentation unit 57D presents the evaluation result of the evaluation unit 255 to the user 2 by voice or light. Or it is set as the structure which displays the evaluation result of the evaluation part 255 on the display apparatus 3, and the display apparatus 3 may be combined as presentation part 57D. When the display device 3 is also used as the presentation unit 57D, it is conceivable that a message indicating the evaluation result is displayed on the display surface 30 after the training time ends.

  The content presented by the presenting unit 57D may be an evaluation score that represents the degree of deviation numerically and quantitatively, or may be a result of ranking the evaluation score in a plurality of stages. For example, when the evaluation unit 255 determines a tendency of deviation such as a large deviation when moving the center of gravity to the right leg side, the presentation unit 57D may present advice according to the determination result. .

  Next, an example will be described in which the user 2 performs training for center of gravity movement using the exercise support system (center of gravity movement training system) 1D described above.

  When a predetermined operation for starting training is performed on the input interface, the control device 5D starts measuring the exercise time with a timer (not shown), and displays the index image 231 and the model image 232 on the display device 3. To display. The user 2 can perform a correct movement of the center of gravity by moving the center of gravity so that the movement of the bar graph of the index video 231 matches the model video 232 while watching the index video 231 and the model video 232. .

  When the exercise time ends, the control device 5D ends the display of the index video 231 and the model video 232, and evaluates the timing shift between the model video 232 and the index video 231 by the evaluation unit 255, and displays it to the presentation unit 57D. To present the evaluation result to the user 2. In this state, when a predetermined operation for starting training is performed on the input interface, the control device 5D starts counting the exercise time again and causes the display device 3 to display the index image 231 and the model image 232. .

  As described above, the exercise support system (center of gravity movement training system) 1D of the present embodiment includes the display device 3 that displays an image on the display surface 30, the control device 5D that displays an image on the display device 3, and the display surface. 30 and a measuring device 8 that is disposed at the feet of the user 2 facing the user 30 and measures the load distribution of the user 2 in a horizontal plane. The control device 5D calculates a balance value that represents a ratio of the left and right or front and rear loads of the user 2 based on the measurement result of the measurement device 8, and changes in the balance value accompanying the movement of the center of gravity of the user 2. An index generation unit 252 that generates an index video to be displayed and displays the index video on the display device 3; an exemplary model generation unit 253 that generates an exemplary video indicating a periodic change in a balance value that is an exemplary center of gravity movement and displays the exemplary video on the display device 3; An evaluation unit 255 that evaluates a shift in timing at which the balance value changes between the model image and the index image, and a presentation unit 57D that presents the evaluation result of the evaluation unit 255 are provided.

  In other words, the exercise support system 1D is measured by the measuring device 8 that has a working surface (the upper surface of the boarding base 80) that receives a load from the user 2 and that measures the load distribution on the working surface, and the measuring device 8. A calculation unit 251 that calculates a balance value that represents a load ratio at a predetermined location in the working surface based on the distribution of the load, a balance value storage unit 2541 that stores the balance value calculated by the calculation unit 251, and a calculation unit 251 Stored in the setting data storage unit 2542 and a setting data storage unit 2542 that stores setting data indicating temporal changes in the target value of the balance value. A target value display unit 2531 for displaying a target value on the display surface 30 based on the set data and a balance value stored in the balance value storage unit 2541 Seek time change comprises a center-of-gravity movement evaluation unit 255 for evaluating a movement of the center of gravity of the user 2 on the basis of the temporal change of the target value indicated by the temporal change settings and the actual balance value. The presentation unit 57D is configured to present the result of evaluation by the gravity center movement evaluation unit 255.

  According to the center-of-gravity movement training system 1D having the above-described configuration, the user 2 learns the correct center-of-gravity movement exemplified in the example video 232 by moving the center of gravity so that the index video 231 is aligned with the model video 232. can do. Here, training the user 2 so that the center of gravity can be moved in accordance with the periodically changing center of gravity position is directly related to learning smooth center of gravity movement. Therefore, the user 2 can perform training for learning smooth center-of-gravity movement necessary for walking or the like only by moving his / her body as if he / she is enjoying a game. That is, according to the exercise support system 1D of the present embodiment, it is possible to train the user 2 to learn smooth center of gravity movement. By performing such training, the user 2 is also trained in instantaneous power, leading to prevention of falls during walking.

  In this exercise support system 1D, the evaluation unit 255 includes, as an evaluation target, a difference in balance value at the same timing between the model video and the index video. In other words, the evaluation unit (center of gravity movement evaluation unit) 255 is configured to evaluate the center of gravity movement using the difference between the balance value and the target value at a predetermined time point.

  Therefore, according to the exercise support system 1D of the present embodiment, the evaluation unit 255 determines the actual user for the exemplary center-of-gravity movement indicated by the exemplary image 232 from the timing difference between the exemplary image 232 and the index image 231. 2 is evaluated, and the evaluation result is fed back to the user 2 from the presentation unit 57D. Therefore, the user 2 can fully understand the necessity and effect of the center-of-gravity movement training based on the evaluation result of whether or not he / she can move the center of gravity smoothly.

  The exercise support system 1D of the present embodiment further includes a half mirror 6 that is disposed on the user 2 side with respect to the display surface 30 and transmits a video displayed on the display surface 30 and reflects a mirror image of the user 2. That is, the exercise support system 1D of the present embodiment includes the half mirror 6 disposed in front of the display surface 30 as a mirror image display unit.

  Therefore, in the exercise support system 1D of the present embodiment, the user 2 can exercise while looking at the mirror image of the user reflected in the half mirror 6, so that the center of gravity moves when the user is in any posture. You can learn visually what to do. Therefore, the user 2 can learn the movement of the body necessary for moving the center of gravity, such as how to tilt the body when applying a load to the right leg, for example, during training. There are advantages. Furthermore, the user 2 can not only visually understand the movement of the center of gravity, but also can perform training to move the center of gravity while confirming his / her posture. For example, the user 2 can perform training to move the center of gravity while checking the inclination of the body. In addition, the user 2 can perform training to move the center of gravity while keeping the line connecting both shoulders horizontal.

  In the exercise support system (center of gravity movement training system) 1D of the present embodiment, the control device 5D includes a storage unit (setting data storage unit) 2542 that stores setting values for determining the movement of the model image, and a storage unit 2542. And a setting update unit 256 that changes the set value in accordance with the evaluation result of the evaluation unit 255. That is, the control device 5 </ b> D includes a setting update unit 256 that changes the temporal change of the target value indicated by the setting data stored in the setting data storage unit 2542 according to the evaluation result by the gravity center movement evaluation unit 255.

  In this configuration, the model generation unit 253 changes the content of the model video 232 according to the evaluation result of the evaluation unit 255.

  That is, when high evaluation is obtained by the evaluation unit 255 (when the deviation is small), the setting update unit 256 shortens the cycle of the set value in order to increase the difficulty of the center of gravity movement indicated by the model video 232, Increase exercise intensity. For example, if the deviation is equal to or less than a predetermined first threshold value, the setting update unit 256 decreases the cycle by a predetermined value or increases the exercise intensity by a predetermined value. On the other hand, when a low evaluation is obtained by the evaluation unit 255 (when the deviation is large), the setting update unit 256 increases the period of the set value in order to reduce the difficulty of the center of gravity movement indicated by the model video 232, Reduce exercise intensity. For example, if the deviation is greater than or equal to a predetermined second threshold value that is greater than the first threshold value, the setting update unit 256 increases the cycle by a predetermined value or decreases the exercise intensity by a predetermined value.

  As a result, the exercise support system (center-of-gravity movement training system) 1D can allow the user 2 to receive training with a degree of difficulty that matches the ability of the user 2 to move the center of gravity, and places an excessive burden on the user 2. It is possible to make appropriate exercises without any problems.

  In the present embodiment, the bar graph image is exemplified as the index image 231 and the model image 232. However, the present invention is not limited to this example. For example, the image of the needle rotating so as to swing left and right from the reference position pointing directly above. It may be.

(Embodiment 6)
The exercise support system (center of gravity movement training system) 1E of the present embodiment is different from the exercise support system (center of gravity movement training system) 1D of the fifth embodiment in that the half mirror 6 is not provided. Further, in the exercise support system 1E of the present embodiment, an imaging device 7 is provided that is disposed in front of the user 2 and has a lens directed in a direction in which the user 2 is imaged from the front.

  Furthermore, the exercise support system 1E of the present embodiment is different from the exercise support system 1D of the fifth embodiment in a control device 5E. As shown in FIG. 20, the control device 5E includes a first extraction unit (feature amount extraction unit) 54, a second extraction unit (reference amount extraction unit) 55, an evaluation unit 56, a presentation unit 57D, and a storage unit. 51, a display control unit 52D, a calculation unit 251, a storage unit (second storage unit) 254, a balance value display unit 2521, a target value display unit 2531, and a centroid movement evaluation unit 255. Unit 53 and an inversion processing unit 58.

  The display control unit 52D functions as an inverted image display unit that displays the horizontally inverted image generated by the inversion processing unit 58 on the display surface 30.

  That is, the exercise support system 1E according to the present embodiment does not present a mirror image that is optically formed, allows the user 2 to visually recognize the reverse video displayed on the display device 3, and The reverse video can be illusioned with its own mirror image. Therefore, according to the exercise support system 1E of the present embodiment, the same effect as when the half mirror 6 is provided can be obtained.

  Further, the index generation unit 252 and the model generation unit 253 cause the display device 3 to display the index video 231 and the model video 232 together with the reverse video generated by the reverse processing unit 58. The inverted video may be displayed so as to overlap with the index video 231 and the model video 232, but in this case, the inverted video is preferably displayed as a semi-transparent video (for example, a transmittance of 50%).

  As described above, the mirror image display means of the exercise support system 1E of the present embodiment captures the user 2 and generates the image of the user 2, and the user 2 generated by the imaging device 7. And a display control 52D for displaying the horizontally inverted image generated by the inversion processing unit 58 on the display surface 30.

  According to the exercise support system 1E of the present embodiment described above, there is an advantage that the configuration can be simplified compared to the exercise support system 1D of the fifth embodiment by the amount that the half mirror 6 is omitted. In addition, in the configuration of the present embodiment, if a display having a relatively large screen is provided in advance, an existing display can be used as the display device 3 without newly installing a dedicated display. System introduction costs can be reduced.

  In addition, since the gravity center movement of the user 2 is presented to the user 2 in the index image 231, it is not essential that the user 2 can exercise while looking at his / her own image (mirror image), and an inverted image is displayed. The function may be omitted.

  Other configurations and functions of the exercise support system 1E of the present embodiment are the same as those of the exercise support system 1D of the fifth embodiment.

  By the way, in each said Embodiment 5, 6, the calculation part 251 calculates | requires the ratio of the user's 2 right and left load as a balance value, and the evaluation part 255 also evaluates the deviation | shift of a gravity center movement based on this balance value. However, the present invention is not limited to this example, and the balance value may be a ratio of loads before and after the user 2. In this case, the exercise support system (center-of-gravity movement training system) 1E can be used for training for center-of-gravity movement that alternately moves the center-of-gravity position in the front-rear direction.

Claims (29)

A display device having a display surface for displaying an image to a user;
A comparison image storage unit that stores a comparison image that is an image of an exerciser performing a predetermined exercise;
A comparative image display unit that displays the comparative image stored in the comparative image storage unit on the display surface;
Mirror image display means for displaying a mirror image of the user superimposed on the comparison image;
A feature amount extraction unit that detects a position of a predetermined sample point on the user's body and obtains a feature amount representing the posture of the user based on the position of the sample point;
A posture evaluation unit that compares the feature amount obtained by the feature amount extraction unit with a reference amount that represents the posture of the exerciser and evaluates a deviation of the posture of the user from the posture of the exerciser;
A presentation unit for presenting a result of the evaluation by the posture evaluation unit;
An exercise support system characterized by comprising: The exercise support system according to claim 1, wherein the mirror image display means is a half mirror disposed on the front surface of the display device. The mirror image display means includes
An imaging device that shoots the user and generates an image of the user;
An inversion processing unit for generating a horizontally inverted image by horizontally inverting the image of the user generated by the imaging device;
An inverted image display unit for displaying the horizontally inverted image generated by the inversion processing unit on the display surface;
The exercise support system according to claim 1, further comprising: The exercise support system according to claim 1, wherein the predetermined exercise is an exercise that serves as an example of an exercise performed by the user. An imaging device that shoots the user performing the predetermined exercise and generates a recorded image that is an image of the user performing the predetermined exercise;
A reference amount extraction unit;
With
The comparative image display unit is configured to display the recorded image generated by the imaging device on the display surface as the comparative image,
The reference amount extraction unit detects a position of the predetermined sample point on the user's body from the recorded image, and obtains a feature amount representing the posture of the user as the reference amount based on the position of the sample point. It is comprised as follows. The exercise | movement assistance system of any one of Claims 1-3 characterized by the above-mentioned. The feature amount extraction unit detects the positions of the plurality of sample points in the user's body, creates a body model indicating the user's body based on the positions of the plurality of sample points, and the body model It is comprised so that the said feature-value may be calculated | required based on. The exercise | movement assistance system of any one of Claims 1-5 characterized by the above-mentioned. The exercise support system according to claim 6, wherein the feature amount is an angle between a straight line connecting the two sample points selected from the plurality of sample points and a predetermined reference line. The exercise support system according to claim 1, wherein the feature amount is an inclination of the user's body. The inclination of the user's body is the inclination of the user's shoulder,
The feature amount extraction unit detects a position of a sample point of the upper right limb of the user and a sample point of the left upper limb, and a straight line and a horizontal line connecting the sample point of the upper right limb and the sample point of the left upper limb The exercise support system according to claim 8, wherein the angle is calculated as an inclination of the shoulder of the user. The inclination of the user's body is the inclination of the trunk of the user,
The feature amount extraction unit detects the position of the sample point of the user's head and the sample point of the waist, and a straight line and a vertical line connecting the sample point of the head and the sample point of the waist The exercise support system according to claim 8, wherein the angle is defined as an inclination of the trunk of the user. The exercise support system according to claim 1, wherein the feature amount is a range of motion of a specific part of the user's body. The specific part is an upper limb of the user,
The feature amount extraction unit detects a position of the sample point of the upper limb of the user and a sample point of the shoulder corresponding to the upper limb, and connects the sample point of the upper limb and the sample point of the shoulder The exercise support system according to claim 11, wherein the angle is defined as a range of motion of the upper limb. The number of the sample points is at least 3 or more,
The exercise support system according to claim 6, wherein the feature amount is an area of a region defined by the plurality of sample points. The said comparative image display part is comprised so that the position and magnitude | size of the said comparative image on the said display surface may be adjusted so that the said comparative image may overlap with the mirror image of the said user. The exercise support system according to any one of 13. The posture evaluation unit is configured to obtain a numerical value indicating a difference between the feature amount and the reference amount,
The exercise support system according to claim 1, wherein the presenting unit is configured to present the numerical value obtained by the posture evaluating unit. A position detector for detecting the position of a specific part of the user's body;
An index setting unit that determines the position of the index on the display surface based on the position detected by the position detection unit;
A determination unit for determining whether or not the index is located at a predetermined position on the display surface;
When the determination unit determines that the index is located at the predetermined position, an event image display unit that displays a predetermined event image at the predetermined position;
Based on the position detected by the position detection unit, an evaluation data creation unit that creates evaluation data indicating a movable range of the specific part;
Based on a comparison between the evaluation data created by the evaluation data creation unit and reference data, a movable range evaluation unit that performs a movable range evaluation of the specific part, and
The exercise support system according to claim 1, wherein the presentation unit is configured to present a result of the evaluation by the range of motion evaluation unit. The exercise support system according to claim 16, wherein the range of motion evaluation unit is configured to employ the evaluation data used for the previous evaluation of the range of motion of the specific part as the reference data. . The exercise support system according to claim 16, wherein the reference data is data indicating a range of motion of the normal specific part of a healthy person. The exercise support system according to any one of claims 16 to 18, wherein the evaluation data includes data indicating an area of a region through which the specific part has passed in a plane parallel to the display surface. The exercise support system according to any one of claims 16 to 19, wherein the evaluation data includes data indicating a movable range of the specific part in a predetermined direction. The exercise support system according to any one of claims 16 to 20, wherein the evaluation data includes data indicating a time required for the user to perform a predetermined action at the specific part. The position detection unit is configured to detect the position of the specific part from the output of a three-dimensional sensor,
The exercise support system according to any one of claims 16 to 21, wherein the evaluation data includes data indicating a volume of a region through which the specific part has passed. The exercise support system according to any one of claims 16 to 22, wherein the evaluation data includes data indicating a locus of the specific part. The mirror image display means is a half mirror disposed on the front surface of the display device,
The index setting unit is configured to determine the position of the index so that the position of the index corresponds to the position of the display surface that overlaps the specific part reflected on the half mirror. The exercise support system according to any one of claims 16 to 23. The mirror image display means includes
An imaging device that shoots the user and generates an image of the user;
An inversion processing unit for generating a horizontally inverted image by horizontally inverting the image of the user generated by the imaging device;
An inverted image display unit for displaying the horizontally inverted image generated by the inversion processing unit on the display surface;
With
24. The index setting unit is configured to determine the position of the index so that the position of the index corresponds to the position of the specific part in the horizontally reversed image. The exercise support system according to any one of the above. A measuring device having a working surface for receiving a load from the user and measuring the distribution of the load on the working surface;
A calculation unit that calculates a balance value representing a ratio of a load at a predetermined location in the working surface based on the distribution of the load measured by the measuring device;
A balance value storage unit for storing the balance value calculated by the calculation unit;
A balance value display unit for displaying the balance value calculated by the calculation unit on the display surface;
A setting data storage unit that stores setting data indicating temporal changes in the target value of the balance value;
A target value display unit for displaying the target value on the display surface based on the setting data stored in the setting data storage unit;
A temporal change of the balance value is obtained from the balance value stored in the balance value storage unit, and the user is based on the temporal change of the balance value and the temporal change of the target value indicated by the setting data. A center-of-gravity movement evaluation unit that evaluates the movement of the center of gravity of
With
The exercise support system according to claim 1, wherein the presentation unit is configured to present a result of the evaluation by the gravity center movement evaluation unit. 27. The exercise support system according to claim 26, wherein the center-of-gravity movement evaluation unit is configured to evaluate the center-of-gravity movement using a difference between the balance value and the target value at a predetermined time point. 27. A setting update unit that changes a temporal change of the target value indicated by the setting data stored in the setting data storage unit according to a result of the evaluation by the gravity center movement evaluation unit. Or the exercise support system of 27. The exercise support system according to any one of claims 26 to 28, wherein the mirror image display means is a half mirror disposed in front of the display surface.

Images