JP2021006194A - Exercise system and exercise application - Google Patents

Abstract

To provide an exercise system capable of making a user do more efficient exercise, and an exercise application.SOLUTION: When a user does exercise, an exercise system 1 displays a sample motion image that indicates a sample exercise motion to the user, and displays the user's motion image that indicates a motion image capturing the user's motion. The sample motion image and the user's motion image are displayed on one liquid crystal screen 61 of a portable terminal 6.SELECTED DRAWING: Figure 1

Description

The present invention relates to an exercise system and an exercise application that support exercise for rehabilitation and the like at a facility or at home.

With the aging of society, the population of elderly people is increasing, and the number of elderly people who need long-term care is also increasing. When an elderly person is in a state generally called "bedridden", it puts a heavy burden not only on the elderly person but also on the caregiver.

For the purpose of living a better life for persons with physical and mental disabilities caused by various causes such as illness and aging phenomenon, for example, rehabilitation (hereinafter also referred to as "rehabilitation") specialists, rehabilitation nurses, physiotherapists, Coordinated support is provided by a number of rehabilitation specialists such as occupational therapists, clinical psychologists and social workers.

In recent years, it has been pointed out that the number of caregivers who support rehabilitation is significantly insufficient, and there is a demand for rehabilitation support devices that can perform safe and efficient rehabilitation.

For example, in Patent Document 1, motion support is displayed in which the motion motion indicated by the sample video content is displayed on the first display section and the motion image captured by the user's motion is displayed on the second display section independent of the first display section. The device is disclosed. In the exercise using this exercise support device, the user performs fitness exercise by imitating this movement while observing the movement movement of the sample of the first display unit of the exercise support device.

JP-A-2009-213782

In the device described in Patent Document 1, since the first display unit that displays the motion motion as a sample and the second display unit that displays the motion image captured by the user's motion are separated from each other, the user becomes a sample. There was a problem that it was difficult to see the motion motion and the motion image captured by one's own motion at the same time, it was difficult to imitate the sample motion motion well, and the exercise (exercise) was troublesome. ..

An object of the present invention is to provide an exercise system and an exercise application that can make a user perform more efficient exercise.

The exercise system of the invention according to claim 1 displays a sample moving image showing a sample exercise operation for the user when the user exercises, and also displays a moving image that captures the movement of the user. It is an exercise system that displays the user moving image to be shown, and is characterized in that the sample moving image and the user moving image are displayed on one screen.

The exercise system of the invention according to claim 2 displays a sample moving image showing a sample exercise operation to the user when the user exercises, and also displays a moving image of the user's movement. It is an exercise system for displaying a user moving image to be shown, and is characterized in that the sample moving image and the user moving image are displayed in an overlapping manner.

The exercise system of the invention according to claim 3 displays a sample moving image showing a sample exercise operation for the user when the user exercises, and also displays a moving image of the user's movement. It is an exercise system for displaying a user moving image to be shown, and is characterized in that the sample moving image and the user moving image are overlapped and displayed in a partially shifted state.

The exercise application of the invention according to claim 4 displays a sample moving image showing a sample exercise operation for the user when the user exercises, and captures the movement of the user. It is an exercise application for displaying a user moving image showing a moving image on the mobile terminal, and is characterized in that the sample moving image and the user moving image are displayed on the mobile terminal on one screen.

The exercise application of the invention according to claim 5 displays a sample moving image showing a sample exercise operation for the user when the user exercises, and captures the movement of the user. It is an exercise application for displaying a user moving image showing a moving image on the mobile terminal, and is characterized in that the sample moving image and the user moving image are superimposed and displayed on the mobile terminal on one screen.

The exercise application of the invention according to claim 6 displays a sample moving image showing a sample exercise operation for the user when the user exercises, and captures the movement of the user. It is an exercise application that displays a user moving image showing a moving image on the mobile terminal, and displays the sample moving image and the user moving image on the mobile terminal on one screen by superimposing them in a partially shifted state. It is characterized by that.

The exercise system and the exercise app in the present invention have made it possible for the user to perform more efficient exercise.

It is a figure which shows the whole structure of the exercise system which concerns on 1st Embodiment of this invention. It is explanatory drawing which shows the home screen of the exercise application which concerns on 1st Embodiment of this invention. It is explanatory drawing which shows the sample moving image selection screen of the exercise application which concerns on 1st Embodiment of this invention. It is explanatory drawing which shows 1st to 3rd examples of the exercise execution screen of the exercise system which concerns on 1st Embodiment of this invention. It is explanatory drawing which shows the 4th example of the exercise execution screen of the exercise system which concerns on 1st Embodiment of this invention. It is a figure which shows the opaque head mounted display used in the exercise system which concerns on the 2nd Embodiment of this invention.

<First Embodiment of the present invention>
Hereinafter, the exercise system and the exercise application according to the first embodiment of the present invention will be described with reference to the drawings.

<Overall Configuration of Exercise System> First, the system configuration of the exercise system according to the first embodiment of the present invention will be described. FIG. 1 is a diagram showing an overall configuration of an exercise system according to the first embodiment.

As shown in FIG. 1, the exercise system 1 according to the first embodiment includes a server 2, an Internet 3, a trainer-side mobile terminal 4 and a webcam 5, and a user-side (the first embodiment). In the case of a patient undergoing rehabilitation), it is composed of a mobile terminal 6 and a webcam 7.

The webcam 5 on the trainer side includes a camera unit 51, a microphone unit 52, and a connection cord 53.

The webcam 5 on the trainer side captures a moving image of the state in which the trainer is exercising (exercise) as a sample moving image showing the movement of the exercise as a sample to the user, and the trainer captures the moving image with the camera unit 51. The voice in the state of exercising is converted into an electric signal by the microphone unit 52. Further, the webcam 5 on the trainer side transmits the video data of the captured moving image and the audio data converted into the electric signal to the mobile terminal 4 on the trainer side via the connection code 53.

The trainer-side mobile terminal 4 can display a sample moving image captured by the webcam 5 on the liquid crystal screen 41 by an exercise application downloaded from the server 2. Further, the mobile terminal 4 on the trainer side transmits the video data and the audio data from the webcam 5 on the trainer side to the server 2 via the Internet 3 by, for example, a moving image file in mov format.

The server 2 stores the moving image file (video data and audio data) from the mobile terminal 4 on the trainer side as an exercise moving image file in a storage means such as a hard disk.

Further, the trainer-side mobile terminal 4 transmits video data and audio data from the trainer-side webcam 5 to the user-side mobile terminal 6 via the Internet 3, for example, by using a moving image file in mov format.

On the other hand, the webcam 7 on the user side includes a camera unit 71, a microphone unit 72, and a connection cord 73.

The webcam 7 on the user side captures a moving image in a state where the user is exercising as a user moving image showing a moving image captured by the user's movement by the camera unit 71, and is in a state where the user is exercising. Is converted into an electric signal by the microphone unit 72. Further, the webcam 7 on the user side transmits the video data of the captured moving image and the audio data converted into the electric signal to the mobile terminal 6 on the user side via the connection code 73.

The mobile terminal 6 on the user side can display the user moving image captured by the webcam 7 on the liquid crystal screen 61 by the exercise application downloaded from the server 2. Further, the mobile terminal 6 on the user side transmits video data and audio data from the webcam 7 on the user side to the mobile terminal 4 on the trainer side via the Internet 3, for example, by using a moving image file in mov format.

The trainer-side mobile terminal 4 is captured by the trainer-side webcam 5 and the user-side webcam 7 by the exercise app, and is transmitted via the user-side mobile terminal 6 and the Internet 2. User moving images can be displayed simultaneously on one liquid crystal screen 41.

In addition, the trainer-side mobile terminal 4 may output audio data recorded by the user-side webcam 7 via the user-side mobile terminal 6 and the Internet 2 from the speaker 62 by the exercise application. it can.

On the other hand, the mobile terminal 6 on the user side is captured by the user moving image captured by the webcam 7 on the user side and the webcam 5 on the trainer side by the exercise application, and is captured by the mobile terminal 4 on the trainer side and the Internet 2. The transmitted sample moving image can be displayed on one liquid crystal screen 61 at the same time.

Further, the mobile terminal 6 on the user side can output the voice data recorded by the webcam 5 on the trainer side and transmitted via the mobile terminal 4 on the trainer side and the Internet 2 from the speaker 62 by the exercise application. it can.

Further, the mobile terminal 6 downloads the exercise video file from the database of the server 2 by the exercise application, and the user moving image captured by the webcam 7 on the user side and the sample moving image of the exercise video file are displayed on one liquid crystal screen. It can be displayed on the 61 at the same time, and the audio data of the exercise moving image file can be output from the speaker 62.

<Screen display by the exercise system> Next, the screen display by the exercise system according to the first embodiment of the present invention will be described. FIG. 2 is an explanatory diagram showing a home screen of the exercise app. FIG. 3 is an explanatory diagram showing a sample moving image selection screen of the exercise application. FIG. 4 is an explanatory diagram showing first to third examples of the exercise execution screen of the exercise system. FIG. 5 is an explanatory diagram showing a fourth example of the exercise execution screen of the exercise system.

In FIG. 2, reference numeral 81 is a home screen of the exercise application displayed on the liquid crystal screen 61 of the mobile terminal 6 on the user side.

On the home screen 81, the upper display unit 82, the calendar unit 83, and the lower display unit 84 are displayed in order from the upper side.

The editing icon 91 is displayed on the upper display unit 82. The date 92 of the current day of the calendar unit 83 is displayed in blue around it.

In each date area of the calendar unit 83, an exercise execution icon 93 indicating the exercise execution status (for example, the number of times), a range of motion icon 94 indicating that the range of motion has been measured, and a muscle strength icon indicating that the muscle strength has been measured 95, a blood pressure icon 96 or the like indicating that the blood pressure has been measured can be displayed.

In the lower display unit 84, a home icon 97 to be tapped when returning to the home screen, a workout icon 98 to be tapped when working out, a playlist icon 99 to be tapped to check the execution status of exercise, and various graphs are displayed. The graph icon 100 to be tapped when displaying is displayed.

When the user-side mobile terminal 6 is placed horizontally and the playlist icon 99 is tapped, as shown in FIG. 3A, the download list display area is displayed on the right side of the liquid crystal screen 61 of the user-side mobile terminal 6 placed horizontally. 101 is displayed, and the consent area 102 for the user is displayed on the left side of the liquid crystal screen 61.

In the download list display area 101, the image 103 of the characters in the download list and the operation buttons 104a, 104b, 104c, 104d used when selecting the exercise video files A, B, C, and D that can be downloaded from the server 2 are displayed. Will be done. In the consent area 102, an image 105 of one's own character and an approval button 106 to be tapped when performing a consent operation are displayed.

For example, when the user taps the operation buttons 104a, 104b, 104c in order and then taps the approval button 106, the play shown in FIG. 3B is displayed on the liquid crystal screen 61 of the horizontally placed mobile terminal 6. The list screen 110 is displayed. An image 111 of characters in the playlist and an exercise moving image playback button 112 are displayed on the upper side of the playlist screen 110 placed horizontally. The exercise moving image reproduction button 112 displays an image 113 of the characters A + B + C indicating the reproduction of the exercise moving image files A, B, and C.

Images 120 of characters in the reproduction mode and mode selection buttons 121, 122, 123, 124 of modes 1, 2, 3, and 4 are displayed on the lower side of the playlist screen 110 placed horizontally. Here, mode 1 is selected by default as the playback mode, and in this state, only the mode selection button 121 is displayed in a bright color. When switching the playback mode, tap the mode selection button of the playback mode you want to switch and select to switch the mode selected by the playback mode, and only the tapped mode selection button is displayed in bright color.

When mode 1 is selected as the playback mode and the exercise moving image playback button 112 is tapped, the image shown in FIG. 4A is displayed.

As shown in FIG. 4A, in the area 131 on the left side of the liquid crystal screen 61 of the horizontally placed mobile terminal 6, the sample moving image 133 of the exercise video file downloaded from the server 2 by the trainer is displayed and placed horizontally. In the area 132 on the right side of the liquid crystal screen 61 of the mobile terminal 6, the user moving image 134 captured by the webcam 7 on the user side is displayed. Further, the mobile terminal 6 outputs the voice data of the exercise moving image file from the speaker 62 (see FIG. 1).

When mode 2 is selected as the playback mode by tapping the mode selection button 122 of mode 2 shown in FIG. 3B, tapping the exercise video playback button 112 displays the image shown in FIG. 4B. ..

As shown in FIG. 4B, in the center of the liquid crystal screen 61 of the horizontally placed mobile terminal 6, the exercise video downloaded from the server 2 is superimposed on the user moving image 135 captured by the webcam 7 on the user side. The sample moving image 136 by the trainer of the file is displayed in a semi-transparent state. Further, the mobile terminal 6 causes the speaker 62 to output the voice data of the exercise moving image file.

When the exercise video playback button 112 is tapped with the mode 3 mode selection button 123 shown in FIG. 3 (b) tapped and the mode 3 is selected as the playback mode, the image shown in FIG. 4 (c) is displayed.

As shown in FIG. 4 (c), in the center of the liquid crystal screen 61 of the horizontally placed mobile terminal 6, the sample moving image by the trainer of the exercise video file downloaded from the server 2 is enlarged by 10%. It is displayed as an image 137, and the user moving image 138 captured by the webcam 7 on the user side is superposed on the sample moving image 137 enlarged by 10%. Further, the mobile terminal 6 causes the speaker 62 to output the voice data of the exercise moving image file.

When the mode selection button 124 of the mode 4 shown in FIG. 3C is tapped and the exercise moving image playback button 112 is tapped with the mode 4 selected as the playback mode, the image shown in FIG. 5 is displayed.

As shown in FIG. 5, in the center of the liquid crystal screen 61 of the mobile terminal 6 on the user side, the sample moving image 139 by the trainer of the exercise video file downloaded from the server 2 is displayed, and above the sample moving image 139. The user moving image 140 captured by the webcam 7 on the user side is superimposed and displayed in a state of being slightly shifted to the left from the sample moving image 139.

Further, the mobile terminal 6 causes the speaker 62 to output the voice data of the exercise moving image file.

The user visually recognizes the image shown in any one of FIGS. 4 (a), 4 (b), 4 (c), and 5 and exercises while checking both the sample moving image and the user moving image by the trainer. By doing this, you will be able to exercise efficiently in a state that is closer to the movement of the trainer.

Here, when the trainer operates the mobile terminal 4 to select the real-time mode, the mobile terminal 6 on the user side captures the user moving image captured by the webcam 7 on the user side and the webcam 5 on the trainer side. Then, the sample moving image transmitted via the mobile terminal 4 on the trainer side and the Internet 2 can be simultaneously displayed on one liquid crystal screen 61. As the simultaneous display method in this case, the methods shown in FIGS. 4 (a), 4 (b), 4 (c), and 5 can be selected.

Further, in the exercise system 1, the display of the sample motion image of the exercise is completed (exercise is completed), and the new exercise execution icon 93 is displayed on the calendar unit 83 of the mobile terminal 6 on the user side shown in FIG. When the number next to the execution icon 93 is updated, at the same time, an email with the name of the exercise (exercise) and the actual time is sent to a specific email address (for example, the email address of the user or trainer). Has the function of

Hereinafter, the configuration and operation of such an embodiment of the present invention will be summarized. The exercise system 1 is a sample moving image showing a sample exercise operation for the user when the user exercises. (Sample moving images 133, 135, 137, 139 shown in FIGS. 4 and 5) are displayed, and a user moving image showing a moving image captured by the movement of the user (user moving image 134 shown in FIGS. 4 and 5). It is an exercise system that displays 136, 138, 140), and displays the sample moving image and the user moving image on one liquid crystal screen 61.

When the user exercises, the exercise system 1 displays a sample moving image (sample moving images 135, 137, 139 shown in FIGS. 4 and 5) showing a sample exercise operation for the user. An exercise system that displays a user moving image (user moving images 136, 138, 140 shown in FIGS. 4 and 5) showing a moving image of the user, the sample moving image and the user moving image. Are superimposed and displayed.

When the user exercises, the exercise system 1 displays a sample moving image (sample moving image 137, 139 shown in FIGS. 4 and 5) showing the operation of the exercise as a sample for the user, and also displays the sample moving image. It is an exercise system that displays user moving images (user moving images 138 and 140 shown in FIGS. 4 and 5) showing moving images captured by the user's movement, and a part of the sample moving image and the user moving image is used. The feature is that they are displayed in a staggered state.

The exercise application of the present embodiment is a sample moving image (sample moving images 133, 135, 137, 139 shown in FIGS. 4 and 5) showing a sample exercise operation for the user when the user exercises. ), And a user moving image (user moving images 134, 136, 138, 140 shown in FIGS. 4 and 5) showing a moving image of the user, which is an exercise application. The image and the user moving image are displayed on one liquid crystal screen 61.

The exercise application of the present embodiment provides sample moving images (sample moving images 135, 137, 139 shown in FIGS. 4 and 5) showing a sample exercise operation for the user when the user exercises. It is an exercise application that displays a user moving image (user moving images 136, 138, 140 shown in FIGS. 4 and 5) showing a moving image that captures the movement of the user, and is an exercise application that displays the sample moving image and the user. The moving image is superimposed and displayed.

When the user exercises, the exercise application of the present embodiment displays a sample moving image (sample moving image 137, 139 shown in FIGS. 4 and 5) showing a sample exercise operation for the user. In addition, it is an exercise application that displays a user moving image (user moving images 138 and 140 shown in FIGS. 4 and 5) showing a moving image that captures the movement of the user, and displays the sample moving image and the user moving image. It is characterized in that it is displayed in an overlapping state with a part shifted.

According to the first embodiment described above, the user can be made to perform more efficient exercise.

<Modified example of the first embodiment of the present invention>
In the first embodiment of the present invention shown in FIGS. 1 to 5, a mobile terminal (smartphone) is used as a means for photographing the trainer or the user and a means for recording the voice of the trainer or the user because of the ease of adjusting the imaging direction. Web cameras 5 and 7 separate from 4 and 6 are used, but in the modification of the first embodiment of the present invention, a means for photographing the trainer and the user and a means for recording the voice of the trainer and the user. The cameras and microphones built into the mobile terminals (smartphones) 4 and 6 are used as the above.

According to such a modification, the same effects as those of the first embodiment shown in FIGS. 1 to 5 can be obtained except that the adjustment of the imaging direction is troublesome, and FIGS. Compared to the first embodiment shown in 5, it has the effect of reducing the overall cost of the exercise system.

<Second Embodiment of the present invention>
Hereinafter, the exercise system and the exercise application according to the first embodiment of the present invention will be described with reference to the drawings.

<Overall Configuration of Exercise System> First, the exercise system according to the second embodiment of the present invention will be described. FIG. 6 is a perspective view showing an opaque head-mounted display to which an exercise system is applied.

In the opaque head-mounted display 200, the user-side mobile terminal 6 shown in FIG. 1 is attached to the inside of the frame 201, and the left and right convex lenses 203L and 203R are arranged in front of the mobile terminal 6 via the holder 202. Is. The left and right convex lenses 203L and 203R are arranged by eyepieces on both the left and right eyes of the user.

Left and right belts 204L and 204R for attaching to the player's head are connected to the left and right side surfaces of the frame 201. The user displays on the liquid crystal screen 61 by looking through the liquid crystal screen 61 of the mobile terminal 6 from the left and right eyes through the left and right convex lenses 203L and 203R with the opaque head mount display 200 attached to his / her head. You can see the image to be displayed.

The mobile terminal 6 is connected to the user-side webcam 5 that captures the user via a connection cord that is longer than the embodiment of FIG. An image similar to that of the first embodiment shown in FIGS. 4 and 5 is displayed on the liquid crystal screen 61 of the mobile terminal 6. According to such a second embodiment, the same effect as that of the first embodiment can be obtained in the exercise using the opaque head-mounted display 200.

<Modified example of the second embodiment of the present invention>
In the second embodiment of the present invention shown in FIG. 6, an opaque head-mounted display generally used in a VR (virtual reality) system is used as a means for displaying a sample moving image and a user moving image. However, in the modified example of the second embodiment of the present invention, an optical transmissive head-mounted display generally used in an AR (augmented reality) system as a means for displaying a sample moving image and a user moving image ( AR goggles) are used.

The transmissive head-mounted display of this modification reflects the image reflected on the liquid crystal screen 61 of the mobile terminal 6 on the half mirror and displays it to the user in a semi-transparent state.

According to such a modification, the same effect as that of the first embodiment can be obtained in the exercise system using the transmissive head-mounted display.

In the first and second embodiments and modifications thereof, a real-time sample moving image captured by the trainer-side camera and a sample of the shooting storage stored in the server 2 are sampled for the user-side mobile terminal 6. Although any of the moving images can be selected and displayed, the configuration may be such that only one of the real-time sample moving image and the sample moving image stored in the photograph can be displayed.

Further, as a method of displaying the sample moving image and the user moving image on one liquid crystal screen 61, various methods other than the methods shown in FIGS. 4 and 5 can be applied. In addition, although the patient is being rehabilitated as a user, the user is not limited to the patient, and various applications such as a valley and dance instructor can be applied.

The system, means, method, etc. of the present invention can be variously changed without changing the gist of the present invention.

For example, as a means for capturing a moving image of a user or a trainer, in addition to a webcam and a digital camera built in a mobile terminal, various applications such as a digital video camera equipped with a storage medium by itself can be applied.
As the recording means, a personal computer, an IC recorder, or the like can be freely selected.

For example, it is possible to combine two or more systems into one, and conversely, it is possible to configure one system from two or more different systems and connect them.
In addition, the first and second embodiments are only two of the best forms at present or a form close thereto.

1: Exercise system 2: Server 3: Internet 4: Mobile terminal on the trainer side 5: Webcam on the trainer side 6: Mobile terminal on the user side 7: Webcam on the user side 7
133, 135, 137, 139: Sample moving image 134, 136, 138, 140: User moving image

Claims (6)

An exercise system that displays a sample moving image showing a sample exercise operation to the user when the user exercises, and also displays a user moving image showing the moving image captured by the user's movement. , An exercise system characterized in that the sample moving image and the user moving image are displayed on one screen. An exercise system that displays a sample moving image showing a sample exercise operation to the user when the user exercises, and also displays a user moving image showing the moving image captured by the user's movement. , An exercise system characterized in that the sample moving image and the user moving image are displayed in an overlapping manner. An exercise system that displays a sample moving image showing a sample exercise operation to the user when the user exercises, and also displays a user moving image showing the moving image captured by the user's movement. , An exercise system characterized in that the sample moving image and the user moving image are superimposed and displayed in a partially shifted state. When the user exercises, the mobile terminal is displayed with a sample moving image showing the movement of the exercise as a sample for the user, and the user moving image showing the moving image captured by the user is displayed on the mobile terminal. An exercise application to be displayed, wherein the sample moving image and the user moving image are displayed on the mobile terminal on one screen. When the user exercises, the mobile terminal is displayed with a sample moving image showing the movement of the exercise as a sample for the user, and the user moving image showing the moving image captured by the user is displayed on the mobile terminal. An exercise application to be displayed, wherein the sample moving image and the user moving image are superimposed and displayed on the mobile terminal on one screen. When the user exercises, the mobile terminal is displayed with a sample moving image showing the movement of the exercise as a sample for the user, and the user moving image showing the moving image captured by the user is displayed on the mobile terminal. An exercise application to be displayed, wherein the sample moving image and the user moving image are overlapped in a partially shifted state and displayed on the mobile terminal on one screen.

Images