JP2007289515A - Exercise support device and its program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To take exercise always appropriately without overstrain when a user takes exercise in real time by presenting the user with appropriate instruction data in accordance with the user's state or instruction content. <P>SOLUTION: In an exercise support server SV, when distributing instruction video data to user terminals UT1 to UTn, a movable range and velocity of the user's movements are detected from the user exercise video data to determine on the basis of a detection result whether or not the user needs correction of the instruction video data. At the same time, it is determined on the basis of metadata of the instruction video data whether or not the exercise changes and, on the basis of the decision result, whether or not the instruction video data are ones needing correction. As a result of the respective determinations, when it is determined that the correction of the instruction video data are needed, the instruction video data are corrected according to information stored in a correction method table 144 and the corrected instruction video data are distributed to the user terminals UT1 to UTn. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an exercise support apparatus used for providing support when, for example, an elderly person exercises at home, and a program thereof.

  The fall accident of the elderly occurs mainly due to a decline in physical functions such as a decrease in muscle strength due to aging. Fractures caused by a fall accident can cause various obstacles and can lead to bedridden. In order to prevent falling accidents and prevent fractures and bedriddenness, it is important to improve declining body functions by increasing muscle strength. Various systems have been proposed.

  For example, a user terminal composed of a personal computer is installed in an elderly person's house, and instruction video data is distributed and displayed from the server device to the user terminal via a communication network. An elderly person exercises while viewing the displayed video data for guidance. If such a system is used, an elderly person can perform appropriate exercises such as gymnastic exercises using a guidance video as an example at home.

  On the other hand, for example, in skiing technical guidance, a video of when the instructor is sliding and a video of when the non-instructor is sliding are respectively captured, and these images are synthesized in time synchronization. A display device has also been proposed. According to such a device, the non-instructor can easily compare and examine the difference between the own form and the instructor's form.

JP 2001-186471 A

  However, in the former system, the video data for guidance created in advance is distributed as it is from the server device and displayed on the user terminal. For this reason, depending on the physical or mental state of the user, the user's movement cannot follow the progress of the movement indicated by the instructional video data, and the user cannot perform an appropriate movement according to the instruction program, In addition, the user was forced to do so, which was not very desirable.

  In the latter device, the non-instructor can compare and examine his own image with the instructor's image after running, but cannot exercise in real time using the instructor's image as a model. That is, it can be used only for examination after the end of exercise. For this reason, the effect cannot be expected for elderly people who are difficult to exercise autonomously.

  The present invention has been made by paying attention to the above circumstances, and the purpose of the present invention is to always provide appropriate instruction data to the user in accordance with the state of the user or the contents of the instruction. It is an object to provide an exercise support apparatus and a program for making it possible to perform appropriate exercises without difficulty when exercising in real time.

  In order to achieve the above object, one aspect of the present invention is that the user adapts to the exercise indicated by the instruction data when presenting instruction data to the user as an example of exercise. Judgment is made whether or not it is possible, and when it is judged that adaptation is impossible, the above-mentioned guidance data is modified to be adaptable, and the revised guidance data is presented to the user. It is.

  Therefore, when it is predicted that the user's movement cannot follow the progress of the movement indicated by the instruction data due to the physical or mental state of the user, the instruction data is automatically corrected, This corrected instruction data is presented to the user. For this reason, the user can always perform an appropriate exercise according to the instruction program in real time without overdoing it.

The present invention is also characterized by having the following various viewpoints.
In the first aspect, when the above determination is made, the range or speed of the user's movement is analyzed from the motion video data recording the state of the user's previous movement, and the user is based on the analysis result. It is determined whether or not can be adapted to the exercise indicated by the instruction data.
If it does in this way, it will be judged whether a user can adapt to the exercise | movement shown by instruction | indication data based on the condition of the exercise | movement which the user performed last time. Therefore, it is possible to make an appropriate determination according to the situation of the user.

According to a second aspect, a means for storing user attribute information representing a situation of the user's exercise is provided, and when the determination is made, the user can use the instruction data based on the stored user attribute information. It is determined whether or not it is adaptable to the indicated movement.
If it does in this way, it will be judged whether a user can adapt to exercise of instruction data based on user attribute information memorized beforehand. Therefore, it is possible to make a simple and quick determination without performing image analysis processing or the like.

A third aspect provides a means for storing exercise attribute information representing the exercise attribute indicated by the instruction data, and the user can adapt to the exercise indicated by the instruction data based on the stored exercise attribute information. It is determined whether or not there is.
If it does in this way, it will be judged whether a user can adapt to the exercise | movement of instruction data based on the attribute of the exercise | movement shown by instruction | indication data. For this reason, even if there is no problem for the user himself / herself, if the exercise load indicated by the selected instruction data is high, or if the exercise indicated by the instruction data needs to prepare the equipment, the indication is not applicable. Appropriate corrections are made to the guidance data as it is determined to be possible.

According to a fourth aspect of the present invention, there is provided means for storing information representing correction contents set in advance in association with at least one of an analysis result of a user's movement range or speed, user attribute information, and exercise attribute information of guidance data When it is determined that adaptation is impossible, information indicating the correction content corresponding to the basis of the determination is read and correction is made to the guidance data.
If it does in this way, when it determines with adaptation being impossible, the correction process according to the basis of this determination will be performed with respect to guidance data. Therefore, appropriate correction processing can always be performed on the guidance data according to the user's situation or the content of the guidance data, and thus it is possible to always present appropriate guidance data to the user.

  The fifth aspect is to perform a correction process for causing the instruction data to be reproduced in slow motion with respect to the instruction data. In this way, when the user cannot follow the speed or tempo of the exercise indicated by the guidance data, the speed or tempo of the exercise based on the guidance data can be reduced.

  A sixth aspect is to insert a pause period before or during the start of the exercise indicated by the guidance data. In this way, for example, when the next exercise uses an exercise tool such as a rubber band or a dumbbell, a pause period (pause period) is inserted before the start of the exercise. For this reason, the user can prepare the exercise equipment with a margin.

  According to a seventh aspect, user video data representing the state of exercise of a user who has been modeled on the corrected instruction data is stored, and a correction history added to the instruction data is stored. When the stored user video data is reproduced, the portion corresponding to the correction is deleted from the user video data based on the stored correction history, thereby reconstructing the user video data. To do.

  Therefore, when reproducing the user video data obtained by imaging the state of the user's exercise, the user video data from which the part corresponding to the correction added to the instruction data is automatically deleted is reproduced. For this reason, for example, the slow motion portion of the exercise is played back at a normal speed, and the pause period inserted before the start of the exercise is deleted and played back continuously. Therefore, it is possible to reproduce user video data in a natural state. This is especially true when the user video data is played back in a state where it is aligned with the guidance data, since the user video data can be played back and displayed in a state that keeps temporal synchronization with the guidance data. It is valid.

  In short, according to the present invention, appropriate instruction data can always be presented to the user according to the user's condition or instruction contents, and therefore, when the user exercises in real time, the appropriate exercise is always reasonable. It is possible to provide an exercise support apparatus capable of performing exercises and a program thereof.

Embodiments according to the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is a schematic configuration diagram showing a first embodiment of an exercise support system according to the present invention. In the exercise support system of this embodiment, user terminals UT1, UT2,... UTn are installed at the homes of users who receive exercise support services such as elderly people, and these user terminals UT1, UT2,. It can be connected to an exercise support server SV installed in a health center, a sports club, a fitness club, or the like via a communication network NW. At the same time, a leader terminal MT used by a leader such as a public health nurse can be connected to the exercise support server device SV via, for example, a LAN (Local Area Network).

  The communication network NW includes, for example, an IP (Internet Protocol) network represented by the Internet and a plurality of access networks for accessing the IP network. As the access network, for example, a DSL (Digital Subscriber Line) or a wired subscriber network using an optical transmission line, a CATV (Cable Television) network, a wireless LAN (Local Area Network) network, a mobile communication network, or a dedicated line network is used. .

  The user terminals UT1, UT2,... UTn are made of, for example, a personal computer, and are provided with a guidance video data reception display function and a user video imaging transmission function. All of these functions are realized by causing an application program to be executed by a central processing unit (CPU).

  When the user performs exercise, the instruction video data reception display function receives and stores the instruction video data distributed from the exercise support server device SV, and displays the instruction video data on the display. If the instruction video data includes music or instructor's voice data, the music or voice data is output from the speaker. The user image capturing / transmission function captures the state of the user during exercise with a camera and transmits the image data to the exercise support server SV as user exercise image data. At this time, the user's voice is detected by a microphone, and the voice data is included in the user motion video data and transmitted.

  Like the user terminals UT1, UT2,... UTn, the instructor terminal MT is also composed of a personal computer and has a function for creating instruction video data and a function for browsing user exercise video data. These functions are also realized by causing an application program to be executed by a central processing unit (CPU).

  The instruction video data creation function creates instruction video data by capturing the state of exercise of the instructor with a camera, stores the created instruction video data in a storage device in the leader terminal MT, and supports exercise Transmit to server device SV. The user exercise video data browsing function sends a user video browsing request to the exercise support server device SV, thereby receiving user exercise video data and instruction video data downloaded from the exercise support server device SV, These video data are displayed side by side on a display.

Next, the exercise support server SV is constituted by a Web server and has the following functions. FIG. 2 is a block diagram showing the configuration.
That is, the exercise support server SV includes a CPU 11, to which a program memory 13 and a data memory 14 are connected via a bus 12, and a communication interface (communication I / F) 15 is further connected.

  The communication I / F 15 performs communication with the user terminals UT1 to UTn and the instructor terminal MT according to a communication protocol defined by the communication network NW under the control of the CPU 11. For example, TCP / IP (Transmission Control Protocol / Internet Protocol) is used as the communication protocol.

The data memory 14 uses, for example, a hard disk or a flash memory as a storage medium, and includes a user video storage area 141, a guidance video storage area 142, a guidance video metadata storage area 143, and a correction method table 144. I have.
In the user video storage area 141, user motion video data sent from the user terminals UT1 to UTn is stored in association with user identification information and date / time information. In the guidance video storage area 142, guidance video data transmitted from the leader terminal MT is stored in association with identification information.

  In the instructional video metadata storage area 143, metadata (exercise attribute information) representing the attributes of a plurality of exercises appearing in the instructional video data is stored in the order of appearance. FIG. 4 shows an example of this metadata, which is composed of a motion ID for identifying a motion, a posture, a tool, and a posture between motions or whether there is a change in the tool for each motion.

  The correction method table 144 is associated with all types of combinations of necessity of correction of instructional video data according to the user's situation and changes in posture or tool between exercises represented by the instructional video metadata. Thus, information representing the contents of appropriate correction processing is stored. FIG. 5 shows an example of the correction method table.

The program memory 13 stores a user video analysis program 131, a correction necessity determination program 132, a guidance video correction program 133, a guidance video distribution control program 134, and a video redisplay control program 135.
The user video analysis program 131 reads user motion video data in which the state of the exercise performed by the user in the past is read from the user video storage area 141 of the data memory 14, and an image is obtained with respect to the user motion video data. By performing the processing, the range or speed of movement of the user is analyzed. Then, the CPU 11 is caused to execute processing for determining whether or not the user can adapt to the exercise appearing in the instructional video data based on the analysis result.

  The correction necessity determination program 132 determines whether or not the instruction video data correction processing is necessary based on whether or not the user video analysis program 131 can adapt the user. At the same time, the corresponding metadata is read from the instruction video metadata storage area 143 of the data memory 14, and the CPU 11 executes a process for determining whether or not the instruction video data correction processing is necessary based on the metadata. Let

  The instruction video correction program 133 reads information indicating the corresponding correction processing contents from the correction method table 144 of the data memory 14 when the correction necessity determination program 132 determines that the instruction video data needs to be corrected. Then, the CPU 11 is caused to execute a process for correcting the instruction video data according to the information indicating the correction content. At the same time, the CPU 11 is caused to execute a process of storing information indicating the history of the correction process applied to the instruction video data in the instruction video storage area 142 of the data memory 14 in association with the instruction video data.

The instruction video distribution control program 134 causes the CPU 11 to execute processing for distributing instruction video data corrected by the instruction video correction program 133 to the user terminals UT1 to UTn.
When a reproduction request for user motion video data is sent from the instructor terminal MT or the user terminals UT1 to UTn, the video redisplay control program 135 corrects the instruction video data corresponding to the user motion video data. Whether it has been added or not is determined based on information representing the history of the correction process. If correction has been made, processing for deleting the portion corresponding to the correction from the user motion video data is performed to reconstruct the user motion video data, and this reconstructed user motion video The CPU 11 is caused to execute a process of transmitting the data to the requesting instructor terminal MT or the user terminals UT1 to UTn together with the original instruction video data before the data is corrected.

Next, the operation of the exercise support server apparatus SV configured as described above will be described.
When using the exercise support service of this system, the user first performs membership registration. This member registration process is performed by accessing the exercise support server device SV from the user terminal UT1 and performing an input operation for member registration on the member registration screen downloaded from the exercise support server device SV. The input information includes the user's name and attribute information, information on athletic ability, and information indicating the purpose of the exercise.

  On the other hand, when the exercise support server device SV receives input information for member registration from the user terminal UT1, the exercise support server device SV issues a user ID and password to the registration requesting user. The ID and password are transmitted to the user terminal UT1. The received input information is stored as personal data. The user terminal UT1 receives the user ID and password sent from the exercise support server SV, and stores them in the personal data storage unit in the data memory together with the inputted personal data.

  When the registration of personal data is completed by transmitting the user ID and password, the exercise support server SV continues to use an application program necessary for the user to use the exercise support service provided by this system. Is downloaded to the user terminal UT1. On the other hand, the user terminal UT1 receives each application program downloaded from the exercise support server device SV, and stores each received application program in the program memory.

  When the series of processing related to user membership registration is completed, the exercise support server SV analyzes the user's personal data stored in a personal data storage area (not shown), and first uses it. Select an exercise menu suitable for the person. The exercise menu includes, for example, fall prevention exercises for care prevention (muscular strength exercises for elderly people with a high risk of fall), health exercises (fat burning exercises) for lifestyle-related disease prevention and diet, jazz dance and yoga, Tai Chi, hula dance, aerobics and so on.

Next, the exercise support server SV creates a schedule for executing the selected exercise menu. For example, if the exercise menu is fall prevention exercises (muscle strength exercises), the exercise schedule is composed by combining multiple types of preparatory exercises, multiple types of strength increase exercises, and multiple types of organizing exercises in time series. Is done. Preparatory exercises include bending and stretching of fingers, raising and lowering elbows, bending and stretching of hips, and examples of strength-up exercises include raising and lowering toes and heels and knee alignment. The organizing exercise includes breathing exercise. The schedule includes the user ID, the instructor's ID, the information indicating the type and content of the exercise, and the exercise start time.
The created schedule data is stored in the personal data storage area of the exercise support server SV, and is notified from the exercise support server SV to the user terminal UT1 and the instructor terminal MT. Thus, the preparation for the user to receive the exercise support service is completed at the user terminal UT1.

Now, when the exercise start time described in the schedule data is reached, an exercise start request is transmitted from the user terminal UT1 to the exercise support server SV. When the exercise support server SV receives the exercise start request, the exercise support server SV executes exercise support control as follows.
(1) Modified distribution of instructional video data
Upon receiving the exercise start request, the CPU 11 of the exercise support server SV reads out instruction video data corresponding to the previously created schedule from the instruction video storage area 142 and distributes it to the user terminal UT1. For data, correction control according to the situation of the user is executed as follows. FIG. 3 is a flowchart showing the control procedure and control contents.
Here, for convenience of explanation, a user of the user terminal UT1 performs an exercise using the same instruction video data as an example on the previous day, and the user exercise video data that captures the situation is a user of the exercise support server SV. The description will be made assuming that the data is stored in the video storage area 141.

  That is, the CPU 11 of the exercise support server SV first reads out user exercise video data obtained by imaging the state of exercise performed on the previous day from the user video storage area 141 in step S31. In step S32, the range of motion of the user and the speed of motion are analyzed from the read user motion image data. This analysis process can be performed, for example, by taking a time difference between images and detecting the moving amount and moving speed of the center of gravity of the difference value.

  Subsequently, the CPU 11 determines in step S33 whether or not the user is a correction target person who needs to correct the instructional video data based on the analysis result of the movable range of the movement and the speed of the movement. For example, if the movement range of exercise does not reach the minimum range set based on the instructional video data, or the speed of exercise does not reach the lower limit speed set based on the instructional video data The user's movement is regarded as not following the movement of the guidance video, and the user is determined to be a correction target person who needs to correct the guidance video data. On the other hand, if the movement range of the exercise is equal to or greater than the above minimum range, or the velocity of the exercise is equal to or greater than the lower limit velocity, it is considered that the user's movement is following the movement of the instruction video, Is determined not to be a correction target person who requires correction of instructional video data.

  Next, the CPU 11 proceeds to step S34 and reads instruction video metadata of the exercise to be performed next. Then, based on this metadata, it is determined in step S35 whether or not the next exercise is to be corrected. For example, assume that the instructional video metadata is configured as shown in FIG. In this case, if the exercise to be performed next is the first exercise, the CPU 11 determines that the content of the first exercise does not need to be corrected because the posture and tool do not change. On the other hand, if the exercise to be performed next is the second exercise, it is determined that the exercise needs to be corrected because the tool is used. Similarly, if the exercise to be performed next is the third exercise, it is determined that the exercise needs to be corrected because the posture changes from the standing posture to the posture using the chair.

  When the determination on the user and the determination on the exercise content are completed, the CPU 11 proceeds to step S36, where the instruction video is corrected based on the determination result in step S33 and the determination result in step S35. Whether or not is necessary. As a result of this determination, if there is no need for correction, the process proceeds to step S37, where instruction video data corresponding to the next exercise is read from the instruction video storage area 142, and this instruction video data is directly sent to the user terminal UT1. To deliver. As a result, the instruction video corresponding to the exercise is displayed on the user terminal UT1, and the user starts the exercise while watching the instruction video.

  On the other hand, in step S36, it is determined that it is necessary to correct the next exercise. In this case, the CPU 11 proceeds to step S38, and reads information representing the correction method from the correction method table 144. In step S39, the instruction video data corresponding to the exercise to be performed next is corrected according to the information indicating the read correction method.

  For example, it is assumed that there is no change in the content of the exercise, but the user is the person to be corrected. In this case, since “slow motion” is read out as the processing content from the correction method table, the CPU 11 performs slow motion processing on the instruction video data corresponding to the next exercise. And this corrected instruction | indication video data is delivered to user terminal UT1 by step S40. As a result, in the user terminal UT1, the motion video is played back in slow motion according to the corrected instruction video data. Therefore, the user can exercise with a margin while watching the instructional video.

  Further, when the user is a person to be corrected and there is a posture change in the exercise, “pause 15 seconds” is read from the correction method table 144 as the processing content. Therefore, the CPU 11 adds a correction for inserting a 15-second pose before starting the exercise to the instruction video data corresponding to the exercise to be performed next. Further, when the exercise tool changes to a rubber band, “pause + 15 seconds” is read from the correction method table 144 as the processing content. Therefore, the CPU 11 modifies the instruction video data corresponding to the next exercise to extend the length of the pause period inserted before starting the exercise for another 15 seconds.

  Then, when the instruction video data correction process is completed, the CPU 11 delivers the instruction video data corrected in step S40 to the user terminal UT1. As a result, in the user terminal UT1, the exercise start timing is delayed only by the pause period in accordance with the corrected instruction video data. Therefore, the user can make preparations for posture change and preparation of exercise equipment during this pose period.

  Further, when the correction process is performed on the instruction video data, the CPU 11 creates information indicating the content and the correction position of the correction process performed on the instruction video data, and further adds the user ID to be distributed and the date / time to this information. Information is added, and this information is stored as correction history information in the instruction video storage area 142 of the data memory 14 in association with the instruction video data to be corrected.

  When the distribution of the instructional video data corresponding to the one exercise is completed, the CPU 11 determines in step S41 whether or not all the exercises are completed. If the next exercise remains, the process returns to step S34. In step S34, metadata corresponding to the exercise to be performed next is read from the instruction video metadata storage area 143. In step S35, it is determined whether or not the next exercise is an exercise requiring correction.

  Subsequently, in step S36, it is determined whether or not the instruction video needs to be corrected based on the determination result obtained in step S33 and the determination result newly obtained in step S35. If the determination result shows that correction is necessary, information indicating the correction method is read out in step S38, the instruction video data corresponding to the exercise to be performed next is corrected in step S39, and then the user is determined in step S40. Deliver to terminal UT1. On the other hand, if correction is unnecessary, the process proceeds to step S37, and the instruction video data corresponding to the exercise to be performed next is delivered to the user terminal UT1 as it is. On the other hand, when all the exercises determined by the schedule are finished, the CPU 11 finishes the distribution control of the instructional video data.

(2) User video storage and playback control
The CPU 11 of the exercise support server device SV executes accumulation and reproduction control of user exercise video data as follows during or after exercise of the user. FIG. 6 is a flowchart showing the control procedure and control contents.
That is, during or after the user's exercise, the CPU 11 of the exercise support server SV receives a request for accumulation of user exercise video data from the user terminal UT1 and an instructor terminal MT in steps S61 and S66, respectively. Monitors the arrival of browsing requests for stored video from.

  In this state, when a storage request for user motion video data arrives from the user terminal UT1, the CPU 11 receives video data that captures the state of user motion transmitted from the user terminal UT1 in step S62, The received video data is sequentially stored in the user video storage area 141 in step S63. At this time, in step S64, the CPU 11 stores the user ID, the exercise ID, and the time stamp indicating the exercise start / end date and time in addition to the video data. Then, the CPU 11 determines whether or not the user motion video data has been received in step S65, and repeats the video data accumulation process in steps S62 to S64 until the reception is completed.

  On the other hand, it is assumed that a request for browsing the stored video is received from the instructor terminal MT in a state where the user motion video data is stored. Then, in step S67, the CPU 11 reads the user motion video data to be browsed from the user video storage area 141 for each exercise, and reads the guidance video data corresponding to the user motion video data from the guidance video data storage area 142. . In step S68, the correction history information is read from the instructional video data storage area 142.

  Subsequently, the CPU 11 determines whether or not the instruction video data has been corrected in step S69 based on the correction history information for each exercise. If no correction is made as a result of this determination, the user motion video data corresponding to the motion and the guidance video data are synthesized in step S71 to generate video data for one screen playback. Video data is transmitted to the instructor terminal MT as a request source. As a result, in the leader terminal MT, video data obtained by combining the user exercise video data and the guidance video data is displayed on the display.

  When the transmission of the reproduction video data corresponding to one exercise is completed, the CPU 11 returns from step S72 to step S67. Then, the user motion video data and the instruction video data corresponding to the next exercise are read out, and the correction history information is read out in step S68, and the instruction video data is corrected in step S69 based on the correction history information. It is determined whether or not

  As a result of this determination, if the correction has been made, the CPU 11 proceeds to step S70, where the part corresponding to the corrected part of the instructional video data is restored from the user motion video data based on the correction history information. Constitute. For example, when slow motion processing is performed on the guidance video data, the user motion video data corresponding to the slow motion processing portion of the guidance video data is reconfigured to be fast-forwarded. If a pause period is inserted before the start of the instruction video data, the time portion of the user motion image data corresponding to the pause period of the instruction video data is deleted.

  When the reconstruction process of the user motion video data is completed, the CPU 11 combines the reconstructed user motion video data with the original instruction video data not corrected in step 71. One-screen playback video data is generated. Then, this video data for reproduction is transmitted to the instructor terminal MT as a request source. As a result, on the instructor terminal MT, video data obtained by synthesizing the user motion video data from which the slow motion or pause period has been deleted and the original instruction video data is displayed on the display.

  That is, on the instructor terminal MT, the user exercise video data and the original instruction video data are always displayed side by side in a time-synchronized state. FIG. 7 shows an example of the display result. IM shows the video of the instructor, and IU shows the video of the user A who is the browsing target. Therefore, the instructor can compare the image obtained by capturing the state of the user's exercise with the instruction image in a state in which a temporal correspondence is always obtained.

  As described above, in the first embodiment, when the instruction video data is distributed to the user terminals UT1 to UTn in the exercise support server device SV, a correction target person who needs to correct the instruction video data. It is determined whether or not. At the same time, the presence or absence of a change in exercise is determined based on the metadata of the instructional video data, and it is determined whether the instructional video data is data that needs to be corrected based on the determination result. If it is determined that the instruction video data needs to be corrected as a result of each determination, the instruction video data is corrected in accordance with the information stored in the correction method table 144, and the corrected instruction video data is used as the user terminal UT1. It is trying to deliver to UTn.

  Therefore, according to the first embodiment, when it is predicted that the movement of the user cannot follow the progress of the movement indicated by the guidance video data due to the physical state of the user, the guidance video data is automatically processed. The instruction video data thus corrected is distributed to the user terminals UT1 to UTn and displayed. For this reason, the user can perform an effective exercise according to the instruction video in real time and without excessive effort.

  In addition, the movable range and speed of the user's movement are detected from the previous user motion video data, and whether or not the user is a correction target who needs to correct the guidance video data based on the detection result. Is determined. Therefore, it is possible to determine whether or not the user can adapt to the exercise indicated by the instructional video data based on the state of the exercise performed by the user last time. Therefore, it is possible to make an appropriate determination according to the situation of the user.

  Furthermore, as described above, the presence / absence of a change in exercise is determined based on the metadata of the instructional video data, and it is determined whether the instructional video data is data that requires correction based on the determination result. I am doing so. For this reason, even if there is no problem for the user himself / herself, when the exercise indicated by the selected instruction data needs to prepare the equipment, it is determined that adaptation is not possible and the instruction video data is appropriately corrected. Can be added.

  Further, the instruction video data is corrected in accordance with the information indicating the correction content stored in the correction method table 144. For this reason, it is possible to always apply appropriate correction processing to the instruction video data according to the situation of the user or the contents of the instruction data, and thus it is possible to always present appropriate instruction data to the user. .

  Further, in the first embodiment, user video data representing the state of exercise of the user performed using the corrected instructional video data as a model is stored, and the content of the correction added to the instructional video data Is stored. Then, when the stored user video data is reproduced, the portion corresponding to the correction is deleted from the user video data based on the stored correction history information, and the user video data is re-generated. I am trying to configure it.

  Therefore, when playing back user video data that captures the state of the user's exercise, the user video data from which the part corresponding to the correction added to the guidance video data is automatically deleted is reconstructed, It is displayed on the leader terminal MT. For this reason, it is possible to display the user exercise video data and the original instruction video data side by side in a state that is always synchronized in time. Therefore, the instructor can compare the image obtained by capturing the state of the user's exercise with the instruction image in a state in which temporal correspondence is always obtained.

(Second Embodiment)
The second embodiment of the present invention provides a user information table for storing user attribute information representing the situation of the user's exercise, and the user modifies the instruction video data according to the contents of the user information table. It is determined whether or not the person is a correction target person who needs In addition, a correction method table storing information indicating the correction contents in association with all combinations of user attribute information, presence / absence of change in posture of exercise and use / non-use of tools is provided, and stored in the correction method table. According to the information representing the contents of the correction method, the instructional video data is corrected and distributed.

FIG. 8 is a block diagram showing a functional configuration of the exercise support server device according to the second embodiment of the present invention. In the figure, the same parts as those in FIG.
The data memory 14 is provided with a user information database 145. In this user information database 145, for example, as shown in FIG. 10, information indicating the degree of care required in association with the user ID, and information indicating whether or not the tool can be used for exercise and whether or not the posture is stored are stored. Yes.

  The correction method table 144 ′ is associated with all combinations of information indicating the degree of care required stored in the user information database 145 and information indicating whether or not the tool can be used for exercise and whether or not the posture can be used. Information indicating correction contents is stored. An example is shown in FIG.

  A user attribute analysis program 136 is newly stored in the program memory 13. The user attribute analysis program 136 performs a process of determining whether or not the user is a correction target person who needs to correct the instructional video data based on the user attribute information stored in the user information database 145. CPU11 is made to perform.

  The instruction video correction program 133 ′ reads out information indicating the corresponding correction processing contents from the correction method table 144 ′ of the data memory 14 when the correction necessity determination program 132 determines that the instruction video data needs to be corrected. . Then, the CPU 11 is caused to execute a process for correcting the instruction video data according to the information indicating the correction content. At the same time, the CPU 11 is caused to execute a process of storing information indicating the history of the correction process applied to the instruction video data in the instruction video storage area 142 of the data memory 14 in association with the instruction video data.

Next, the correction delivery control operation of the instructional video data by the exercise support server device SV configured as described above will be described. FIG. 9 is a flowchart showing the control procedure and control contents. In the figure, the same parts as those in FIG.
First, the CPU 11 of the exercise support server SV reads the attribute information of the user as the delivery destination from the user information database 145 of the data memory 14 in step S91. In step S33, based on the read user attribute information, it is determined whether or not the user is a correction target person who needs to correct the instructional video data. For example, as shown in FIG. 10, for the user with user ID = 1 and the user with user ID = 2, the degree of care required is “1”, and there is no hindrance to the use of tools and changes in posture. Therefore, it is determined that the person is a non-correction target who does not need correction. On the other hand, for the user with user ID = 4, the degree of care required is “5”, and the posture is “impossible to stand”, so it is determined that the user is to be corrected.

  Next, the CPU 11 proceeds to step S34, and reads the instruction video metadata of the exercise to be performed next, as described in the first embodiment. Then, based on this metadata, it is determined in step S35 whether or not the next exercise is to be corrected. Subsequently, in step S36, the CPU 11 determines whether or not the instruction video needs to be corrected based on the determination result in step S33 and the determination result in step S35. As a result of this determination, if there is no need for correction, the process proceeds to step S37, where instruction video data corresponding to the next exercise is read from the instruction video storage area 142, and this instruction video data is directly sent to the user terminal UT1. To deliver.

  On the other hand, in step S36, it is determined that it is necessary to correct the next exercise. In this case, the CPU 11 proceeds to step S38, and reads information representing the correction method from the correction method table 144 ′. In step S39, the instruction video data corresponding to the exercise to be performed next is corrected according to the information indicating the read correction method.

  For example, if the user of the user terminal UT1 has a degree of care required of 4, and there is no change in posture in the next exercise and no tool is used, the correction method table 144 ′ shows “slow motion” as the correction contents. Is read out. For this reason, the slow motion processing is applied to the instruction video data corresponding to the next exercise. And this corrected instruction | indication video data is delivered to user terminal UT1 by step S40. As a result, in the user terminal UT1, the motion video is played back in slow motion according to the corrected instruction video data. Therefore, the user can exercise with a margin while watching the instructional video.

  If the user is a person requiring correction with a degree of care required of “4” or more and there is a change in posture in exercise, “pause 30 seconds” is read from the correction method table 144 ′ as the processing content. For this reason, the CPU 11 adds correction for inserting a pause for 30 seconds to the instruction video data corresponding to the exercise to be performed next before the exercise starts. Similarly, if the user is a non-correction target person with a degree of care required of “3” or less, but there is a change in posture in the exercise, “pause 15 seconds” is read as the processing content from the correction method table 144 ′. Therefore, the CPU 11 adds a correction for inserting a 15-second pose before starting the exercise to the instruction video data corresponding to the exercise to be performed next.

  Further, when the exercise tool changes to a rubber band, “pause + 15 seconds” is read as the processing content from the correction method table 144 ′. Therefore, the CPU 11 modifies the instruction video data corresponding to the next exercise to extend the length of the pause period inserted before starting the exercise for another 15 seconds. Similarly, when the exercise tool changes to a dumbbell, “pause + 10 seconds” is read as the processing content from the correction method table 144 ′. Therefore, the CPU 11 modifies the instruction video data corresponding to the exercise to be performed next to extend the length of the pause period to be inserted before the exercise starts for another 10 seconds.

  Then, when the instruction video data correction process is completed, the CPU 11 delivers the instruction video data corrected in step S40 to the user terminal UT1. As a result, in the user terminal UT1, the exercise start timing is delayed only by the pause period in accordance with the corrected instruction video data. Therefore, the user can make preparations for posture change and preparation of exercise equipment during this pose period.

  Further, when the correction process is performed on the instruction video data, the CPU 11 creates information indicating the content and the correction position of the correction process performed on the instruction video data, and further adds the user ID to be distributed and the date / time to this information. Information is added, and this information is stored as correction history information in the instruction video storage area 142 of the data memory 14 in association with the instruction video data to be corrected.

  When the distribution of the instructional video data corresponding to the one exercise is completed, the CPU 11 determines in step S41 whether or not all the exercises are completed. If the next exercise remains, the process returns to step S34. In step S34, metadata corresponding to the exercise to be performed next is read from the instruction video metadata storage area 143. In step S35, it is determined whether or not the next exercise is an exercise requiring correction.

Subsequently, in step S36, it is determined whether or not the instruction video needs to be corrected based on the determination result obtained in step S33 and the determination result newly obtained in step S35. If the determination result shows that correction is necessary, information indicating the correction method is read out in step S38, the instruction video data corresponding to the exercise to be performed next is corrected in step S39, and then the user is determined in step S40. Deliver to terminal UT1. On the other hand, if correction is unnecessary, the process proceeds to step S37, and the instruction video data corresponding to the exercise to be performed next is delivered to the user terminal UT1 as it is. On the other hand, when all the exercises determined by the schedule are finished, the CPU 11 finishes the distribution control of the instructional video data.
The user video accumulation and playback control operations are performed according to the same control procedure and control contents as those of the first embodiment (FIG. 6) described above.

  As described above, in the second embodiment, the user information table 145 that stores the user attribute information indicating the situation of the user's exercise is provided, and the user gives guidance according to the contents of the user information table 145. It is determined whether or not the person to be corrected needs to correct the video data. Therefore, simple and quick determination processing can be performed without requiring heavy processing such as image analysis processing.

(Other embodiments)
In each of the above-described embodiments, all processing related to correction and distribution of instructional video data is performed in the exercise support server device. However, the present invention is not limited thereto, and instruction video data that is not processed by the user terminals UT1 to UTn is received from the exercise support server device, and the user terminals UT1 to UTn are all involved in correction and display for the received instruction video data. You may make it perform the process of. In this case, the user terminals UT1 to UTn function as exercise support apparatuses according to the present invention.

  Further, in the above embodiment, when the motion video data of the user, which is modeled on the guidance video data subjected to the slow motion processing, is reproduced on the leader terminal MT, the slow motion portion is fast-forwarded at a normal speed. I tried to play it. However, the present invention is not limited to this, and if the instructor wishes to play the video in slow motion, the user motion video data can be obtained by transmitting a command to that effect from the instructor terminal MT to the exercise support server device SV. You may comprise so that it may download to the leader terminal MT from the exercise | movement assistance server apparatus SV with a slow motion.

Furthermore, in the above embodiment, the case where instruction video data is distributed has been described as an example. However, the instruction data is not necessarily video data, and may be audio data or text data.
In addition, the types and configurations of exercise support devices, control procedures and control details for correction and presentation of instruction data, re-display control procedures and control details for user video data, correction types for exercise types and instruction data, etc. Various modifications can be made without departing from the scope of the present invention.

  In short, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in each embodiment. Furthermore, you may combine suitably the component covering different embodiment.

BRIEF DESCRIPTION OF THE DRAWINGS It is a schematic block diagram of the exercise assistance system provided with the exercise assistance apparatus concerning 1st Embodiment of this invention. It is a block diagram which shows the function structure of the exercise assistance server apparatus which is 1st Embodiment of the exercise assistance apparatus concerning this invention. It is a flowchart which shows the correction | amendment control procedure and control content of instruction | indication video data by the exercise | movement assistance server apparatus shown in FIG. It is a figure which shows an example of instruction | indication video metadata used in the correction control shown in FIG. It is a figure which shows an example of the correction method table used in the correction control shown in FIG. It is a flowchart which shows the reproduction | regeneration control procedure and control content of user exercise | movement video data by the exercise | movement assistance server apparatus shown in FIG. It is a figure which shows the example of a display of instruction | indication video data and user exercise | movement video data displayed by the reproduction | regeneration control shown in FIG. It is a block diagram which shows the function structure of the exercise assistance server apparatus which is 2nd Embodiment of the exercise assistance apparatus concerning this invention. It is a flowchart which shows the correction control procedure and control content of instruction | indication video data by the exercise | movement assistance server apparatus shown in FIG. It is a figure which shows an example of the user information table used in the correction control shown in FIG. It is a figure which shows an example of the correction method table used in the correction control shown in FIG.

Explanation of symbols

  UT1 to UTn ... user terminal, SV ... exercise support server device, MT ... instructor terminal, NW ... communication network, 11 ... CPU, 12 ... bus, 13 ... program memory, 131 ... user video analysis program, 132 ... modification Necessity determination program, 133, 133 '... instruction video correction program, 134 ... instruction video distribution control program, 135 ... video redisplay control program, 136 ... user attribute analysis program, 14 ... data memory, 141 ... user video storage Area 142. Instruction video storage area 143 Instruction video metadata storage area 144 and 144 ′ Correction method table 145 User information database 15 Communication interface (communication I / F)

Claims (9)

A first storage means for storing instruction data as a model when the user exercises;
Determination means for determining whether or not the user can adapt to the exercise indicated by the instruction data;
When it is determined by the determination means that adaptation is not possible, correction means for adding correction to make the guidance data adaptable;
An exercise support apparatus comprising: presentation means for presenting instruction data corrected by the correction means to the user. The determination means includes
Means for analyzing the range or speed of the user's movement from the motion video data recording the state of the user's past movement;
The exercise support apparatus according to claim 1, further comprising: a unit that determines whether the user can adapt to the exercise indicated by the instruction data based on the analysis result. The determination means includes
Means for storing user attribute information representing a situation regarding the user's exercise;
The exercise support according to claim 1, further comprising means for determining whether or not the user can adapt to the exercise indicated by the instruction data based on the stored user attribute information. apparatus. The determination means includes
Means for storing exercise attribute information representing an attribute of exercise indicated by the instruction data;
The exercise support apparatus according to claim 1, further comprising: means for determining whether the user can adapt to the exercise indicated by the instruction data based on the stored exercise attribute information. . The correcting means is
Correction content storage means for storing information representing a correction content set in advance in association with at least one of the user attribute information and the exercise attribute information of the guidance data, the analysis result of the range or speed of the user When,
When it is determined by the determination means that adaptation is not possible, information indicating the correction content corresponding to the basis of the determination is read from the correction content storage means, and the guidance is based on the information indicating the read correction content. The exercise support apparatus according to claim 2, further comprising means for correcting data.   The exercise support apparatus according to claim 1, wherein the correction unit performs a correction process for reproducing the instruction data in slow motion with respect to the instruction data.   The exercise support apparatus according to claim 1, wherein the correction unit inserts a pause period before or during the start of the exercise indicated by the instruction data. Means for storing user video data representing the status of the user's exercise performed using the corrected instruction data as a model;
Means for storing a correction history added to the instruction data;
When the stored user video data is reproduced, the portion corresponding to the correction is deleted from the user video data based on the stored correction history, so that the uncorrected user video data is reproduced. The exercise support apparatus according to claim 1, further comprising means for configuring the exercise support apparatus. A program used in an exercise support apparatus that performs a process of reading instruction data serving as a model when a user exercises from a storage unit and presenting the instruction data to a presentation unit using a computer,
A process for determining whether or not the user can adapt to the exercise indicated by the instruction data;
When it is determined that adaptation is not possible, processing for making corrections to make the guidance data adaptable;
The program which makes the said computer perform the process which makes the said presentation part show the said corrected instruction | indication data.

Images