JP4594157B2 - Exercise support system, user terminal device thereof, and exercise support program - Google Patents

Description

  The present invention relates to an exercise support system that remotely supports a user's exercise using a communication network, a user terminal device thereof, and an exercise support program.

  The fall accident of the elderly occurs mainly due to a decline in physical functions such as a decrease in muscle strength due to aging. Fractures caused by a fall accident can cause various obstacles and can lead to bedridden. In order to prevent falling accidents and prevent fractures and bedriddenness, it is important to improve declining body functions by increasing muscle strength. Various systems have been proposed.

  For example, a simulation game that allows a virtual experience of exercise along a virtual course by performing an actual exercise is advanced in real time, and an exercise that calculates and notifies the amount of exercise based on the measurement result of the biological information measurement unit when performing an actual exercise There is an instruction device (see, for example, Patent Document 1).

  In addition, a health guidance system has been proposed in which personal medical / examination information is registered in a database, and exercise / health / nutrition guidance is provided from a remote location via a network based on the registered individual medical / examination information. (For example, refer to Patent Document 2).

JP 2002-346013 A

JP 2002-351993 A

  However, in the exercise instruction device and the health guidance system described above, it is difficult for the user to confirm his / her own movement, and it is difficult for the instructor to convey a shift or error in the movement to the user. For this reason, there is a problem in that it is difficult to receive accurate guidance, and as a result, the exercise effect is difficult to appear as compared with the case of actually visiting a fitness club or a sports gym and receiving guidance from a leader.

  The present invention has been made paying attention to the above circumstances, and the purpose of the present invention is to enable the user himself / herself to accurately grasp the shift and error of the movement, thereby enabling accurate and effective exercise at all times. It is to provide an exercise support system, a user device thereof, and an exercise support program.

In order to achieve the above object, an exercise support system and a program therefor according to the first invention comprise means for storing first personal data relating to a user's exercise ability or exercise purpose and a plurality of instructions in the exercise support device. Means for storing second personal data including information representing the coaching class of the person, and the athletic ability of the user from among the plurality of leaders based on the stored first and second personal data Alternatively, there are provided means for selecting a leader suitable for the purpose of exercise and means for transmitting guidance image data of the selected leader from the leader terminal of the leader to the user terminal . On the other hand, the user terminal captures the instruction image data transmitted from the exercise support device and presents it to the user, and images the user who exercises using the presented instruction image data as an example. In addition to means for obtaining user image data, a difference detection means and a notification means are provided. Then, by means of the difference detection means, whether the user performs the exercise by looking at the exercise image data of the instructor as a real image or the exercise by looking at it as a mirror image, the exercise direction input by the user prior to the exercise is selected. If it is determined based on the information and it is determined that the exercise is performed as a real image as a result of this determination, the difference in motion between the user's exercise image data and the instructor's exercise image data is calculated. On the other hand, if it is determined that the exercise is performed as a mirror image as a result of the determination, the mirror image data is generated based on the received exercise image data of the instructor, and the user's exercise image is generated. A motion difference between the data and the generated mirror image data is detected. When the detected difference in motion exceeds a threshold value, the notification means notifies the user to that effect.

  Therefore, according to the present invention, the user can perform an exercise using the instruction video as an example in his terminal device without going to a health center or a gym. Moreover, when a difference greater than or equal to the threshold value occurs between the user's movement and the leader's movement, the user is notified. For this reason, even though the user is exercising alone, it is possible to correct his / her movement each time, thereby making it possible to always perform an accurate and effective exercise.

Further, according to the present invention, it is possible to transmit the leader image data output from the leader terminal to the user terminal and present it to the user, thereby enabling the user to stay with the leader while in a remote place. It is possible to exercise in real time. Moreover, based on the personal data of the user and the personal data of the instructor, an instructor suitable for the user's athletic ability or purpose is selected from a plurality of instructors, and the guidance of the selected instructor is selected. Image data is sent to the user terminal. For this reason, the user can receive remote guidance from a leader suitable for his / her exercise ability or exercise purpose.

On the other hand, an exercise support system and a program therefor according to the second invention comprise means for storing first personal data relating to the exercise ability or exercise purpose of the user and an instruction class of a plurality of instructors in the exercise support device. Based on the stored first and second personal data, means for storing second personal data including information representing the information, means for storing instruction image data of the plurality of leaders, and Means for selecting instruction image data of a leader suitable for the exercise ability or purpose of the user from a plurality of instruction image data, and means for transmitting the selected instruction image data to the user terminal. . On the other hand, as in the first invention, the user terminal receives the instruction image data transmitted from the exercise support device and presents it to the user, and uses the presented instruction image data as a model. In addition to means for obtaining user image data by imaging a user performing exercise, a difference detection means and a notification means are provided. Then, by means of the difference detection means, whether the user performs the exercise by looking at the exercise image data of the instructor as a real image or the exercise by looking at it as a mirror image, the exercise direction input by the user prior to the exercise is selected. If it is determined based on the information and it is determined that the exercise is performed as a real image as a result of this determination, the difference in motion between the user's exercise image data and the instructor's exercise image data is calculated. On the other hand, if it is determined that the exercise is performed as a mirror image as a result of the determination, the mirror image data is generated based on the received exercise image data of the instructor, and the user's exercise image is generated. A motion difference between the data and the generated mirror image data is detected. When the detected difference in motion exceeds a threshold value, the notification means notifies the user to that effect.

  If comprised in this way, since the memorize | stored instruction | indication image data is delivered to a user terminal, compared with the case where the exercise | movement image data of an instructor is transmitted in real time from an instructor terminal to a user terminal, many in the same time slot | zone. The instruction image data suitable for the user can be distributed to the user terminal. In addition, the user does not have to adjust to the time when the instructor performs, and there is an advantage that the instructor can receive on-demand exercise instruction whenever he wants to exercise.

Further, according to the first and second inventions, when a difference equal to or greater than the threshold value is generated between the movement of the user and the mirror image data of the instructor, the fact is notified to the user. For this reason, even though the user is exercising alone, it is possible to correct his / her movement each time, so that the user can always perform an accurate and effective exercise.

  The user terminal device and the program according to the present invention detect the difference in movement by comparing the user image data and the instruction image data for each body part when detecting the difference in movement. Then, the detected difference in motion for each part is compared with a threshold value set for each part, and when a part in which the difference in motion exceeds the threshold value is detected, the user is notified of the fact. It is characterized by doing.

  If it does in this way, the difference of a motion between a user and a leader will be detected for every part of a user's body, and the size will be judged. For this reason, the user can know and correct the movement deviation or error for each part of the body such as the arm, knee, or waist, and can perform more effective exercise.

  In addition, when a user performs several types of exercise | movement, the determination threshold value of a monitoring object site | part and a difference is set for every exercise | movement type. Then, for each type of exercise, the user image data and the instruction image data are compared for each part of the body and the difference in the movement is detected, respectively, and the difference in the movement for each detected part is determined for each of the above-described types of movement. It may be compared with the threshold value set for each, and when the part where the difference in motion exceeds the threshold value is detected, that fact may be notified to the user.

In short, in the present invention, instruction image data serving as an example of exercise or mirror image data thereof is compared with image data obtained by imaging a user during exercise, and a difference in motion is detected, and the detected difference in motion is detected. When the threshold value exceeds the threshold, the user is notified of this.
Therefore, according to the present invention, the user himself / herself can accurately grasp the shift and error of the movement, and thereby the exercise support system, the user device and the exercise support that can always perform an accurate and effective exercise. A program can be provided.

Embodiments of an exercise support system according to the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is a schematic configuration diagram showing a first embodiment of an exercise support system according to the present invention. In the exercise support system according to the first embodiment, a plurality of user terminals UT1 to UTn installed in a user's home or the like are connected to the exercise support server device SV installed in a health center, a sports club, a fitness club, or the like. However, it can be connected via the communication network NW. At the same time, a leader terminal MT used by the leader is connected to the exercise support server device SV via, for example, a LAN (Local Area Network).

  The communication network NW includes an IP (Internet Protocol) network represented by the Internet and a plurality of access networks for accessing the IP network. As the access network, for example, a DSL (Digital Subscriber Line) or a wired subscriber network using an optical transmission line, a CATV (Cable Television) network, a wireless LAN (Local Area Network) network, a mobile communication network, or a dedicated line network is used. .

By the way, the instructor terminal MT is composed of, for example, a personal computer and has the following functions. FIG. 2 is a block diagram showing the configuration.
That is, the leader terminal MT includes a central processing unit (CPU) 11. The CPU 11 is connected to a program memory 13 and a data memory 14 via a bus 12, and further includes a communication interface (communication I / F) 15, a camera interface (camera I / F) 16, and a display interface (display I / F). 17, an audio input / output interface (audio input / output I / F) 18 and an input interface (input I / F) 19 are connected to each other.

  The communication I / F 15 performs bidirectional communication with the exercise support server device SV according to a communication protocol defined by the communication network NW under the control of the CPU 11. For example, TCP / IP (Transmission Control Protocol / Internet Protocol) is used as the communication protocol.

  The camera I / F 16 takes in the image data of the instructor captured by the camera 20 during the exercise period under the control of the CPU 11. The display I / F 17 displays the exercise image data of the instructor captured by the camera 20 and the received exercise image data of the user on the display 21 under the control of the CPU 11.

  The voice input / output I / F 18 is used when a voice call is made with the user during or before and after the exercise period. Under the control of the CPU 11, the voice of the instructor is transmitted to the microphone 23. And the received voice signal sent from the user terminal is output from the speaker 22. The input IF 19 captures data input from an input device such as a keyboard or a mouse.

  The data memory 14 uses, for example, a hard disk, flash memory, RAM, or the like as a storage medium, and includes an image data storage area 14a in addition to a working storage area. In this image data storage area 14a, the exercise image data of the leader imaged by the camera 20 and the exercise image data of the user sent from the user terminal are stored.

The program memory 13 stores an image capturing control program 13a, an image transmission / reception control program 13b, and an image editing program 13c as application programs according to the present invention.
The image capturing control program 13a operates the camera I / F 16 to capture the exercise image data of the instructor captured by the camera 20, and stores it in the image data storage area 14a. At this time, the voice data of the instructor input to the microphone 23 simultaneously with the imaging is also included in the exercise image data and stored in the image data storage area 14a.

  The image transmission / reception control program 13b operates the communication I / F 15 during the exercise instruction execution period, and the instruction image data of the instructor acquired by the image acquisition control program 13a or the instruction stored in the image data storage area 14a. The exercise image data of the person is transmitted from the communication I / F 15 to the user terminals UT1 to UTn via the exercise support server device SV. At the same time, the user's exercise image data sent from the user terminals UT1 to UTn via the exercise support server device SV is received via the communication I / F 15.

The image editing program 13c displays one screen of the exercise image data of the instructor captured by the image capture control program 13a and the exercise image data of the user received by the image transmission / reception control program 13b during the exercise instruction implementation period. Editing is performed so that the images are arranged on the top, and the edited image data is displayed on the display 21 via the display I / F 17.
The display 21 may be a display attached to the instructor terminal MT, but a television receiver or a video projector provided separately may be used. In addition, the type, shape, and size of the display device are not particularly limited.

Next, the exercise support server SV is constituted by a Web server and has the following functions. FIG. 3 is a block diagram showing the configuration.
That is, the exercise support server device SV includes a CPU 31. A program memory 33 and a data memory 34 are connected to the CPU 31 via a bus 32, and a communication interface (communication I / F) 35 is further connected.

  The communication I / F 35 communicates with the user terminals UT1 to UTn and the instructor terminal MT according to a communication protocol defined by the communication network NW under the control of the CPU 31. As described above, for example, TCP / IP (Transmission Control Protocol / Internet Protocol) is used as the communication protocol.

The data memory 34 uses, for example, a hard disk, flash memory, RAM, or the like as a storage medium, and includes a personal data storage area 34a and an image data storage area 34b.
The personal data storage area 34a stores user personal data sent from the user terminals UT1 to UTn. The personal data includes a user membership number, user attribute information, information on athletic ability, and information indicating the purpose of exercise. The attribute information includes an address, name, contact address, and the like. Information on athletic ability includes age, gender, height, weight, exercise history, medical history, diagnosis contents (hypertension, diabetes, etc.) by medical institutions, and past exercise results and exercise ability set accordingly Levels (Beginner, Intermediate, Advanced, etc.) are added. Information on the purpose of exercise includes lifestyle-related disease prevention, care prevention (fall prevention), diet (weight down, partial thinning (foot, arms, waist, etc.)), muscle strength, exercise deficiency, refresh (whole body relaxation exercise) , Desk work fatigue, etc.), for hobbies and fun.

  The image data storage area 34b stores exercise image data of the leader transmitted from the leader terminal MT. The exercise image data is read from the image data storage area 34b and transmitted when the exercise support server device SV provides the instruction image data to the user terminals UT1 to UTn instead of the instructor terminal.

The program memory 33 stores a personal data management program 33a and an image data distribution control program 33b.
The personal data management program 33a receives user personal data by communicating with the user terminals UT1 to UTn through the communication I / F 35, and stores the received personal data in the personal data storage area 34a. .

  The image data distribution control program 33b receives the exercise image data of the leader transmitted from the leader terminal MT or the exercise image data of the leader read from the image data storage area 34b from the communication I / F 35. Deliver to terminals UT1 to UTn. At the same time, the user's exercise image data transmitted from the user terminals UT1 to UTn is transferred from the communication I / F 35 to the instructor terminal MT.

On the other hand, the user terminals UT1 to UTn are composed of personal computers, for example, and have the following functions. FIG. 4 is a block diagram showing the configuration.
That is, each of the user terminals UT1 to UTn includes a central processing unit (CPU) 41, like the leader terminal MT described above. The CPU 41 is connected to a program memory 43 and a data memory 44 via a bus 42, and further includes a communication interface (communication I / F) 45, a camera interface (camera I / F) 46, and a display interface (display I / F). 47, a voice input / output interface (voice input / output I / F) 48 and an input interface (input I / F) 49 are connected to each other.

  The communication I / F 45 performs bidirectional communication with the exercise support server device SV according to a communication protocol defined by the communication network NW under the control of the CPU 41. For example, TCP / IP (Transmission Control Protocol / Internet Protocol) is used as the communication protocol.

  The camera I / F 46 captures user image data captured by the camera 50 during the exercise period under the control of the CPU 41. The display I / F 47 displays the user's own exercise image data captured by the camera 50 and the instructor's exercise image data received by the communication I / F 45 on the display 51 under the control of the CPU 41. .

  Under the control of the CPU 41, the voice input / output I / F 48 captures the user's transmitted voice from the microphone 53 and outputs the received voice signal transmitted from the instructor terminal serving as the other party of communication from the speaker 52. The input IF 49 captures data input from an input device such as a keyboard or a mouse.

  The data memory 44 uses, for example, a hard disk, flash memory, RAM, or the like as a storage medium, and includes a personal data storage area 44a and an image data storage area 44b in addition to a work storage area. The personal data storage area 44a stores personal data input by the user at the time of member registration, that is, the same data as the personal data stored in the personal data storage area 34a of the exercise support server SV. In the image data storage area 44b, the received exercise image data of the instructor and the user's own exercise image data captured by the camera 50 are stored.

  In the program memory 43, as an application program for carrying out the present invention, in addition to a personal data setting control program, an image capturing control program 43a, an image transmission / reception control program 43b, an image editing program 43c, and an operation difference detection program 43d and an operation tendency comparison program 43e are stored.

  Among these programs, the image capture control program 43a, the image transmission / reception control program 43b, the image editing program 43c, the motion difference detection program 43d, and the motion trend comparison program 43e are downloaded from the exercise support server device SV after membership registration. The Of course, it is possible to read and set up each application program from an external recording medium such as a CD-ROM or a memory card.

  The personal data setting control program receives input of personal data and exercise purpose data by the user, and transmits the input personal data and exercise purpose data from the communication I / F 45 to the exercise support server device SV. Execute the process. For example, the homepage disclosed on the Web is accessed by the exercise support server device SV in response to the user's operation, and personal data input by the user and data representing the purpose of exercise are received on the homepage input screen. In addition, prior membership registration is required to access the homepage, and the homepage can be accessed by inputting the user ID and password given from the exercise support server device SV by this membership registration. .

  The image capture control program 43a operates the camera I / F 46 to capture the user's motion image data captured by the camera 50 and stores it in the image data storage area 44b. At this time, the user's voice data input to the microphone 53 simultaneously with the imaging is also included in the motion image data and stored in the image data storage area 44b.

  The image transmission / reception control program 43b operates the communication I / F 45 during the exercise execution period, and transmits the exercise image data of the user captured by the image capture control program 43a from the communication I / F 45 to the exercise support server SV. Then, it transmits to the leader terminal MT. At the same time, the exercise image data of the instructor sent from the instructor terminal MT via the exercise support server device SV is received via the communication I / F 45 and stored in the image data storage area 44b.

  The image editing program 43c displays, on one screen, the exercise image data of the user captured by the image capture control program 43a and the exercise image data of the instructor received by the image transmission / reception control program 43b during the exercise period. The edited image data is displayed on the display 51 via the display I / F 47.

  The motion difference detection program 43d is provided between the exercise image data of the user captured by the image capture control program 43a and the exercise image data of the instructor received by the image transmission / reception control program 43b during the exercise implementation period. Is detected for each monitoring target part. Specifically, the user's motion image data and the instructor's motion image data are subdivided (coordinated) into mesh shapes, and the monitoring target parts of the instructor and the user, such as the neck and the hand, for each of these coordinates. Differences in movement states (timing, angle, posture, etc.) of the legs, knees, hips, etc. are detected.

  Further, the motion difference detection program 43d processes the instructor's motion image data using CG (Computer Graphic) technology or the like prior to the above-described motion difference detection, and thereby the instructor in the instructor's motion image data. Is matched with the user's body type in the user's motion image data.

  The motion tendency comparison program 43e calculates the motion difference between the motion image data of the user and the motion image data of the instructor detected by the motion difference detection program 43d as a threshold value for each monitoring target part. Compare. Then, an alarm sound is generated from the speaker 52 when a monitoring target part whose motion difference exceeds a threshold value is detected.

  Prior to the comparison process, the movement tendency comparison program 43e includes information included in the personal data of the user stored in the personal data storage area 44a, that is, information on exercise ability and information indicating the purpose of exercise. In addition, a process for setting an appropriate threshold value for each monitoring target part of the user is performed.

Next, the operation of the exercise support system configured as described above will be described. FIG. 5 is a flowchart showing the control procedure and control contents of the user terminals UT1 to UTn.
When using the exercise support service of this system, the user first performs membership registration. This member registration process is performed as follows. That is, the user performs an operation for opening a corresponding homepage on the Web at the user terminal (for example, UT1). Then, the CPU 41 of the user terminal UT1 activates the browser function to access the home page, downloads the display data of the member registration screen, and displays it on the display 51. In this state, if the user performs an input operation for member registration on the member registration screen, the CPU 41 captures the input user attribute information, information on athletic ability, and information indicating the purpose of the exercise. These pieces of information are transmitted from the communication I / F 45 to the exercise support server device SV.

  On the other hand, when the exercise support server device SV receives input information for member registration from the user terminal UT1, the exercise support server device SV issues a user ID and password to the registration requesting user. The ID and password are transmitted to the user terminal UT1. The received input information is stored in the personal data storage area 34a in the data memory 34 as personal data. The user terminal UT1 receives the user ID and password sent from the exercise support server device SV via the communication I / F 45, and stores them in the personal data storage area 44a together with the inputted personal data.

  When the registration of personal data is completed by transmitting the user ID and password, the exercise support server SV subsequently obtains an application program necessary for the user to use the exercise support service provided by this system. Download to the user terminal UT1. The downloaded programs include an image capture control program 43a, an image transmission / reception control program 43b, an image editing program 43c, an operation difference detection program 43d, and an operation tendency comparison program 43e. On the other hand, the user terminal UT1 receives each program downloaded from the exercise support server device SV and stores the received program in the program memory 43.

  When the user is registered as a member, the exercise support server device SV analyzes the user's personal data stored in the personal data storage area 34a, and first selects an exercise menu suitable for the user. . Examples of exercise menus include fall prevention exercises for care prevention (muscle-up exercises for elderly people with a high risk of fall), health exercises (fat burning exercises) for lifestyle-related disease prevention and diet, jazz dance and yoga, Tai Chi, hula dance, aerobics and so on.

  Next, the exercise support server SV creates a schedule for executing the selected exercise menu. For example, if the exercise menu is fall prevention exercises (muscle strength exercises), the exercise schedule is composed by combining multiple types of preparatory exercises, multiple types of strength increase exercises, and multiple types of organizing exercises in time series. Is done. Preparatory exercises include bending and stretching of fingers, raising and lowering elbows, bending and stretching of the hips, and muscle strength raising exercises include raising and lowering toes and heels and knee alignment. The organizing exercise includes breathing exercise. The schedule includes the user ID, the instructor's ID, the information indicating the type and content of the exercise, and the exercise start time.

  The created schedule data is stored in the personal data storage area 34a of the exercise support server device SV and notified from the exercise support server device SV to the user terminal UT1 and the instructor terminal MT.

When the schedule data is notified, exercise support control is performed in the user terminal UT1 as follows.
That is, at the user terminal UT1, when the exercise preparation time determined by the above schedule is reached (for example, 5 minutes before the start of exercise), the user terminal UT1 moves from step S1 to step S2 as shown in FIG. First, a threshold value for determining the movement deviation is set. The determination threshold value is set by reading out information contained in the user's personal data from the personal data storage area 44a, that is, information relating to athletic ability and information indicating the purpose of the exercise, and analyzing each read out information. Is made by

  For example, in the case of elderly people or beginner level users, the judgment threshold is set high so that this is detected as a movement shift or error only when there is a significant difference in movement, such as when the left and right legs are raised. To do. On the other hand, for advanced level users and users with a large number of implementations, the judgment threshold is set low so that even if the difference in movement is small, this is detected as a shift or error in movement. .

  The determination threshold is set for each monitoring target part of the user. For example, if the user's purpose of exercise is strength training of arms and legs, elbows and knees are selected as monitoring target parts. Then, based on information related to the exercise ability such as the age, exercise history, and medical history of the user, determination thresholds suitable for the user are set for each of the selected monitoring target parts.

  For example, in arm strength training, the effect is low when the elbow is lowered, so even if there is a slight movement difference in the elbow position (relative to the shoulder position), this is detected as a movement deviation or error. Set the judgment threshold value low. On the other hand, the determination threshold is set to be high for a part not related to the movement of the muscle to be trained so that even if a slight difference occurs in the movement, this is not detected as a movement deviation or error. In addition, a sick part or a painful part is included in the personal data, and a high threshold is set for the sick part or the painful part or the difference detection itself is not performed (that is, the part to be monitored). May be performed.

  In addition, when the exercise schedule is composed of a combination of a plurality of exercises as described above, for each of the plurality of exercises, the determination threshold is based on the contents of the exercise and the personal information of the user. Is set. For example, for a preparatory exercise for bending and stretching a finger, the monitoring target region is “a finger of a hand”, and a threshold value corresponding to the bending and stretching of the finger is set. For the preparatory exercise for bending and stretching the elbow, the monitoring target region is “elbow”, and a threshold value corresponding to the bending and stretching of the elbow is set.

  Next, when the exercise start time determined by the schedule is reached, the exercise support server device SV establishes a communication link between the instructor terminal MT and the user terminal UT1, and thereby, between the instructor and the user. Voice communication or television telephone communication becomes possible. When the instructor and the user exchange greetings and start exercise, the exercise image data of the instructor captured by the camera 20 at the instructor terminal MT is transmitted to the user terminal UT1 via the exercise support server device SV. Is transmitted to.

  In step S4, the user terminal UT1 receives the instructor's exercise image data via the communication I / F 45, stores it in the image data storage area 44b, and displays it on the display 51. At the same time, in step S3, the user's movement is imaged by the camera 50, and the movement image data of the user is stored in the image data storage area 44b, and the movement image of the instructor received in step S6. The data is edited in one screen in time synchronization, and the edited image data is displayed on the display 51 in step S7. FIG. 6 shows an example of the display result. In the figure, D1 indicates the exercise image data of the instructor, and D2 indicates the exercise image data of the user.

When the image editing is performed, the user terminal UT1 processes the exercise image data of the instructor using the CG technique or the like in step S5 in order to bring the instructor's body shape closer to the user's body shape. The exercise image data of the CG-processed leader is stored in the image data storage area 44b and displayed on the display 51. If the user feels uncomfortable with the exercise image data of the leader that has been subjected to CG processing, the exercise image data of the leader before the CG processing may be displayed.
Thus, after that, the user can exercise while comparing his own exercise image with the exercise image of the instructor.

Now, when the user's exercise is started with the exercise image data of the instructor as an example, the user terminal UT1 is connected with the user in parallel with the display of the exercise image data of the instructor and the user. The difference detection of the movement between the leader and the determination process is performed as follows.
That is, first, in step S8, the CG processed instructor's exercise image data and the user's exercise image data are read from the image data storage area 44b, respectively, and the parts to be monitored are compared on both image data. The difference in movement between the monitoring target parts is detected. For example, how much time difference there is between the timing when the leader raises his right hand and the timing when the user raises his right hand, or how much the elbow and knee angles and postures differ when the limb is raised To detect. Specifically, the motion image data of the instructor and the user is subdivided (coordinated) into mesh shapes, and how the monitored target parts such as elbows and knees move on these coordinates is detected. Is done.

  Next, in step S9, the user terminal UT1 compares the detected movement difference between the monitoring target parts with the determination threshold value previously set in step S2. And when the monitoring object site | part in which the difference of a motion exceeds a determination threshold value, an alarm sound is generated from the speaker 52 by step S10.

For example, in the case of an elderly person or a user at an elementary level, an alarm sound is generated only when the movements of the legs to be raised are different and the movements are significantly different. On the other hand, in the case of a high-level user or a user with a large number of implementations, even if the difference in movement is small, this is detected as a shift or error in movement and an alarm sound is generated. Instead of the alarm sound, a voice message for notifying the user of a part having a large movement deviation may be generated and output by the voice synthesis means.
Therefore, the user can notice the deviation or error of his / her movement with respect to the instructor by the alarm sound or the voice message, thereby correcting his / her movement.

  FIG. 7 is a diagram for more specifically explaining the detection and determination results of the above-described movement deviation, and FIG. 7A shows time-series changes in the actions of the instructor and the user. Yes. FIGS. 7B and 7C divide the exercise image data of the instructor and the exercise image data of the user into meshes, respectively, and show the difference between the instructor's movement and the user's movement. .

  For the exercise image data of the instructor and the user displayed side by side as shown in FIG. 6 on the display 51, the height, arm position, waist position, etc. from a stationary state with both hands spread out in advance. By detecting each edge and determining an operation point, as shown in FIGS. 7 (b) and (c), the motion point of each operation point can be determined by dividing the mesh and obtaining a vector based on the coordinate position. The direction or the like can be detected.

  When the operation between the instructor and the user is viewed in time series, it can be seen that there is a large difference in movement during the period from time t1 to time t2 shown in FIG. It can also be seen that the user's movement tends to be delayed compared to the instructor during the period from time t3 to time t4. Differences in these movements are detected by differences in movement between the instructor and the user at each point divided into meshes, as shown in FIGS. 7B and 7C. That is, when the pose of the instructor is compared with the pose of the user, it is detected that the user's arm is at a position lower than the position p1 and the user's knee is at a position lower than the position p2.

  In addition, as described above, the determination threshold is set for each monitoring target part based on information related to the exercise ability included in the user's personal data immediately before the start of exercise and information indicating the exercise purpose. Yes. For this reason, for example, in the case of strength training that is ineffective in a state where the elbow is lowered, an alarm sound is generated even if the elbow position (relative relationship with the shoulder position) is slightly shifted. On the other hand, no alarm sound is generated even if there is a slight difference between parts that are not related to the movement of the muscles to be trained (for example, the effect does not change even if the legs are open or closed). The alarm sound is generated in real time as the user's exercise progresses. For example, an alarm sound is generated from the speaker 52 in the period from time t1 to time t2 and in the period from time t3 to time t4 in FIG.

  In addition, when a user exercises while watching the exercise image data of the instructor, the user raises the right hand when the instructor raises the right hand, and raises the left hand by looking at the instructor's image as a mirror image There are people. Therefore, when detecting the difference between the exercise image data of the user and the exercise image data of the instructor, the user exercises by looking at the exercise image data of the instructor as a real image, or sees the exercise image data as a mirror image. Determine whether to perform. When exercise is viewed as a mirror image, the mirror image data is generated based on the received exercise image data of the instructor, and the mirror image data of the user's exercise image data and the instructor's exercise image data. Detect the difference in motion between and. Whether or not the user exercises by looking at the instructor's exercise image data as a real image or as a mirror image is determined based on the selection information of the exercise direction input by the user prior to the exercise. Can be done.

  The above operation is repeatedly executed until the end of one kind of motion is detected in step S11. When the exercise schedule is composed of a plurality of preparation exercises, strength-up exercises and organizing exercises as described above, the processing from step S1 to step S11 is repeatedly executed for each of these exercises.

  On the other hand, in the leader terminal MT, similarly to the user terminal UT1, the user's exercise image data and the leader's own exercise image data are displayed on the display 21 in a state of being arranged on one screen. At the same time, the alarm sound generated at the user terminal UT1 is transmitted to the instructor terminal MT together with the user's motion image data and output from the speaker 22 as a loud voice. For this reason, the instructor confirms the state of the user with the user's motion image displayed on the display 21 and, based on the alarm sound generated from the speaker 22, gives the user a “higher skill. “Let ’s raise it” and “Next, I ’ll raise my foot”.

  As described above, in the first embodiment, in the user terminal UT1, the user's exercise image data captured by the camera 50 and the instructor's exercise image data sent from the instructor terminal MT are stored in time. In synchronization with each other, it is edited to one screen and displayed on the display 51. In parallel with the above display operation, the motion image data of the user and the motion image data of the instructor that has been subjected to CG processing to approximate the body shape are compared for each monitoring target region, and the difference in motion is calculated. The alarm sound is output from the speaker 52 when the detected motion difference exceeds the determination threshold value.

  Therefore, the user can exercise while using the exercise image data of the instructor displayed on the display 51 as a model and confirming his / her movement, posture and the like based on his / her exercise image data. In addition, when a difference greater than the determination threshold occurs between the movement of the user and the movement of the instructor, an alarm sound is generated at that time to notify the user that his / her movement has deviated. . For this reason, even though the user is exercising alone, it is possible to correct his / her movement in real time each time, thereby making it possible to always exercise accurately and effectively.

  Further, a difference in movement is detected for each monitoring target part, and is compared with a determination threshold set for each monitoring target part. For this reason, it is possible to detect and determine the deviation of the movement of the user for each monitoring target part, and thereby it is possible to accurately perform the exercise suitable for the purpose of the exercise. In addition, the determination threshold value is set based on personal data immediately before the user's exercise that reflects the previous exercise results and the like. For this reason, it is possible to determine the movement deviation according to the recent exercise ability of the user.

For example, a reference value for generating an alarm sound is individually set based on an athletic ability level updated by a user's latest exercise performance, an obesity calculated from weight relative to height, and a medical history such as poor knee. In this way, it is possible to prevent the alarm sound from being generated when the movement is slightly delayed or when the knee does not rise like a leader.
Further, since the motion image data of the instructor is subjected to CG processing for bringing the body shape closer to the motion difference detection process, even if the body shape of the instructor and the body shape of the user are significantly different, they are accurately It is possible to detect a shift in the movement of.

  The first embodiment described above exemplifies a case where an alarm sound is generated when the movements of the legs to be raised differ significantly, such as left and right. However, depending on the type of exercise, such as muscular strength-up exercises, the method of raising the foot may be reversed left and right, and there is also an exercise in which the purpose is achieved by raising the foot alternately left and right.

  For example, when the user views the exercise image data of the instructor as a “mirror image”, when the instructor starts exercising from the right elbow, the user starts exercising from the left elbow. Is reasonable. However, even if it starts from the right elbow, there is no difference in the exercise effect if the elbow is bent and stretched alternately left and right next. Accordingly, in this case, the user terminal compares both the exercise image data of the instructor and the mirror image data obtained by inverting the left and right thereof with the exercise image data of the user. Then, the smaller one of the comparison results is selected, and the magnitude is determined by a threshold value. In this way, even if the movement of the instructor and the movement of the user are opposite to each other, the movement of the user at this time can be prevented from being erroneously detected as an abnormal movement.

  On the other hand, in an exercise in which left and right movements are important, such as dance, either the instructor's exercise image data or its mirror image data is compared with the user's exercise image data. Then, the difference in motion obtained as a result of this comparison is determined based on the threshold value. In this way, an alarm can be generated when the user's movement is opposite to the left and right.

  In addition, in the case of fall prevention exercises for the purpose of care prevention, elderly people with a high risk of fall are targeted. For example, there is a fall prevention exercise for supporters and care recipients. In this case, it is rather dangerous if the user tries to keep up with the instructor's tempo. Therefore, when such an elderly person (including a long-term care insurance certified person) who has a high risk of falling uses, a difference from the tempo of the leader video is not detected as a difference.

  For example, if the instructor performs gymnastics four times alternately left and right, and the elderly slowly performs the right three times and the left two times, the time delay of this movement is not detected as a difference in movement. Only one point of motion is compared with the instructor's motion image data in one cycle of motion. Then, for example, if the armpit is not open when the armpit is open, the armpit is set as the monitoring target part, while the time difference is not notified.

(Second Embodiment)
In the second embodiment of the present invention, when a plurality of users perform group exercises with one instructor at the same time, it is possible to detect a difference in motion between the user and the instructor and to determine the determination. It is what.
FIGS. 8 and 9 are block diagrams showing the configurations of the exercise support server device SV and the user terminals UT1 to UTn according to the second embodiment of the present invention, respectively. In this figure, the same parts as those in FIG. 3 and FIG. In addition, the instructor terminal is substantially the same as the user terminals UT1 to UTn, and thus illustration is omitted.

  First, as shown in FIG. 8, the exercise support server SV newly includes a group data management program 33c and a group distribution control program 33d as application programs for realizing the present invention, and these programs are stored in a program memory. 331. The data memory 341 is newly provided with a group data storage area 34c.

  The group data management program 33c analyzes the personal data stored in the personal data storage area 34a for each user, and groups users who have the same exercise ability and desire the same exercise time zone based on the result. To do. Then, an instructor is determined for each group, and an exercise schedule is created and stored in the group data storage area 34c.

  Based on the data stored in the group data storage area 34c, the group distribution control program 33d creates a communication link for multipoint conference communication between a plurality of user terminals that exercise during the same time period and the leader terminal. Establish and enable conference communication between multiple user terminals and instructor terminals.

  On the other hand, as shown in FIG. 9, the user terminals UT1 to UTn include a group image transmission / reception control program 43f and a group image editing program 43g as application programs for realizing the present invention. It is stored in the memory 431.

  The group image transmission / reception control program 43f transmits the user's exercise image data captured by the camera 50 from the communication I / F 45 to the other user terminals belonging to the same group and the instructor terminal MT via the exercise support server device SV. To do. At the same time, exercise image data sent from the instructor terminal MT and the other user terminals via the exercise support server device SV is received via the communication I / F 45.

  The group image editing program 43g uses the user's own exercise image data captured by the camera 50, the received instructor's exercise image data, and the received other user's exercise image data as 1 The screen is edited and displayed on the display 51.

Next, the operation of the exercise support system configured as described above will be described. FIG. 10 is a flowchart showing a control procedure and control contents of the user terminals UT1 to UTn.
When the user is registered as a member, the exercise support server SV analyzes personal data of each user stored in the personal data storage area 34a and creates an exercise schedule for each user. For example, users who have a common purpose of exercise, have the same level of athletic ability, and desire the same time zone are selected and grouped. A common schedule is created for this group. This schedule includes a group ID, a user ID constituting the group, an ID of the instructor in charge, information indicating the type and content of the exercise, and an exercise start time. The created schedule data is stored in the group data storage area 34c of the exercise support server device SV, and notified from the exercise support server device SV to each corresponding user terminal (for example, UT1 to UT5) and the instructor terminal MT. Is done.

When the setting of the schedule is completed, exercise support control is performed as follows.
That is, at the user terminals UT1 to UT5, when the exercise preparation time determined by the above schedule is reached (for example, 5 minutes before the start of the exercise), the user terminals UT1 to UT5 respectively perform steps S21 to S22 as shown in FIG. Here, first, a threshold value for determining a movement deviation is set. The determination threshold value is set by reading out the user's own personal data from the personal data storage area 44a and analyzing the read personal data. Specifically, in the same manner as in the first embodiment, an optimum value is set for each monitoring target site in consideration of information regarding the exercise ability and information indicating the purpose of exercise for each user.

  Next, when the exercise start time determined by the schedule is reached, a conference communication link is established between the instructor terminal MT and the plurality of user terminals UT1 to UT5 constituting the group by the exercise support server device SV. A conference voice call or conference videophone communication is possible between the user and each user. Then, when the instructor and each user exchange greetings and start exercise, the exercise image data of the instructor captured by the camera 20 at the instructor terminal MT is transmitted to each user via the exercise support server SV. The data is transmitted to terminals UT1 to UT5, respectively.

  Each of the user terminals UT1 to UT5 receives the instructor's exercise image data via the communication I / F 45 in step S24, stores it in the image data storage area 44b, and displays it on the display 51. At the same time, in step S23, the user's own motion is imaged by the camera 50, and the user's own motion image data is stored in the image data storage area 44b. Send to the user terminal. Further, the motion image data transmitted from another user terminal in step S25 is received via the communication I / F 45.

  The user terminals UT1 to UT5 edit the received exercise image data of the instructor and the captured user's own exercise image data into one screen in time synchronization, and The received motion image data of the other user is added to the one screen, and the edited image data is displayed on the display 51 in step S28. FIG. 11 shows an example of the display result. In the figure, D3 indicates the exercise image data of the instructor, and D4 indicates the exercise image data of the user. Further, D5 to D8 indicate motion image data of other users in the same group.

  Further, when performing the image editing, each of the user terminals UT1 to UT5 uses CG technology or the like for the exercise image data of the instructor in step S26 in order to bring the instructor's body shape closer to the user's body shape. Processing is performed, and the CG processed instructor's exercise image data is stored in the image data storage area 44b and displayed on the display 51. If the user feels uncomfortable with the exercise image data of the leader that has been subjected to CG processing, the exercise image data of the leader before the CG processing may be displayed.

  Thus, thereafter, each user can exercise at his / her user terminals UT1 to UT5 while comparing his / her exercise image with the exercise image of the instructor. At the same time, it is possible to check the state of the exercise of other users, thereby making it possible to perform the exercise in an atmosphere where the same place group exercise is performed.

Now, when the group exercise which uses the exercise image data of the instructor as an example is started, the user terminals UT1 to UT5 are respectively connected with the user and the instructor in parallel with the display processing of each of the exercise image data. The difference detection of the motion between them and the determination process are performed.
That is, first, in step S29, the CG-processed instructor's exercise image data and the user's own exercise image data are read from the image data storage area 44b, respectively, and the monitoring target parts on both image data are compared. A difference in motion between the monitoring target parts is detected. As the detection method, similarly to the first embodiment, the motion image data of the instructor and the user are subdivided (coordinated) into mesh shapes, and the monitoring target parts such as elbows and knees on the coordinates. This is done by detecting how it has moved.

Next, in step S30, the user terminals UT1 to UT5 respectively compare the detected motion difference between the monitoring target parts with the determination threshold value set in step S22. And when the monitoring object site | part in which the difference in a motion exceeds a determination threshold value, an alarm sound is generated from the speaker 52 by step S31. Instead of the alarm sound, a voice message for notifying the user of a part having a large movement deviation may be generated and output by the voice synthesis means.
Therefore, each user can notice a deviation or an error of his / her movement with respect to the instructor by the alarm sound or the voice message, thereby correcting his / her movement. The above operation is repeated until the end of the exercise is detected in step S32.

  On the other hand, the user's exercise image data transmitted from each of the user terminals UT1 to UT5 is transmitted to the instructor terminal MT via the exercise support server device SV. In the instructor terminal MT, the user's exercise image data is stored in the image data storage area 14a, and after being synchronized with the instructor's exercise image data in time, it is edited and displayed on one screen. 21 is displayed as a list. In this way, the instructor can monitor the state of exercise of each user belonging to the group he / she is in charge of while comparing it with his / her own exercise image. In addition, the presence / absence status of the user can be grasped based on whether or not the user's exercise image is displayed.

  As described above, according to the second embodiment, even when a plurality of users perform group exercises with one instructor at the same time, at each user terminal UT1 to UT5, the instructor's exercise image data. And a motion difference between the user's own motion image data are detected for each monitoring target region, and the detected motion difference is determined based on a determination threshold value.

  Therefore, each user can exercise while using the exercise image data of the instructor displayed on the display 51 as a model and confirming his / her movement and posture based on his / her exercise image data. If a difference equal to or greater than the determination threshold occurs between the person's movements, an alarm sound is generated at that time, and it is possible to grasp that the movement of the person is shifted. Therefore, even though each user is exercising alone, it is possible to correct his / her movements in real time each time, thereby enabling accurate and effective exercises at all times. It becomes.

  When displaying each of the motion image data D3 to D8, the motion image of the user (Mr. A) is highlighted with a frame, or the motion image data of the user (Mr. A) is used for other purposes. It may be displayed larger than the exercise image data of the person. In this way, the user can easily confirm his / her movement.

  In addition, when the user (Mr. B) is absent or participates from the middle, character data such as “non-participation” or “rest” is displayed instead of the exercise image data of the user (Mr. B). It is good to. In addition, in the user terminal of the user who joined from the middle, it may be possible to receive the ongoing guidance from the middle, but whether or not all distribution is possible for each exercise program in advance, You may be made to receive instruction | indication from the beginning by receiving all the image data of ongoing instruction | indication.

  Furthermore, since the user may exercise too much by performing the entire distribution of the exercise program, each time the distribution is received, the exercise support server device SV is inquired, and the exercise support by the exercise support server device SV is used. Depending on the situation, it may be possible to notify the user terminal of a message such as "Let's do too much exercise so let's do it tomorrow" or if you have a rest for a while, "Let's work hard and exercise a little at a time" Good.

  Furthermore, the user's exercise image data performed in the past is stored in the image data storage area 44b. Therefore, by selectively reading out the accumulated data according to the user's request, the image data of the number of exercises, the image data of the exercise of the month and the day, the image data of the latest exercise, etc. are displayed. be able to.

  Furthermore, in the image data storage area 44b, voices of instructors and other users are stored together with the exercise image data, and when the exercise image data is displayed on the display 51, the stored instructor and other users' voices are stored. Sound is also output from the speaker 52. In addition to that, an alarm sound of the user whose motion difference is detected with the instructor is also emitted from the speaker 52. For this reason, it becomes difficult to distinguish between the alarm sound of another user and the alarm sound generated for itself. In such a case, instead of sounding an alarm sound, a text message is displayed on the frame of the user's image displayed on the screen, or a mark such as a circle is flashed on the part where the difference has occurred. It is good to make it.

(Third embodiment)
The third embodiment of the present invention enables a user to selectively receive exercise guidance from a plurality of leaders.
FIG. 12 is a schematic block diagram showing a third embodiment of the exercise support system according to the present invention. The same parts as those in FIG. A plurality of leader terminals MT1, MT2,... Are connected to the exercise support server SV via a LAN. These leader terminals MT1, MT2,... Are used by different leaders, but all have the same configuration as the leader terminal described in the first embodiment.

  FIGS. 13 and 14 are block diagrams showing configurations of the exercise support server device SV and the user terminals UT1 to UTn according to the third embodiment of the present invention, respectively. In this figure, the same parts as those in FIG. 3 and FIG. 4 or FIG. 8 and FIG.

  First, as shown in FIG. 13, the exercise support server SV newly includes an instructor data management program 33e and a menu determination program 33f as application programs for realizing the present invention. It is stored in the memory 332. The data memory 342 is newly provided with a leader data storage area 34d and a schedule data storage area 34e.

  The leader data management program 33e acquires the personal data of the leader from each of the leader terminals MT1, MT2,..., And stores the acquired personal data of the leader in the leader data storage area 34d. The instructor's personal data includes the instructor's name, gender, career, instruction class (beginner, intermediate, advanced, diet, yoga, tai chi, etc.).

  The menu determination program 33f analyzes the personal data of the user, the personal data of the instructor, and the schedule data by, for example, the data mining method, and based on the analysis result, an appropriate instructor (teaching class) and exercise time zone Select. Then, the selected leader (teaching class) and exercise time zone are presented to the user as a recommended menu. Also, the user's answer information for the recommended menu presented above is received, and a schedule reflecting the answer information is created. Then, the created schedule data is stored in the schedule data storage area 34e.

On the other hand, as shown in FIG. 14, the user terminals UT1 to UTn are newly provided with a menu selection control program 43h as an application program for realizing the present invention, and this program is stored in the program memory 432.
The menu selection control program 43h displays this menu on the display 51 when a recommended menu is sent from the exercise support server device SV. And when a user performs selection designation | designated operation with respect to this menu with the input device 54, the process which returns the selection result to the exercise support server apparatus SV as reply information is performed.

Next, the operation of the exercise support system configured as described above will be described. FIG. 15 is a flowchart showing the control procedure and control contents of the exercise support server device SV and the user terminals UT1 to UTn.
When the personal data of the instructor is registered and the membership registration of the user is completed, the exercise support server device SV executes the menu determination program 33f in step S41, thereby the instruction stored in the instructor data storage area 34d. The user data and personal data of each user stored in the personal data storage area 34a are analyzed to create a recommended menu for exercise for each user.

  For example, an exercise menu that makes it easy to burn body fat for dieting purposes is included in the exercise scenario. For health maintenance purposes, exercise whole body exercises that do not burden the body, exercises that do not burden the knees or hips for people with poor knees or lower back, and if it is better to move the knees lightly or move firmly. The recommended menu is determined according to the individual physical condition of the user, such as when it is better or when it is better not to move.

  Then, according to the above decision, the “exercise class” starts from “beginner” for the first time, and after receiving several exercise instructions, the classes “intermediate” and “advanced” are updated according to the level of the user. In addition, as to whether the “exercise form” is an individual exercise or a group exercise, an appropriate one is selected according to the user's exercise ability, exercise purpose, and desired time zone. Further, regarding “exercise time zone”, considering sex, age, occupation, etc., if it is a housewife, it starts from “3 pm” and selects “1 hour”. Then, each element selected as described above is used as a recommended menu.

  Next, in step S42, the exercise support server device SV transmits the created recommended menu from the communication I / F 35 to the corresponding user terminal (for example, UT1). On the other hand, when the user terminal UT1 receives the recommended menu transmitted from the exercise support server SV via the communication I / F 45, the process proceeds from step S43 to S44, and the received recommended menu is displayed on the display 51. indicate. An example of the recommended menu displayed in FIG. 16 is shown.

  In this state, it is assumed that the user performs a selection operation on the displayed recommended menu using the input device 54 and then performs a transmission operation. Then, the user terminal UT1 moves from step S45 to step S46, and returns the selected menu as response information to the exercise support server device SV.

  For example, when all the menus are “OK”, the user presses the “Send” button as it is. In this case, the received recommended menu is returned as it is. When “exercise start time” is “NG” and the other menu is “OK”, “X” is input to the above “NG” menu, and “○” is displayed for the other menus. Enter. Then, enter a desired time in the “exercise start time” description field (the field in which “3 pm” is described), for example, “10 am”, and press the “send” button. In this case, the menu whose start time is corrected by the user is returned as response information to the exercise support server SV.

  On the other hand, when the response information of the menu is returned from the user terminal UT1, the exercise support server device SV receives the response information in step S47 and then proceeds to step S48, where the received response information is received. Are stored in the personal data storage area 34a to be added to the personal data.

  Next, the exercise support server device SV executes the group management program 33c in step S49, and analyzes the personal data of the user stored in the personal data storage area 34a. Based on the analysis result, for example, users who have a common exercise purpose, have the same level of exercise ability, and desire the same time zone are selected and grouped. In step S50, the leader's personal data is read from the leader data storage area 34d, and a leader suitable for the group is selected and assigned.

  Subsequently, a schedule for the group is created in step S51. This schedule includes a group ID, a user ID constituting the group, an ID of the instructor in charge, an exercise class, and an exercise start time. In step S52, the created schedule data is stored in the schedule data storage area 34e, and from the exercise support server device SV to the corresponding user terminals (for example, UT1 to UT5) and instructor terminals (for example, MT1). Sent.

  It should be noted that the group exercise support control operation executed in the exercise support server SV, the exercise image data display process executed in the user terminal, the movement difference detection process between the user and the instructor, and the like The determination processing operation is the same as the procedure described in the second embodiment.

As described above, according to the third embodiment, in the exercise support server SV, guidance suitable for the user from among a plurality of leaders based on the personal data of the user and the personal data of the leader. A person (teaching class) is selected. At the same time, a recommended menu is created and presented to the user. When the user selects or corrects the presented menu, the response information is returned to the exercise support server device SV. Then, grouping of users reflecting the answer information and creation of a schedule are performed, and exercise support is executed according to the created schedule.
Therefore, for the user, the options for the exercise menu are expanded, and this makes it possible to perform exercise with a high degree of freedom suitable for his / her exercise ability, purpose and desire.

(Other embodiments)
In each of the embodiments described above, in the user terminals UT1 to UTn, an operation difference between the user's motion image data and the instructor's motion image data is detected and determined. However, the same processing may be performed in the leader terminal MT. Even in this case, since the alarm sound generated in the leader terminal MT is transmitted to the user terminals UT1 to UTn together with the motion image data, the user moves his / her movement with respect to the leader while viewing the motion image data of the leader. Can be recognized.

  Also, the detection of motion difference between the motion image data of the user and the motion image data of the instructor and the determination process thereof can be performed in the exercise support server device SV. In this way, since the server apparatus SV can perform image processing with a large load, there is an advantage that the processing load on the user terminals UT1 to UTn and the instructor terminal MT can be reduced accordingly.

  Furthermore, in the above-described embodiment, the schedule setting type that receives exercise guidance in real time has been described as an example. However, the present invention is not limited to this, and for example, an on-demand type that allows the user to exercise at any time may be used. This is because the image data of the instructor is stored in advance in the exercise support server device, and the stored image data is selectively read out according to the user's request, streaming from the exercise support server device to the user terminal, etc. It can be realized by distributing by.

  Furthermore, in the said embodiment, it demonstrated as a thing which displays the image of a leader and a user along with the screen of a display apparatus, and detects the difference in a motion. However, when there is a one-to-one instruction and user, semi-transparent image data may be displayed in an overlapping manner. If it does in this way, it will become possible to confirm more clearly whether it is exercising similarly. At that time, as described in the first embodiment, the instructor's exercise image data is processed by using the CG technology or the like, and the processed instructor image data is displayed on top of the user's image data. Even better. In this way, even when the body shape of the instructor and the user are different, it is possible to display images with reduced image shift due to the difference in body shape. In short, the display method is not particularly limited as long as the movements of the instructor and the user can be displayed on the same screen.

Furthermore, the motion difference detection result or determination result is added to the personal data or schedule data and stored, and the leader or exercise menu is selected based on the stored motion difference detection result or determination result at the start of the next exercise. You may make it change into a more suitable thing.
Furthermore, as means for detecting the motion difference between the instructor and the user, a comparison means by motion capture may be employed, and other means for comparing the actions are not particularly limited.

Furthermore, as a display of the user terminals UT1 to UTn and the instructor terminal MT, a display attached to the terminal may be used, but a separately provided television receiver or video projector may be used. In particular, as a display of the user terminal, a head-mounted display that can view an image from the front regardless of its own movement (orientation) may be used. In addition, the type, shape, and size of the display device are not particularly limited.
In addition, the configuration of the entire system, the configuration of the exercise support device, the user terminal and the instructor terminal, and the control procedure and control content for exercise support can be variously modified and implemented without departing from the scope of the present invention. .

  In short, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

1 is a schematic configuration diagram showing a first embodiment of an exercise support system according to the present invention. The block diagram which shows the structure of the leader terminal in the system shown in FIG. The block diagram which shows the structure of the exercise | movement assistance server apparatus in the system shown in FIG. The block diagram which shows the structure of the user terminal in the system shown in FIG. The flowchart which shows the control procedure and control content of the user terminal shown in FIG. The figure which shows the example of a display when a user's exercise image data and a leader's exercise image data are displayed as a list. The figure for demonstrating concretely the detection and determination result of a motion shift between a user and a leader. The block diagram which shows the structure of the exercise | movement assistance server apparatus concerning 2nd Embodiment of this invention. The block diagram which shows the structure of the user terminal concerning the 2nd Embodiment of this invention. The flowchart which shows the control procedure and control content of the user terminal shown in FIG. The figure which shows the example of a display at the time of displaying the exercise | movement image data of a leader, the exercise image data of a user himself, and the exercise image data of other users as a list. The schematic block diagram which shows 3rd Embodiment of the exercise | movement assistance system concerning this invention. The block diagram which shows the structure of the exercise | movement assistance server apparatus in the system shown in FIG. The block diagram which shows the structure of the user terminal in the system shown in FIG. The flowchart which shows the control procedure and control content of the exercise | movement assistance server apparatus and user terminal which were each shown in FIG.13 and FIG.14. The figure which shows the example of a display of a recommendation menu.

Explanation of symbols

  UT1 to UTn ... user terminal, SV ... exercise support server device, MT, MT1, MT2 ... instructor terminal, NW ... communication network, 11, 31, 41 ... CPU, 12, 32, 42 ... bus, 13, 33, 43, 331, 332, 431, 432 ... program memory, 13a, 43a ... image capture control program, 13b, 43b ... image transmission / reception control program, 13c, 43c ... image editing program, 33a ... personal data management program, 33b ... image Data distribution control program, 33c ... group data management program, 33d ... group distribution control program, 33e ... leader data management program, 33f ... menu determination program, 43d ... motion difference detection program, 43e ... motion tendency comparison program, 43f ... group Image transmission / reception control program 43g ... Group image editing program, 43h ... Menu selection control program, 14, 32, 44, 341, 342 ... Data memory, 14a, 34b, 44b ... Image data storage area, 34a, 44a ... Personal data storage area, 34c ... Group Data storage area, 34d ... instructor data storage area, 34e ... schedule data storage area, 15, 35, 45 ... communication interface, 16,46 ... camera interface, 17,47 ... display interface, 18,48 ... voice input / output interface 19, 49 ... input interface, 20, 50 ... camera, 21, 51 ... display, 22, 52 ... speaker, 23, 53 ... microphone, 24, 54 ... input device.

Claims (5)

An exercise support system comprising a user terminal used by a user and an exercise support device connectable to the user terminal via a communication network,
The exercise support device includes:
Means for storing first personal data relating to the athletic ability or purpose of the user;
Means for storing second personal data including information representing instruction classes of a plurality of leaders;
Means for selecting a leader suitable for the exercise ability or purpose of the user from the plurality of leaders based on the stored first and second personal data;
Means for transmitting instruction image data of the selected instructor from the instructor terminal of the instructor to the user terminal , and
The user terminal is
Means for receiving instruction image data transmitted from the exercise support device and presenting the received instruction image data to a user;
Means for obtaining user image data by imaging a user who exercises using the presented instruction image data as a model;
A difference detecting means for comparing the user image data with the instruction image data or the mirror image data thereof, and detecting a difference in movement;
Informing means for informing the user when the detected motion difference exceeds a threshold value,
The difference detection means includes
Whether the user performs the exercise by viewing the instructor's exercise image data as a real image or the mirror image , based on the selection information of the exercise direction input by the user prior to the exercise Determination means for determining;
A means for detecting a difference in motion between the user's motion image data and the instructor's motion image data when the determination means determines that the exercise is to be performed as a real image;
When it is determined by the determination means that the exercise is performed as a mirror image, the mirror image data is generated based on the received exercise image data of the instructor, and the user's exercise image data and the generated image are generated. And a means for detecting a difference in motion with the mirror image data. An exercise support system comprising a user terminal used by a user and an exercise support device connectable to the user terminal via a communication network,
The exercise support device includes:
Means for storing first personal data relating to the athletic ability or purpose of the user;
Means for storing second personal data including information representing instruction classes of a plurality of leaders;
Means for storing instruction image data of the plurality of leaders;
Means for selecting, based on the stored first and second personal data, instruction image data of an instructor suitable for a user's exercise ability or purpose from among the plurality of stored instruction image data; ,
Means for transmitting the selected instruction image data to the user terminal, and
The user terminal is
Means for receiving instruction image data transmitted from the exercise support device and presenting the received instruction image data to a user;
Means for obtaining user image data by imaging a user who exercises using the presented instruction image data as a model;
A difference detecting means for comparing the user image data with the instruction image data or the mirror image data thereof, and detecting a difference in movement;
Informing means for informing the user when the detected motion difference exceeds a threshold value,
The difference detection means includes
Whether the user performs the exercise by viewing the instructor's exercise image data as a real image or the mirror image , based on the selection information of the exercise direction input by the user prior to the exercise Determination means for determining;
A means for detecting a difference in motion between the user's motion image data and the instructor's motion image data when the determination means determines that the exercise is to be performed as a real image;
When it is determined by the determination means that the exercise is performed as a mirror image, the mirror image data is generated based on the received exercise image data of the instructor, and the user's exercise image data and the generated image are generated. And a means for detecting a difference in motion with the mirror image data. The notification means includes
Means for storing personal data relating to the user's athletic ability or purpose of exercise;
Exercise support according to claim 1 or 2, characterized in that the means for variably setting a value corresponding to the user's exercise capacity or kinetic purposes the threshold based on personal data the storage, further comprising system. The difference detection means includes
Means for processing at least one of the user image data and the instruction image data so as to correspond the body shape of the user in the user image data and the body shape of the instructor in the instruction image data;
Wherein the processed user image data guidance image data or by comparing the mirror image data, movement support system according to claim 1 or 2, characterized in that it comprises means for detecting a difference between the movement.   An exercise support program for causing a computer provided in the user terminal and the exercise support apparatus to execute processing by each means provided in the exercise support system according to claim 1.

Images