JP2015119833A - Exercise support system, exercise support method, and exercise support program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an exercise support system, an exercise support method, and an exercise support program which can provide appropriate advice for each instruction point regarding an exercise posture or the like of a user, and effectively improve the exercise posture or the like.SOLUTION: An exercise support system comprises: a wrist device 100 and a chest device 200 for acquiring sensor data or the like during a running motion; an imaging device 300 for acquiring a running image by synchronizing with the sensor data or the like; a network server 700 for processing and analyzing the sensor data or the like and the running image, and generating advice data that includes a comparison image consisting of one-cycle running images of a user US and an elite runner, an indicator displayed while being superimposed on the comparison image for each instruction item, and an advice text corresponding to the instruction items; and a user terminal 900 or the like for displaying the advice data through the network 600 in a predetermined display mode.

Description

  The present invention relates to an exercise support system, an exercise support method, and an exercise support program, and more particularly, to an exercise support system, an exercise support method, and an exercise support program for assisting grasping and improving an exercise state.

  In recent years, with an increase in health consciousness, there are an increasing number of people who regularly perform exercises such as running, walking, and cycling to maintain or improve their health. In addition, among these people, there are an increasing number of people who perform full-scale training with the goal of participating in various competitions and competitions.

  On the other hand, there is almost no opportunity for such general people to receive analysis and advice from leaders and experts regarding the quality of their exercise posture (for example, running form). For this reason, there is a growing demand to understand and analyze the state of exercise from a more professional and scientific viewpoint, with a focus on people who are highly health-oriented and competition-oriented, and to reflect it in daily training.

  In recent years, products and technologies that meet such demands have been researched and developed. For example, Patent Document 1 describes that advice corresponding to an image obtained by shooting a swing motion or the like of a golf player who is a user is selected from a plurality of advices and provided to the user. Patent Document 1 also describes that a video of a swinging motion of a professional golfer corresponding to a swinging motion of a golf player is provided to a user as a reference.

JP 2005-253858 A

  In the method for providing advice on the exercise posture and the like described in Patent Document 1 described above, a method is used in which points to be advised (instruction points) are automatically selected according to the captured user's video. . For this reason, appropriate advice is not always provided for the instruction point desired by the user. That is, advice different from the instruction point desired by the user may be provided.

  Further, in Patent Document 1, it is disclosed to display a video of a professional golfer as a reference, but since it is a function that merely displays a video during a swing operation of a professional golfer, the user's own exercise posture, etc. It was difficult to compare and analyze, and it was not possible to obtain a sufficient guidance effect on improvement of exercise posture.

  Therefore, in view of the above-described problems, the present invention provides appropriate advice for each instruction point (guidance item) regarding the user's exercise posture and the like, and can effectively improve the exercise posture and the like. An object is to provide a system, an exercise support method, and an exercise support program.

The exercise support system according to the present invention includes:
A sensor device for obtaining motion data related to the motion state of the user during exercise;
An imaging device that acquires first video data obtained by capturing the motion posture of the user during the exercise in synchronization with the operation of the sensor device;
From the first video data acquired by the imaging device, based on the motion data, create a first posture video indicating the motion posture of the user for one cycle of the motion, From the second video data prepared in advance showing the ideal motion posture, the ideal motion posture for one cycle of the movement is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image. A data processing unit having a comparison video creation unit that creates a second posture image adjusted as described above and creates a comparison image obtained by combining the first posture image and the second posture image;
Browsing devices that display support data including advice information associated with the comparison video according to a preset guidance item and the comparison video;
It is characterized by providing.

The exercise support method according to the present invention includes:
Get motion data related to the motion status of the user during exercise,
Acquiring the first video data of the motion posture of the user during the exercise in synchronization with the acquisition of the motion data;
From the first video data, based on the motion data, create a first posture video showing the motion posture of the user for one cycle of the movement,
From the stored video data prepared in advance showing the ideal motion posture of the exercise, the ideal motion posture for one cycle of the motion is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image Create a second posture image adjusted to
Creating a comparison image combining the first posture image and the second posture image;
Displaying support data including advice information associated with the comparison video according to the instruction items set in advance and the comparison video;
It is characterized by that.

The exercise support program according to the present invention includes:
On the computer,
Get motion data related to the motion status of the user during exercise,
First video data obtained by photographing the user's motion posture during exercise is acquired in synchronization with the acquisition of the motion data,
From the video data, based on the motion data, to create a first posture video showing the motion posture of the user for one cycle of the movement,
From the stored video data prepared in advance showing the ideal motion posture of the exercise, the ideal motion posture for one cycle of the motion is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image To create a second posture image adjusted to
Creating a comparison video that combines the first posture video and the second posture video;
Display support data including advice information associated with the comparison video according to the instruction items set in advance and the comparison video;
It is characterized by that.

  ADVANTAGE OF THE INVENTION According to this invention, about a user's exercise posture etc., an appropriate advice can be provided for every instruction | indication point, and an exercise posture etc. can be improved effectively.

It is a schematic structure figure showing one embodiment of an exercise support system concerning the present invention. It is a schematic block diagram which shows an example of the sensor apparatus applied to the exercise assistance system which concerns on this embodiment. It is the schematic which shows the example of mounting | wearing of the sensor apparatus applied to the exercise assistance system which concerns on this embodiment. It is a block diagram which shows the example of 1 structure of the wrist apparatus applied to the exercise assistance system which concerns on this embodiment. It is a block diagram which shows one structural example of the chest apparatus applied to the exercise assistance system which concerns on this embodiment. It is a block diagram which shows the example of 1 structure of the imaging device applied to the exercise assistance system which concerns on this embodiment. It is a block diagram which shows the example of 1 structure of the display glass applied to the exercise assistance system which concerns on this embodiment. It is a block diagram which shows the example of 1 structure of the information communication terminal applied to the exercise assistance system which concerns on this embodiment, and a user terminal. It is a block diagram showing an example of 1 composition of a network server applied to an exercise support system concerning this embodiment. It is a flowchart which shows an example of the exercise support method in the exercise support system which concerns on this embodiment. It is the schematic which shows an example of the technique of the high speed imaging | photography applied to the exercise | movement assistance method which concerns on this embodiment. It is a flowchart which shows an example of the comparison image | video production | generation process applied to the exercise | movement assistance method which concerns on this embodiment, and an analysis and advice data creation process. It is a flowchart which shows an example of the 1 cycle running image | video creation process applied to this embodiment. It is explanatory drawing which shows the concept of the operation | movement element of driving | running | working operation | movement, and the definition of 1 cycle in the 1 cycle running image | video production process applied to this embodiment. It is a conceptual diagram for demonstrating the 1 cycle running image | video creation process applied to this embodiment. It is the schematic which shows the creation example of the comparison image | video in the exercise | movement assistance method which concerns on this embodiment. It is a list | wrist which shows the example of the guidance item in the exercise | movement support method which concerns on this embodiment. It is a conceptual diagram which shows the example of a display of the parameter | index in each guidance item applied to this embodiment. It is a figure for demonstrating matching with the output of the sensor apparatus (acceleration sensor) applied to this embodiment, and the detection item in another detection apparatus. It is a conceptual diagram which shows the example of calculation of the guidance item based on the sensor data acquired by the sensor apparatus (acceleration sensor) applied to this embodiment. It is the flowchart and schematic which show an example of the parameter | index production process applied to this embodiment. It is a flowchart which shows an example of the advice data display process applied to the exercise assistance method which concerns on this embodiment. It is the schematic which shows the example of a display of the advice data displayed on the user terminal etc. which are applied to the exercise support system concerning this embodiment. It is a flowchart which shows the other example of the parameter | index production process applied to this invention. It is the schematic which shows the user interface applied to the parameter | index production process which concerns on this application example. It is a flowchart which shows the other example of the advice text creation process applied to this invention. It is a schematic block diagram which shows the modification of the exercise assistance system which concerns on this embodiment.

  Hereinafter, an exercise support system, an exercise support method, and an exercise support program according to the present invention will be described in detail with reference to embodiments. In the following embodiments, a case where the user performs an exercise accompanied by a running operation such as running will be described.

<Exercise support system>
FIG. 1 is a schematic configuration diagram showing an embodiment of an exercise support system according to the present invention. FIG. 2 is a schematic configuration diagram illustrating an example of a sensor device applied to the exercise support system according to the present embodiment. FIG. 3 is a schematic diagram illustrating an example of wearing sensor devices applied to the exercise support system according to the present embodiment. FIG. 4 is a block diagram illustrating a configuration example of a wrist device applied to the exercise support system according to the present embodiment. FIG. 5 is a block diagram illustrating a configuration example of a chest device applied to the exercise support system according to the present embodiment. FIG. 6 is a block diagram illustrating a configuration example of an imaging device applied to the exercise support system according to the present embodiment. FIG. 7 is a block diagram illustrating a configuration example of the display glasses applied to the exercise support system according to the present embodiment. FIG. 8 is a block diagram illustrating a configuration example of an information communication terminal and a user terminal applied to the exercise support system according to the present embodiment. FIG. 9 is a block diagram illustrating a configuration example of a network server applied to the exercise support system according to the present embodiment.

  As shown in FIGS. 1 to 3, the exercise support system according to the present embodiment schematically includes a wrist device (sensor device) 100 worn on the wrist by the user US who is the measurement subject, and a chest device worn on the chest ( Sensor device) 200, imaging device 300 capable of high-speed photography, display glass 400 mounted on the head, information communication terminal 500, network 600, data processing device such as network server 700, and user terminal ( Browsing device) 900.

(List device 100)
As shown in FIGS. 2A and 3A, the wrist device 100 is a wristwatch-type or wristband-type sensor device worn on the wrist of the user US, and the user US is exercising (during a running operation). In addition, it has a function of acquiring various sensor data (motion data) and accumulating the results while calculating data indicating the motion state as needed. The wrist device 100 is roughly classified to detect the motion state and position of the user US, and attach the device main body 101 to the wrist by winding the device main body 101 that provides the user US with predetermined information and the wrist of the user US. And an external configuration including a band portion 102.

Specifically, the wrist device 100 includes, for example, as shown in FIG.
Positioning System; global positioning system) receiving circuit 120, input operation unit 130, output unit 140, communication function unit 150, arithmetic circuit 160, memory unit 170, timing circuit 180, operating power supply 190, It has.

  The sensor unit 110 is a motion sensor for detecting the motion of the human body (particularly, the swing of the arm during running, the cycle (cycle) of the running operation, the running speed, the trajectory, etc.). For example, as shown in FIG. A triaxial acceleration sensor 111, a triaxial angular velocity sensor (gyro sensor) 112, and a triaxial geomagnetic sensor 113 are provided. The three-axis acceleration sensor 111 detects the rate of change in the operating speed during the movement of the user US (acceleration) and outputs it as acceleration data. Here, acceleration data in three axial directions orthogonal to each other are output. Further, the triaxial angular velocity sensor 112 detects a change in the operation direction (angular velocity) during the movement of the user US and outputs it as angular velocity data. Here, angular velocity data in each rotation direction is output for three orthogonal axes that define acceleration data. The triaxial geomagnetic sensor 113 detects the earth's magnetic field (magnetic field) and outputs it as geomagnetic data or direction data. Here, geomagnetic data in three axial directions orthogonal to each other is output. The sensor data (acceleration data, angular velocity data, geomagnetic data) detected by the sensor unit 110 is associated with time data defined by a time measuring circuit 180 described later, and a memory for storing sensor data in the memory unit 170 described later. 171 is stored in a predetermined storage area.

  The GPS receiving circuit 120 receives radio waves from a plurality of GPS satellites, detects a geographical position based on latitude and longitude information, and outputs the detected position as position data. Based on the position data detected by the GPS receiving circuit 120, the travel distance and travel locus of the user US are acquired by the arithmetic circuit 160 described later. In addition, the GPS receiving circuit 120 obtains the traveling speed of the user US using the Doppler shift effect of radio waves from GPS satellites. The GPS data including the travel distance and travel speed acquired by the GPS receiving circuit 120 is associated with the time data defined by the time measuring circuit 180 in the same manner as the sensor data described above, and the sensor data in the memory unit 170 is recorded. The data is stored in a predetermined storage area of the storage memory 171. Here, the GPS data acquired by the GPS receiving circuit 120 is used in combination with the travel distance and travel speed acquired based on the sensor data detected by the sensor unit 110 described above, or by complementing each other. In addition, detection accuracy such as travel distance and travel speed can be improved.

  For example, as illustrated in FIG. 4, the input operation unit 130 includes an operation switch 131 and a touch panel 132. For example, as shown in FIG. 2A, the operation switch 131 is a push button type switch provided so as to protrude from the side surface of the device main body 101, and controls the sensing operation in the sensor unit 110 described above. These are used for various input operations such as setting of items to be displayed on the display unit 141.

  In addition, the touch panel 132 is provided on the front side (view side) of the display unit 141 provided in the output unit 140 described later, and touches an area corresponding to the information displayed on the display unit 141 to thereby display the information. The corresponding function is selectively executed. Here, the function realized by the touch panel 132 may be equivalent to the function realized by the operation switch 131 described above, or may have a function specific to the input operation by the touch panel 132. Note that the input operation unit 130 may have, for example, a configuration including only one of the operation switch 131 and the touch panel 132 described above.

  For example, as illustrated in FIG. 4, the output unit 140 includes a display unit 141, an acoustic unit 142, and a vibration unit 143. The display unit 141 includes, for example, a liquid crystal display panel or a light emitting element display panel, and provides or notifies various information to the user US through vision by displaying numerical information, graphs, and the like. Here, the display unit 141 is at least sensor data detected by the sensor unit 110 described above, GPS data acquired by the GPS receiving circuit 120, various exercise information created based on these data, Display time information such as time in real time. The output unit 140 may display various sensor data transmitted from the chest device 200 described later, various exercise information and biological information created based on the sensor data. Specifically, as shown in FIG. 3B, for example, the display unit 141 displays the running time (indicated as “TIME” in the figure) and the running pace (indicated as “PASE” in the figure) during the running operation. ), Mileage (indicated in km in the figure), heart rate (indicated in ppm in the figure), stride (indicated in cm in the figure), change in heart rate (in the figure, "Heart Rate" Notation) and the like are displayed in the form of numerical information, a graph, or the like. The display form of these various types of exercise information is arbitrarily set by operating the operation switch 131 or the touch panel 132 described above.

  The acoustic unit 142 includes acoustic devices such as a buzzer and a speaker, and provides or notifies various information to the user US through hearing by generating sound information such as predetermined timbres, sound patterns, and voice messages. . The vibration unit 143 has a vibration device such as a vibration motor or a vibrator, and generates or transmits vibration information such as a predetermined vibration pattern and its strength, thereby providing or notifying various information to the user US through a tactile sense. To do. Note that the output unit 140 may have a configuration including at least one of the display unit 141, the acoustic unit 142, and the vibration unit 143, for example. Here, when providing specific information such as numerical information to the user US, it is preferable to have a configuration including at least one of the display unit 141 and the acoustic unit 142.

  The communication function unit 150 transfers the sensor data acquired by the sensor unit 110 and the GPS data acquired by the GPS receiving circuit 120 (hereinafter collectively referred to as “sensor data etc.”) to the information communication terminal 500 described later. It functions as an interface when In addition, the communication function unit 150 is an interface for transmitting a synchronization signal for synchronizing time data associated with sensor data, heartbeat data, running video, and the like with a chest device 200 and an imaging device 300 described later. Also works. Further, the communication function unit 150 also functions as an interface when receiving sensor data, heart rate data, or the like acquired by the chest device 200 or transmitting various types of exercise information displayed on the display glass 400. Here, as a technique for transferring or transmitting / receiving sensor data, a synchronization signal, and the like to / from the chest device 200, the imaging device 300, the display glass 400, and the information communication terminal 500 via the communication function unit 150, for example, various methods are available. A wireless communication system or a wired communication system via a communication cable can be applied.

When transferring the sensor data or the like by a wireless communication method, for example, Bluetooth (registered trademark) communication, which is a short-range wireless communication standard for digital devices, or a low power consumption communication standard in this communication standard Bluetooth® energy (Bluetooth® low energy (LE)) communication established as is well applicable. Alternatively, Wi-Fi (wireless) that enables wireless communication over relatively long distances
fidelity (registered trademark) communication and communication methods equivalent to these can also be applied satisfactorily. According to such a wireless communication system, data transfer can be performed satisfactorily even with small power generated using, for example, energy harvesting technology as an operating power source 190 described later. When the sensor data or the like is transferred by a wired communication method, for example, a USB (Universal Serial Bus) standard communication cable used for connection between a personal computer and peripheral devices, or communication of an equivalent communication method. The cable can be applied well.

  For example, as shown in FIG. 4, the memory unit 170 is roughly divided into a sensor data storage memory (hereinafter referred to as “sensor data memory”) 171 and a program storage memory (hereinafter referred to as “program memory”) 172. And a work data storage memory (hereinafter referred to as “work memory” 173).

  The sensor data memory 171 has a non-volatile memory such as a flash memory. The sensor data acquired by the sensor unit 110 or the GPS receiving circuit 120 described above is associated with time data defined by the time measuring circuit 180 in accordance with a predetermined data. Save to storage area. The program memory 172 has a ROM (read only memory), and realizes predetermined functions in each configuration such as a sensing operation in the sensor unit 110 and the GPS receiving circuit 120 and a data transfer operation in the communication function unit 150. Save the control program. The working memory 173 has a RAM (Random Access Memory), and temporarily stores various data used when executing the control program and various generated data. A part or all of the sensor data memory 171 may have a form as a removable storage medium such as a memory card, and may be configured to be detachable from the wrist device 100.

  The arithmetic circuit 160 is an arithmetic processing device such as a CPU (central processing unit) or MPU (microprocessor), and is based on an operation clock generated by the time measuring circuit 180 and is stored in the program memory 172 described above. Run the control program. Thereby, the arithmetic circuit 160 controls various operations such as a sensing operation in the various sensors 111 to 113 of the sensor unit 110 and the GPS receiving circuit 120, an information providing operation in the output unit 140, and a data transfer operation in the communication function unit 150. To do. Note that the control program executed in the arithmetic circuit 160 may be incorporated in the arithmetic circuit 160 in advance.

  The clock circuit 180 is an RTC (real time clock) module having an oscillator that generates a basic clock, and clocks even when the wrist device 100 is powered off or is not sensing with various sensors. Continue. Then, the timer circuit 180 synchronizes the operation clock that defines the operation timing of each component of the wrist device 100 and the time data with the chest device 200 and the imaging device 300 described later based on the generated basic clock. A synchronization signal, time data indicating the current time, and the like are generated. In addition, the timing circuit 180 measures the acquisition timing of the sensor data and the like in the sensor unit 110 and the GPS reception circuit 120 described above and outputs them as time data. Thereby, the time data is stored in the sensor data memory 171 in association with the sensor data or the like. The time data is displayed on the display unit 141 of the output unit 140 described above, so that the current time and the like are provided to the user US.

  The operating power supply 190 supplies driving power to each component inside the device main body 101 of the wrist device 100. As the operation power supply 190, for example, a commercially available primary battery such as a coin-type battery or a button-type battery, or a secondary battery such as a lithium ion battery or a nickel-metal hydride battery can be applied. In addition to the primary battery and the secondary battery, the operating power supply 190 may be a power supply using energy harvesting technology that generates power using energy such as vibration, light, heat, and electromagnetic waves. In addition, when the wrist device 100 has a configuration in which sensor data or the like is transferred to the information communication terminal 500 by a wired communication method, driving power is supplied from the information communication terminal 500 via a communication cable, The secondary battery of the operating power supply 190 may be charged.

(Chest machine 200)
As shown in FIGS. 2B and 3A, the chest device 200 is a chest-mounted sensor device that is worn on the chest of the user US. Similarly to the wrist device 100 described above, the chest device 200 exercises the user US. It has a function of acquiring various sensor data (motion data) during the running (running operation), and accumulating the results while calculating data indicating the exercise state as needed. The chest device 200 roughly includes a device main body 201 that detects the user's US motion state and biological information, and a belt unit 202 that is attached to the chest of the user US by winding the device main body 201 around the chest. It has an external configuration.

  Specifically, for example, as shown in FIG. 5, the chest device 200 includes a sensor unit 210, a heartbeat detection circuit 220, an operation switch 230, a communication function unit 250, an arithmetic circuit 260, a memory unit 270, A timer circuit 280 and an operating power supply 290 are provided. Here, the description of the configuration equivalent to the wrist device 100 described above will be simplified.

  Similar to the wrist device 100 described above, the sensor unit 210 is a motion sensor for detecting the movement of the human body (particularly, running form, running direction, stride, etc.). For example, as shown in FIG. An acceleration sensor 211, a triaxial angular velocity sensor 212, and a triaxial geomagnetic sensor 213 are provided. The sensing operations of these various sensors 211 to 213 are executed at a rate of 100 times or more per second (that is, a sampling frequency of 100 Hz or more, preferably 200 Hz) during running. The detected sensor data (acceleration data, angular velocity data, geomagnetic data) is associated with time data defined by a timing circuit 280 described later, and a predetermined storage area of a sensor data memory 271 of the memory unit 270 described later. Saved in.

  The heartbeat detection circuit 220 is provided on the inner surface side (human body side) of the belt unit 202 of the chest device 200, and is connected to an electrode (not shown) arranged so as to be in direct contact with the chest of the user US. The heartbeat detection circuit 220 detects a change in the electrocardiographic signal output from the electrode and outputs it as heartbeat data. The heart rate data is stored in a predetermined storage area of the sensor data memory 271 of the memory unit 270 in association with the time data defined by the timer circuit 280, similarly to the sensor data described above.

  The operation switch 230 is an input operation unit having at least a power switch. When the operation switch 230 is operated by the user US, the operation power supply state from the operation power supply 290 to each component is supplied (supplied or cut off). To control on / off of the power of the chest device 200. The operation switch 230 includes a sensor control key switch, and controls the start or stop of the sensing operation in the sensor unit 210 and the heart rate detection circuit 220 when the operation switch 230 is operated by the user US.

  The communication function unit 250 uses the wrist device 100 and the information communication terminal 500 for the sensor data acquired by the sensor unit 210 and the heart rate data acquired by the heart rate detection circuit 220 (hereinafter collectively referred to as “sensor data etc.”). It functions as an interface when transferring to the device or when synchronizing with the wrist device 100. Here, as a method of transferring or transmitting / receiving sensor data, a synchronization signal, and the like to / from the wrist device 100 and the information communication terminal 500 via the communication function unit 250, various methods are used as in the wrist device 100 described above. A wireless communication system or a wired communication system can be applied.

  The memory unit 270 is roughly divided into a sensor data memory (sensor data storage memory) 271, a program memory (program storage memory) 272, and a work memory (work data storage memory), similarly to the list device 100 described above. ) 273. The sensor data memory 271 stores the sensor data acquired by the sensor unit 210 and the heart rate detection circuit 220 described above in a predetermined storage area in association with the time data. The program memory 272 stores a control program for realizing a predetermined function in each configuration, such as a sensing operation in the sensor unit 210 and the heart rate detection circuit 220 and a data transfer operation in the communication function unit 250. The work memory 273 temporarily stores various data used when executing the control program and various generated data. The sensor data memory 271 has a part or all of a form as a removable storage medium, and is configured to be detachable from the chest device 200, like the wrist device 100 described above. Also good.

  The arithmetic circuit 260 is an arithmetic processing unit such as a CPU or MPU, and executes a predetermined control program stored in the above-described program memory 272 based on an operation clock generated by the time measuring circuit 280. Thereby, the arithmetic circuit 260 controls operations in the respective components such as various sensors 211 to 213 of the sensor unit 210 and a sensing operation in the heart rate detection circuit 220 and a data transfer operation in the communication function unit 250. Note that the control program executed in the arithmetic circuit 260 may be incorporated in the arithmetic circuit 260 in advance.

  The timer circuit 280 is an RTC module having an oscillator that generates a basic clock, and generates an operation clock that defines the operation timing of each component of the chest device 200 based on the generated basic clock. In addition, the timer circuit 280 measures the acquisition timing of sensor data and the like in the sensor unit 210 and the heartbeat detection circuit 220 described above, and outputs them as time data. Thereby, the time data is stored in the sensor data memory 271 in association with the sensor data or the like. Here, the time data is synchronized between the chest device 200 and the wrist device 100 based on the synchronization signal transmitted from the wrist device 100 described above. The synchronization operation between the wrist device 100 and the chest device 200 is executed, for example, at the start timing when the power is turned on in the wrist device 100 and the chest device 200 or the start timing of the sensing operation in the sensor units 110 and 210. It may be a thing. In addition, this synchronization operation may be executed at regular time intervals, arbitrary timing, or always.

  The operating power supply 290 supplies driving power to the components inside the device main body 201 of the chest device 200 when the operation switch 230 described above is operated. As the operating power source 290, for example, a commercially available primary battery or secondary battery can be applied, and a power source using energy harvesting technology can also be applied. When the chest device 200 has a configuration in which sensor data or the like is transferred to the information communication terminal 500 by a wired communication method, driving power is supplied from the information communication terminal 500 via a communication cable, The secondary battery of the operating power supply 290 may be charged.

(Imaging device 300)
The imaging device 300 can shoot images such as a digital still camera and a digital video camera that can perform high-speed shooting (high-speed shooting) of the posture (running form) and running image (moving image) of the user US during exercise. Device. In the present embodiment, it is preferable to apply the imaging apparatus 300 that can perform high-speed shooting of approximately 100 frames or more (preferably 200 frames) per second. Here, the shooting speed of the imaging device 300 is set to be equal to or an integer multiple of the operating frequency (100 Hz to 200 Hz; sensing speed) of various sensors provided in the wrist device 100 and the chest device 200 described above. ing. In general, the shooting speed of images in commercially available imaging devices is approximately 30 frames or 60 frames per second, but in recent years, imaging devices capable of high-speed shooting of 100 frames or more per second are commercially available at low cost. It has come to be. Thereby, in this invention, a commercially available general purpose product can be applied and a system can be constructed | assembled simply and cheaply.

  Specifically, the imaging device 300 includes, for example, as illustrated in FIG. 2C and FIG. 6, a photographing unit 310, a lens unit 320, a shutter unit 330, an input operation unit 335, a display unit 340, A communication function unit 350, an arithmetic circuit 360, a memory unit 370, a timer circuit 380, and an operating power source 390 are provided. Here, the description of the configuration equivalent to the wrist device 100 or the chest device 200 described above is simplified.

  The imaging unit 310 includes, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), and scans an optical image that has passed through various lenses constituting the lens unit 320 described later. The image data is converted into a two-dimensional image signal every predetermined period, and image data for each screen (frame) is acquired. Each image data acquired by the photographing unit 310 is associated with time data defined by a timing circuit 380, which will be described later, in a predetermined storage of an image data memory (image data storage memory) 371 of the memory unit 370, which will be described later. Save sequentially to the area.

  The lens unit 320 has a plurality of lenses such as a focus lens and a zoom lens. Here, by adjusting the focusing condition by moving the focus lens in the optical axis direction, an automatic focusing process for focusing on an arbitrary subject is executed.

  The shutter unit 330 starts shooting a video by pressing a shutter button or a recording button of the input operation unit 335 described later, and ends when the button is pressed again. In the still image shooting mode, a still image of an arbitrary subject is shot by pressing the shutter button.

  The input operation unit 335 includes a power switch. When the power switch is operated by the user US, the input operation unit 335 controls the supply state (supply or cutoff) of driving power from the operation power supply 390 to each component, and performs imaging. The power supply of the device 300 is controlled to be turned on / off. The input operation unit 335 includes various operation buttons. For example, a shutter button for instructing photographing of a subject and a selection of an imaging mode, a function, and the like on a menu screen displayed on a display unit 340 described later are selected. A mode button for instructing, a zoom button for instructing adjustment of the zoom amount in the lens unit 320, and the like are provided. The input operation unit 335 may include a touch panel on the front side (view side) of the display unit 340 described later in addition to the various operation buttons described above or instead of the operation buttons. Here, the function realized by the touch panel may be equivalent to the function realized by the operation button described above, or may have a function specific to the input operation by the touch panel.

  The display unit 340 includes, for example, a liquid crystal display panel or a light emitting element display panel. The display unit 340 captures a live view image based on subject image data acquired by the lens unit 320 and the imaging unit 310 at the time of imaging, or is captured by the imaging unit 310. The image stored in the image data memory 371 is displayed. Further, the display unit 340 displays a menu screen that is selected and instructed by various operation buttons of the input operation unit 335.

  The communication function unit 350 functions as an interface when transferring the running video stored in the image data memory 371 to the information communication terminal 500 described later or when synchronizing with the wrist device 100. Here, as a method of transferring or transmitting / receiving a running image, a synchronization signal, and the like to / from the wrist device 100 and the information communication terminal 500 via the communication function unit 350, as in the wrist device 100 described above, various methods are used. A wireless communication system or a wired communication system can be applied.

  The memory unit 370 is roughly divided into an image data storage memory (hereinafter referred to as “image data memory”) 371, a program memory (program storage memory) 372, and a work memory (work data storage memory) 373. ,have. The image data memory 371 sequentially stores the image data photographed by the photographing unit 310 described above in a predetermined storage area in association with the time data. Here, during the period from when the shutter button is pressed to when the shutter button is pressed again, the image data is continuously stored in association with the time data, thereby generating video data (running video). The program memory 372 stores a control program for realizing a predetermined function in each configuration, such as a photographing operation in the photographing unit 310, the lens unit 320, and the shutter unit 330, and a data transfer operation in the communication function unit 350. The work memory 273 temporarily stores various data used when executing the control program and various generated data. Note that part or all of the image data memory 371 may have a form as a removable storage medium such as a memory card, and may be configured to be detachable from the imaging device 300.

  The arithmetic circuit 360 is an arithmetic processing unit such as a CPU or an MPU, and executes a predetermined control program stored in the above-described program memory 372 based on an operation clock generated by the timer circuit 380. As a result, the arithmetic circuit 360 controls operations in each configuration such as a photographing operation in the photographing unit 310, the lens unit 320, and the shutter unit 330, and a data transfer operation in the communication function unit 350. Note that the control program executed in the arithmetic circuit 360 may be incorporated in the arithmetic circuit 260 in advance.

  The timer circuit 380 is an RTC module having an oscillator that generates a basic clock, and generates an operation clock that defines the operation timing of each component of the imaging device 300 based on the generated basic clock. In addition, the timing circuit 380 measures the acquisition timing of the image data in the photographing unit 310, the lens unit 320, and the shutter unit 330 described above and outputs it as time data. Thereby, the time data is stored in the image data memory 371 in association with the image data. Here, synchronization of time data is achieved between the imaging device 300 and the wrist device 100 based on the synchronization signal transmitted from the wrist device 100 described above. The synchronization operation between the wrist device 100 and the imaging device 300 is similar to the above-described synchronization operation between the wrist device 100 and the chest device 200. The activation timing when the power is turned on, the photographing unit 310, the lens unit 320, It may be executed at the start timing of the photographing operation in the shutter unit 330. In addition, this synchronization operation may be executed at regular time intervals, arbitrary timing, or always.

  The operating power supply 390 supplies driving power to each component in the imaging apparatus 300 by operating the power switch of the input operation unit 335 described above. As the operating power supply 390, a primary battery or a secondary battery can be used. Note that when the imaging device 300 has a configuration for transferring video data to the information communication terminal 500 by a wired communication method, driving power is supplied from the information communication terminal 500 via a communication cable, The secondary battery of the power supply 390 may be charged.

(Display glass 400)
As shown in FIGS. 2D and 3A, the display glass 400 is a glasses-type or goggles-type information display device that is worn on the head of the user US (in front of the field of view). The display glass 400 is roughly divided into a device main body 401 having a transmissive display unit 440 on which various types of information are displayed, and the display unit 440 of the device main body 401 supported by the ear and nose of the user US. It has an external structure including a temple 402 that is mounted so as to be fixed in front of the US visual field. The display glass 400 may have a configuration in which a display control unit (not shown) is integrally incorporated in the device main body 401 or the temple 402 as shown in FIG. 2D, for example. Alternatively, a commercially available sports glass, sunglasses, glasses, goggles, or the like may be added to a display control unit having an image projection device.

  Specifically, as shown in FIG. 7, for example, the display glass 400 is roughly divided into an operation unit 430, a display unit 440, a communication function unit 450, an arithmetic circuit 460, a memory unit 470, and a timing circuit 480. And an operating power supply 490. Here, the description of the configuration equivalent to that of the wrist device 100, the chest device 200, and the imaging device 300 described above will be simplified.

  The operation unit 430 includes a power switch. When the power switch is operated by the user US, a driving power supply state (supply or cutoff) from the operation power supply 490 described later to each component in the display glass 400 is provided. To control on / off of the power supply of the display glass 400. The operation unit 430 has operation buttons and is used for display settings for various types of exercise information on the display unit 440 described later.

  As shown in FIG. 2D, the display unit 440 has, for example, a transmissive liquid crystal display panel capable of color or monochrome display or an organic display in a configuration in which the display control unit is integrally incorporated in the device main body 101. An EL display panel or the like can be applied, and exercise information and ecological information are transparently displayed in real time on the view of the user US in a manner superimposed on the surrounding scenery. In addition, in a configuration in which a display control unit is additionally assembled in a commercially available sports glass or the like, by directly transmitting and displaying on an image projection apparatus (not shown) arranged in front of the user's US field of view, In the field of view, exercise information and ecological information are displayed superimposed on the surrounding scenery. For example, as shown in FIG. 3 (c), the display unit 440 displays the number of steps during travel (indicated by bpm in the figure), the heart rate, pace, split time, lap time, travel distance, calories not shown. The consumption amount and the like are displayed in the form of numerical information and a graph. In addition, the display form of these various exercise information is arbitrarily set by operating an operation button of the operation unit 430, for example.

  The communication function unit 450 functions as an interface when receiving various exercise information acquired by the wrist device 100 or the chest device 200 from the wrist device 100. Here, as a method of transmitting / receiving exercise information and the like to / from the wrist device 100 via the communication function unit 450, various wireless communication methods and wired communication methods, similar to the chest device 200 and the imaging device 300 described above, are used. Can be applied.

  The memory unit 470 has a predetermined function in each configuration, such as a data memory for storing various types of exercise information transmitted from the wrist device 100 described above, a display operation in the display unit 440, a data transfer operation in the communication function unit 450, and the like. A program memory for storing a control program for realizing the above and a working memory for temporarily storing various data when the control program is executed.

  The arithmetic circuit 460 is an arithmetic processing unit such as a CPU or an MPU, and executes a predetermined control program stored in the memory unit 470 based on the operation clock generated by the timer circuit 480. Thereby, the arithmetic circuit 460 controls operations in the respective components such as a display operation of various exercise information on the display unit 440 and a data transfer operation in the communication function unit 250. Note that the control program executed in the arithmetic circuit 460 may be incorporated in the arithmetic circuit 460 in advance.

  The timer circuit 480 is an RTC module having an oscillator that generates a basic clock, and generates an operation clock that defines the operation timing of each component of the display glass 400 based on the generated basic clock.

  The operating power supply 490 supplies driving power to each component inside the device main body 401 of the display glass 400 when the operation unit 430 described above is operated. As the operating power source 490, for example, a commercially available primary battery or secondary battery can be applied, and a power source using energy harvesting technology can also be applied.

(Information communication terminal 500)
As shown in FIG. 1, the information communication terminal 500 is a network communication device having a function of connecting to a network 600 such as the Internet and incorporating a web browser as browsing software. The information communication terminal 500 is, for example, a notebook type or desktop type personal computer 501, a high-function mobile phone (hereinafter referred to as “smart phone”) 502, a tablet terminal 503, or a dedicated terminal (not shown). ) Etc. are applied. In particular, since network communication devices such as the smartphone 502 and the tablet terminal 503 are equipped with a function for connecting to the network 600 and a web browser as standard, the network 600 can be easily used regardless of the location within a predetermined communication range. Can be connected to. In the present embodiment, the information communication terminal 500 can be applied as a user terminal 900 described later. Further, in the present embodiment, the information communication terminal 500 may have only a function of transferring sensor data and running video, and in that case, for example, as shown in FIG. An access point 504 such as Wi-Fi (Wi-Fi (registered trademark)) communication may be applied.

  Specifically, for example, as shown in FIG. 8, the information communication terminal 500 generally includes an input operation unit 530, a display unit 540, a communication function unit 550, an arithmetic circuit 560, a memory unit 570, and a clock circuit. 580 and an operating power source 590. Here, the description of the configuration equivalent to the wrist device 100 and the chest device 200 described above is simplified.

  The input operation unit 530 is an input unit such as a keyboard, a mouse, a touch pad, or a touch panel attached to the personal computer 501, the smartphone 502, the tablet terminal 503, or the like. The input operation unit 530 selects an arbitrary icon or menu displayed on the display unit 540, which will be described later, or designates an arbitrary position on the screen to correspond to the icon, menu, or the position. The function is executed.

  The display unit 540 includes, for example, a liquid crystal display or a light emitting element display, a display panel, at least sensor data acquired by the wrist device 100 or the chest device 200 described above, and a running image captured by the imaging device 300. Is transmitted to the network server 700 via the network 600 to be described later. As will be described later, the information communication terminal 500 can also be applied to a user terminal 900 for browsing advice data (support data) created in the network server 700. In this case, the display unit 540 has a one-cycle running video (details will be described later) that repeats the running operation for one cycle (one cycle) created based on the sensor data and the running video, Various types of information (indicators and advice text for each guidance item) based on the analysis result are displayed in a predetermined display form.

  The communication function unit 550 transfers (uploads) sensor data and the like acquired by the wrist device 100 and the chest device 200 and a running video captured by the imaging device 300 to the network server 700 via the network 600 described later. At this time, it functions as an interface for receiving (downloading) the advice data created in the network server 700. Here, as a method of receiving sensor data and running images from the wrist device 100, the chest device 200, and the imaging device 300 via the communication function unit 550, as described above, various wireless communication methods and wired communication methods are used. Can be applied. In addition, as a method for connecting the information communication terminal 500 and the network 600 when transmitting sensor data or a running video to the network server 700 by the communication function unit 550 or receiving advice data from the network server 700, for example, Via a wired connection method that connects via an optical fiber line network, an ADSL (asymmetric digital subscriber) line network, etc., a mobile phone line network, a high-speed mobile communication line network, a wireless LAN (local area network), etc. A wireless connection method for connection can be applied.

  The memory unit 570 roughly includes a transfer data memory 571, a program memory 572, and a work memory 573, similarly to the list device 100 and the chest device 200 described above. The transfer data memory 571 stores the sensor data and the like transferred from the list device 100 and the chest device 200 described above and the running video transferred from the imaging device 300 in a predetermined storage area in association with each other. The program memory 572 stores a control program for realizing predetermined functions in each configuration, such as a display operation in the display unit 540 and a data transfer operation in the communication function unit 550. The work memory 573 temporarily stores various data used when the control program is executed and various generated data. The transfer data memory 571, like the list device 100 and the chest device 200 described above, has a part or all of its form as a removable storage medium, and is configured to be detachable from the information communication terminal 500. It may be.

  The arithmetic circuit 560 executes a predetermined control program stored in the program memory 572 based on the operation clock generated in the time measuring circuit 580, thereby causing the display operation in the display unit 540 and the communication function unit 550 to perform the operation. It controls operations in each configuration such as data transfer operations. Note that the control program executed in the arithmetic circuit 560 may be incorporated in the arithmetic circuit 560 in advance. The timing circuit 580 generates an operation clock that defines the operation timing of each component of the information communication terminal 500 based on the basic clock.

  The operating power supply 590 supplies driving power to each component of the information communication terminal 500. The operating power supply 590 is a secondary battery such as a lithium ion battery in a mobile terminal such as the smartphone 502. In the notebook personal computer 501 and the tablet terminal 503, a secondary battery such as a lithium ion battery or a commercial AC power supply is applied. A commercial AC power supply is applied to a desktop personal computer.

(Network 600)
The network 600 is a computer network that can send and receive sensor data, running video, advice data, and the like between the information communication terminal 500 described above and a network server 700 described later. Here, the network 600 may be a network that can be used by the public such as the Internet, or may be a network that can be used limitedly by a specific organization such as a company, a region, or an educational institution.

(Network server 700)
The network server 700 is an application server having at least functions of data processing and analysis described later. The network server 700 also includes a memory and a database for storing and storing sensor data transferred from the information communication terminal 500, running video, advice data created in processing and analysis processing described later, and the like. In preparation. As shown in FIG. 1, the network server 700 processes and analyzes sensor data and running images transferred from the information communication terminal 500 via the network 600, and creates advice data related to the running operation of the user US. To do. Then, in response to a request (request) from the user terminal 900, the network server 700 displays the running form of the user US and the ideal running form for each instruction point on the display unit 540 of the user terminal 900 based on the advice data. Are displayed in a display form that can be compared with each other, and advice for improvement is displayed. Note that the computer network constructed by the network 600 and the network server 700 described above may use a commercial cloud computing type service (cloud system) via the Internet, for example.

  Specifically, for example, as shown in FIG. 9, the network server 700 includes an input operation unit 730, a display unit 740, a communication function unit 750, an arithmetic circuit (comparison video creation unit, index creation unit, advice information creation). Section, display data creation section) 760, memory section 770, timing circuit 780, operating power supply 790, and database 800. Here, the description of the configuration equivalent to that of the wrist device 100, the chest device 200, and the information communication terminal 500 described above will be simplified.

  The input operation unit 730 includes an input device such as a keyboard and a mouse, for example, and is used to select an arbitrary icon or menu displayed on the display unit 740 and to indicate an arbitrary position. The display unit 740 includes a display and a display panel, and displays information related to various operations in the network server 700.

  The communication function unit 750 functions as an interface when receiving sensor data or the running video transferred from the information communication terminal 500 described above, or transmitting advice data created in the network server 700 to the user terminal 900. To do.

  The memory unit 770 includes a transfer data memory 771, a program memory 772, and a work memory 773. The transfer data memory 771 stores sensor data and running images transferred from the information communication terminal 500 described above. The program memory 772 is a control program for realizing predetermined functions in the display unit 740 and the communication function unit 750, and an algorithm for executing predetermined processing and analysis processing based on transferred sensor data and running images. Save the program. The work memory 773 temporarily stores various data used when executing the control program and the algorithm program, and various generated data.

  The database 800 includes a running data database (hereinafter referred to as “running data DB”) 810, a user video database (hereinafter referred to as “user video DB”) 820, an elite runner video database (hereinafter referred to as “elite runner video DB”). ”And an advice data database (hereinafter referred to as“ advice data DB ”) 840.

  The running data DB 810 stores and accumulates sensor data or the like acquired by the wrist device 100 or the chest device 200 and transferred (uploaded) via the information communication terminal 500 and the network 600. The user video DB 820 stores and accumulates the running video of the user US acquired by the imaging device 300 and transferred (uploaded) via the information communication terminal 500 and the network 600 or directly via the network 600. The running video of the user US is a video of the running video taken by the user US performing a running operation with various sensors such as the wrist device 100 and the chest device 200 described above. A specific photographing method will be described later. The user video DB 820 also stores and stores a one-cycle running video (first posture video) that repeats a running operation for one cycle, which is created by the arithmetic circuit 760 based on the accumulated running video. . Here, the sensor data and the like stored in the running data DB 810 and the running video stored in the user video DB 820 are integrated and managed in association with each other. That is, the wrist device 100, the chest device 200, and the imaging device 300, for example, using Bluetooth (registered trademark) communication to synchronize the operation clocks in advance, so that the time associated with the sensor data or the running video Data is managed in an integrated manner using a common time stamp.

  The elite runner video DB 830 is an elite runner video data representing an ideal (exemplary or reference) running form video by the elite runner, which is the target of the comparative analysis of the running video of the user US in the exercise support method described later. Are stored and stored in advance. This running image of the elite runner is a running image of the running run with the various sensors attached to the elite runner, similar to the running image of the user US, and a video taken during the running. Further, the running video of the elite runner is shared by each user who uses the exercise support system according to the present embodiment via the network 600 (on the cloud system). The running video of the elite runner may be taken once and stored in advance in the elite runner video DB 830, or as necessary (for example, when a new running method is proposed). The elite runner video DB 830 may be updated by shooting, or elite runner video data may be added. The elite runner video DB 830 also includes a one-cycle running video (second posture video) that repeats the running operation for one cycle, which is created by the above-described arithmetic circuit 760 based on the accumulated elite runner video data. Stored and accumulated.

  Here, in this embodiment, an elite runner is a runner having an ideal running form with a track record and having a relatively high running power, such as a runner who has won a higher rank in a famous marathon event or the like. Means a runner having a record exceeding the time (for example, 2 hours 30 minutes in a full marathon). The definition of the elite runner is not limited to the professional grade runner as described above, and may be a runner image of a runner having at least an ideal running form. Therefore, in the case of a beginner or intermediate of a marathon, an image of an ideal running form that serves as a model or reference according to the level may be used as an elite runner image.

  The advice data DB 840 stores and accumulates advice data corresponding to each of a plurality of instruction items (instruction points) regarding the running operation. Here, each guidance item (it mentions later in detail) about running operation is set up beforehand. The advice data stored in the advice data DB 840 includes a comparison video of running motion, an index assigned to the comparison video, and advice text (advice information) corresponding to each guidance item. Here, in the 1-cycle running video of the elite runner composing the comparative video, the indication points, guide lines, arrows, numerical values, etc. for clearly indicating each guidance item are the guidance items in the one-cycle running video. Is given to a video (stop video) at a timing according to the above, and is stored in advance in the advice data DB 840.

  The database 800 may be built in the network server 700 as shown in FIG. 9, or may be externally connected to the network server 700 or directly connected to the network 600. Good.

  The arithmetic circuit 760 executes the following processing and analysis processes by executing a predetermined algorithm program stored in the program memory 772 based on the operation clock performed in the time measuring circuit 780. The arithmetic circuit 760 compares the one-cycle running video created based on the sensor data of the user US and the running video and the one-cycle running video created based on the elite runner video data of the elite runner. Create In addition, the arithmetic circuit 760 gives an index such as an instruction point or a guide line for clearly indicating each instruction item to a video stopped at a timing corresponding to each instruction item in the created comparison image. Associate advice text corresponding to each instruction item. The association information of the comparison video, the index, and the advice text is stored in the advice data DB 840 as advice data.

  In addition, the arithmetic circuit 760 allows the user US to access the network server 700 using the user terminal 900, thereby obtaining advice data including a comparison video, an index, and an advice text according to the request of the user US from the advice data DB 840. Web display data (display data) to be read out appropriately and displayed in a predetermined display form is created. Note that the control program and algorithm program executed in the arithmetic circuit 760 may be incorporated in the arithmetic circuit 760 in advance. In the network server 700, a commercial AC power source is applied as the operating power source 790.

(User terminal 900)
The user terminal 900 is a network communication device having a configuration (see FIG. 8) equivalent to the information communication terminal 500 described above. The user terminal 900 accesses the web display data for displaying the comparison video, the index, and the advice text included in the advice data in a predetermined display form when the user US accesses the network server 700 via the network 600. It is received (downloaded) and displayed on the display unit 540 using a web browser.

  As a result, the user US can browse the running video acquired during his running and the running video of the elite runner in a display form that can be compared, and accurately grasp the features of his running form for each instruction item. Then, based on the provided advice, it can be reflected in the improvement of the exercise method thereafter.

  As described above, the user terminal 900 may apply the information communication terminal 500 used when transferring sensor data or the running video to the network server 700. May use another network communication device. In the latter configuration, for example, sensor data or a running video is transferred to the network server 700 using the personal computer 501, and the advice data is obtained by accessing the network server 700 using the smartphone 502 or the tablet terminal 503, for example. Displayed and viewed. A display example of advice data (comparison video, index, advice text) on the display unit 540 of the user terminal 900 will be described in detail later.

<Exercise support method>
Next, a control method (exercise support method) in the exercise support system according to the present embodiment will be described with reference to the drawings. Here, a series of exercise support methods from acquisition of sensor data and running video by the exercise support system according to the present embodiment to comparison video creation processing, running form analysis processing, advice data creation, and display processing Will be described.

  FIG. 10 is a flowchart illustrating an example of an exercise support method in the exercise support system according to the present embodiment. FIG. 11 is a schematic diagram illustrating an example of a high-speed shooting method applied to the exercise support method according to the present embodiment.

  In the exercise support method according to the present embodiment, as shown in the flowchart of FIG. 10, it is roughly divided into a sensing / data collection procedure (steps S101 to S109), a data processing / analysis procedure (steps S110 and S111), and an advice. A data providing procedure (step S112) is sequentially executed. Here, the data processing / analysis procedure and the advice data provision procedure are realized based on a predetermined algorithm program executed in the arithmetic circuit 760 of the network server 700.

[Sensing data collection procedure]
In the sensing data collection procedure, as shown in FIG. 10, first, the user US operates the power switch of the wrist device 100 or the chest device 200 worn on the body, so that the wrist device 100, the chest device 200, the display glass ( (Not shown) 400 is activated. In addition, the user US operates the power switch of the imaging device 300 to activate the imaging device 300. As a result, a synchronization signal is transmitted and received between the wrist device 100, the chest device 200, and the imaging device 300 using, for example, Bluetooth (registered trademark) LE communication, and the respective operation clocks are synchronized ( Step S101).

  Next, the user US starts the high-speed shooting by operating the imaging device 300 simultaneously with the start of running or at an arbitrary timing before and after the start of running (step S102) (step S103). At this time, the sensing operation is started when the user US operates the wrist device 100 and the chest device 200. The high-speed shooting by the imaging device 300 and the sensing operation by the wrist device 100 and the chest device 200 are performed simultaneously with the end of running by the user US or at any timing before and after the running end (step S107). This is continued until the device 100 and the chest device 200 are operated and terminated (step S106). As a result, a running image indicating the posture and running method of the user US during the running operation is collected, and sensor data indicating the exercise state and biological information during the running operation are collected (step S104).

  For example, as shown in FIG. 11A, the collection of running images is fixed to a side of the user US by a tripod or the like when the user US uses the treadmill 1000 for running. The image pickup device 300 is arranged to take a high-speed image of an exercise posture (running form) during running operation and an image of how to run. Further, when the user US runs outdoors or the like, as shown in FIG. 11B, the user US is in front of the imaging device 300 (shooting range FR or field of view) in which the shooting range is fixed by a tripod or the like. Take a high-speed shot of the running form and how to run as you run through. Here, when shooting a running video of the user US, a marker that defines an index (indicating points, guide lines, arrows, etc .; details will be described later) for clearly indicating various instruction items related to the running form described later. Is executed in a state of being attached to a predetermined position of the body (specifically, the top of the head, the shoulder, the wrist, the waist, the shoe tip, etc.). Alternatively, a running image is photographed by wearing special clothing for photographing in which a pattern corresponding to the marker is woven in advance or a patch is sewn.

  Note that in the high-speed shooting of running video by the imaging device 300, the user US may directly perform the start and end of shooting instructions, or there are assistants and cooperators regarding shooting of the running video. May be requested to the assistant or the like. When the imaging device 300 has a remote control function, for example, as shown in FIG. 11A, for example, while the user US is running on the treadmill 1000, the wrist device 100, the treadmill 1000, etc. May be instructed to start and end shooting using, for example, Bluetooth (registered trademark) communication or WiFi (Wi-Fi (registered trademark)) communication. Further, when the imaging device 300 has a moving object detection function, for example, as shown in FIG. 11B, high-speed shooting is automatically performed when the user US enters the shooting range FR (frame-in). May be set to start and end the shooting by automatically ending the shooting when the user US leaves the shooting range FR (frame out). Here, when the user US shoots an image that passes through the front of the imaging device 300, the installation position of the imaging device 300 and the lens unit so that approximately 3 to 5 steps of images are captured within the imaging range FR. It is preferable to adjust the zoom amount at 320.

  With these methods, a running video for a period from the photographing start time pointed to by the user US to the photographing end point point is acquired and stored in a predetermined storage area of the image data memory 371 in association with the time data.

  During the running operation, as shown in FIGS. 3A and 4, in the wrist device 100 worn by the user US on the wrist, the sensor unit 110 performs acceleration data, angular velocity data, geomagnetism during the running operation. Sensor data including data is detected. In the case of running with outdoor movement, GPS data including position data and travel speed data is detected by the GPS receiving circuit 120. These sensor data and GPS data are stored in a predetermined storage area of the sensor data memory 171 in association with time data.

  Further, as shown in FIGS. 3A and 5, in the chest device 200 worn by the user US on the chest, the sensor unit 210 detects sensor data including acceleration data, angular velocity data, and geomagnetic data during the running operation. Is done. In addition, heart rate data is acquired by the heart rate detection circuit 220. These sensor data and heart rate data are stored in a predetermined storage area of the sensor data memory 271 in association with time data.

  The sensor data and the like acquired by the wrist device 100 and the chest device 200 described above and the running video acquired by the imaging device 300 are synchronized when the wrist device 100, the chest device 200, and the imaging device 300 are activated, respectively. It is associated with time data generated based on the operation clock. Therefore, the sensor data and the running video are stored in a substantially synchronized state.

  Further, for example, in the wrist device 100, the running speed (or pace) is calculated by the arithmetic circuit 160 based on the time data and the position data. Further, for example, in the chest device 200, the calorie consumption is calculated by the arithmetic circuit 260 based on the time data, the heart rate data, the weight and age of the user US, and the like. Various pieces of information such as travel speed and calorie consumption are stored in predetermined storage areas of the sensor data memories 171 and 271 in association with time data.

  The sensor data collected during the running operation, GPS data, heart rate data, or various information calculated based on these sensor data and the like are displayed during the running operation, for example, the display unit 141 of the wrist device 100, It is displayed on the display unit 440 of the display glass 400 in real time and provided to the user US (step S105). Here, various types of information displayed on the display unit 141 of the list device 100 and the display unit 440 of the display glass 400 are transmitted by the communication function units 150, 250, and 450 of the list device 100, the chest device 200, and the display glass 400, for example. Transmission / reception is performed constantly or at predetermined time intervals using Bluetooth (registered trademark) communication.

  Next, after the sensing operation by the wrist device 100 and the chest device 200 and the high-speed shooting by the imaging device 300 are finished, as shown in FIG. 1, the wrist device 100 and the chest device 200 are connected to a predetermined wireless communication system or wired communication. The system is connected to the information communication terminal 500 such as the personal computer 501, the smartphone 502, the tablet terminal 503, or the like (step S108). As a result, the sensor data and the like stored in the sensor data memories 171 and 271 are transmitted to the information communication terminal 500 by the communication function units 150 and 250 of the wrist device 100 and the chest device 200 and temporarily stored in the transfer data memory 471. The The sensor data transmitted to the information communication terminal 500 is transferred to the network server 700 via the network 600 by the communication function unit 450 (step S109).

  In addition, as shown in FIG. 1, the imaging device 300 is connected to the information communication terminal 500 by a predetermined wireless communication method or wired communication method in the same manner as the wrist device 100 and the chest device 200 described above (step S108). As a result, the running video stored in the image data memory 371 is transmitted to the information communication terminal 500 by the communication function unit 350 of the imaging device 300 and temporarily stored in the transfer data memory 471. Then, the running video transmitted to the information communication terminal 500 is transferred to the network server 700 via the network 600 by the communication function unit 450 (step S109).

  Note that the process of transferring the sensor data acquired by the wrist device 100 and the chest device 200 and the running video acquired by the imaging device 300 to the network server 700 via the information communication terminal 500 is the wireless communication method described above. It is not limited to a method using a wired communication system. For example, when the sensor data memories 171 and 271 of the wrist device 100 and the chest device 200 and a part or all of the image data memory 371 of the imaging device 300 have a form as a removable storage medium such as a memory card. Then, these memory cards (storage media) are removed from the wrist device 100, the chest device 200, and the imaging device 300, and inserted into the card slot of the information communication terminal 500, thereby transferring the sensor data and the running video to the information communication terminal 500. It may be a thing.

  The processing for transferring the sensor data acquired by the wrist device 100 and the chest device 200 as described above and the running video acquired by the imaging device 300 to the network server 700 is performed by the personal computer 501 or the smartphone shown in FIG. The method is not limited to the method using the information communication terminal 500 such as 502. For example, when the wrist device 100, the chest device 200, and the imaging device 300 have a data transfer function by Wi-Fi (Wi-Fi (registered trademark)) communication or the like, for example, as shown in FIG. The sensor data and the running video may be directly transferred to the network server 700 via the access point 504.

  The sensor data and the running video transferred to the network server 700 by the information communication terminal 500 are stored in a predetermined storage area of the transfer data memory 771 of the memory unit 770. For example, the user US connects the wrist device 100, the chest device 200, and the imaging device 300 to the information communication terminal 500 in the process of transferring sensor data or the like or the running video to the network server 700 (steps S108 and S109). In the state, it is manually executed by operating the input operation unit 530 of the information communication terminal 500. Alternatively, the list device 100, the chest device 200, and the imaging device 300 may be connected to the information communication terminal 500 (including the access point 504) to automatically execute a series of transfer processes.

  The sensor data and the running video transferred (uploaded) to the network server 700 via the information communication terminal 500 are stored and accumulated in predetermined storage areas of the running data DB 810 and the user video DB 820, respectively. Here, since the sensor data and the running image stored in each database are acquired in a state where the sensor device (the list device 100 and the chest device 200) and the imaging device 300 are synchronized in advance, each of them is included in the synchronization signal. Is associated with time data defined on the basis of. As a result, the network server 700 manages the sensor data stored in the running data DB 810 and the running video stored in the user video DB 820 in association with each other based on the time data.

[Data processing / analysis procedure]
FIG. 12 is a flowchart illustrating an example of comparison video creation processing and analysis / advice data creation processing applied to the exercise support method according to the present embodiment. FIG. 13 is a flowchart illustrating an example of a one-cycle running video creation process applied to the present embodiment. FIG. 14 is an explanatory diagram illustrating the concept of the operation elements of the running motion and the definition of one cycle in the one-cycle running video creation process applied to the present embodiment. FIG. 15 is a conceptual diagram for explaining a one-cycle running video creation process applied to the present embodiment. FIG. 16 is a schematic diagram illustrating an example of creating a comparison video in the exercise support method according to the present embodiment.

  In the data processing / analysis procedure, as shown in FIG. 10, first, the arithmetic circuit 760 of the network server 700 is based on the sensor data and the like stored in the running data DB 810 and the running video stored in the user video DB 820. Thus, a one-cycle running video showing the running form (exercise posture) of the user US is created. Then, the arithmetic circuit 760 executes a process of creating a comparison video between the one-cycle running video of the user US and the one-cycle running video of the elite runner stored in advance in the elite runner video DB 830 (step S110).

(Comparison video creation process)
In the comparison video creation process, specifically, as shown in FIG. 12, first, the arithmetic circuit 760 of the network server 700 is transferred (uploaded) via the information communication terminal 500 and the network 600, and is stored in the running data DB 810. The stored sensor data and the like and the running video saved in the user video DB 820 are read out (step S121). Here, as described above, the sensor data and the running video are associated with time data synchronized with each other.

  Next, the arithmetic circuit 760 creates a one-cycle running video that repeats one cycle of running video based on the read sensor data and the running video (step S122). Specifically, in general, the running motion such as running is performed, for example, as shown in the upper run model of FIG. 14 from the kicking of one foot (the left foot in the drawing) to the grounding of the other foot ( (Right foot grounding) and kicking (right foot grounding), one foot grounding (left foot grounding), then one foot kicking (left foot grounding) again in sequence. Two steps can be defined as one cycle. Here, in the running motion shown in FIG. 14, the period from “left foot landing” to “right foot grounding” and the period from “right foot grounding” to “left foot grounding” are defined as “free leg period”. Can do. In addition, the period from "Right foot grounding" to "Right foot grounding" can be defined as "Right foot landing phase", and the period from "Left foot grounding" to "Left foot grounding" can be defined as "Left foot stance phase". . In the “stance phase”, the body is accelerated in the direction of travel by applying force to the ground with the foot, and in the “free leg period”, the speed obtained in the “stance phase” is decelerated. By alternately repeating such “standing phase” and “swing phase”, the running state is maintained and the vehicle can continue to run.

  On the other hand, as shown in the sensor data graph in the lower part of FIG. 14, at the grounding timing of the running motion (“right foot grounding” and “left foot grounding” of the running motion model), In particular, a signal waveform characteristic of the vertical component of acceleration data detected by the three-axis acceleration sensor 211 is observed. Therefore, as shown in FIG. 14, by observing the signal waveform of the vertical component of this acceleration data, it is possible to detect the ground point where either the left or right foot is grounded. As a result, the running motion for one cycle from the grounding of one foot (for example, the right foot) to the grounding of the next foot (for example, the right foot) through the series of motion elements of the running motion can be determined and handled. Sensor data for one cycle is extracted (step S131).

  Next, based on the time data associated with the extracted sensor data and the like for one cycle, the arithmetic circuit 760 generates a running video corresponding to the one cycle from the running video of the user US stored in the user video DB 820. Cut out (step S132). That is, using the time data associated with the sensor data and the running video as a time stamp, as shown in FIG. 15, the starting point of the sensor data for one cycle extracted in step S131 from the running video of the user US as shown in FIG. By extracting video data corresponding to time data from (for example, a right foot contact point) to an end point (next right foot contact point), a running image corresponding to one cycle of sensor data or the like is cut out. Here, since the cut sensor data and the running video are synchronized, the running video indicates whether the foot to be grounded at the ground point detected based on the sensor data or the like is the left or right foot. It can be determined based on.

  Next, as shown in FIG. 15, the arithmetic circuit 760 repeats the running operation for one cycle by setting the cut running image for one cycle to be loop-reproduced between the end point and the start point. A one-cycle running video is created (step S133). The created one-cycle running video of the user US is stored in a predetermined storage area of the user video DB 820.

  Next, as shown in FIG. 12, the arithmetic circuit 760 shows the one-cycle running video of the elite runner that is read from the elite runner video DB 830 as to how the foot of the user US moves step by step. The time axes of both running videos are adjusted so as to synchronize with the way the feet move step by step (step S123). Here, the arithmetic circuit 760 uses the time of the 1-cycle running video of the elite runner so as to synchronize the ground contact timing (that is, the pitch) in the 1-cycle running video of the elite runner on the basis of the 1-cycle running video of the user US. Adjust the axis. Specifically, for example, when the time of one cycle of the elite runner's running operation is shorter than the time of one cycle of the user US's running operation, the time of one cycle of the elite runner's running operation is set as the time of the user US's running operation. The time axis of the elite runner's 1-cycle running video is adjusted and synchronized so that the elite runner's running motion is slow-played with respect to the original running motion. The 1-cycle running video of the elite runner stored and accumulated in the elite runner video DB 830 is acquired in advance in the same manner as the above-described process for creating the 1-cycle running video of the user US (see FIGS. 13 to 15). It is created based on the sensor data and the running image during the run operation of the runner.

  Next, the arithmetic circuit 760 combines the one-cycle running video of the user US adjusted so that the time axes are synchronized with the one-cycle running video of the elite runner to create a comparative video as shown in FIG. (Step S124). Here, as a comparative video, for the running form of the user US and the elite runner, each one-cycle running video is arranged in parallel so as to be adjacent to the left and right of the drawing so that the visual comparison is easy. A synchronized video is created. The created comparison video of the user US and the elite runner is stored in a predetermined storage area of the advice data DB 840. This comparison video is displayed in a predetermined display form on the display unit 540 of the user terminal 900 using a web browser in the advice data provision procedure described later.

  Next, as shown in FIG. 10, a plurality of instruction items for the running operation set in advance are analyzed, and processing for creating advice data is executed (step S111). In this analysis / advice data creation processing, based on the sensor data and the like acquired by the wrist device 100 and the chest device 200 and stored in the running data DB 810, the arithmetic circuit 760 converts the running form into the running form as shown in FIG. We will sequentially analyze the various guidance items involved. Then, in the comparative video described above, an index for clearly indicating each guidance item and its analysis result is given to the video (stop video) at a timing corresponding to each guidance item (step S126) and corresponding to each guidance item. The advice text extracted and associated (step S127) is repeatedly executed for the number of instruction items (steps S125 and S128).

(Analysis and advice data creation processing)
Here, the analysis processing in various instruction items and the indices given to the running video will be described in detail.
FIG. 17 is a list showing examples of instruction items in the exercise support method according to the present embodiment. FIG. 18 is a conceptual diagram illustrating a display example of an index in each instruction item applied to the present embodiment. Here, in FIG. 18, for the sake of simplicity, the running video is displayed using a skeleton model for convenience.

  Specifically, in the analysis / advice data creation process, as shown in FIG. 17, for example, as the guidance items related to the running form, as shown in FIG. 17, the maximum kick force and maximum propulsive force during the running operation, the contact time, the vertical movement of the body, The pitch, trunk shake and tilt, stride, running speed, running trajectory, arm swing, landing brake, center of gravity, etc. are sequentially analyzed. Here, the instruction items and the order thereof shown in FIG. 17 are merely examples, and the present invention is not limited thereto. That is, as long as it is related to the running form (exercise posture), analysis may be performed only for an arbitrary item among the guidance items shown in FIG. 17, and other guidance items are added. It may be a thing. Moreover, you may change arbitrarily the order of the analysis process of each guidance item.

  In the analysis of the maximum kick force during the running operation (guidance item I = 1 in FIG. 17), based on the triaxial acceleration data acquired by the chest device 200, when the foot is landed, it is upward from the ground. The ground reaction force (unit: N or sec or N / sec) to be received is calculated. In this embodiment, the downward force is measured by observing the vertical component of the acceleration data in the three-axis direction detected by the three-axis acceleration sensor 211, and the ground reaction force (force action, law of reaction) is measured. The maximum value of the force that pushes up the body when the foot kicks the ground downward is calculated. Here, it is determined that if the numerical value of the maximum kick force is larger, or if the value is equal to or greater than a predetermined value, efficient and powerful running can be performed, and fast and easy running can be achieved. Further, if the maximum kick force has a large margin with respect to the muscular strength of one's own foot, it is determined that a good propulsive force (a force to move forward) can be obtained. As shown in FIG. 18 (a), this maximum kick force is stopped at a timing at which the maximum kick force can be clearly shown in the one-cycle running video constituting the comparison video in the advice data display described later. In the video, an indication point P and an arrow R indicating the magnitude of the kick force are displayed on the toes (or soles) as indices.

  Further, in the analysis of the maximum propulsive force during the running operation (guidance item I = 2 in FIG. 17), it proceeds from the ground when the foot is landed based on the triaxial acceleration data acquired by the chest device 200. The ground reaction force (unit: N or sec or N / sec) received in the direction is calculated. In this embodiment, the force in the traveling direction (propulsion direction) is measured by observing the longitudinal component of the acceleration data in the three-axis direction detected by the three-axis acceleration sensor 211, and the ground reaction force (the action of the force) is measured. According to the law of reaction, when the foot kicks the ground backward, the maximum value of the force that advances the body forward is calculated. Here, the higher the maximum propulsive force value, the higher the traveling speed (speed). However, if the traveling speed can be maintained with this numerical value being small, it will be judged that efficient and powerful driving can be achieved, and that it is possible to run quickly and easily. . As shown in FIG. 18B, this maximum propulsive force is stopped at a timing at which the maximum propulsive force can be clearly shown in the one-cycle running video constituting the comparison video, as shown in FIG. 18B. In the image, an indication point P and an arrow R indicating the magnitude of the propulsive force are displayed on the toes (or soles) as indices.

  Further, in the analysis of the contact time during the running operation (guidance item I = 3 in FIG. 17), the time from the contact of the foot to the ground (based on the acceleration data in the three-axis directions acquired by the chest device 200 ( Unit: msec or%) is calculated. In the present embodiment, by observing the vertical component of the acceleration data in the triaxial direction detected by the triaxial acceleration sensor 211, as shown in FIG. The ground point is detected and the contact time is calculated individually. Here, if the numerical value of the contact time is shorter (that is, the pitch is larger) or less than a predetermined value, it is determined that efficient and fast running is possible. As shown in FIG. 18C, this touch-down time is displayed in a stop video at a timing at which the touch-down time can be clearly shown in the one-cycle running video constituting the comparison video. The indicator point P and the arrow R indicating the length of the contact time are displayed on the toes (or soles) as indices.

  Further, in the analysis of the vertical movement of the body during the running operation (guidance item I = 4 in FIG. 17), the change in the vertical direction of the body is calculated based on the acceleration data in the three-axis directions acquired by the chest device 200. Is done. In this embodiment, by observing the vertical component of the acceleration data in the triaxial direction detected by the triaxial acceleration sensor 211, the highest rise point and the lowest drop point of the body are detected, and the vertical change is detected. The width of is calculated. Here, the larger the value of the vertical movement of the body, the higher the kicking force in the upward direction, which means that if the same stride, the greater the force will be exerted to advance the same distance, but more vertical movement than necessary is energy A loss will occur. On the other hand, if the body does not move up and down, it cannot run, and if the up and down movement is extremely small, it cannot run on speed. From this, it is determined that if the numerical value of the vertical movement of the body is in an appropriate range, efficient and fast running can be performed. As shown in FIG. 18D, this vertical movement of the body is stopped at a timing at which the vertical movement can be clearly shown in the one-cycle running video constituting the comparison video, as shown in FIG. In the image, an indication point P and an arrow R indicating the magnitude of vertical movement are displayed at the top of the head as indices.

  Further, in the analysis of the pitch during the running operation (the instruction item I = 5 in FIG. 17), the number of steps per minute (unit: bpm) is calculated based on the acceleration data in the three-axis directions acquired by the chest device 200. It is measured. Here, since traveling speed (speed) = pitch × stride, it is determined that the greater the numerical value of the pitch and stride, the faster the traveling. In this case, it is necessary to apply muscle strength that can withstand a large vertical movement of the body. If the pitch value is within an appropriate range, it is determined that the pace can be maintained. As shown in FIG. 18 (e), this pitch is an index in a stop video at a timing at which the pitch can be clearly specified in one cycle running video constituting the comparative video, as shown in FIG. As shown, the indicated point P and the measured value K of the pitch are displayed on the toes (or soles).

  Further, in the analysis of trunk shake during the running operation (guidance item I = 6 in FIG. 17), based on the acceleration data in the three-axis direction and the angular velocity data in the three-axis direction acquired by the chest device 200, Changes (differences) in the front and rear, left and right, and up and down directions of the reference axis (body axis) of the trunk within a specific time (for example, one cycle in a running operation) are calculated. In this embodiment, when the position of the top of the body is fixed as the shake of the trunk, the change in the angle of the reference axis of the trunk in each of the front, rear, left, and right directions is maximum. Calculated as an angle. Here, it is determined that stable and efficient running can be performed as the numerical value of the shake of the trunk is smaller or within a predetermined range. As shown in FIG. 18 (f), the trunk shake is displayed at a timing at which the trunk shake can be clearly shown in the one-cycle running video constituting the comparison video. In the stop video, an indication point P and a guide line G corresponding to the body axis and an arrow R indicating the size of blur are displayed on the top and lower back as indicators.

  Further, in the analysis of the stride during the running operation (the instruction item I = 7 in FIG. 17), based on the GPS data acquired by the wrist device 100 or the speed data set in the treadmill, at a predetermined timing. The stride (unit: cm) is measured. Here, it is determined that the greater the numerical value of the stride, the faster the vehicle can run. If the stride value is within an appropriate range, it is determined that the pace can be maintained. In general, if fatigue accumulates during a running operation, the stride becomes shorter and the pitch tends to be maintained by increasing the pitch. Therefore, it is determined whether the vehicle is running well in relation to the pitch. In the display of advice data, which will be described later, as shown in FIG. 18 (g), this stride is an index in a stop video at a timing at which a stride can be clearly shown in one cycle running video constituting a comparative video. As shown, an indication point P and an arrow R indicating the size of the stride are displayed on the toes (or soles).

  Further, in the analysis of the running speed during the running operation (guidance item I = 8 in FIG. 17), a predetermined timing based on the GPS data acquired by the wrist device 100 or the speed data set in the treadmill. The traveling speed (speed) or the required time (pace) per unit distance is calculated. Here, it is determined that efficient running is possible by considering the running speed and the distribution of the pace assuming a race or the like. In addition, in relation to other instruction items, if a predetermined running speed and pace can be maintained, it is determined that efficient running is possible. In the display of advice data, which will be described later, this travel speed is a calculated value of the travel speed as an index in a stop video at an arbitrary timing that can clearly indicate the travel speed among the one-cycle running images constituting the comparison video. Is displayed.

  Further, in the analysis of the travel locus during the running operation (the instruction item I = 9 in FIG. 17), the travel locus (route) or the travel distance is acquired based on the GPS data acquired by the wrist device 100. . Here, it is determined that efficient running can be performed by considering a running method according to a running locus and a running distance assuming a race or the like.

  Further, in the analysis of the arm swing during the running operation (guidance item I = 10 in FIG. 17), based on the acceleration data and the angular velocity data in the three-axis directions acquired by the wrist device 100, the arm swing angle ( Unit: °) is measured. In the present embodiment, the angle of the arm from the state in which the arm (for example, the left arm) on which the wrist device 100 is worn is maximally pulled forward to the state in which the arm is pulled back backward is measured. Here, generally, when the arm swing angle is smaller than usual, the traveling speed tends to decrease. From this, it is determined that the greater the arm swing value is, or the greater the predetermined value is, the more efficient and powerful running is possible. If the arm swing angle is maintained within an appropriate range, it is determined that the pace can be maintained. In the display of advice data, which will be described later, this arm swing is stopped at a timing at which the arm swing can be clearly shown in one cycle running video composing the comparison video, as shown in FIG. In the image, an indication point P and an arrow R indicating the magnitude of arm swing are displayed on the arm (or wrist) as an index.

  Further, in the analysis of the landing brake during the running operation (guidance item I = 11 in FIG. 17), the traveling direction from the ground when the foot is landed based on the triaxial acceleration data acquired by the chest device 200. The ground reaction force (unit: N or sec or N / sec) received in the opposite direction is calculated. In the present embodiment, the force in the direction opposite to the traveling direction is measured by observing the longitudinal component of the acceleration data in the triaxial direction detected by the triaxial acceleration sensor 211, and the ground reaction force (the action of the force, According to the law of reaction, the maximum value of the force that restrains the body backward when the foot stretches the ground forward is calculated. Here, when the traveling speed is increased and the landing brake value is increased, the deceleration force is increased. Therefore, even if the traveling speed is increased, the landing brake value is decreased to achieve efficient driving. As shown in FIG. 18 (i), this landing brake is displayed in a stop image at a timing at which the landing brake can be clearly shown in the one-cycle running image constituting the comparison image. The indicator point P and the arrow R indicating the size of the landing brake are displayed on the toes (or soles) as indices.

  Further, in the analysis of the inclination of the trunk during the running operation (guidance item I = 12 in FIG. 17), the acceleration data in the three-axis direction and the angular velocity data in the three-axis direction acquired by the chest device 200, the one-cycle running image The inclination angle of the reference axis (body axis) of the trunk is calculated based on the indication points of the top of the body and the waist provided to the body. In the present embodiment, the inclination (inclination angle) in each of the front and rear, left and right, and up and down directions of the reference axis (body axis) of the trunk within a specific time (for example, one cycle in the running operation) is calculated. . Here, it is determined that stable and efficient running can be performed as the trunk tilts moderately in the traveling direction and the left and right tilt angles are smaller. In addition, since the numerical value of the inclination of the trunk also varies among elite runners, it is determined whether or not good running is possible in consideration of individual differences. As shown in FIG. 18 (j), this trunk inclination is a timing at which the trunk inclination can be clearly shown in the one-cycle running video constituting the comparison video, as shown in FIG. 18 (j). In the stop video, an indication point P and a guide line G corresponding to the body axis and an arrow R indicating the magnitude of the inclination are displayed on the top and lower back as indicators.

  Further, in the analysis of the position of the center of gravity during the running operation (guidance item I = 13 in FIG. 17), the height of the user US registered in advance and the shoulder and waist of the body given to the one-cycle running video are recorded. Based on the indicated point, the center of gravity of the body is calculated. Then, the intersection of the center of gravity line obtained by extending the calculated center of gravity point vertically downward and the ground surface is defined as the position of the center of gravity. Here, as the position of the center of gravity is closer to the ground contact point of the forefoot (foot on the forward side) in the running operation, it is determined that the landing brake is not applied and efficient and fast running is possible. In the display of advice data, which will be described later, the position of the center of gravity is, as an index, a shoulder portion and a waist portion in a stop image at a timing at which the position of the center of gravity can be clearly specified among the one-cycle running images constituting the comparison image. An indication point and an arrow corresponding to the barycentric line indicating the position of the barycenter are displayed at the barycentric point.

  In the analysis process of each instruction item described above, the index (indicating points, guide lines, arrows, numerical values, etc.) is added to the running video for each one-cycle running video of the user US and the elite runner constituting the comparative video. Is done. Here, in the one-cycle running video, the indication point, which is one of the indices given to the stop video at the timing according to each instruction item, is the body and the shooting point when shooting the running video of the user US and the elite runner. It is given to the position of the marker attached to the wear. In addition, a guide line corresponding to a body axis that is one of the indices is given based on a specific indication point given to the position of the marker. Note that a method for creating an index such as an indication point or a guide line will be described in more detail in a specific example described later.

  Also, among the various instruction items shown in FIG. 17, all of the instruction items of I = 1 to I = 12 are the three-axis acceleration sensor 211, the three-axis angular velocity sensor 212 of the chest device 200, and the wrist device 100. Analysis processing can be performed using sensor data acquired by any of the triaxial acceleration sensor 111, the triaxial angular velocity sensor 112, and the GPS receiving circuit 120.

  The correspondence relationship between sensor data acquired by a sensor device worn by the user and sensor data acquired by another detection device that directly detects the user's movement state in the present embodiment will be described below with a specific example. To do. Here, the case where the force plate installed on the floor is applied as another detection device that directly detects the user's movement state will be described.

  FIG. 19 is a diagram for explaining the association between the output of the sensor device (acceleration sensor) applied to the present embodiment and the detection items in another detection device (force plate). FIG. 19A is a graph showing changes in triaxial forces (Fx, Fy, Fz) acquired when a user who is a measurement person steps on a force plate placed on the floor during a running operation. It is an example. FIG. 19B shows the acceleration in the triaxial direction (corresponding to the triaxial acceleration sensor 111 shown in FIG. 4) of the chest device worn by the user during the above running operation. It is an example of the graph which shows the change of Accel_X, Accel_Y, Accel_Z). FIG. 20 is a conceptual diagram illustrating a calculation example of instruction items based on sensor data acquired by a sensor device (acceleration sensor) applied to the present embodiment.

  In the change in the force Fz in the z direction (vertical direction perpendicular to the ground) shown in FIG. 19A, the maximum value “A” of the force Fz represents the maximum kick force, and the inclination “B” represents the landing impact force. In the change in the force Fy in the y direction (the longitudinal direction of the traveling direction parallel to the ground), the time “C” represents the landing brake component time (time ratio), and the minimum value “D” represents the maximum braking force. The maximum value “E” represents the maximum driving force. Here, the feature point in the change in the triaxial force detected by the force plate shown in FIG. 19A is associated with the feature point in the change in the triaxial acceleration shown in FIG. 19B. Thus, the above-described items (detected items shown in A to E) that can be detected by the force plate can be detected also in the acceleration sensor. Further, as shown in FIGS. 19A and 19B, by associating one pattern in the detection result of a specific person to be measured (user), acceleration is also performed for other persons to be measured (users). The detection items (A to E) of the force plate can be detected by the sensor.

  Thereby, as shown in FIG. 20, the acceleration vector V at the time of landing is based on the acceleration data in the three-axis directions acquired when the user US wears the sensor device (the wrist device or the chest device) and performs the running operation. The value of the landing brake force can be calculated by calculating (the combined vector of the three axial components) and taking the X component of the vector V. Further, the maximum propulsive force and the maximum kick force can be calculated by the same method. Therefore, it is possible to perform analysis processing on the above-described various instruction items (see FIG. 17) using sensor data acquired by the wrist device 100 or the chest device 200.

(How to create indicators)
Next, an index creation method (index creation process) given in the above-described analysis process of various instruction items will be described with a specific example.

  FIG. 21 is a flowchart and a schematic diagram illustrating an example of index creation processing applied to the present embodiment. Here, a case will be described in which indicators such as instruction points and guide lines that are applied to the analysis processing are created when the guidance items are the trunk shake, tilt, and the position of the center of gravity.

  In the index creation process for the one-cycle running video of the user US, first, as shown in FIGS. 21A and 21B, the arithmetic circuit 760 of the network server 700 reads the one-cycle running video from the user video DB 820. The one-cycle running video read out here is created based on the running video shot with the markers serving as the base points for clearly indicating the above-mentioned various instructional items and the analysis results thereof attached to a predetermined position on the body. It has been done.

  Next, the arithmetic circuit 760 performs image analysis on a video (stopped video) stopped at a timing according to each instruction item from the read one-cycle running video, thereby recognizing the marker, and The positions of the shoulder and waist markers are detected (steps S141 and S142).

  Next, the arithmetic circuit 760 uses the detected position of the marker at the top of the head as the indication point P1 and the position of the marker at the waist as the indication point P2, and passes through these indication points P1 and P2 and corresponds to the guide line G1 corresponding to the body axis. Is created (step S143). That is, the guide line G1 is automatically created with the designated points P1 and P2 as base points.

  Next, the arithmetic circuit 760 calculates the ratio of the height of the user US registered in advance, the height of the shoulder based on the detected position of the marker on the shoulder, and the ratio of the height of the shoulder based on the position of the marker on the waist. The barycentric point P3 is calculated (step S144).

  Next, the arithmetic circuit 760 creates a centroid line G2 that passes through the calculated centroid point P3 and extends in a vertical direction (a direction perpendicular to the ground), and a centroid position P4 that is an intersection of the centroid line G2 and the ground surface. Is calculated.

  In addition, the index in the 1-cycle running video of the elite runner is also created by the same method as the above-described index creation process in the 1-cycle running video of the user US. Here, the index in the 1-cycle running video of the elite runner is created in association with each guidance item described above prior to the analysis / advice data creation process for the 1-cycle running video of the user US, and is specified in the advice data DB 840. Are stored in advance in the storage area.

  That is, in the analysis / advice data creation processing (step S111 in FIG. 10 and steps S125 to S128 in FIG. 12) in the present embodiment, the arithmetic circuit 760, for example, as shown in FIG. In accordance with a plurality of instruction items (I = 1 to I = 13) relating to the operation, the following processing operations are sequentially repeated.

  First, the arithmetic circuit 760 is given in advance to the 1-cycle running image of the elite runner for the 1-cycle running image of the user US in the comparison image composed of the 1-cycle running image of the user US and the elite runner. An index similar to the index (indicating points, guide lines, arrows, numerical values, etc.) is created. Then, the arithmetic circuit 760 associates the created index data with a stop video at a timing corresponding to each instruction item of the user's one-cycle running video. Thereby, an index for clearly indicating each instruction item and its analysis result is given to the stop video at the timing corresponding to each instruction item (step S126).

  Next, the arithmetic circuit 760 extracts the advice text set in advance corresponding to each instruction item from the advice data DB 840, and responds to each instruction item of the user's one-cycle running video to which the above-described index is assigned. It associates with the stop video at the determined timing (step S127).

  The arithmetic circuit 760 repeatedly executes the above processing operations (steps S126 and S127) sequentially for the number of instruction items (I = 1 to I = 13) shown in FIG. A series of processing ends (steps S125 and S128).

  Then, the arithmetic circuit 760 stores the advice data including the comparison video, the index, and the association information of the advice text created by the above-described series of processing (steps S125 to S128) in a predetermined storage area of the advice data DB. Save (step S129).

[Providing advice data]
FIG. 22 is a flowchart showing an example of advice data display processing applied to the exercise support method according to the present embodiment. FIG. 23 is a schematic diagram illustrating a display example of advice data displayed on a user terminal or the like applied to the exercise support system according to the present embodiment. The display example of advice data shown below is merely an example applicable to the exercise support system according to the present invention, and the type of information to be displayed, the display method, the display position, etc. are arbitrarily set. It may be a thing.

  In the advice data provision procedure, as shown in FIGS. 1 and 10, in response to a request from the information communication terminal 500 or the user terminal 900 (hereinafter abbreviated as “user terminal 900 etc.”) that has accessed the network server 700. The arithmetic circuit 760 reads the advice data stored in the advice data DB and creates web display data in a predetermined display format. Then, when the arithmetic circuit 760 provides the web display data to the user terminal 900 or the like via the network 600, the advice data is displayed in a predetermined display form using a web browser in the display unit 540 of the user terminal 900 or the like. It is displayed (step S112). Here, as described above, since the user terminal 900 or the like has a function of connecting to the network 600 and incorporates a web browser which is browsing software, the advice data created as web display data in the network server 700. Can be displayed on the web screen of the display unit 540 in a predetermined display form.

(Advice data display processing)
In the advice data display process, specifically, as shown in FIG. 22, for example, first, the user US operates the user terminal 900 or the like to access the network server 700, whereby the display unit of the user terminal 900 or the like is displayed. For example, a web screen 910 as shown in FIG. Then, in the main menu 914 of the web screen 910 displayed on the display unit 540, the user US selects, for example, the “Compare with professional” icon in the “Compare” menu, thereby running the elite runner by the video. A function for comparing with the form is executed (step S151). Thereby, the arithmetic circuit 760 of the network server 700 sequentially performs the following processing operations in accordance with a plurality of instruction items (I = 1 to I = 13) relating to the running operation set in advance, for example, as shown in FIG. Run repeatedly.

  In the form comparison function based on video, first, the arithmetic circuit 760 of the network server 700 reads out a comparative video composed of one-cycle running video of the user US and the elite runner stored in the advice data DB 840, and displays the predetermined video. Create web display data in the format. Then, the arithmetic circuit 760 provides the web display data to the user terminal 900 or the like via the network 600, whereby the front surface of the frame 912 of the web screen 910 displayed on the display unit 540 as shown in FIG. A new web screen 920 is displayed so as to overlap (view side). In the frame 922 of the web screen 920, a comparison video composed of the one-cycle running video 924 of the user US and the one-cycle running video 926 of the elite runner is reproduced and displayed (step S153). Here, in the comparison video, the one-cycle running video 924 of the user US is arranged in the area on the left side of the drawing, and the one-cycle running video 926 of the elite runner serving as a model (or reference) of the running form is displayed in the central area of the drawing. Be placed. The comparison video is a one-cycle running video of the user US and the elite runner that is repeatedly played back (loop playback) for a predetermined period. Also, the one-cycle running video 924 of the user US and the one-cycle running video 926 of the elite runner composing the comparison video are time axes of both videos so that the foot movements are almost at the same timing (synchronized). Playback is displayed with adjusted.

  Next, the arithmetic circuit 760 temporarily stops the comparative video being reproduced and displayed at a timing according to each instruction item in accordance with the order of instruction items (I = 1 to I = 13) set in advance. Then, the arithmetic circuit 760 reads out the index given in the instruction item from the advice data DB 840 and provides it to the user terminal 900 or the like, whereby the one-cycle running video 924 of the user US paused on the web screen 920. The index is superimposed and displayed on the one-cycle running video 926 of the elite runner (step S154). Specifically, for example, when the instruction item is the position of the center of gravity (I = 13), for example, as shown in FIG. 23, as an index, the guide line G1 corresponding to the body axis or the center of gravity line passing through the center of gravity is used. The center of gravity position P4, which is the intersection of G2, the center of gravity line G2 and the ground surface, is displayed superimposed on each one-cycle running video 924, 926 of the user US and the elite runner.

  Next, the arithmetic circuit 760 reads the advice text corresponding to the instruction item from the advice data DB 840 and provides it to the user terminal 900 or the like during the period in which the index is displayed on the user terminal 900 or the like. The advice text is displayed adjacent to the comparison image 920 (step S155). Specifically, as shown in FIG. 23, in the advice text area 928 arranged in the area adjacent to the comparison image on the web screen 920 (on the right side of the drawing), the instruction item for temporarily stopping the comparison image, and Advice text related to the index superimposed on the comparison video (here, the inclination of the body axis and the position of the center of gravity) is displayed (step S155).

  Then, the arithmetic circuit 760 continues the pause state of the comparison video in the user terminal 900 or the like for a predetermined time, and gives the above-described index (guide line G1, barycentric line G2, barycentric position P4) and advice text for a predetermined time. Only display. In addition, the arithmetic circuit 760 repeatedly reproduces (loop reproduction) the comparison video, for example, three times (three periods) during a time that is easy for the user US to visually recognize (step S156).

  The arithmetic circuit 760 repeatedly executes the above processing operations (steps S153 to S156) sequentially for each instruction item in accordance with the order of instruction items (see FIG. 17) set in advance, and the number of items of all instruction items is completed. Then, a series of processing is terminated (steps S152 and S157).

  In addition, in the web screen 920 shown in FIG. 23, 929 synchronizes the one-cycle running video 924 of the user US and the one-cycle running video 926 of the elite runner that constitute the comparison video, and performs fast reverse, rewind, and stop. This is a control icon for performing playback control such as playback and fast forward. When the user US performs an operation of selecting an arbitrary icon with the input operation unit 530 such as a mouse pointer or a touch panel, the comparison video is reproduced and displayed in an arbitrary direction at an arbitrary speed.

  In the above-described advice data display example (FIG. 23), an example is shown in which the comparison video and the index are superimposed and displayed for the case where the guidance item is the position of the center of gravity. Advice data is provided via the terminal 900 or the like. Here, in the case of other instruction items, as shown in FIG. 18, indicators such as instruction points, guide lines, arrows, numerical values, etc. for clearly indicating each instruction item indicate timings according to the instruction items. It is displayed superimposed on the stop video.

  Further, in the above-described advice data display example (FIG. 23), the web screen 920 on which the advice data is displayed is overlapped with the front surface (view side) of the frame 912 of the web screen 910 on which the main menu 914 is displayed. Although an example of display is shown, the present invention is not limited to this. That is, the advice data may be displayed in the frame 912 of the web screen 910 without displaying the new web screen 920.

  As described above, in this embodiment, the running video of the elite runner who serves as a model for the running form is acquired in advance, and the index according to the instruction item regarding the running motion is added to the video for one cycle cut out from the running video. Is stored in a server on the network (cloud system). Next, a running video of a user who is to receive advice is taken and registered in a server on the network. Next, on the server, the video for one cycle of the user and the video for one cycle of the elite runner are synthesized in a synchronized state to create a comparative video arranged in parallel so that the two can be easily compared visually. To do. Next, in the same way as the index in each instruction item given to the video for one cycle of the elite runner, an index according to the instruction item regarding the running motion is given to the video for one cycle of the user, and the instruction item is given to the instruction item. Associate the corresponding advice text. Then, the user accesses the server from the user terminal, reads the advice data including the comparison video, the index, and the association information of the advice text, and displays the data in a predetermined display form on the display unit. The comparison video and advice text provide advice for each instruction item related to your running action.

  Therefore, according to the exercise support system and the exercise support method according to the present embodiment, the user can compare his running form and the like with a running image of an elite runner as a model through visual guidance for each instruction item. Therefore, understanding is easy and appropriate advice can be received, and the running form can be improved effectively.

  In addition, according to the present embodiment, the running form is analyzed and the advice data is created by the server on the network, so that the user can simply take a running video and register it on the server on the network. It is possible to automatically create advice data in accordance with preset guidance items.

  Also, according to the present embodiment, the user can receive advice on the running form and the like via the network, so that the service according to the present embodiment can be used anywhere where there is a network environment. It is possible to improve the convenience of the exercise support system.

(Other examples of how to create metrics)
In the above-described embodiment, the user US captures a running image in a state where the marker is attached to a predetermined position (the top of the head, the shoulder, the wrist, the waist, the shoe tip, etc.) in advance, and performs image analysis to perform the position of the marker. A method to automatically detect the is shown. The present invention is not limited to this, and an index creation method (index creation process) as described below can be applied.

  FIG. 24 is a flowchart showing another example of index creation processing applied to the present invention. FIG. 25 is a schematic diagram showing a user interface applied to the index creation processing according to this application example.

  In another example of the index creation process applied to the present invention, first, when shooting a running video of the user US, there is no special preparation (that is, a state where no marker is attached to a predetermined position of the body) In this case, a running video is taken on a treadmill or outdoors, and is transferred (uploaded) to the network server 700 together with sensor data acquired in synchronization. Here, the series of comparison video creation processing and analysis / advice data creation processing described above are executed in the network server 700 for the transferred sensor data and the running video, but the image is taken without attaching a marker to the body. In the running image, it is not possible to automatically create an indication point, a guide line or the like as an index.

  Therefore, in this application example, the user US itself executes a process of creating an index while watching the running video. Here, the case where the position of the guide line or the center of gravity corresponding to the body axis is created as an index will be described, as in the case shown in FIGS.

  Specifically, as shown in FIG. 24, for example, the index creation process according to this application example is performed by the user US first accessing the network server 700 by operating the user terminal 900 or the like. The arithmetic circuit 760 displays a web screen 910 as shown in FIG. 23 on the display unit 540 of the user terminal 900 or the like via the network 600, for example. Then, the user US selects, from the main menu 914 of the web screen 910, for example, an “Create index” icon (not shown) in the “User operation” menu (not shown), thereby causing the arithmetic circuit 760. Causes the display unit 540 of the user terminal 900 or the like to display a new web screen 930 for creating an index as shown in FIG. 25, for example (step S161). Thereby, the screen shifts to the index creation screen by the user US. In this state, in the frame 932 of the web screen 930, the one-cycle running video 934 of the user US in a state where no index is assigned and the one-cycle running video 936 of the elite runner in which the index is assigned in advance are adjacent. The comparison video arranged is displayed. Further, the one-cycle running video 934 of the user US and the one-cycle running video 936 of the elite runner constituting the comparison video are repeatedly reproduced and displayed with the time axes of both videos adjusted to be synchronized.

  Next, the arithmetic circuit 760 temporarily stops the comparative video being reproduced and displayed at a timing corresponding to each instruction item in accordance with the order of instruction items (see FIG. 17) set in advance (step S162). Then, the arithmetic circuit 760 designates the first instruction point that defines an index for clearly indicating the instruction item at the timing when the comparison video stops, so as to designate the first instruction point in the one-cycle running video 934 of the user US. (Step S163). Specifically, as shown in FIG. 25, the index creation procedure area 938 arranged in the area adjacent to the comparison image on the web screen 930 (on the right side of the drawing) corresponds to the instruction item for which the comparison image is temporarily stopped. A message prompting the user to designate the first designated point (the top of the head in this case) is displayed. At this time, referring to the 1-cycle running video 936 of the elite runner to which the index is assigned in advance, the user may be prompted to designate the first indication point.

  Next, according to the message displayed by the user US in the index creation procedure area 938, as shown in FIG. 25, the first indication point (the top of the head) P1 is displayed in the one-cycle running video of the user US that is paused. Designation is performed using the mouse pointer PT or the like (step S164).

  Next, as in step S163 described above, the arithmetic circuit 760 displays a message prompting the user to designate the second indication point (in this case, the center of the waist) in the index creation procedure area 938 of the web screen 930. Then, the user US is requested to designate the next designated point in the one-cycle running video 934 of the user US who is paused (step S165). At this time, it may be urged to refer to the 1-cycle running video 936 of the elite runner to which the index is given in advance to designate the second indication point.

  Next, according to the message displayed by the user US in the index creation procedure area 938, as shown in FIG. 25, the second designated point (center of the waist) P2 in the one-cycle running video of the user US paused. Is designated using the mouse pointer PT or the like (step S166).

  Next, the arithmetic circuit 760 creates a guide line G1 corresponding to the instruction item based on the first and second instruction points designated by the user US (step S167). Here, a guide line G1 corresponding to the body axis passing through the first and second designated points P1 and P2 is automatically created.

  In the flowchart shown in FIG. 24, the process of creating the guide line G1 corresponding to the body axis has been described. By repeating the same process, the center of gravity is calculated and the center of gravity is calculated as shown in FIG. Based on the points, the centroid line G2 and the centroid position P4 are created. That is, the user US creates indices such as instruction points, guide lines, and arrows according to each instruction item.

  As shown in FIG. 25, the index created in this way is given to the one-cycle running video 934 of the user US paused at a timing corresponding to the instruction item and displayed in a superimposed manner. Thereby, it is paused at the same timing, and is displayed as a comparison video together with a one-cycle running video 936 of an elite runner to which indexes (guide line G1, centroid line G2, and centroid position P4 corresponding to the body axis) have been assigned in advance. The

  These comparison videos and indices are stored as advice data in a predetermined storage area of the advice data DB together with advice text corresponding to the guidance item. Such a series of index creation processing is repeatedly executed every time the running video of the comparative video is paused at a timing corresponding to each instruction item.

  According to such an application example, when the user shoots a running video, it is not necessary to attach a marker to a predetermined position of the body or wear a specially processed wear at the position of the marker. Thus, it is possible to greatly reduce the burden and effort of the user at the time of shooting.

(Another example of how to create advice text)
In the above-described embodiment, predetermined advice text corresponding to each guidance item is stored in advance in the advice data DB 840, and the advice extracted corresponding to each guidance item in the analysis / advice data creation processing of the user US running form A method of displaying the advice text together with the comparison video on the display unit 540 of the user terminal 900 or the like in association with the running video (stop video) is shown. The present invention is not limited to this, and an advice text creation method (advice text creation processing) as described below can be applied.

FIG. 26 is a flowchart showing another example of advice text creation processing applied to the present invention.
In another example of the advice text creation process applied to the present invention, first, the user US transfers (uploads) the sensor data and the running video to the network server 700. Here, as shown in the above-described embodiment, the running video imaged by the user US may be one that has been previously photographed with a marker attached to the body, or the application example described above (other than the index creation method). As shown in the example), the user US manually creates an index by operating the user terminal 900 or the like after taking a picture without attaching a marker and transferring the running video to the network server 700. Also good. The network server 700 executes the above-described series of comparison video creation processing and analysis / advice data creation processing on the transferred sensor data and the running video. As a result, indices such as instruction points and guide lines for clearly indicating each instruction item are given to the one-cycle running images of the user US and the elite runner constituting the comparison image.

  Next, as shown in FIG. 26, the arithmetic circuit 760 of the network server 700 compares the numerical values of the sensor data of the user US and the elite runner in a specific instruction item, and calculates the difference d (step S171). Specifically, the arithmetic circuit 760 uses sensor data (for example, acceleration data and angular velocity data acquired by the chest device 200) used for analyzing a guidance item (see FIG. 17) for which the user US receives advice on the running form. The difference d is calculated by comparing the numerical value of the sensor data and the numerical value of the sensor data acquired in synchronization when the running video of the elite runner is taken and used for the analysis of the guidance item. Here, as described above, since the one-cycle running video 934 of the user US constituting the comparison video and the one-cycle running video 936 of the elite runner are adjusted so that the time axes of both videos are synchronized, Each sensor data synchronized with these images is also synchronized with each other.

  Next, the arithmetic circuit 760 determines whether or not the calculated difference d is smaller than a preset reference value RA (step S172). Here, the reference value RA serving as a reference for comparison determination is set to a numerical value that can determine, for example, a state in which the difference d between the sensor data of the user US and the elite runner is extremely small and the two are approximated or matched. The

  If it is determined in step S172 that the difference d is smaller than the reference value RA (that is, the sensor data of the user US and the elite runner is approximate or coincident), the arithmetic circuit 760 determines from the advice data DB 840. The advice text TA corresponding to the reference value RA is extracted and associated with the video (stop video) at the timing corresponding to the instruction item (step S173).

  Then, when the user US operates the user terminal 900 or the like to access the network server 700, the comparison video on the web screen, the index superimposed on the video paused for each instruction item, and the above comparison result The based advice text TA is displayed as advice data (step S174). Specifically, for example, when the instruction item is the position of the center of gravity, the goodness of the running form such as “The forefoot is landing near the position of the center of gravity and the ride is very efficient”. An advice text TA for evaluating is displayed.

  On the other hand, when the difference d is larger than the reference value RA in step S172, the arithmetic circuit 760 determines whether or not the calculated difference d is smaller than a preset reference value RB (step S175). ). Here, the reference value RB serving as a reference for comparison determination is, for example, a state in which the difference d between the sensor data of the user US and the elite runner is relatively small, but both have a certain difference equal to or greater than the reference value RA. It is set to a numerical value that can be discriminated.

  If it is determined in step S175 that the difference d is smaller than the reference value RB (that is, the sensor data of the user US and the elite runner has a certain difference), the arithmetic circuit 760 determines the advice data DB 840. The advice text TB corresponding to the reference value RB is extracted from the video and is associated with the video (stop video) at the timing corresponding to the instruction item (step S176).

  Then, when the user US operates the user terminal 900 or the like to access the network server 700, the comparison video on the web screen, the index superimposed on the video paused for each instruction item, and the above comparison result The based advice text TB is displayed as advice data (step S177). Specifically, for example, when the instruction item is the position of the center of gravity, while evaluating the goodness of the running form, such as "You can run more efficiently if you land your forefoot a little closer to the position of the center of gravity." The advice text TB for advising further improvement points is displayed.

  On the other hand, when the difference d is larger than the reference value RB in step S175, the arithmetic circuit 760 determines whether or not the calculated difference d is smaller than a preset reference value RC (step S178). ). Here, the reference value RC serving as a reference for comparison determination is set to a numerical value that can determine, for example, a state where the difference d between the sensor data of the user US and the elite runner is relatively large.

  If it is determined in step S178 that the difference d is smaller than the reference value RC (that is, the sensor data of the user US and the elite runner has a relatively large difference), the arithmetic circuit 760 determines the advice data The advice text TC corresponding to the reference value RC is extracted from the DB 840 and associated with the video (stop video) at the timing corresponding to the instruction item (step S179).

  Then, when the user US operates the user terminal 900 or the like to access the network server 700, the comparison video on the web screen, the index superimposed on the video paused for each instruction item, and the above comparison result The based advice text TC is displayed as advice data (step S180). Specifically, for example, when the instruction item is the position of the center of gravity, the advice text TC that advises the improvement point of the running form such as “Let's try to land the forefoot near the position of the center of gravity.” Is displayed.

  Thus, in this application example, the sensor data of the user US and the elite runner are compared, and advice according to the comparison result is provided to the user US. Here, by preparing a plurality of reference values serving as a reference for comparison judgment and repeatedly executing a plurality of stages of comparison judgment processing, the difference between the sensor data of the user US and the elite runner, that is, the running of the user US and the elite runner It is possible to discriminate between different forms. In FIG. 26, the three-stage comparison / determination process of steps S172, S175, and S178 is shown. In this case, in the advice data DB 840, one or a plurality of reference values serving as a reference for comparison determination and a plurality of advice texts corresponding to the comparison result are stored in advance.

  According to such an application example, the user US can receive advice regarding more detailed improvement points according to the quality of his / her running form, and can effectively improve the running form.

  In this application example, the numerical values of the sensor data of the user US and the elite runner are compared and the advice text corresponding to the difference is provided to the user US, but the present invention is limited to this. It is not a thing. For example, the position, angle, direction, and the like of indices (for example, indication points and guide lines) assigned to the one-cycle running video of the user US and elite runner are compared, and advice corresponding to the difference is provided to the user US. There may be.

(Modification of the system)
Next, a modified example of the exercise support system according to the above-described embodiment will be described.
FIG. 27 is a schematic configuration diagram illustrating a modified example of the exercise support system according to the present embodiment. Here, components equivalent to those in the above-described embodiment (see FIG. 1) are denoted by the same reference numerals, and description thereof is simplified.

  In the above-described embodiment, sensor data and running images acquired during exercise are transferred to the network server 700 connected to the network 600, and the network server 700 performs a series of comparison video creation processing and analysis / advice data creation. The case where a so-called cloud computing type system that provides advice data to the user terminal 900 or the like via the network 600 after the processing has been described has been described. However, the present invention is not limited to this, and after processing and analyzing sensor data and running images acquired during exercise directly in the information communication terminal 500, the display unit of the user terminal 900 or the information communication terminal 500 The advice data may be displayed on 540 and provided to the user US.

  Specifically, as shown in FIG. 27, the exercise support system according to the present modified example is roughly summarized as a wrist device 100, a chest device 200, an imaging device 300, an information communication terminal 500 such as a personal computer 505, and a user. Terminal 900. Here, the information communication terminal 500 performs a series of comparison video creation processing, analysis / advice data creation processing, advice data display processing for sensor data and the running video, which are executed in the network server 700 shown in the above-described embodiment. Equivalent processing function.

  In such an exercise support system, as shown in FIG. 27, first, sensor data and the like during a running operation are acquired by the wrist device 100 and the chest device 200, and a running video is acquired by the imaging device 300. Next, after the end of running, the sensor data and the running video are transferred to the information communication terminal 500. Then, in the information communication terminal 500, the transferred sensor data and the running video are processed and analyzed, and the comparison video composed of the one-cycle running video of the user US and the elite runner is superposed and displayed for each instruction item. And advice data including the advice text corresponding to the guidance item is created. Thereby, on the display unit 540 of the information communication terminal 500, the comparison video in which the index is superimposed and displayed for each instruction item and the advice text corresponding to the instruction item are displayed in a predetermined display form. Further, a comparison video on which an index is superimposed and an advice text are displayed in a predetermined display form on the user terminal 900 such as the smartphone 901 or the tablet terminal 902 connected to the information communication terminal 500 by a predetermined communication method. Web display data set to be displayed is transmitted. Thereby, advice data is displayed on the display unit 540 of the user terminal 900 in a predetermined display form. In this case, the method of transmitting the advice data from the information communication terminal 500 to the user terminal 900 may be a method of transmitting by directly connecting to each other by wireless communication or wired communication, or transmitting via various networks. It may be a thing, and may deliver data via storage media, such as a memory card.

  According to this, since a series of comparison video creation processing, analysis / advice data creation processing, and advice data display processing are performed on the sensor data and the running video in the information communication terminal 500, the sensor data and the running video are displayed. The time required when transferring to the network server can be reduced. In addition, since a network connection environment is not required, sensor data and running video processing and analysis processing are possible even in information communication terminals 500 that do not have a network connection function or in situations or environments where it is difficult to connect to the network. And appropriate advice can be provided to the user US.

  In the present modification, the information communication terminal 500 that processes and analyzes the sensor data and the running video transferred from the wrist device 100 and the chest device 200 and generates advice data is selected from various information communication terminals. Although the case where the personal computer 505 having a relatively high arithmetic processing capability is applied is shown, depending on the content of the arithmetic processing, or when sufficient arithmetic processing capability is provided, other devices such as a smartphone and a tablet terminal are used. A terminal may be applied.

  In the embodiment and the modification described above, as shown in FIG. 1 to FIG. 3 and FIG. 27, the user US uses the wrist device 100, the chest device 200, and the display glass as the configuration of the exercise support system according to the present invention. Although the case where the running operation is performed while wearing 400 is described, the present invention is not limited to this. That is, the exercise support system according to the present invention may select which sensor device is to be attached depending on which instruction item is to be advised, and which sensor device is an essential configuration. It may be determined whether to do. Therefore, in the above-described embodiment, for example, only the sensor data acquired by the chest device 200 and the running video are used for the analysis items and the guidance items used for creating the advice data (for example, the guidance items I = 1 to I = in FIG. 17). When receiving the advice on 6), the wrist device 100 may not be mounted, or the wrist device 100 may not be provided. In addition, in a case where advice regarding heartbeat is not received, the chest device 200 may have a configuration in which the heartbeat detection circuit 220 is not provided. In addition, when various exercise information is not provided to the user US in real time during the running operation or when it is not necessary to provide the information, the display glass 400 and the wrist device 100 (or the output unit 140 of the wrist device 100) are used. You may have the structure which is not provided.

  Further, in the above-described embodiment and modification, the case where advice is provided on the running form of the user US with reference to a running image of a specific elite runner has been described, but the present invention is not limited thereto. It is not something. For example, obtain and register running images of multiple elite runners with different running methods and running powers such as pitch running method and stride running method, or multiple elite runners with different physiques such as height and weight, age, gender, etc. This is classified into, for example, running type, running power, physique, age, male and female, and the like. Then, the user US selects an elite runner that he / she wants to compare from among the plurality of registered elite runners, and compares the running video of the selected elite runner with the running video of the user US to provide advice data. May be created. Alternatively, for example, the user US inputs at least one of physique information such as height and weight, gender information, age information, and running power information such as running time to the user terminal 900 and the like, and based on this input information One or a plurality of elite runners to be compared are automatically extracted, and the user US selects from the automatically selected or extracted images, and the running video of the selected elite runner and the running video of the user US are selected. Compared to the above, advice data may be created. Alternatively, based on the input information, for example, one or more elite runners with similar running ability are automatically extracted, and this is automatically selected or extracted, and the user US selects and selects it. Further, the advice data may be created by comparing the running video of the elite runner with the running video of the user US.

  Further, in the above-described embodiment and modification, the case where the wrist device 100 attached to the wrist or the chest device 200 attached to the chest is applied as the sensor device is shown, but the present invention is not limited to this. Absent. The present invention may be applied to other sensor devices as long as it can acquire sensor data or the like indicating the operating state or biological information in a human body during exercise, for example, an upper arm or an ankle. It may be attached to the waist or shoelace.

  In the embodiment and the modification described above, the example of running is described as an exercise to which the exercise support system is applied. However, the present invention is not limited to this, and for example, walking, cycling, golf swing, etc. The present invention may be applied to other movements involving periodic movements of the body.

As mentioned above, although some embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It includes the invention described in the claim, and its equivalent range.
Hereinafter, the invention described in the scope of claims of the present application will be appended.

(Appendix)
[1]
A sensor device for obtaining motion data related to the motion state of the user during exercise;
An imaging device that acquires first video data obtained by capturing the motion posture of the user during the exercise in synchronization with the operation of the sensor device;
From the first video data acquired by the imaging device, based on the motion data, create a first posture video indicating the motion posture of the user for one cycle of the motion, From the second video data prepared in advance showing the ideal motion posture, the ideal motion posture for one cycle of the movement is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image. A data processing unit having a comparison video creation unit that creates a second posture image adjusted as described above and creates a comparison image obtained by combining the first posture image and the second posture image;
Browsing devices that display support data including advice information associated with the comparison video according to a preset guidance item and the comparison video;
An exercise support system comprising:

[2]
The data processing unit and the browsing device are connected to a network,
The comparison video creation unit includes the operation data acquired by the sensor device and transmitted via the network, and the first video data acquired by the imaging device and transmitted via the network. Based on the comparison video,
The exercise support according to [1], wherein the browsing device displays the support data in a predetermined display form based on display data created by the data processing unit and received via the network. system.

[3]
The data processing unit includes an index creation unit that creates index data for providing an image including at least one of a guide line and an arrow to the comparison video for clearly indicating a guidance location in the guidance item,
The exercise support system according to [1], wherein the support data includes the index data.

[4]
The data processing unit includes a display data creating unit that creates display data for the browsing device to display the support data in a predetermined display form and transmits the display data to the viewing device.
The comparative video is a video that is loop-reproduced in one cycle of the movement,
The display data creation unit attaches the image based on the index data to the video in which the comparison video is stopped at a timing according to the guidance item, and associates the advice information corresponding to the guidance item. , Create the display data,
The browsing device pauses the comparison video at a timing according to the instruction item, and displays the indicator superimposed on the stopped first posture image and the second posture image, and the instruction The exercise support system according to [3], wherein the advice information corresponding to the item is displayed.

[5]
The imaging device captures and acquires the movement posture in a state in which a marker serving as a base point for clearly indicating the instruction item is attached to the human body when acquiring the first video data;
The index creation unit creates the index data so that the image is added to a position based on the position of the marker included in the first video data with respect to the comparison video. The exercise support system according to [3] or [4].

[6]
[3] or [4], wherein the index creation unit creates the index data for the first posture image based on an indication point of a position designated according to the instruction item. ] The exercise support system according to the above.

[7]
The second video data indicates an ideal motion posture of the exercise, and a plurality of persons having different at least one of a plurality of items including running method, running power, physique, age, and sex, during the exercise It contains multiple shot video data acquired by shooting the posture,
[1] to [6], wherein the comparison video creation unit creates the second posture video based on the photographed video data of a specific person selected in the second video data. The exercise support system according to any one of the above.

[8]
The browsing device has an input unit for inputting at least one of the user's physique information, gender information, age information, and running power information,
The comparison video creation unit extracts a single person based on the information input to the input unit of the browsing device from the plurality of persons in the second video data, and the extracted person is the specific person One or a plurality of persons that are selected as persons or are extracted from the plurality of persons in the second video data based on the information input to the input unit of the browsing device, and the extracted one or a plurality of persons are extracted The exercise support system according to [7], wherein any one of the persons is selected as the specific person in response to a request from the browsing device.

[9]
The data processing unit includes an advice information creation unit that associates the advice information with the first posture image corresponding to the instruction item,
The advice information creation unit associates character information prepared in advance corresponding to the instruction item as the advice information with the first posture image, or the first posture image according to the instruction item Any one of [1] to [8], wherein character information prepared in advance is associated with the first posture image as the advice information based on a comparison result with the second posture image. The exercise support system described.

[10]
The sensor device includes at least an acceleration sensor that detects acceleration of the human body during the exercise, and an angular velocity sensor that detects an angular velocity of the human body during the exercise,
The comparison video creation unit creates the first posture video based on the acceleration, the angular velocity, and the first video data, according to any one of [1] to [9], Exercise support system.

[11]
Get motion data related to the motion status of the user during exercise,
Acquiring the first video data of the motion posture of the user during the exercise in synchronization with the acquisition of the motion data;
From the first video data, based on the motion data, create a first posture video showing the motion posture of the user for one cycle of the movement,
From the stored video data prepared in advance showing the ideal motion posture of the exercise, the ideal motion posture for one cycle of the motion is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image Create a second posture image adjusted to
Creating a comparison image combining the first posture image and the second posture image;
Displaying support data including advice information associated with the comparison video according to the instruction items set in advance and the comparison video;
An exercise support method characterized by that.

[12]
On the computer,
Get motion data related to the motion status of the user during exercise,
First video data obtained by photographing the user's motion posture during exercise is acquired in synchronization with the acquisition of the motion data,
From the video data, based on the motion data, to create a first posture video showing the motion posture of the user for one cycle of the movement,
From the stored video data prepared in advance showing the ideal motion posture of the exercise, the ideal motion posture for one cycle of the motion is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image To create a second posture image adjusted to
Creating a comparison video that combines the first posture video and the second posture video;
Display support data including advice information associated with the comparison video according to the instruction items set in advance and the comparison video;
An exercise support program characterized by this.

100 List device 110, 210 Sensor unit 120 GPS receiving circuit 140 Output unit 150, 250, 350, 550, 750 Communication function unit 160, 260, 360, 560, 760 Arithmetic circuit 170, 270, 370, 570, 770 Memory unit 200 Chest device 220 Heart rate detection circuit 300 Imaging device 310 Imaging unit 400 Display glass 500 Information communication terminal 540 Display unit 600 Network 700 Network server 800 Database 810 Running data DB
820 User Video DB
830 Elite Runner Video DB
840 Advice data DB
900 User terminal 910, 920, 930 Web screen 924, 926, 934, 936 One-cycle running video 928 Advice text area 938 Index creation procedure area US user

Claims (12)

A sensor device for obtaining motion data related to the motion state of the user during exercise;
An imaging device that acquires first video data obtained by capturing the motion posture of the user during the exercise in synchronization with the operation of the sensor device;
From the first video data acquired by the imaging device, based on the motion data, create a first posture video indicating the motion posture of the user for one cycle of the motion, From the second video data prepared in advance showing the ideal motion posture, the ideal motion posture for one cycle of the movement is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image. A data processing unit having a comparison video creation unit that creates a second posture image adjusted as described above and creates a comparison image obtained by combining the first posture image and the second posture image;
Browsing devices that display support data including advice information associated with the comparison video according to a preset guidance item and the comparison video;
An exercise support system comprising: The data processing unit and the browsing device are connected to a network,
The comparison video creation unit includes the operation data acquired by the sensor device and transmitted via the network, and the first video data acquired by the imaging device and transmitted via the network. Based on the comparison video,
2. The exercise support according to claim 1, wherein the browsing device displays the support data in a predetermined display form based on display data created by the data processing unit and received via the network. system. The data processing unit includes an index creation unit that creates index data for providing an image including at least one of a guide line and an arrow to the comparison video for clearly indicating a guidance location in the guidance item,
The exercise support system according to claim 1, wherein the support data includes the index data. The data processing unit includes a display data creating unit that creates display data for the browsing device to display the support data in a predetermined display form and transmits the display data to the viewing device.
The comparative video is a video that is loop-reproduced in one cycle of the movement,
The display data creation unit attaches the image based on the index data to the video in which the comparison video is stopped at a timing according to the guidance item, and associates the advice information corresponding to the guidance item. , Create the display data,
The browsing device pauses the comparison video at a timing according to the instruction item, and displays the indicator superimposed on the stopped first posture image and the second posture image, and the instruction The exercise support system according to claim 3, wherein the advice information corresponding to the item is displayed. The imaging device captures and acquires the movement posture in a state in which a marker serving as a base point for clearly indicating the instruction item is attached to the human body when acquiring the first video data;
The index creation unit creates the index data so that the image is added to a position based on a position of the marker included in the first video data with respect to the comparison video. Item 5. The exercise support system according to Item 3 or 4.   The index creation unit creates the index data for the first posture image based on an indication point of a position designated according to the instruction item. The exercise support system described. The second video data indicates an ideal motion posture of the exercise, and a plurality of persons having different at least one of a plurality of items including running method, running power, physique, age, and sex, during the exercise It contains multiple shot video data acquired by shooting the posture,
The said comparison image | video preparation part produces the said 2nd attitude | position image | video based on the said picked-up image data of the specific person selected in the said 2nd image data. The exercise support system described in 1. The browsing device has an input unit for inputting at least one of the user's physique information, gender information, age information, and running power information,
The comparison video creation unit extracts a single person based on the information input to the input unit of the browsing device from the plurality of persons in the second video data, and the extracted person is the specific person One or a plurality of persons that are selected as persons or are extracted from the plurality of persons in the second video data based on the information input to the input unit of the browsing device, and the extracted one or a plurality of persons are extracted The exercise support system according to claim 7, wherein any one of the persons is selected as the specific person in response to a request from the browsing device. The data processing unit includes an advice information creation unit that associates the advice information with the first posture image corresponding to the instruction item,
The advice information creation unit associates character information prepared in advance corresponding to the instruction item as the advice information with the first posture image, or the first posture image according to the instruction item The character information prepared in advance is associated with the first posture image as the advice information based on a comparison result with the second posture image. Exercise support system. The sensor device includes at least an acceleration sensor that detects acceleration of the human body during the exercise, and an angular velocity sensor that detects an angular velocity of the human body during the exercise,
The exercise support according to claim 1, wherein the comparison video creation unit creates the first posture video based on the acceleration, the angular velocity, and the first video data. system. Get motion data related to the motion status of the user during exercise,
Acquiring the first video data of the motion posture of the user during the exercise in synchronization with the acquisition of the motion data;
From the first video data, based on the motion data, create a first posture video showing the motion posture of the user for one cycle of the movement,
From the stored video data prepared in advance showing the ideal motion posture of the exercise, the ideal motion posture for one cycle of the motion is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image Create a second posture image adjusted to
Creating a comparison image combining the first posture image and the second posture image;
Displaying support data including advice information associated with the comparison video according to the instruction items set in advance and the comparison video;
An exercise support method characterized by that. On the computer,
Get motion data related to the motion status of the user during exercise,
First video data obtained by photographing the user's motion posture during exercise is acquired in synchronization with the acquisition of the motion data,
From the video data, based on the motion data, to create a first posture video showing the motion posture of the user for one cycle of the movement,
From the stored video data prepared in advance showing the ideal motion posture of the exercise, the ideal motion posture for one cycle of the motion is shown, and the movement of the human body is synchronized with the movement of the human body in the first posture image To create a second posture image adjusted to
Creating a comparison video that combines the first posture video and the second posture video;
Display support data including advice information associated with the comparison video according to the instruction items set in advance and the comparison video;
An exercise support program characterized by this.

Images