JP2014004119A - Exercise support device, exercise support method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve feeling of entertainment in a lesson while ensuring an occasion to display exercise image information in a display.SOLUTION: An exercise support device is provided with acquisition means for acquiring a music piece composed of a plurality of melody parts, music control means for outputting a music piece acquired by the acquisition means, allocation means for allocating, to a melody part of a music piece, in accordance therewith, one of exercise motion adapted to perform an exercise movement with a predetermined load applied to a body and enjoy motion adapted to perform a movement set to the music piece, and image control means for outputting, in a display 4, an image of avatars 11 and 12 exercising according to the melody part of the music piece outputted from the music control means in exercise motion or enjoy motion allocated by the allocation means.

Description

  The present invention relates to an exercise support apparatus. Specifically, the present invention relates to an exercise support device that can output exercise content according to the melody part of the music to be output.

  2. Description of the Related Art Conventionally, exercise support devices that perform exercise support by displaying a video of a person who performs a predetermined exercise operation in accordance with music are known. For example, in Patent Document 1, the exercise support apparatus displays both general exercise video information and reduced exercise video information according to the levels of a plurality of participants participating in the group lesson. The reduced exercise image information is an image of an exercise having a lower exercise load than general exercise image information.

JP 2011-194025 A

  In the exercise support apparatus described in Patent Literature 1, general exercise video information and reduced exercise video information are repeatedly displayed on the display. In this case, there is a problem that the user feels tired or tired because the motion picture is continuously displayed on the display from the start to the end of the lesson.

  The present invention has been made to solve the above-described problems. It is an object of the present invention to provide an exercise support device that reduces feelings of getting tired or tired by displaying motion suitable for music on a display even when exercise image information is repeatedly displayed on a display. Objective.

  In order to achieve the above object, the first invention is an exercise support apparatus, an acquisition means for acquiring music composed of a plurality of melody parts, and a music for outputting the music acquired by the acquisition means Depending on the control means and the melody part of the music, either the first movement that performs the movement of the body with a predetermined load on the body or the second movement that performs the movement according to the music is performed. An image that causes the display unit to output an image representing the first motion or the second motion assigned by the assigning means in accordance with the assigning means assigned to the part and the melody part of the music outputted by the music control means. And a control means.

  In the first invention of the present application, according to each part of the music used at the time of the lesson, the first exercise that performs the motion of applying a predetermined load to the body, or the second that performs the operation according to the music Set the sequence content to assign one of the exercises. Thereby, the participant can perform not only the first exercise monotonously and continuously, but also the second exercise having a high entertainment factor, and the lesson can be made sharp. As a result, it is possible to improve the feeling of lesson entertainment while ensuring the opportunity to display exercise video information on the display.

  In a second aspect based on the first aspect, the music control means outputs the music composed of the plurality of melody parts including a chorus part of the music, and the allocation means assigns the second movement to the music. It is characterized by assigning to a chorus part.

  Thereby, a feeling of entertainment can further be heightened by assigning the 2nd movement with a high entertainment element to the chorus part which excites most in the flow of music.

  In a third aspect based on the second aspect, the acquisition means acquires the music composed of the plurality of melody parts in association with the telop associated with the sub part of the music, and the video When the music control part outputs the music part, the control unit displays the telop associated with the music part and the video representing the second movement on the display unit. Features.

  Thereby, it is possible to further improve the feeling of excitement at the most exciting part by acquiring the telop in association with the part of the musical piece and displaying it together with the second exercise.

  In a fourth aspect based on the third aspect, the acquisition means corresponds to the music sub part as the music composed of the plurality of melody parts and the telop associated with the music sub part. Acquired in association with the lyrics, and when the music control unit outputs the chorus part of the music, the video control unit, the lyrics associated with the chorus part of the music, and the video representing the second movement Is displayed on the display unit.

  Thereby, by acquiring and displaying the lyrics of the chorus part as a telop, it is possible to make all the participants utter the lyrics and further improve the sense of unity and entertainment.

  According to a fifth aspect of the present invention, in any one of the second to fourth aspects, the image control unit includes an imaging unit that images a participant who views the video output to the display unit, and the video control unit includes the music control unit. When the chorus part of the music is output by the above, the image picked up by the image pickup means and the video representing the second movement are displayed on the display unit.

  Thereby, it is possible to further improve the feeling of excitement at the most exciting part by capturing the participant's own image in association with the part of the musical piece and displaying it together with the second exercise.

  According to a sixth invention, in any one of the second to fourth inventions, the music control means outputs the music composed of the plurality of melody parts including a chorus part of the music, and the allocation means The first movement is preferentially assigned to those other than the chorus part of the music.

  Thereby, by preferentially assigning the first exercise to the parts other than the chorus part, it is possible to secure an opportunity to obtain an excitement in the chorus part while also ensuring an opportunity to perform an exercise corresponding to the athletic ability level of each participant.

  In a seventh aspect based on any one of the first to sixth aspects, at least one of the first movement and the second movement displays both a first movement and a second movement having different movement contents. It is characterized by that.

  As a result, the degree of freedom of the lesson can be further improved because the degree of freedom in selecting exercises that the lesson participants should follow and operate is generated. In addition, when the motion contents of each of the plurality of exercises are made different depending on the athletic ability level, a functional lesson according to the athletic ability level of each participant is possible.

  In order to achieve the above object, an eighth invention is a program, an acquisition step for acquiring a music composed of a plurality of melody parts, and a music control step for outputting the music acquired by the acquisition step And a first exercise that performs an exercise operation with a predetermined load applied to the body, or a second exercise that performs an operation in accordance with the music in accordance with the melody part of the music output by the music control step. And a video control step of causing the display unit to output a video representing the first motion or the second motion to which is assigned.

  In the eighth invention of the present application, according to each part of the music used at the time of the lesson, the first exercise that performs the motion of applying a predetermined load to the body or the second that performs the operation according to the music Set the sequence content to assign one of the exercises. Thereby, the participant can perform not only the first exercise monotonously and continuously, but also the second exercise having a high entertainment factor, and the lesson can be made sharp. As a result, it is possible to improve the feeling of lesson entertainment while ensuring the opportunity to display exercise video information on the display.

  In order to achieve the above object, a ninth invention is an exercise support method, wherein an exercise support device acquires music composed of a plurality of melody parts, and the acquisition step acquired by the acquisition step Depending on the music control step output by the exercise support device and the melody part of the music, the music is subjected to a first exercise that performs an exercise operation with a predetermined load on the body, or an operation that matches the music. The second assigned to the melody part of the music, which is assigned by the exercise support apparatus to the melody part of the music, and the melody part of the music output by the music control step. And a video control step of outputting video representing the first exercise or the second exercise on the display unit by the exercise support device.

  In the ninth invention of the present application, according to each part of the music used at the time of the lesson, the first exercise for performing the motion of applying a predetermined load to the body or the second according to the music Set the sequence content to assign one of the exercises. Thereby, the participant can perform not only the first exercise monotonously and continuously, but also the second exercise having a high entertainment factor, and the lesson can be made sharp. As a result, it is possible to improve the feeling of lesson entertainment while ensuring the opportunity to display exercise video information on the display.

  In order to achieve the above object, a tenth aspect of the present invention is a system comprising a exercise support device and a server, wherein the server is a melody part of a piece of music acquired by the exercise support device. And assigning means for allocating, to the melody part of the music piece, either the first movement for performing the movement of the movement with a predetermined load on the body or the second movement for performing movement according to the music, The exercise support apparatus includes: an acquisition unit that acquires music composed of a plurality of melody parts; a music control unit that outputs the music acquired by the acquisition unit; and a melody of the music that is output by the music control unit Video control means for outputting a video representing the first motion or the second motion allocated by the server to a display unit in accordance with a part; Characterized in that it comprises.

  In the tenth invention of the present application, according to each part of the music to be used at the time of the lesson, the first exercise that performs the motion of applying a predetermined load to the body or the second that performs the operation according to the music Set the sequence content to assign one of the exercises. Thereby, the participant can perform not only the first exercise monotonously and continuously, but also the second exercise having a high entertainment factor, and the lesson can be made sharp. As a result, it is possible to improve the feeling of lesson entertainment while ensuring the opportunity to display exercise video information on the display. Further, the configuration on the exercise support device side can be simplified, and the cost can be reduced.

  ADVANTAGE OF THE INVENTION According to this invention, the entertainment feeling of a lesson can be improved, ensuring the opportunity to display exercise video information on a display.

1 is an external view of an exercise support apparatus according to a first embodiment of the present invention. It is a block diagram which shows the electric constitution of the exercise assistance apparatus of 1st Embodiment. It is a figure which shows the example of a display of the exercise motion image | video of the avatar classified by level displayed on a display by the exercise assistance apparatus of 1st Embodiment. It is a figure which shows the example of a display of the enjoyment motion image | video of the avatar classified by level displayed on a display by the exercise assistance apparatus of 1st Embodiment. It is a figure which shows the example of a display of the synthetic | combination image | video of the enjoyment motion image and camera image of the avatar classified by level displayed on a display by the exercise assistance apparatus of 1st Embodiment. It is a figure showing an example of the sequence content corresponding to a predetermined music. It is a figure showing the other example of the sequence content corresponding to a predetermined music. It is a figure showing the schematic flow about the handling of the various data in the exercise assistance apparatus of 1st Embodiment, and a file. It is a figure showing an example of a music composition table. It is a figure showing an example of the exercise motion composition table when the maximum level division number is 5. It is a figure showing an example of an enjoy motion structure table when the maximum level division number is set to 5. It is a figure showing an example of the default of an applicable motion setting table. It is a figure showing an example by the user setting of an applied motion setting table. It is a figure showing an example of the sequence setting based on an applied motion setting table. It is a figure showing an example of the sequence file when the number of level divisions is 2. It is an example of the flowchart showing the control content which CPU performs. It is a block diagram which shows the electrical structure of the exercise assistance apparatus of 2nd Embodiment. It is a figure showing the schematic flow about the handling of the various data in the exercise assistance apparatus of 3rd Embodiment, and a file. It is a block diagram which shows the electrical structure of the exercise assistance apparatus of 3rd Embodiment.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

<External configuration of the exercise support apparatus 1 of the first embodiment>
FIG. 1 is an external view of an exercise support apparatus 1 according to a first embodiment to which the present invention is applied. The exercise support device 1 includes a speaker 2, a display 4, an operation input unit 5, and a camera 3. The display 4 displays an exercise image. When the motion video is displayed on the display 4, music output together with the motion video is output by the speaker 2. Using the operation input unit 5, the user inputs information for selecting exercise and information for selecting music. For example, the operation input unit 5 is a keyboard or a mouse. As shown in FIG. 1, the user can exercise by looking at the exercise image displayed on the display 4. The camera 3 captures an image of a user who is exercising in a moving image format. The number of users who exercise using the exercise support device 1 may be basically any number, but in the example of the present embodiment below, participation in a group composed of two or more people (six in the illustrated example) A description will be given using an example in which a person exercises using the exercise support apparatus 1.

<Electrical Configuration of Exercise Support Device of First Embodiment>
FIG. 2 is a block diagram illustrating an electrical configuration of the exercise support apparatus 1 according to the first embodiment. As shown in FIG. 2, the exercise support apparatus 1 according to the first embodiment includes a CPU 6 that controls the exercise support apparatus 1. The CPU 6 is directly electrically connected to the HDD 7 and the RAM 8, and the speaker 2, the camera 3, the display 4, the operation input unit 5, and the network connection unit 9 are electrically connected via the interface 10. Connected. The CPU 6 constitutes a computer that controls the operation of the exercise support apparatus 1 together with storage means such as the HDD 7 and the RAM 8. The network connection unit 9 communicates information with an external server or the like (not shown in FIG. 2) via the Internet line NW. The display 4 corresponds to a display unit described in each claim, and the camera 3 corresponds to an imaging unit described in each claim.

  The HDD 7 is a nonvolatile storage device. The HDD 7 includes a program information storage area 7a, a music data storage area 7b, a motion data storage area 7c, a music composition table storage area 7d, an exercise motion composition table 7e, and an enjoy motion composition table 7f. An applied motion setting table 7g and a sequence file storage area 7h are set.

  The program information storage area 7a stores an editing application program and an output application program. These two application programs will be described later in detail (see FIG. 8 described later). The application program may be downloaded from a predetermined server on the Internet line NW, for example, or may be recorded on a recording medium such as a CD-ROM and read via the recording medium. Anyway.

  The music data is stored in the music data storage area 7b. This music data is sound source data of music that is output from the speaker 2 in parallel when the exercise support apparatus 1 displays the exercise video on the display 4. In the example of the present embodiment, this music data is format data compliant with the MIDI (Musical Instrument Digital Interface) standard.

  Motion data is stored in the motion data storage area 7c. This motion data is data that defines the content of exercise to be displayed as the exercise video corresponding to each of a plurality of parts constituting the music. In the example of the present embodiment, two types of motion data are prepared: exercise motion and enjoy motion. These two types of motion data will be described in detail with reference to FIGS.

  The music composition table storage area 7d stores a music composition table that describes each part composition in units of music. The music composition table will be described in detail later with reference to FIG.

  The exercise motion configuration table storage area 7e stores an exercise motion configuration table that describes which exercise motion motion data can be displayed in which part in units of music. The exercise motion configuration table will be described in detail later with reference to FIG.

  The enjoy motion configuration table storage area 7f stores an enjoy motion configuration table that describes which enjoy motion motion data can be displayed on which part in units of music. The enjoy motion configuration table will be described in detail later with reference to FIG.

  The applied motion setting table storage area 7g stores an applied motion setting table that describes the setting of which part of exercise motion or enjoy motion is applied to which part in units of music. This applied motion setting table will be described in detail with reference to FIGS.

  The sequence file storage area 7h stores a sequence file that describes a sequence of which motion data of which motion data is displayed on which part for each musical piece. This sequence file will be described in detail with reference to FIGS.

  The RAM 8 is a rewritable volatile storage device in which an applicable motion setting table temporary storage area 8a and a sequence file temporary storage area 8b are set.

  An applied motion setting table and a sequence file are temporarily stored in the applied motion setting table temporary storage area 8a and the sequence file temporary storage area 8b, respectively.

<Example of display of exercise video by exercise support device of this embodiment>
3-5 is a figure which shows the example of a display of the exercise | movement image | video displayed on the display 4 by the exercise | movement assistance apparatus 1 of 1st Embodiment. As described above, in this embodiment, music is output from the speaker 2 and a motion image is displayed on the display 4. The motion video displays the whole body of a virtual human body called a so-called avatar, and operates the avatar's body in synchronization with the rhythm of the music. Then, when the participant performs the same operation as the avatar in accordance with the rhythm of the music, it is possible to perform a prescribed exercise lesson as if it were a virtual instructor.

  Here, as described above, when lesson participants are a group of two or more people, there are many variations in the level of athletic ability among participants of a general group in public facilities. Therefore, in the example of the present embodiment, as shown in FIG. 3, a plurality of avatars 11 and 12 are displayed for each level appropriately classified, and exercises suitable for each level are individually displayed. In the example shown in the drawing, an avatar 11 for advanced users is displayed on the left side, and exercise that incorporates a large amount of motion (for example, jump) having a relatively large motion and a high exercise load is performed. In addition, an avatar 13 for beginners is displayed on the right side, and exercise that incorporates many motions that are relatively small in movement and low in exercise load (for example, only the upper body or only the lower body) is performed. That is, a plurality of pieces of exercise video information are displayed on the display 4 at the same time, and each participant selects and browses exercise video information (avatars 11 and 12) suitable for his / her athletic ability level, and exercises according to the movement. I do.

  However, in general, you may perform exercises that apply a predetermined load on your body in this way, but if you continue to exercise just as it is throughout the lesson, all participants will continue to work in stoic and clerical work. I get tired and tired of being caught by the sense of being.

  Therefore, in the exercise support device 1 of the present embodiment, the participant is caused to perform an operation with a high entertainment element at the timing when the rust portion or the like rises in the music flow. As a result, the lesson can be sharpened and the feeling of entertainment can be improved. The operation of each avatar at the normal time shown in FIG. 3 is an exercise in which a predetermined load is applied to the body according to the corresponding athletic ability level. On the other hand, in the climax part of the music, for example, as shown in FIG. 4, the operation of raising and lowering the fist by simply raising one hand (see the avatar for the advanced level on the left side), (See Beginner level avatar). The operation as shown in FIG. 4 is preferably an operation such as dance or choreography that can be easily performed with a sense of entertainment and comfort without a relatively large load on the body. In the following, exercise that applies a predetermined load to the body as described with reference to FIG. 3 is referred to as “exercise motion”, and movement according to music as described with reference to FIG. 4 is referred to as “enjoy motion”.

  In addition, when displaying the motion video of an enjoy motion, as shown in FIG. 4, a character string (hereinafter referred to as “telop”) describing the shout and the lyrics of the music is also displayed, and all participants can speak to further It can improve the sense of unity and entertainment. Furthermore, in this embodiment, as shown in FIG. 5, a participant's own moving image captured by the camera 3 may be displayed in combination with a motion image of the avatar's enjoy motion. Thereby, a further feeling of entertainment can be produced. The motion expressed by the exercise motion described above corresponds to the first motion described in each claim, the motion expressed by the enjoy motion described above corresponds to the second motion described in each claim, and a plurality of avatars Each motion when exercising corresponds to the first motion and the second motion described in each claim.

<Description of sequence>
In the exercise support apparatus 1 according to the present embodiment, music that is a basic unit of a lesson can be arbitrarily selected. And the sequence file which sets the number of avatars displayed according to each athletic ability level of each participant who can be changed for each lesson and the content of each avatar's exercise corresponding to the selected music is created for each timing.

  FIG. 6 is a diagram illustrating an example of sequence contents corresponding to a predetermined music piece. First, lessons are conducted in units of music. Therefore, one piece of music to be used for the lesson is selected first. Any musical piece can be divided into a plurality of melody parts (hereinafter, simply referred to as parts) in time series as the entire configuration. In the example shown in the figure, the selected music is divided into five parts, which are played in the order of A melody, B melody, chorus, A melody, chorus. Note that basically the same part content (two A melody in the illustrated example) is played with the same rhythm and melody. MIDI data, which is sound source data of music, is generated corresponding to each part, and one music data is configured by collecting them in time series. In the example of the present embodiment, the MIDI data corresponding to each sub part includes telop data corresponding to the character string information of the telop.

  On the other hand, each avatar exercises based on the corresponding motion data. This motion data is three-dimensional data (so-called vector data) that defines the movement of each body part and joint of the corresponding avatar in time series, and is generated corresponding to each part of the music. In the illustrated example, an avatar corresponding to athletic ability level 1 exercises based on the motion data of exercise motion A-1 during the performance of the first part of the music. This notation of “EX motion A-1” means that the avatar corresponding to athletic ability level 1 is an exercise motion performed in the music part of A melody. In the illustrated example, the avatar corresponding to athletic ability level 1 exercises based on the motion data of the enjoyment motion S-1 during the performance of the music part. The notation of “EN motion S-1” means that the avatar corresponding to athletic ability level 1 is an enjoy motion performed during the chorus part.

  Accordingly, the avatar corresponding to the athletic ability level 1 corresponds to the order of the contents of each part of the music shown in the drawing, exercise motion A-1 → exercise motion B-1 → enjoy motion S-1 → exercise motion A-1 → enjoy motion. Exercise in order of S-1. Similarly, an avatar corresponding to athletic ability level 2 exercises in the order of exercise motion A-2 → exercise motion B-2 → enjoy motion S-2 → exercise motion A-2 → enjoy motion S-2. In the example of the present embodiment, the camera video (participant's moving image) is synthesized and displayed during the performance of all the chorus parts of the music.

  Such a sequence changes depending on the part composition of the selected music piece. For example, as in the comparative example shown in FIG. 7, when the number of music composition parts (six) and the order of the chorus parts are different, the order of the exercise motion, the enjoy motion, the savitellop, and the camera video display is corresponding to this. Be placed. That is, as shown in the figure, when the number of constituent parts of the selected music is six, each avatar performs six motions corresponding to the six parts. These six motions are motions corresponding to the contents of each part. In addition, a savitelop and a camera video display are also displayed corresponding to the contents of each part. In the exercise support apparatus 1 of the present embodiment, it is necessary to set the sequence contents as described above for each lesson according to the selected music and each exercise ability level of the participant, and to create a sequence file in which the sequence contents are recorded.

  FIG. 8 is a diagram showing a schematic flow of handling various data and files in the exercise support apparatus 1 of the present embodiment. In FIG. 8, by first executing an editing application, music used for a lesson is selected from music data recorded in the HDD 7. Then, the editing application refers to the motion data, the music composition table, the exercise motion composition table, the enjoy motion composition table, and the applied motion setting table, which are also recorded in the HDD 7, and the exercise ability of each participant input separately. Set the sequence contents according to the level and create a sequence file. That is, the editing application assigns either exercise motion data or enjoy motion data according to each part of the selected music piece, and assigns whether to display a camera video according to each part.

  Next, by executing the output application, the music data (MIDI data and telop data) recorded in the HDD 7 is reproduced and output to the speaker 2 and the display 4 in accordance with the sequence contents described in the sequence file. Similarly, the motion data recorded in the HDD 7 is reproduced and displayed on the display 4. In addition, the moving image captured by the camera 3 is also synthesized and displayed according to the same sequence content.

  FIG. 9 is a diagram illustrating an example of a music composition table recorded in the music composition table storage area 7 d of the HDD 7. This music composition table lists all the music names stored in the HDD 7 in the column direction in the figure, and the row direction in the figure describes the part structure of each music corresponding to the passage of time. . As the part configuration, the arrangement of MIDI data and telop data (abbreviated as “present” and “none” in the figure) in the order of the parts in the corresponding music is described along with the number of music parts of each music. In this music composition table, each MIDI data and telop data is described by respective identification information (data ID), and a predetermined music is reproduced through the entire music by referring to this music composition table. It is possible to grasp which MIDI data should be output in which order.

  FIG. 10 is a diagram illustrating an example of an exercise motion configuration table when the maximum number of level divisions is five. Note that the number of level divisions is the number of groupings according to the level of athletic ability of the group participants in the lesson, that is, the number of avatars displayed on the display 4. This exercise motion configuration table is recorded in advance in the exercise motion configuration table storage area 7e corresponding to each piece of music stored in the HDD 7 (music A in the illustrated example). In the exercise motion composition table, each athletic ability level is listed in the column direction in the figure, and the row direction in the figure is MIDI data (telop data) that can be output in the order of the parts of the music used as time passes. Is omitted as being included) and exercise motion data is described. In the example of the present embodiment, exercise motion data respectively corresponding to combinations of all parts including the chorus part and all athletic ability levels is stored in the HDD 7 in advance.

  Also, the enjoy motion configuration table stored in the enjoy motion configuration table storage area 7f of the HDD 7 has a table configuration equivalent to the exercise motion configuration table as shown in FIG. Then, enjoy motion data is stored in the HDD 7 in advance for combinations of all parts and all athletic ability levels that are not limited to the chorus parts. In this example, in each motion configuration table, for example, level 5 is the level with the highest exercise capacity. Then, the output application shown in FIG. 8 displays level names corresponding to the vicinity of each avatar on the display screen of the display 4 so that the participants can be clearly distinguished.

  FIG. 12 is a diagram illustrating an example of the applied motion setting table stored in the applied motion setting table storage area 7 g of the HDD 7. This applied motion setting table is stored in correspondence with each piece of music stored in the HDD 7 (music A in the illustrated example). In the applied motion setting table, the types of part contents that make up the music are listed in the column direction in the figure, and it is described whether exercise motion or enjoy motion is applied corresponding to each part content type Has been. In the example shown in the drawing, the setting contents for applying exercise motion to the A melody part and B melody part in the music A and applying the enjoy motion to the chorus part are stored in the HDD 7 as a default. In addition, in the applicable motion setting table, whether or not to display a camera video is set as an option corresponding to the type of each part content of the music piece A. In the illustrated example, the camera video is not displayed for the A melody part and the B melody part in the music A, and the camera video is set to be displayed for the chorus part.

  Note that the setting contents in the applied motion setting table can be arbitrarily changed by the lesson management user. For example, as shown in FIG. 13, the exercise content may be applied to only the A melody part in the music A, and the enjoyment motion may be applied to the B melody part and the climax part. In the illustrated example, the camera video is not displayed only on the A melody part in the music A, and the camera video is displayed on the B melody part and the climax part.

  FIG. 14 is a diagram illustrating an example of sequence setting performed based on the applied motion setting table. In the example shown in the figure, the case where the music A is selected and the number of level divisions is 1 (that is, the number of display avatars is 1) is shown. Also, the setting of whether or not to display the camera video is omitted. In FIG. 14, the exercise motion configuration table stores exercise motion A-1 → exercise motion B-1 → exercise motion S-1 → exercise motion A-1 → exercise motion S-1 in the order of the part of music A. Yes. In the enjoy motion configuration table, the order of the part of music A is stored as enjoy motion A-1 → enjoy motion B-1 → enjoy motion S-1 → enjoy motion A-1 → enjoy motion S-1. In the setting contents (default) of the applied motion setting table in the illustrated example, setting contents for applying exercise motion corresponding to each of the A melody part and B melody part and applying the enjoyment motion corresponding to the climax part are stored. Based on the settings described in the applicable motion setting table, in the sequence file, exercise motion A-1 → exercise motion B-1 → enjoy motion S-1 → exercise motion A-1 corresponding to the part order of the music piece A. → The sequence of enjoy motion S-1 is set.

  In other words, the sequence setting is an operation of assigning either exercise motion or enjoy motion according to each part of the music. In this sequence setting, the setting content of the applied motion setting table is a reference for the assignment. Therefore, depending on the setting contents of the applied motion setting table, it is possible to assign only one of exercise motion or enjoy motion through all parts of the music, and various assignment methods can be arbitrarily set.

  The sequence file created by such sequence setting has a configuration shown in FIG. 15, for example. This sequence file is also created in units of music used for the lesson (song A in the example shown in the figure), and the row direction in the figure lists the part order of the music used as time passes. The output contents of each music part are described in the row direction. The output content of each music part includes MIDI data of the part content corresponding to each music part (abbreviated as including telop data), avatar motion data corresponding to each level division, and camera video The presence or absence of display is described. Note that the sequence contents of the sequence file shown in FIG. 15 where the number of level divisions is 2 correspond to the sequence contents shown in FIG. In the illustrated example, the level items to be applied are described as level 1 and level 4, but the level items to be applied may be changed as appropriate according to the athletic ability level of each participant in the lesson. .

  In the example of the present embodiment, each MIDI data and each motion data are described by respective identification information (data ID) in each sequence file illustrated above, but the present invention is not limited to this. For example, the corresponding MIDI data and motion data may be recorded as they are instead of the identification information. In this case, the output application shown in FIG. 8 can display the reproduction of the music and the avatar's movement based only on the sequence file without referring to each data recorded in the HDD 7.

<Specific flow of sequence setting process>
FIG. 16 is an example of a flowchart showing the control contents executed by the CPU 6 shown in FIG. 2 in order to realize the sequence setting process in the present embodiment described above, and the reproduction of music and the display of motion video based on the sequence setting process. It is. This flow starts to be executed when called from the main menu of the exercise support device 1, for example.

  In step S <b> 5, the CPU 6 selects music to be used for the lesson based on the input from the administrator user via the operation input unit 5. At this time, the music names of all the music recorded in the HDD 7 may be listed on the display 4 and displayed.

  Then, the process proceeds to step S10, and the CPU 6 sets the number of level divisions and application levels in the lesson. In this setting, the administrator user sets the number of level divisions and the application level based on the input operation through the operation input unit 5 while referring to the athletic ability level of each participant separately registered in the database or the like. .

  Then, the process proceeds to step S15, where the CPU 6 acquires a default applied motion setting table recorded in the HDD 7, and the setting contents of the administrator user based on the input operation via the operation input unit 5 as necessary. Change (assignment criteria).

  In step S20, the CPU 6 initializes the value of the counter variable I corresponding to the music part number to 1.

  Then, the process proceeds to step S25, and the CPU 6 determines whether or not the value of the counter variable I is equal to or less than the total number of parts of the music selected in step S5. If the value of the counter variable I is equal to or less than the total number of parts of the selected music piece, the determination is satisfied (step S25: YES), and the CPU 6 proceeds to step S30.

  In step S30, the CPU 6 initializes the value of the counter variable J corresponding to the athletic ability level to 1.

  Then, the process proceeds to step S35, and the CPU 6 determines whether or not the value of the counter variable J is equal to or less than the number of level divisions set in step S10. If the value of the counter variable J is equal to or less than the number of level divisions, the determination is satisfied (step S35: YES), and the CPU 6 proceeds to step S40.

  In step S40, the CPU 6 refers to the applied motion setting table and acquires the type of applied motion (attribute information code for identifying exercise motion or enjoy motion) corresponding to the content of the I-th part of the selected music piece.

  Then, the process proceeds to step S45, and the CPU 6 determines whether or not the type of applied motion acquired in step S40 is an exercise motion. If the acquired type of applied motion is exercise motion, the determination is satisfied (step S45: YES), and the CPU 6 proceeds to step S50.

  In step S50, the CPU 6 refers to the exercise motion configuration table, and acquires identification information of exercise motion data corresponding to the Jth application level in the I-th part content of the selected music piece.

  Then, the process proceeds to step S55, and the CPU 6 additionally describes the identification information of the exercise motion data acquired in step S50 in the item of the Jth application level of the Ith part in the sequence file. Although not shown, information regarding the presence / absence of camera image display is also acquired by referring to the applicable motion setting table in step S40 and reflected in the sequence file in step S55.

  Then, the process proceeds to step S70, and the CPU 6 increments the value of the counter variable J by 1. And it returns to step S35 and repeats the same procedure.

  On the other hand, in the determination in step S45, if the type of applied motion acquired in step S40 is an enjoy motion, the determination is not satisfied (step S45: NO), and the CPU 6 proceeds to step S60.

  In step S60, the CPU 6 refers to the enjoy motion configuration table, and acquires identification information of the enjoy motion data corresponding to the Jth applied level in the I-th part content of the selected music piece.

  Then, the process proceeds to step S65, and the CPU 6 additionally describes the identification information of the enjoy motion data acquired in step S60 in the item of the Jth applied level of the Ith part in the sequence file. Although not shown, information regarding the presence / absence of camera image display is also acquired by referring to the applicable motion setting table in step S40 and reflected in the sequence file in step S65. Then, the process proceeds to step S70.

  On the other hand, if the value of the counter variable J is larger than the number of level divisions in the determination in step S35, the determination is not satisfied (step S35: NO), and the CPU 6 proceeds to step S75.

  In step S75, the CPU 6 increases the value of the counter variable I by 1. And it returns to step S25 and repeats the same procedure.

  On the other hand, if the value of the counter variable I is larger than the number of all parts of the selected music piece in the determination in step S25, the determination is not satisfied (step S25: NO), and the CPU 6 proceeds to step S100.

  In step S100, a music video output process is performed for performing music data reproduction output, telop data display output, motion data display output, and camera video display output based on the sequence setting contents of the created sequence file. Then, this flow ends. In step S100, various exercises are executed by the avatar displayed on the display 4.

  In the above, the procedure from step S5 to step S75 in the flow shown in FIG. 16 corresponds to the assigning means and the assigning step described in each claim. Further, the procedure of the music video output process in step S100 corresponds to the acquisition means, acquisition step, music control means, music control step, video control means, and video control step described in each claim. Note that the procedure from step S5 to step S75 in the flow of FIG. 16 corresponds to the editing application shown in FIG. 8, and the procedure of step S100 corresponds to the output application shown in FIG. In FIG. 16, two applications are continuously executed as a series of processes. However, the present invention is not limited to this, and each application may be executed individually.

  As described above, in the exercise support device 1 of the present embodiment, exercise motion that performs an exercise operation with a predetermined load on the body, according to each part of the music used when the lesson is performed, or Set the sequence contents so that one of the enjoy motions that perform the operation according to the music is assigned. As a result, the participants can not only continuously exercise exercises monotonously, but also interlace with enjoyment motions that have high entertainment elements, so that the lessons can be made sharp. As a result, it is possible to improve the feeling of lesson entertainment while ensuring the opportunity to display exercise video information on the display.

  In the present embodiment, in particular, at least one of the part that displays the exercise motion and the part that displays the enjoy motion displays a plurality of avatars having different operation contents. As a result, the degree of freedom of the lesson can be further improved because the degree of freedom in selecting exercises that the lesson participants should follow and operate is generated. In addition, when the operation contents of a plurality of avatars are made different depending on the athletic ability level, a functional lesson according to the athletic ability level of each participant is possible.

  In addition, in the present embodiment, it is possible to further enhance the feeling of entertainment by allocating an enjoyment motion having a high entertainment element to the most exciting part of the music flow.

  In the present embodiment, in particular, the telop data is acquired in association with the tune part of the music and displayed together with the enjoy motion, so that the feeling of excitement at the most exciting part can be further improved.

  In addition, in this embodiment, in particular, by acquiring and displaying the lyrics of the chorus part as telop data, it is possible to make all the participants utter the lyrics and further improve the sense of unity and entertainment.

  In addition, in this embodiment, in particular, it is possible to further improve the feeling of excitement in the most exciting part by capturing images of the participants themselves in association with the part of the musical piece and displaying them together with the enjoyment motion.

  In addition, in this embodiment, in particular, exercise motions corresponding to the level of athletic ability of each participant are secured while securing an opportunity to get a feeling of excitement in the chorus part by preferentially assigning exercise motion to parts other than the chorus part. Can also be secured.

  The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit and technical idea of the present invention. Hereinafter, such modifications will be described in order.

(1) When making an external server perform sequence file creation In the first embodiment, the exercise support apparatus 1 basically performs so-called sequence file creation, music playback and motion video display based on the sequence file creation. Although it was a stand-alone form, the present invention is not limited to this. In addition, a so-called cloud configuration may be employed in which an external server connected via the Internet line NW shares the sequence file creation processing and the like.

  FIG. 17 is a block diagram showing an electrical configuration of the exercise support apparatus 1A of the second embodiment, and corresponds to FIG. 2 in the first embodiment. In FIG. 17, only the part related to the transmission / reception of data via the Internet line NW by the exercise support device 1A and the external server 100 is shown, and the operation input unit 5 and the speaker 2 shown in FIG. The illustration of the camera 3 and the display 4 is omitted.

  In FIG. 17, the external server 100 includes a CPU 106, an HDD 107, a RAM 108, a network connection unit 109, and an interface 110. The difference in hardware configuration when compared with the first embodiment is that the information of the music configuration table, exercise motion configuration table, and enjoy motion configuration table is not the HDD 7 on the exercise support device 1A side but the external server 100 side. It differs in that it is stored in the HDD 107. Although not particularly illustrated, the software configuration is different in that the editing application is executed not on the exercise support apparatus 1A side but on the external server 100 side.

  In the present embodiment, the operation input unit 5 (not shown in FIG. 17) on the side of the exercise support apparatus 1A used by the user inputs and designates the selection of music and the number of level divisions and application levels according to the participant status. Thus, the information is transmitted to the external server 100 via the Internet line NW. The external server 100 that has received these information sets the sequence content with reference to the music composition table and the like, and returns a sequence file describing the sequence content to the exercise support apparatus 1A. On the side of the exercise support apparatus 1A that has received the sequence file, the music data and motion data recorded in the HDD 7 can be reproduced and displayed based on the sequence contents of the sequence file.

  That is, only the creation process of the sequence file is assigned to the external server 100, and the exercise support is as much as the external server 100 can share the storage capacity of the music composition table and the load of the creation process that are required only during the creation process. The configuration of the device 1A can be simplified. Thereby, the exercise support apparatus 1A of the present embodiment can obtain the same effects as those of the first embodiment, and can simplify and reduce the cost of the apparatus itself. In addition, when the management user changes the setting content of the applicable motion setting table on the exercise support device 1A side, the sequence setting based on the allocation criteria of the changed setting content is also transmitted by transmitting the external server together with that. It can also be performed by an external server.

(2) When outputting exercise video information with music video data In the first and second embodiments, the music support data and motion data are stored on the exercise support device 1 and 1A side, and are described in the sequence file. The motion video information is output by reproducing the music data and reproducing the motion data (so-called vector data) along the sequence contents, but the present invention is not limited to this. In addition, the exercise support device may be configured to output exercise video information only by reproducing music moving image data (so-called raster data).

  FIG. 18 is a diagram showing a schematic flow of handling various data and files in the exercise support apparatus 1B of the third embodiment, and corresponds to FIG. 8 in the first embodiment. In FIG. 18, the editing application creates a sequence file, and based on this, the generating application reproduces music data and motion data recorded on the HDD 7 and music video data (for example, a raster conforming to a standard such as MPEG, FLASH, etc.). Format audio / video data). By reproducing and outputting the music moving image data to the speaker 2 and the display 4 by an output application, the same effect as in the first embodiment can be obtained. In addition, if a sequence for the presence or absence of camera video display is incorporated in the music video data, the camera video display corresponding to the part can be switched.

  In the output application in the first embodiment, the CPU 6 is required to have a high processing capability in order to simultaneously output both music data and motion data in real time in accordance with the sequence contents described in the sequence file during the lesson. On the other hand, in the exercise support device 1B of the present embodiment, the output application simply reproduces the music video data during the lesson, so that the processing capability required for the CPU 6 compared to the above output application is reduced. It can be greatly reduced, and the exercise support device 1B itself can be simplified and reduced in cost.

  Even in the case of this embodiment, it is possible to configure in the form of a cloud. For example, as shown in FIG. 19 corresponding to FIG. 2 and FIG. 17 described above, various data and tables necessary for generating the sequence file and the music video data are recorded only in the HDD 107 of the external server 100A, and the exercise support apparatus Only the output application and the default application motion setting table can be stored in the HDD 7 of 1B. The output application of the exercise support apparatus 1B receives and reproduces music moving image data from the external server 100A via the Internet line NW by a so-called streaming method or the like. As described above, in the entire system S, the music data, motion data, music composition table, and the like having a large storage capacity and a high update frequency are centrally stored and managed in the external server 100A. Further, the creation of a sequence file with a high processing load and generation of music moving image data are concentrated on the external server 100A. As a result, the configuration on the side of the exercise support device 1B can be further simplified to reduce the cost, and the latest music and motion data can be used in real time.

  Note that the function of reproducing and outputting music moving image data as described above is equivalent to a normal so-called karaoke device (not shown). Due to the compatibility of the functions of the exercise support device of the present invention and the karaoke device, the music video data of the exercise video may be reproduced and output using a general karaoke device instead of the dedicated exercise support device. At this time, not only a stand-alone karaoke apparatus but also a communication karaoke apparatus can be used corresponding to the cloud form. In addition to hardware compatibility between the exercise support device of the present invention and a general karaoke device, there is software compatibility between the motion video music video data and the karaoke music video data. For example, lyrics data indicating the lyrics of the chorus part included in song data as karaoke content that has been used conventionally (character strings of lyrics: corresponding to the lyrics described in each claim), and output of motion picture song video data It can also be used as a telop to be displayed at times. In addition, the storage device on the karaoke device side stores the music data and motion data in part units described in the first embodiment, and includes an appropriate operation input unit, which can execute an editing application and an output application. It is good. In this case, the karaoke apparatus can set a sequence and output an exercise video based on the sequence as in the exercise support apparatus of the first embodiment.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

1, 1A, 1B Exercise support device 2 Speaker 3 Camera 4 Display 5 Operation input unit 6 CPU
7 HDD
8 RAM
9 Network connection part 10 Interface 11, 12 Avatar 100, 100A External server NW Internet line

Claims (10)

Obtaining means for obtaining a music composed of a plurality of melody parts;
Music control means for outputting the music acquired by the acquisition means;
Assigning to the melody part of the music one of the first movement that performs the movement of the body with a predetermined load and the second movement that performs the movement according to the music according to the melody part of the music Means,
In accordance with the melody part of the music output by the music control means, video control means for causing the display unit to output a video representing the first motion or the second motion assigned by the assignment means;
An exercise support apparatus comprising: The music control means outputs the music composed of the plurality of melody parts including a music chorus part,
The exercise support apparatus according to claim 1, wherein the assigning unit assigns the second exercise to a chorus part of the music. The acquisition means acquires the music composed of the plurality of melody parts in association with the telop associated with the chorus part of the music,
The video control means causes the display unit to display the telop associated with the music chorus part and the video representing the second movement when the music chorus part is output by the music control means. The exercise support apparatus according to claim 2. The acquisition means acquires the music composed of the plurality of melody parts and the telop associated with the music part of the music in association with the lyrics corresponding to the music part of the music,
The video control means causes the display unit to display lyrics associated with the music chorus part and the video representing the second movement when the music chorus part is output by the music control means. 4. The exercise support apparatus according to claim 3, wherein Comprising imaging means for imaging participants viewing the video output to the display unit;
The video control means causes the display unit to display an image picked up by the image pickup means and a video representing the second movement when the music control part outputs a chorus part of the music. The exercise support apparatus according to any one of claims 2 to 4. The music control means outputs the music composed of the plurality of melody parts including a chorus part of the music,
The exercise support apparatus according to claim 2, wherein the assigning unit preferentially assigns the first exercise other than the chorus part of the music.   The exercise support apparatus according to claim 1, wherein at least one of the first exercise and the second exercise displays both a first action and a second action having different action contents. . An acquisition step of acquiring a music composed of a plurality of melody parts;
A music control step for outputting the music acquired by the acquisition step;
According to the melody part of the music output by the music control step, either the first motion that performs the motion motion with a predetermined load on the body or the second motion that performs the motion according to the music A video control step of causing the display unit to output a video representing the assigned first motion or the second motion;
A program that causes a computer to execute. An acquisition step in which the exercise support device acquires music composed of a plurality of melody parts;
The music control step in which the exercise support device outputs the music acquired in the acquisition step;
According to the melody part of the music, the exercise support device performs either the first exercise for performing an exercise with a predetermined load on the body or the second exercise for performing an operation according to the music. Assigning steps to the melody parts of
Video control that the exercise support device outputs on the display unit the video representing the first exercise or the second exercise assigned by the assigning step according to the melody part of the music outputted by the song control step. Steps,
Exercise support method including. A system comprising an exercise support device and a server,
The server
According to the melody part of the music acquired by the exercise support device, either the first exercise for performing an exercise operation with a predetermined load on the body or the second exercise for performing an operation in accordance with the music is performed. It has an assigning means to assign to the melody part of the song,
The exercise support device includes:
Obtaining means for obtaining a music composed of a plurality of melody parts;
Music control means for outputting the music acquired by the acquisition means;
In accordance with the melody part of the music output by the music control means, video control means for causing the display unit to output a video representing the first motion or the second motion assigned by the server;
A system comprising:

Images