JP6048136B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to a technical field for generating exercise content for supporting exercise performed by a user while listening to music.

  For example, Patent Literature 1 discloses a technique for generating exercise content by determining music corresponding to a plurality of exercise operations determined by a user according to the exercise operation. On the other hand, Patent Literature 2 discloses a technique for generating athletic content by determining an athletic motion corresponding to a component of a music according to the component of the music. The generated exercise content includes, for example, a moving image and music that show how the exercise operation is performed.

JP 2011-45477 A JP 2012-65966 A

  As the exercise content, there is a content in which an exercise motion is assigned to each of a plurality of performance parts constituting the music. When exercising using such exercise content, the user may want to repeatedly perform an exercise operation that is not good. At this time, the user can change the output position of the exercise content to the output part of the performance part to which the poor exercise operation is assigned by performing a rewind operation or a fast-forward operation. However, in this case, the performance parts are output in an order different from the composition order of the plurality of performance parts constituting the music. Therefore, the performance order of the performance parts of the music is changed. Depending on how the order of the pieces of music to be played is changed, the music to be played may feel uncomfortable, and the user may not be able to enjoy exercising along with the music.

  The present invention has been made in view of the above points, and an information processing apparatus and an information processing device that can repeatedly perform an exercise operation desired by a user while allowing the user to enjoy exercise in accordance with music. It is an object to provide a method and a program.

In order to solve the above problems, the invention according to claim 1 is characterized in that performance part information indicating a performance order of a plurality of performance parts constituting a musical piece and a plurality of exercises associated with each of the plurality of performance parts. shows a plurality of operation information indicating the operation, and repeatable performance part information indicating the repeat play are possible performance part of the plurality of performance parts, and the music information representing the music, the image the motion operation is performed Based on the music information stored in the storage means, storage means for storing video information, and the output means outputs the plurality of performance parts according to the performance order indicated by the performance part information stored in the storage means is allowed, the movement stored in said storage means as a movement operation associated with the performance part which is output by the output means among the plurality of performance parts An image movement operation is performed indicating information, based on said stored video information in the storage unit, a first control means for Ru is outputted by said output means, said plurality of said output means by said first control means when by sequentially outputting the performance part, and accepting means for accepting designation of exercise motion where the repetition of the plurality of motion operation is requested, to said output means when said designation is accepted by said accepting means of the performance part which playback order of playing part after being good Ri output has been determined, the repeatable performance part information stored in the storage means, a performance part indicating that it is capable of repeatedly playing are repeated and setting means for setting the repetition part, said by the output means, the output of the set the playing part in by Ri said recurring part in the setting means, The repetitive motion operation indicated by the operation information associated with the performance part which is set in the part is allowed to continuously output the video to be performed in the pre said storage means, the repeated part set by the setting means, characterized in that it comprises a second control means for outputting the same time the output unit and a video repetitive motion operation in which Ru is required is made by the specifying accepted by said accepting means.

According to a second aspect of the present invention, the second control unit continues the repetition after the first control unit causes the output unit to output the performance part set as the repetition part according to the performance order. The output means outputs the part and the image of the exercise operation requested to be repeated by the designation received by the receiving means, and the first control means is configured to output the output means by the second control means. wherein after outputting the repeated part, said the performance part of the next subsequent playback order of the set performance parts to repeat part is defined, the next subsequent movement operation associated with the playback order of the performance parts in The output means outputs the video to be performed according to the performance order .

According to a third aspect of the present invention, the setting means sets the repetitive part each time the designation is accepted by the accepting means, and the second control means sets the repetitive part by the setting means. the Rugoto, said repeated part, characterized in that to output said video repeat the requested movement operation is performed by the specifying accepted by said accepting means.

Invention according to claim 4, wherein the accepting means accepts a motion operation and number of repetitions repetitions is required, the second control means repeatedly number of times accepted by the accepting unit, the repetitive part and And outputting an image of the exercise operation requested to be repeated according to the designation received by the receiving means .

Invention of claim 5, wherein the setting means, said one performance part indicated by the repetitive performance part information, there are a plurality repeat can der Ru performance part is after the time when the designation is accepted by said accepting means In this case, among the plurality of performance parts that can be repeated, the performance part that is output in the order closest to the performance part currently output by the output means is set as the repetition part.

According to a sixth aspect of the present invention, there is provided a first time information indicating a performance time of each of the plurality of performance parts, and a second time indicating a respective operation time of the plurality of exercise motions assigned to the plurality of performance parts. And second storage means for storing information, wherein the second control means stores the performance time of the repetitive part indicated by the first time information stored in the second storage means in the second storage means. when repeating said second time information stored indicates is two times the operation time of the requested exercise motion, when by outputting the repeated part by said output means, movement operation repeatedly is requested The video to be performed is output twice or more.

The invention according to claim 7 is the first time information indicating the performance time of each of the plurality of performance parts, and the second time indicating the operation time of each of the plurality of exercise motions assigned to the plurality of performance parts. Second storage means for storing information, and third storage means for storing, for each exercise action, voice information indicating a voice that supports the exercise action, wherein the second control means is the second storage means. The performance time of the repetitive part indicated by the first time information stored in is longer than the operation time of the exercise operation for which the repetition indicated by the second time information stored in the second storage means is requested and If it is less than twice the operation time, when they are to output the repetition part by said output means, movement dynamic of the repetition is requested by the specifying accepted by said accepting means An image movement operation sound and repetition is requested indicated by the voice information corresponding to the place, characterized thereby sequentially output by the output means.

The invention according to claim 8 further includes fourth storage means for storing tempo information indicating the original tempo of the music, wherein the first control means stores the tempo information stored in the fourth storage means. According to the tempo shown , the plurality of performance parts and images showing a plurality of movements associated with each of the plurality of performance parts are output according to the performance order , and the second control means is configured to output the fourth memory. according slower tempo than the tempo indicated by the tempo information stored in the means, by the output means, the repeated part, a video in which the receiving unit movement operation in which the repetition by the specifying accepted is requested by is performed Is output.

  The invention according to claim 9 is characterized in that the information processing apparatus is a karaoke apparatus.

The invention according to claim 10 is an information processing method executed by the information processing apparatus , corresponding to each of the plurality of performance parts and performance part information indicating a performance order of the plurality of performance parts constituting the music a plurality of operation information indicating a plurality of motion behavior attached, and repeatable performance part information indicating the repeat play are possible performance part of the plurality of performance parts, and the music information representing the music, the movement operation The output means outputs the plurality of performance parts according to the performance order indicated by the performance part information stored in the storage means based on the music information stored in the storage means for storing video information indicating the video to be performed. is output, stored is in the storage means as the motion operation associated with the performance part which is output by the output means among the plurality of performance parts An image movement operation is performed to the operation information indicates a, on the basis of said stored image information in the storage unit, a first control step of outputting by the output means, to said output means by said first control step when by sequentially outputting said plurality of performance parts, a reception step of receiving designation of exercise motion where the repetition of the plurality of motion operation is required, the output time when the designation is accepted by said accepting step of the performance part which playback order of subsequent performance parts being output Ri by the means stipulated, the repeatable performance part information stored in the storage means, a performance part indicating that it is capable of repeatedly playing a setting step of setting the repeat part repeated, by the output section, the repeated part in the setting step Output of the set the performance part, and said the repetitive motion operation indicated by the operation information associated with the performance part which is set in part is made continuous to the output of the video to be performed in the storage means, said setting step characterized in that it comprises said repeating part that has been set, and a second control step of outputting the same time the output unit and a video repeatedly requested Ru movement operation is performed by the specifying accepted by said accepting step by And

According to an eleventh aspect of the present invention, in the computer of the information processing apparatus, performance part information indicating a performance order of a plurality of performance parts constituting a music piece, and a plurality of exercise operations associated with each of the plurality of performance parts a plurality of operation information indicating a video showing a repeatable performance part information indicating the repeat performance parts are possible play of the plurality of performance parts, and the music information representing the music, the image the motion operation is performed based on the information and the music information stored in the storage means for storing, the storage means is outputted by the output unit of the plurality of performance parts in accordance with the playback order indicated by the performance part information stored within said plurality of performance The action information stored in the storage means is shown as an exercise action associated with the performance part output by the output means among the parts. An image movement operation is performed, on the basis of said stored image information in the storage unit, a first control step of Ru is output by said output means, said plurality of performance parts to said output means by said first control step when by sequentially outputting an accepting step of accepting a specification of exercise motion where the repetition of the plurality of motion operation is required, Ri by said output means when said designation is accepted by said accepting step output of the playing part defined by that of the performance part later playback order is to be, the repeatable performance part information stored in the storage means, a performance part indicating that it is capable of repeatedly playing the repeated part repeated a setting step of setting, by the output section, the set in the repeat part performance by the setting step The output of the over bets, and said the repetitive motion operation indicated by the operation information associated with the performance part which is set in part is made continuous to the output of the video to be performed in the storage means, set by the setting step the repeating part, characterized in that to execute a second control step of outputting the same time the output unit and a video repeatedly requested Ru movement operation is performed by the specifying accepted by said accepting step.

According to the invention of claim 1, 10 or 11, repeatable performance parts are repeatedly output continuously. Then, during the output of the repeatable performance part , an image in which the exercise operation requested to be repeated is output. Therefore, the output order of the performance parts is not substantially changed from the composition order of the performance parts. Therefore, it is possible to repeatedly perform the exercise operation desired by the user while allowing the user to enjoy the exercise according to the music.

  According to the invention described in claim 3, the user can repeatedly perform the exercise operation for each exercise operation desired to be repeated.

  According to the fourth aspect of the present invention, the user can perform the exercise operation desired to be repeated by adding the number of times desired by the user.

  According to invention of Claim 5, the user can perform the exercise | movement operation which he wants to repeat at an early stage.

  According to the sixth aspect of the present invention, it is possible to reduce the time during which the user is not exercising during the re-output of the repeated part. Therefore, it is possible to prevent the user from spending time.

  According to the seventh aspect of the invention, during the re-output of the repetitive part, when the video of the motion motion desired to be repeated is not output, the sound supporting the motion motion desired to be repeated is output. Therefore, it is possible to prevent the user from spending time.

  According to invention of Claim 8, the user can perform the exercise | movement operation which wants to repeat at a slower speed than usual. For this reason, it is possible to easily memorize poor movements.

It is a figure showing an example of outline composition of exercise content generation system 1 of one embodiment. (A) is a figure which shows an example of the structure of the performance part of the music contained in athletic content, and an example of the exercise | movement motion allocated to the performance part, (B) is the output terminal 5 receiving the request | requirement of repetition of an exercise | movement movement It is a figure which shows the example of the output order of the performance part and exercise | movement image at the time of recording. It is a figure which shows the example of a display of a repeat motion setting screen. (A) thru | or (D) is a figure which shows the example of the process for making up the difference of reproduction time. 7 is a flowchart illustrating a processing example of a CPU of a remote controller 66. 5 is a flowchart illustrating a processing example of a CPU 51 of the output terminal 5. (A) And (B) is a figure which shows the example of a display of a repeat motion setting screen.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, embodiment described below is embodiment at the time of applying this invention to the exercise content production | generation system which produces | generates the exercise content for supporting exercise. The exercise content includes video and audio for supporting exercise.

[1. Configuration of Exercise Content Generation System 1]
First, the configuration of the exercise content generation system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a schematic configuration example of an exercise content generation system 1 according to the present embodiment. As shown in FIG. 1, the exercise content generation system 1 includes a distribution server 2 and one or more output terminals 5. The distribution server 2 and the output terminal 5 can be connected via the network 10. The network 10 includes, for example, the Internet. A database 3 is connected to the distribution server 2. Information relating to exercise and information relating to music are registered in the database 3. The distribution server 2 distributes information registered in the database 3 to the output terminal 5 periodically or in response to a request from the output terminal 5.

  The output terminal 5 is a terminal device installed in the facility 4, for example. The output terminal 5 is an example of an information processing apparatus of the present invention. The output terminal 5 is used by a user 41 of the facility 4. The facility 4 may be a sports facility, for example. The user 41 receives an exercise lesson at the sports facility. The exercise lesson is a lesson composed of a plurality of exercise movements. The output terminal 5 in this case may be a personal computer, for example. The facility 4 may be a karaoke store, for example. In the karaoke store, the user 41 sings karaoke music. The output terminal 5 in this case is a karaoke apparatus, for example. Hereinafter, a case where the facility 4 is a sports facility will be described as an example. Differences between sports facilities and karaoke stores will be described as appropriate.

  The output terminal 5 can be connected to the monitor 57. The monitor 57 is an example of output means of the present invention. The monitor 57 may be a display device including a plurality of speakers 64 and a display 67. In this case, the output terminal 5 can be connected to the display 67. The output terminal 5 can be connected to a speaker 64. When the output terminal 5 outputs an audio signal to the monitor 57, music or the like is output from the speaker 64. When the output terminal 5 outputs a video signal to the monitor 57, an exercise video or the like is displayed on the display 67. The motion video is a moving image that shows a figure 83 performing a motion motion. The figure 83 is a virtual object in the form of, for example, a person, an animal, a virtual creature, or a robot. An exercise image is an example of an image in the present invention. The output terminal 5 outputs a signal so that the music output from the speaker 64 and the movement of the figure 83 displayed on the display 67 are synchronized. Outputting music and motion video is an example of outputting motion content. The exercise content is an example of content in the present invention. The user 41 can exercise while watching the figure 83 displayed on the display 67 while listening to the music output from the speaker 64. When the facility 4 is a karaoke store, the display 67 displays, for example, a figure 83 that performs a dance operation corresponding to a karaoke song. In this case, the user 41 can dance while watching the figure 83 displayed on the display 67 while singing along with the music output from the speaker 64. The operator 42 can operate the output terminal 5 using the remote controller 66 or the like. The user 41 and the operator 42 may be the same person. When the facility 4 is a sports facility, the operator 42 may be an instructor, for example.

[2. Repeated exercise during exercise lessons]
The exercise content output by the monitor 57 when an exercise lesson is performed includes music and exercise video. The exercise content may include voice of narration for supporting the user 41 who exercises. FIG. 2A is a diagram illustrating an example of the configuration of a performance part of a music included in athletic content and an exercise operation assigned to the performance part. As shown in FIG. 2A, a music piece is composed of a plurality of performance parts. An exercise motion is assigned to each of the plurality of performance parts. Examples of the types of exercise motions assigned include aerobic exercise, anaerobic exercise, and stretching. Examples of the aerobic exercise include march and front lunge. Examples of the anaerobic exercise include a shoulder press and a chest press. Examples of stretching exercises include upper arm stretching and neck stretching. When the facility 4 is a karaoke facility, the performance part is assigned a song and a dance action corresponding to the performance part. The dance motion is a motion that is choreographed to the music to dance to the music. Even when the facility 4 is a sports facility, a dance operation may be assigned to the performance part.

  When an exercise lesson is performed, the output terminal 5 causes the speaker 64 to output music in the order of performance parts according to the composition of the music. For example, as shown in FIG. 2A, music is output in the order of A melody, B melody, chorus 1, A melody, B melody, chorus 2, C melody, chorus 3, etc. At this time, the output terminal 5 outputs the music according to the original tempo of the music. In addition, the output terminal 5 causes the display 67 to display an exercise image in which the figure 83 performs the exercise operation assigned to the performance part currently being output. For example, in FIG. 2 (A), the motion action of motion 1 is assigned to the A melody having the first performance order among the performance parts constituting the music. Therefore, when the first A melody in the performance order is output, an exercise image in which motion 1 is performed is displayed. The user 41 exercises while listening to the music output according to the composition of the music at a tempo suitable for the music. Thereby, the user 41 can enjoy exercise according to the music.

  By the way, when performing an exercise lesson, the user 41 may want to repeatedly perform an exercise operation that is not good among the exercise operations constituting the exercise lesson. For example, it is assumed that the user 41 wants to perform the motion 1 assigned to the first A melody with the performance order again when the B melody with the second performance order is output. In this case, the user 41 or the operator 42 can operate the remote controller 66 to rewind the exercise content playback position to the first A melody in the performance order. Thereby, the user 41 can repeatedly perform the motion 1. However, in this case, the performance parts are reproduced in the order of A melody, B melody, A melody, B melody, and chorus 1. That is, the performance order of the performance parts is switched. Therefore, the user 41 may feel uncomfortable with the music being played, and the user 41 may not be able to enjoy exercising along with the music.

  Therefore, the exercise content generation system 1 can repeatedly perform the exercise operation desired by the user 41 without changing the performance order of the performance parts. Specifically, among the plurality of performance parts constituting the music, performance parts that can be repeatedly played are set in advance. A performance part that can be repeated is called a repeatable part. For example, a performance part that has little discomfort even if it is repeatedly played is set as a repeatable part. The repeatable part may be rust, for example. The repeatable part may be a performance part different from the chorus. In addition, there may be a motion motion specialized for the assigned performance part among the motion motions assigned to the performance part. The exercise motion specialized for a specific performance part is, for example, an exercise operation that is difficult to perform smoothly when the user 41 tries to operate according to the output of a performance part other than the specific performance part. An exercise motion specialized for a specific performance part may be preset as the specific part.

  The user 41 operates the remote controller 66 when he / she wants to repeatedly perform any one of the exercise operations constituting the exercise lesson. The operator 42 may operate the remote control. As a result, a repeat motion setting screen is displayed on the remote controller 66. FIG. 3 is a diagram illustrating a display example of a repeat motion setting screen. As shown in FIG. 3, the repeat motion setting screen includes an exercise content configuration table 110, a display switching box 120, a progress bar 130, a repeat motion display column 140, a repeat tempo setting column 150, a repeat count setting column 160, and a send button 170. Is displayed. The athletic content configuration table 110 shows a plurality of performance parts constituting the music in the order of performance. In addition, the exercise content configuration table 110 shows exercise operations assigned to each of the plurality of performance parts. The display switching box 120 is a list box for switching the display method of the exercise content configuration table 110. For example, as a display method, the user 41 can select display of only the name of each exercise action. As a display method, it is possible to select the display of the name of each movement and the part ID of each performance part. The part ID is identification information indicating the performance order of the performance parts. Further, as the display method, it is possible to select the display of the name of each movement, the part ID of each performance part, and the lyrics of each performance part. The progress bar 130 indicates the progress of the reproduction of exercise content. In the example of FIG. 3, it is shown that the A melody having the fourth performance order is being reproduced. In the repeat motion display field 140, the name of the motion motion that is required to be repeated is displayed. The motion that requires repetition is called repeat motion. When the user 41 selects any exercise motion from the exercise content configuration table 110, the name of the selected exercise operation is displayed in the repeat motion display field 140. The user 41 can select a repeat motion from all of the exercise motions constituting the exercise lesson. In other words, the user 41 selects any of the exercise operation for which the exercise image has been displayed, the exercise operation for which the current exercise image is displayed, and the exercise operation for which the exercise image is not yet displayed as the repeat motion. Can do. The repeat tempo setting field 150 is an input field for inputting a tempo when the repeat part is output again. The tempo when the repeat part is output again is called the repeat tempo. In the repeat tempo setting field 150, the original tempo of the music is input in advance. The user 41 can change the repeat tempo to a tempo slower than the original tempo. Further, the user 41 can change the repeat tempo to a faster tempo than the original tempo. The repeat count setting field 160 is an input field for inputting the number of times to repeat the repeat motion. The number of times the repeat motion is performed again is called the number of repeats. In the repeat count setting field 160, 1 is input in advance as the repeat count. The user 41 can change the repeat count input in the repeat count setting field 160 to 2 or more. The transmission button 170 is a button for the remote controller 66 to transmit a repeat signal to the output terminal 5. The repeat signal is a signal indicating a request for repetition of the movement operation.

  By receiving the repeat signal, the output terminal 5 accepts a request for repetition of the motion and accepts a repeat motion and the number of repeats. The output terminal 5 sets a repeatable part among performance parts that have not been output when a repeat request is received as a performance part that is actually repeatedly performed. A performance part that is actually played repeatedly is called a repeat part. The output terminal 5 outputs the repeat part again after outputting the repeat part according to the composition order of the music. Thereby, the output terminal 5 outputs a repeat part continuously and repeatedly. When the repeat part is being output again, the output terminal 5 displays a motion image in which the repeat motion is performed. Thereby, the substantial performance order of performance parts is not changed. Further, the user 41 can repeatedly perform the exercise motion desired by the user 41.

  A specific example will be described. In FIG. 2A, rusts 1, 2, and 3 are set as repeatable parts. Also, the motion 2 assigned to the second B melody in the performance order is set as the specific motion. FIG. 2B is a diagram illustrating an example of the output order of performance parts and exercise video when the output terminal 5 receives a request for repetition of exercise. For example, it is assumed that the user 41 selects the motion 1 as a repeat motion when the second B melody in the performance order is output. Then, the remote controller 66 transmits a repeat signal for repeating motion 1. In this case, repeatable parts that are repeat part candidates are chorus 1, 2, and 3. In this embodiment, when there are a plurality of repeat part candidates, a repeat part is automatically set from a plurality of repeatable parts. Specifically, the output terminal 5 sets a repeatable part having a performance order closest to the currently output performance part among the plurality of repeatable parts as a repeat part. Further, the output terminal 5 assigns a repeat motion to the repeat part to be output again. Thereby, the user 41 can perform an exercise operation desired to be repeated at an early stage. In the example of FIG. 2B, the repeatable part whose performance order is closest to the second B melody with the performance order is the chorus 1. Accordingly, the chorus 1 is set as a repeat part. Thereafter, the output terminal 5 outputs the chorus 1 in accordance with the composition order of the music, and displays the motion video of the motion 3 originally assigned to the chorus 1. After the output of the chorus 1 is completed, the output terminal 5 continuously outputs the chorus 1 again and displays a motion image of the motion 1 that is a repeat motion. Assume that when the user 41 selects a repeat motion, the repeat tempo is changed to a tempo slower than the original tempo of the music. In this case, the output terminal 5 re-outputs the repeat part at the playback speed according to the repeat tempo, and displays the motion video of the repeat motion at the playback speed according to the repeat tempo. Thereby, the user 41 can perform an unsatisfactory exercise at a slower speed than usual. For this reason, it is possible to easily memorize poor movements. Note that the output terminal 5 may automatically set the repeat tempo. For example, the output terminal 5 may set a repeat tempo that is a predetermined tempo slower than the original tempo.

  When the repeat part is output again, the output terminal 5 may cause the speaker 64 to output a rhythm sound before and after the repeat part to be output again. The reason is, for example, to reduce the discomfort felt by the user 41 with respect to the music piece by repeating the repeat part. In the example of FIG. 2B, output is performed in the order of chorus 1, rhythm sound, chorus 1, rhythm sound, and A melody. Also in this case, when the output terminal 5 re-outputs the repeat part, the motion image of the repeat motion is displayed. When outputting the rhythm sound, the output terminal 5 may display, for example, an exercise image in which the figure 83 performs an action of taking a rhythm with feet or hands.

  Thereafter, when the B melody with the fifth performance order is output, the user 41 selects the motion 5 assigned to the fifth B melody with the performance order as the repeat motion. At this time, the user 41 inputs 2 as the number of repeats. In this case, repeatable parts that are repeat part candidates are rust 2 and 3. Of the choruses 2 and 3, the repeatable part whose performance order is closest to the fifth B melody in the performance order is the chorus 2. Therefore, the output terminal 5 sets the chorus 2 as a repeat part. Thereafter, the output terminal 5 outputs the chorus 2 in accordance with the composition order of the music and displays the motion video of the motion 6 originally assigned to the chorus 1. Subsequently, the output terminal 5 re-outputs the chorus 2 twice in succession and displays the motion video of the motion 5 twice.

  Thereafter, it is assumed that the user 41 selects the motion 6 as a repeat motion when the C melody is output. In this case, the output terminal 5 sets the chorus 3 as a repeat part. Further, it is assumed that the user 41 selects the motion 8 as a repeat motion when the rust 3 is being output. Also in this case, the output terminal 5 sets the chorus 3 as a repeat part. After that, the output terminal 5 outputs the chorus 3 according to the composition order of the music and displays the motion video of the motion 8 originally assigned to the chorus 3. Subsequently, the output terminal 5 re-outputs the rust 3 and displays a motion image of the motion 6. Subsequently, the output terminal 5 re-outputs the rust 3 and displays a motion image of the motion 8. In this way, the output terminal 5 sets a repeat part each time it receives a request for repetition of an exercise operation, and every time a repeat part is set, the repeat part is output again and a motion image of the repeat motion is displayed. Let

  Note that the user 41 cannot select motion 2 as a repeat motion. The reason is that motion 2 is a motion motion specialized in B melody.

  By the way, the performance time of each of the plurality of performance parts constituting the music is determined in advance. The output terminal 5 generates the motion video so that the motion time of the motion motion assigned to the performance part matches the performance time of the performance part assigned the motion motion. The motion time of the motion motion is a motion video playback time. The output terminal 5 matches the playback time of the motion video with the performance time of the performance part to which the motion motion indicated by the motion video is assigned. Then, the output terminal 5 matches the timing of the performance part output start and the motion video display start timing, and matches the timing of the performance part output end and the motion video display end. When repeating the repeat motion, the output terminal 5 may assign the repeat motion to a repeat part that is different from the originally assigned performance part. The performance time of each of the plurality of performance parts constituting the music may be different for each performance part. For this reason, the operation time of the repeat motion and the performance time of the repeat part may be different. Therefore, the output terminal 5 performs a process for making up for the difference between the operation time of the repeat motion and the performance time of the repeat part.

  FIG. 4A to FIG. 4D are diagrams illustrating an example of processing for compensating for the difference in reproduction time. Let TA be the playback time of the motion video of the repeat motion, and TB be the performance time of the repeat part. When TA> TB, the motion image of the repeat motion is displayed even after the output of the repeat part is completed. Therefore, the user 41 has time to perform repeat motion without listening to music. Therefore, as shown in FIG. 4A, the output terminal 5 causes the speaker 64 to continuously output the rhythm sound when the output of the repeat part is completed. The output terminal 5 continues to output the rhythm sound until the motion image of the repeat motion is completed.

  When TA <TB, the repeat part is output even after the display of the motion image of the repeat motion is completed. Therefore, there is a time during which the user 41 is listening to only the music without exercising. Therefore, when TB is twice or more of TA, as shown in FIG. 4 (B), the output terminal 5 continuously displays the motion image of the repeat motion twice or more when the repeat part is output. Display. Let N be the number of times to display the motion video. The output terminal 5 determines N such that N × TA ≦ TB and N × TA is closest to TB. In the example of FIG. 4B, TB is three times TA. Therefore, the motion image of repeat motion is displayed three times continuously. Thereby, it can prevent that the user 41 has time.

  When TB is less than twice TA, as shown in FIG. 4C or 4D, the output terminal 5 sequentially outputs the narration and the motion video of the repeat motion when the repeat part is output. Let The output terminal 5 outputs narration that supports repeat motion. While the repeat part is being output, the user 41 performs repeat motion or listens to narration. Therefore, it is possible to prevent the user 41 from having time. As shown in FIG. 4C, for example, a plurality of narrations with different playback times are prepared for each movement. In the example of FIG. 4C, three types of narration are shown. Let TC be the total narration playback time. The output terminal 5 selects a narration in which TA + TC is closest to TB from narrations that satisfy TA + TC ≦ TB. Note that the number of narrations may be more or less than three. The output terminal 5 may adjust the playback speed of the narration so that, for example, TA + TC = TB.

  As shown in FIG. 4C, the output terminal 5 may first output a narration and then display a motion image of repeat motion. At this time, the output terminal 5 matches the timing of the end of display of the motion image of the repeat motion and the end of output of the repeat part. The output terminal 5 may or may not match the narration output start timing and the repeat part output start timing. The narration to be output at this time may be, for example, a narration explaining that the repeat part is repeated. The narration that is output may be a narration that explains the contents of the repeat part, for example. By outputting the narration first, the user 41 can be prepared to perform a repeat part.

  As shown in FIG. 4D, the output terminal 5 may first display a motion image of repeat motion and then output a narration. At this time, the output terminal 5 matches the timing of the start of display of the motion image of the repeat motion and the output start of the repeat part. The output terminal 5 may or may not match the timing of the end of narration output and the end of repeat part output. The narration output at this time may be, for example, a narration that supplementarily describes the repeat part.

[3. Configuration of each device]
Next, the configuration of each device included in the athletic content generation system will be described with reference to FIG.

[3-1. Configuration of distribution server 2]
As shown in FIG. 1, the distribution server 2 includes a CPU 21, a ROM 22, a RAM 23, a bus 24, an I / O interface 25, a display control unit 26, a disk drive 28, a network communication unit 30, and an HDD (hard disk drive) 37. . The CPU 21 is connected to the ROM 22, the RAM 23, the bus 24, and the I / O interface 25 via the bus 24. The CPU 21 controls each unit of the distribution server 2 by executing a program stored in the ROM 22 or the HDD 37. Connected to the I / O interface 25 are a database 3, a display control unit 26, a disk drive 28, a network communication unit 30, a keyboard 31, a mouse 32, and an HDD 37. The CPU 21 accesses the database 3 via the I / O interface 25. The display control unit 26 outputs a video signal to the monitor 57 based on the control of the CPU 21. The disk drive 28 writes data to and reads data from the recording medium 29. The network communication unit 30 performs control for the distribution server 2 to connect to the network 10. The HDD 37 stores an OS, various control programs, and the like.

  Data such as motion data, music data, repeatable part information, and specific motion information is registered in the database 3. The motion data is data that defines the motion motion of the figure 83 in the three-dimensional virtual space. The motion data is data for displaying the motion motion of the figure 83 on the display 67. The motion data includes the coordinates of each part of the body of the figure 83 according to the progress of the motion movement. The motion data is registered in association with the motion information. The motion information is identification information indicating an exercise motion. Examples of motion information indicating a gymnastic action include “half squat” and “march”. Examples of motion information indicating the dance motion include “A melody of song X”, “B melody of song X”, “rust of song X”, “A melody of song Y”, and the like.

  The music data is performance data for outputting music from the speaker 64. The music data is an example of music information in the present invention. The music data may be, for example, data in MIDI (Musical Instrument Digital Interface) format. The song data includes information such as song ID, song name, artist name, original tempo, composition of performance part of song, lyrics and the like. The music ID is music identification information. In addition, the music data defines timing for switching performance parts, display timing of lyrics telop, timing to change the color of lyrics telop, and the like. For example, when the music data is data in the MIDI format, the music data can include a meta message in addition to the MIDI message as actual performance data. Examples of the meta message include a marker message indicating a performance part and a lyrics message. Therefore, a part ID for identifying a performance part and lyrics can be described in the music data as a message. For example, a music sequencer described later is installed in the output terminal 5. The output terminal 5 reproduces the music data by executing the music sequencer, and outputs a read message when reading a meta message or the like from the music data. For example, the timing at which the marker message is output is the timing at which the performance part indicated by the marker message is started.

  The narration data is audio data for outputting narration by the speaker 64. The narration data may be WAV format (RIFF Waveform Audio Format) data. A plurality of narration data is registered for each movement. The narration data is registered in association with the narration ID, the motion information, and the reproduction time of the narration. The narration ID is identification information of narration data.

  The repeatable part information indicates a repeatable part among a plurality of performance parts constituting the music. Repeatable part information is registered for each piece of music. The repeatable part information includes the part ID of the repeatable part.

  The specific motion information is registered for each specific motion. The specific motion information includes the motion information of the specific motion, the music ID of the music to which the specific motion can be assigned, and the part type of the performance part. The part type indicates the type of performance part. Examples of the part type include A melody, B melody, C melody, and rust.

[3-2. Configuration of output terminal 5]
As shown in FIG. 1, the output terminal 5 includes a CPU 51, a ROM 52, a RAM 53, a bus 54, an I / O interface 55, a display control unit 56, a disk drive 58, a network communication unit 60, an audio output unit 63, and a signal transmission / reception unit. 65 and HDD 7. The CPU 51 is connected to the ROM 52, the RAM 53, the bus 54, and the I / O interface 55 via the bus 54. The CPU 51 controls each unit of the output terminal 5 by executing a program stored in the ROM 52 or the HDD 7. Connected to the I / O interface 55 are an HDD 7, a display control unit 56, an audio output unit 63, a disk drive 58, a network communication unit 60, a keyboard 61, a mouse 62, a microphone 68, and a signal transmission / reception unit 65. The display control unit 56 outputs a video signal to the monitor 57 based on the control of the CPU 51. The audio output unit 63 outputs an audio signal to the monitor 57 based on the control of the CPU 51. The disk drive 58 writes and reads data to and from the recording medium 59. The signal transmission / reception unit 65 receives a signal output from the remote controller 66. Further, the signal transmission / reception unit 65 transmits a signal to the remote controller 66. The remote controller 66 is for the operator 42 to operate the output terminal 5. The remote controller 66 includes a CPU, a ROM, a RAM, a flash memory, a signal transmission / reception unit, a display, buttons, and the like.

  The HDD 7 is an example of a storage unit, a second storage unit, a third storage unit, and a fourth storage unit in the present invention. The HDD 7 stores motion data, music data, narration data, repeatable part information, specific motion information, and the like distributed from the distribution server 2. The HDD 7 stores lesson information. The lesson information is list information that defines the structure of an exercise lesson. For example, the output terminal 5 generates lesson information based on the operation of the operator 42. When the facility 4 is a karaoke store, for example, lesson information is generated in advance and registered in the database 3. The output terminal 5 downloads lesson information from the distribution server 2.

  The lesson information includes a music ID, a tempo, a plurality of part IDs, a part type and a performance time, a plurality of motion information and operation times, repeatable part information, and specific motion information. The music ID indicates a music that is output while the lesson is being performed. The tempo is the original tempo of the music indicated by the music ID. The tempo included in the lesson information is an example of tempo information in the present invention. The plurality of part IDs indicate the configuration of the performance part of the music indicated by the music ID. The plurality of part IDs are arranged in the order of performance of the performance parts. The part type indicates the type of performance part indicated by the part ID. The performance time is the performance time of the performance part indicated by the part ID. The performance time included in the lesson information is an example of first time information in the present invention. The motion information indicates the motion motion assigned to the performance part. The motion information is associated with the part ID of the performance part to which the motion motion indicated by the motion information is assigned. The operation time is the operation time of the exercise operation indicated by the motion information. The operation time included in the lesson information is an example of second time information in the present invention. The motion time of the motion motion basically matches the performance time of the performance part to which the motion motion is assigned. Therefore, the lesson information may include only one of the performance time and the operation time. The repeatable part information indicates a repeatable part of the music indicated by the music ID. The specific motion information indicates a specific motion among a plurality of motion operations constituting the exercise lesson.

  A method for determining performance time and operation time will be described. For example, in the music data, as described above, the original tempo of the music, the MIDI message as performance data, the marker message indicating the performance part, and the like are described. CPU51 may calculate the performance time of each performance part based on these information described in music data. In addition, each motion data defines an exercise operation such that the exercise operation is performed for a time corresponding to a predetermined count number, for example. The count number is the number of beats per measure × the number of measures. For example, the count number of exercise motions may be 32 counts. When the tempo is determined, the actual time corresponding to the count number is determined. The CPU 51 may calculate the operation time based on the count number of the exercise operation and the original tempo of the music.

  When setting a repeat part during an exercise lesson, the CPU 51 adds repeat information to the lesson information. The repeat information includes the part ID of the repeat part, the motion information of the repeat motion, the repeat tempo, and the number of repeats. Further, the output terminal 5 adds the reproduction information to the lesson information in association with the repeat information. The reproduction information includes rhythm sound reproduction information, repeat motion reproduction information, and narration reproduction information. The rhythm sound reproduction information indicates that the rhythm sound is output after the output of the repeat part is completed. When the operation time TA of the repeat motion is longer than the performance time TB of the repeat part, rhythm sound reproduction information is added. The repeat motion playback information indicates the number of times that the motion image of the repeat motion is displayed when the repeat part is output. The narration playback information indicates the narration ID of the narration that is output when the repeat part is output.

  When the exercise lesson starts, the CPU 51 acquires the music ID from the lesson information. The CPU 51 acquires music data corresponding to the music ID acquired from the lesson information. Further, the CPU 51 acquires the part ID from the lesson information in accordance with the performance order of the performance parts. CPU51 specifies the data part corresponding to the performance part which acquired part ID shows from music data. Then, the CPU 51 reproduces the specified data portion of the music data according to the original tempo set in the lesson information. The CPU 51 acquires the motion information associated with the acquired part ID from the lesson information. The CPU 51 generates motion picture moving image data based on the motion data corresponding to the acquired motion information. Then, the CPU 51 displays the motion video on the display 67 based on the moving image data. When the reproduction of one performance part is completed, the CPU 51 determines whether or not the performance part that has been reproduced is set as a repeat part based on the repeat information included in the lesson information. When the performance part that has been reproduced is not set as a repeat part, the CPU 51 reproduces the performance part in the next performance order. When the performance part that has been reproduced is set as the repeat part, the CPU 51 re-outputs the repeat part according to the repeat information and displays the motion video of the repeat motion. When the re-output of the repeat part is completed, the CPU 51 reproduces the performance part in the performance order next to the repeat part. Details of processing based on repeat information will be described later.

  The HDD 7 further stores various programs such as an OS, an exercise support program, a 3D engine, and a music sequencer. The exercise support program is a program for supporting the exercise of the user 41. The exercise support program causes the CPU 51 as a computer to execute at least a first control step, a reception step, a setting step, and a second control step. The 3D engine is a program for generating an image obtained by projecting a figure 83 that moves in a three-dimensional virtual space onto a two-dimensional plane based on motion data. The process of generating an image includes projective transformation, clipping, hidden surface removal, shading, texture mapping, and the like. The CPU 51 executes the 3D engine and sequentially generates still images. The CPU 51 generates moving image data from a plurality of still images that are sequentially generated. The CPU 51 sequentially outputs the still images included in the moving image data to the display control unit 56, whereby the motion video is displayed on the display 67.

  The music sequencer is a program for reproducing music data. The CPU 51 generates a sound signal corresponding to the music data by executing the music sequencer. Further, the CPU 51 generates various messages (events) by executing the music sequencer. As the message, for example, there is a message generated at a predetermined time interval according to the tempo. This message is called a MIDI clock or a synchronization message. Examples of the message include a performance end message and a lyrics message. The performance end message is a message indicating the end of the performance of the entire music.

  Various programs may be downloaded from the server such as the distribution server 2 via the network 10, for example. Various programs may be recorded on the recording medium 59 and read via the disk drive 58. The 3D engine and the music sequencer may be dedicated hardware instead of a program. The output terminal 5 may include a 3D engine or a music sequencer as hardware.

  The CPU 51 outputs an audio signal corresponding to the music data to the audio output unit 63 and outputs a video signal corresponding to the generated image from the display control unit 56 according to the set tempo. The CPU 51 synchronizes the output timing of the music audio signal and the output timing of the motion video signal based on the synchronization message. As a result, a figure 83 that performs an exercise motion in synchronization with the music output from the speaker 64 is displayed on the display 67.

[4. Operation of Exercise Content Generation System 1]
Next, operations of the exercise content generation system 1 will be described with reference to FIGS. FIG. 5 is a flowchart showing a processing example of the CPU of the remote controller 66. The user 41 operates the remote controller 66 to select desired exercise content. Then, the remote controller 66 transmits a reproduction start signal for reproducing exercise content to the output terminal 5. The output terminal 5 that has received the reproduction start signal transmits lesson information corresponding to the selected exercise content to the remote controller 66. Further, the output terminal 5 starts reproduction of the selected exercise content. The output terminal 5 that has started the reproduction of the exercise content transmits a notification signal indicating the reproduction state of the exercise content to the remote controller 66 at predetermined time intervals, for example. The notification signal includes, for example, the part ID of the performance part being reproduced, the elapsed time from the start of reproduction of the performance part being reproduced, the motion information of the exercise motion indicated by the exercise image being reproduced, and the like. When the reproduction of the exercise content is finished, the output terminal 5 transmits a notification signal indicating the end of the reproduction. The remote controller 66 that has received the lesson information starts the process shown in FIG.

  The remote controller 66 displays a content playback operation screen (step S1). The content reproduction operation screen is a screen for performing an exercise content reproduction operation. On the content playback operation screen, a playback button, a pause button, a stop button, a fast forward button, a rewind button, a repeat setting button, and the like are displayed. Next, the remote controller 66 determines based on the notification signal received from the output terminal 5 whether or not the reproduction of the exercise content has ended (step S2). At this time, if the remote controller 66 determines that the reproduction of the exercise content has not ended (step S2: NO), the process proceeds to step S3. In step S <b> 3, the remote controller 66 determines whether or not the repeat setting button has been selected by the user 41. At this time, if it is determined that the repeat setting button has not been selected (step S3: NO), the remote controller 66 proceeds to step S2. On the other hand, when it is determined that the repeat setting button has been selected (step S3: YES), the remote controller 66 proceeds to step S4.

  In step S4, the remote controller 66 displays a repeat motion setting screen based on the lesson information and the notification signal received from the output terminal 5. On the repeat motion setting screen, the user 41 selects a repeat motion and inputs a repeat tempo and the number of repeats. Then, the remote controller 66 sets the motion information of the selected repeat motion, the input repeat tempo and the number of repeats as a repeat signal (step S5). Next, the remote controller 66 determines whether there is a repeatable part that has not yet been checked whether repeat motion can be assigned among repeatable parts of the music being played back (step S6). At this time, if it is determined that there is a repeatable part that has not been checked yet (step S6: YES), the remote controller 66 proceeds to step S7. On the other hand, if the remote controller 66 determines that all repeatable parts have been checked (step S6: NO), the process proceeds to step S11.

  In step S7, the remote controller 66 selects one repeatable part that has not been checked yet, based on the repeatable part included in the lesson information. The remote controller 66 determines whether or not the selected repeatable part is a performance part to which a repeat motion can be assigned. Specifically, the remote controller 66 determines whether or not the reproduction of the selected repeatable part has already been completed based on the notification signal. The remote controller 66 determines that the repeat motion cannot be assigned when the reproduction of the selected repeatable part has already been completed (step S7: NO). The remote controller 66 acquires specific motion information from lesson information when the reproduction of the selected repeatable part is not completed. Next, the remote controller 66 determines whether or not the repeat motion is a specific motion based on the specific motion information. If the repeat motion is not a specific motion, the remote controller 66 determines that a repeat motion can be assigned (step S7: YES). When the repeat motion is a specific motion, the remote controller 66 acquires the part type of the performance part to which the repeat motion is assigned from the lesson information. Further, the remote controller 66 acquires the part type of the selected repeatable part from the lesson information. Then, the remote controller 66 determines whether or not the part type of the performance part to which the repeat motion is assigned matches the part type of the repeatable part. When the part types match, the remote controller 66 determines that repeat motion can be assigned (step S7: YES). If the part types do not match, the remote controller 66 determines that repeat motion cannot be assigned (step S7: NO). If it is determined that the repeat motion can be assigned, the remote controller 66 proceeds to step S8. On the other hand, if it is determined that the repeat motion cannot be assigned, the remote controller 66 proceeds to step S6.

  In step S8, the remote controller 66 determines whether or not repeat part candidates have already been set from repeatable parts that have already been checked. At this time, if it is determined that the repeat part candidate has already been set (step S8: YES), the remote controller 66 proceeds to step S9. On the other hand, when it is determined that the repeat part candidate is not set (step S8: NO), the remote controller 66 proceeds to step S10. In step S9, the remote controller 66 determines whether the performance order of the selected repeatable part is closer to the performance order of the currently played performance part than the performance order of the current repeat part candidate. At this time, if the remote controller 66 determines that the performance order of the selected repeatable part is closer to the performance order of the current repeat part candidate (step S9: YES), the process proceeds to step S10. On the other hand, if the remote controller 66 determines that the performance order of the selected repeatable part is not closer to the performance order of the current repeat part candidate (step S9: NO), the remote control 66 proceeds to step S6. In step S10, the remote controller 66 sets the repeat part candidate as the selected repeatable part. Next, the remote controller 66 proceeds to step S6.

  In step S11, the remote controller 66 determines whether or not a repeat part candidate is set. At this time, if the remote controller 66 determines that no repeat part candidate is set (step S11: NO), the process proceeds to step S12. In step S12, the remote controller 66 displays a message indicating that repeat setting cannot be performed. Next, the remote controller 66 proceeds to step S1. On the other hand, when it is determined that the repeat part candidate has been set (step S11: YES), the remote controller 66 proceeds to step S13. In step S <b> 13, the remote controller 66 sets the repeat part candidate part ID as a repeat part part ID in the repeat signal. Next, the remote controller 66 transmits a repeat signal to the output terminal 5 (step S14). Next, the remote controller 66 proceeds to step S1. If the remote controller 66 determines in step S2 that the reproduction of the exercise content has ended (step S2: YES), the remote control 66 ends the process shown in FIG.

  Note that the output terminal 5 may execute the processes of steps S6 to S11. For example, after step S5, the remote controller 66 transmits a repeat signal including the motion information of the repeat motion, the repeat tempo, and the number of repeats to the output terminal 5. The output terminal 5 performs the processes of steps S6 to S11 based on the received repeat signal. When the repeat part candidate is set in step S11, the CPU 51 sets the repeat part.

  FIG. 6 is a flowchart illustrating a processing example of the CPU 51 of the output terminal 5. When the CPU 51 receives the reproduction start signal from the remote controller 66, the CPU 51 acquires lesson information corresponding to the exercise content selected by the user 41 from the HDD 7 and stores it in the RAM 53. Then, the CPU 51 starts the process shown in FIG. CPU51 determines whether reproduction | regeneration of exercise | movement content was complete | finished (step S21). For example, the CPU 51 determines whether or not the output of the performance part whose performance order is the last has been completed based on the lesson information. The CPU 51 determines that the reproduction of the exercise content is finished when the output of the performance part whose performance order is the last is completed. When the performance part whose performance order is the last is set as a repeat part, the CPU 51 determines that the reproduction of the exercise content is completed when the re-output of the performance part whose performance order is the last is completed. When the CPU 51 determines that the reproduction of the exercise content has not ended (step S21: NO), the CPU 51 proceeds to step S22. In step S <b> 22, the CPU 51 determines whether a repeat signal has been received from the remote controller 66. At this time, if the CPU 51 determines that it has received a repeat signal (step S22: YES), it proceeds to step S23. On the other hand, when determining that the repeat signal has not been received (step S21: NO), the CPU 51 proceeds to step S30.

  In step S23, the CPU 51 acquires motion information, part ID, repeat tempo, and repeat count from the repeat signal. The CPU 51 generates repeat information including the acquired information. Then, the CPU 51 adds the generated repeat information to the lesson information stored in the RAM 53. The CPU 51 sets a repeat part by adding repeat information. When the CPU 51 automatically sets the repeat tempo, the CPU 51 acquires the original tempo from the lesson information. The CPU 51 determines a tempo slower than the original tempo as the repeat tempo. For example, the CPU 51 calculates a repeat tempo by multiplying the original tempo by a predetermined coefficient stored in the HDD 7. The CPU 51 sets the determined repeat tempo as repeat information.

  Next, the CPU 51 acquires the operation time TA of the repeat motion and the performance time TB of the repeat part from the lesson information based on the part ID and the motion information included in the repeat information. Then, the CPU 51 determines whether TA is longer than TB (step S24). At this time, if the CPU 51 determines that TA is equal to or less than TB (step S24: NO), the CPU 51 proceeds to step S26. On the other hand, if the CPU 51 determines that TA is longer than TB (step S24: YES), the CPU 51 proceeds to step S25. In step S25, the CPU 51 adds rhythm sound reproduction information to the lesson information in association with the added repeat information. Next, the CPU 51 proceeds to step S30.

  In step S26, the CPU 51 determines whether TB is equal to or greater than twice TA. At this time, if the CPU 51 determines that TB is less than twice TA (step S26: NO), the CPU 51 proceeds to step S28. On the other hand, if the CPU 51 determines that TB is equal to or greater than twice TA (step S26: YES), the CPU 51 proceeds to step S27. In step S27, the CPU 51 adds repeat motion playback information in association with the added repeat information. At this time, the CPU 51 calculates N = INT (TB / TA). INT (X) is a function that returns a value obtained by rounding down a value after the decimal point of X to make X an integer. The CPU 51 sets N as repeat motion reproduction information. Next, the CPU 51 proceeds to step S28.

  In step S28, the CPU 51 determines whether or not there is a surplus in the playback time of the repeat part. When TB is longer than TA and TB is less than twice TA, there is a remainder of time of TB-TA. Further, when TB is twice or more of TA and TB is longer than N × TA, there is a remainder of time of TB−N × TA. If the CPU 51 determines that there is no remaining playback time for the repeat part (step S28: NO), the CPU 51 proceeds to step S30. On the other hand, when the CPU 51 determines that there is a surplus in the playback time of the repeat part (step S28: YES), the CPU 51 proceeds to step S29. In step S29, the CPU 51 adds narration reproduction information to the lesson information in association with the added repeat information. At this time, the CPU 51 acquires the reproduction times TC of a plurality of narration data corresponding to the repeat motion from the HDD 7. Next, the CPU 51 selects narration data in which TA + TC is closest to TB from narration data satisfying TA + TC ≦ TB. Then, the CPU 51 sets the narration ID of the selected narration data in the narration reproduction information. When there is no narration data satisfying TA + TC ≦ TB, the CPU 51 does not add narration reproduction information. After finishing the process of step S29, the CPU 51 proceeds to step S30.

  In step S30, the CPU 51 determines whether or not to reproduce the repeat part. When the reproduction of one performance part is completed, the CPU 51 stores the part ID of the performance part that has been reproduced in the RAM 53. Next, the CPU 51 determines whether or not repeat information including the part ID of the performance part that has been reproduced has been added to the lesson information. At this time, if the repeat information including the part ID of the performance part that has been reproduced has not been added, the CPU 51 determines not to reproduce the repeat part (step S30: NO). In this case, the CPU 51 proceeds to step S31. On the other hand, when repeat information including the part ID of the performance part that has been reproduced has been added, the CPU 51 determines to reproduce the repeat part (step S30: YES). In this case, the CPU 51 proceeds to step S32.

  In step S31, the CPU 51 reproduces the exercise content according to the lesson information. Specifically, the CPU 51 acquires the part ID of the performance part that has been reproduced from the RAM 53. Based on the part ID acquired from the RAM 53, the CPU 51 acquires the part ID of the performance part in the next performance order of the performance part that has been reproduced from the lesson information. Then, the CPU 51 may erase the part ID of the performance part that has been reproduced from the RAM 53. With these processes, the CPU 51 can sequentially output a plurality of performance parts constituting the music in the order of performance. In addition, after outputting the repeat part, the CPU 51 can output the performance part in the performance order next to the performance part set as the repeat part. Then, the CPU 51 can sequentially output the performance parts from the performance parts in the performance order next to the performance parts set as the repeat parts. CPU51 which acquired part ID of the performance part of the next performance order specifies the data part corresponding to the performance part which part ID acquired from lesson information shows from the music data corresponding to music ID contained in lesson information. Then, the CPU 51 causes an audio signal corresponding to the specified data to be output from the audio output unit 63 to the speaker 64. Thus, the CPU 51 reproduces the performance part. Further, the CPU 51 acquires motion information associated with the part ID acquired from the lesson information from the lesson information. The CPU 51 generates motion picture moving image data based on the motion data corresponding to the acquired motion information. Then, the CPU 51 causes the video signal of the motion video to be output from the display control unit 56 to the display 67 based on the moving image data. In this way, the CPU 51 reproduces the motion image of the motion motion assigned to the performance part. The CPU 51 outputs an audio signal and a video signal according to the original tempo included in the lesson information. After finishing the process of step S31, the CPU 51 proceeds to step S21.

  In step S <b> 32, the CPU 51 causes the audio output unit 63 to output an audio signal of rhythm sound to the speaker 64. Next, the CPU 51 outputs a motion image of the repeat part and the repeat motion according to the repeat information (step S33). Specifically, the CPU 51 specifies a data part corresponding to the repeat part indicated by the part ID included in the repeat information from the music data corresponding to the music ID included in the lesson information. Then, the CPU 51 causes an audio signal corresponding to the specified data to be output from the audio output unit 63 to the speaker 64. Further, the CPU 51 causes the video signal of the motion video to be output from the display control unit 56 to the display 67 based on the motion data of the repeat motion indicated by the motion information included in the repeat information. The CPU 51 outputs an audio signal and a video signal according to the repeat tempo included in the repeat information. When the narration playback information is not added to the lesson information, the CPU 51 matches the playback start timing of the repeat part with the playback start timing of the motion video of the repeat motion.

  When the rhythm sound reproduction information is added to the lesson information, the CPU 51 transmits the rhythm sound audio signal from the audio output unit 63 to the speaker 64 until the reproduction of the motion video is completed after the reproduction of the repeat part is completed. To output. When the narration reproduction information is added to the lesson information, the CPU 51 causes the audio output unit 63 to output to the speaker 64 an audio signal corresponding to the narration data corresponding to the narration ID set in the narration reproduction information. Thus, the CPU 51 reproduces the narration. At this time, the CPU 51 matches the playback start timing of the repeat part and the playback start timing of the narration. After the reproduction of the narration is completed, the CPU 51 reproduces the motion video. At this time, the CPU 51 matches the timing of the end of playback of the repeat part and the end of playback of the motion image of the repeat motion. The processing described here is a processing example in the case where the example shown in FIG. 4C is adopted in FIGS. 4C and 4D. When repeat motion playback information is added to the lesson information, the CPU 51 repeatedly plays back the motion video of the repeat motion for the number of times set in the repeat motion playback information while the repeat part is played back. When the number of repeats included in the repeat information is set to 2 or more, the CPU 51 repeats the reproduction of the motion video of the repeat part and repeat motion for the number of repeats. When finishing the process of step S33, the CPU 51 deletes the repeat information and reproduction information used for reproduction from the lesson information. Then, the CPU 51 causes the audio output unit 63 to output an audio signal of rhythm sound to the speaker 64 (step S34). Next, the CPU 51 proceeds to step S21. In step S21, when the CPU 51 determines that the reproduction of the exercise content has ended (step S21: YES), the CPU 51 ends the process shown in FIG.

  As described above, according to the present embodiment, when the exercise content is output, the CPU 51 selects one of the exercise operations assigned to the plurality of performance parts constituting the music outputted from the speaker 64. Receiving a request for repeated exercise movements. The CPU 51 sets a repeatable part as a repeat part among performance parts whose output has not been completed when the request is received. After the repeat part is output from the speaker 64, the CPU 51 causes the speaker 64 to output the repeat part again. When the repeat part is output again, the CPU 51 causes the display 67 to display an exercise image in which the exercise operation requested to be repeated is performed. Accordingly, it is possible to repeatedly perform the exercise operation desired by the user while allowing the user to enjoy the exercise according to the music.

  In the above embodiment, the repeat part is automatically set. However, the user 41 may be able to select a repeat part. 7A and 7B are diagrams showing display examples of the repeat motion setting screen. 7, elements similar to those in FIG. 3 are given the same reference numerals. As shown in FIG. 7A, an exercise content configuration table 110, a display switching box 120, a progress bar 130, a repeat motion display column 140, a repeat part display column 180, and a send button 170 are displayed on the repeat motion setting screen. The The user 41 selects any exercise motion from the exercise content configuration table 110. Then, the remote controller 66 specifies a repeatable part to which a repeat motion can be assigned from among a plurality of performance parts constituting the music. This determination is the same as the determination in step S7 shown in FIG. Then, as shown in FIG. 7B, the remote controller 66 changes the display of the exercise content configuration table 110 so that repeatable parts to which repeat motion can be assigned can be identified. In the example of FIG. 7B, the fourth A melody in the performance order is being reproduced. Therefore, repeat motion can be assigned to the rust 2 and the rust 3. On the other hand, a repeat motion cannot be assigned to the chorus 1. The user 41 selects a desired repeatable part from repeatable parts to which repeat motion can be assigned. Then, the remote controller 66 displays the part ID of the selected repeatable part in the repeat part display field 180. Further, the remote controller 66 sets the part ID of the selected repeatable part in the repeat signal.

  Further, when the user selects a repeat setting button on the content reproduction operation screen displayed by the remote controller 66, the remote controller 66 may transmit a repeat signal. And the output terminal 5 may determine the exercise | movement motion by which the exercise | movement image | video is displayed on the display 67 at the time of receiving a repeat signal to a repeat motion. In this case, the output terminal 5 automatically sets a repeat part. Then, the output terminal 5 causes the speaker 64 to re-output the repeat part, and when the repeat part is re-output, causes the display 67 to display a motion image in which the repeat motion automatically determined by the output terminal 5 is performed. The user 41 can repeatedly perform the exercise operation only by operating the repeat setting button when the exercise image of the exercise operation to be repeated is displayed.

  In the above embodiment, the information processing apparatus of the present invention is applied to the output terminal 5. However, the information processing apparatus of the present invention may be applied to the distribution server 2. For example, the distribution server 2 may previously generate audio data for each performance part and moving image data of an exercise video for each exercise operation based on the lesson information. When the exercise lesson is performed, the distribution server 2 transmits the audio data and the moving image data to the output terminal 5 by, for example, a streaming method. As a result, the distribution server 2 causes the output terminal 5 to output the music and display the motion video. Further, the information processing apparatus of the present invention may be applied to the output terminal 5 and the distribution server 2. The output terminal 5 and the distribution server 2 may perform processing in cooperation.

1 Exercise content generation system 2 Distribution server 3 Database 5 Output terminal 7 HDD
51 CPU
52 ROM
53 RAM
56 Display Control Unit 60 Network Communication Unit 63 Audio Output Unit 68 Microphone 57 Monitor 64 Speaker 67 Display

Claims (11)

Performance part information indicating the performance order of a plurality of performance parts constituting a musical piece, a plurality of motion information indicating a plurality of movements associated with each of the plurality of performance parts, and repetition among the plurality of performance parts and playing possible repeatable performance part information indicating the performance parts are a music information indicating the music, storage means for storing the image information indicating the image the motion operation is performed,
Based on the music information stored in the storage means, the plurality of performance parts are output by the output means in accordance with the performance order indicated by the performance part information stored in the storage means, and among the plurality of performance parts, Based on the video information stored in the storage unit, an image in which the motion operation indicated by the operation information stored in the storage unit is performed as an exercise operation associated with the performance part output by the output unit. a first control means for Ru is outputted by said output means,
When you are a plurality of performance parts are sequentially output to the output means by the first control means, and receiving means for receiving designation of exercise motion where the repetition of the plurality of motion operation is required,
Among the specified playback order after playing parts being output Ri by said output means when the accepted is determined performance part by the receiving unit, the repeatable performance part information stored in said storage means but setting means for the performance part indicating that it is possible to repeatedly play is set to repeat part repeated,
By the output section, the setting output of the performance part which is set to the repeated part Ri by the means, and said operation information associated with the performance part which is set to the repeated part in the storage means indicating movement operation by continuously output of the video to be performed, the said repeated part set by the setting means, said a video motion operation repeatedly Ru is required is made by the specifying accepted by accepting means simultaneously outputs Second control means for outputting by means;
An information processing apparatus comprising: The second control means, after the performance part set as the repeat part is output to the output means by the first control means in accordance with the performance order, is received by the repeat part and the reception means. The output means outputs an image in which the motion operation requested to be repeated by the designation is performed,
Said first control means, said after output of the repetition part to said output means by a second control means, the playing part of the next subsequent playback order of playing part of the set in the repetitive part is defined, The information processing apparatus according to claim 1, wherein the output unit outputs an image in which an exercise motion associated with the performance parts in the next and subsequent performance orders is performed according to the performance order . The setting means sets the repeated part every time the designation is accepted by the accepting means,
It said second control means, every time the repetitive part is set by the setting unit, and the repeating part, a video in which the said repetition is requested by the specifying accepted by accepting means movement operation is performed The information processing apparatus according to claim 1, wherein the information processing apparatus outputs the information processing apparatus. The receiving unit receives a movement operation and a number of repetitions repetition is required,
The second control unit, the repetition number of times received by the reception means, the repeated part, wherein the repeat is requested by the specifying accepted by accepting means exercise motion is possible to output the video to be performed The information processing apparatus according to any one of claims 1 to 3. The setting means, wherein among the repeated performance part showing performance part information, when said reception means by playing part Ru can der repeatedly after the time when the designation is accepted there are multiple play repeatedly plural possible The performance part output in the order nearest to the performance part currently output by the said output means among the parts is set to the said repetition part, The any one of Claims 1 thru | or 4 characterized by the above-mentioned. Information processing device. Second storage means for storing first time information indicating each performance time of the plurality of performance parts and second time information indicating each operation time of the plurality of exercise motions assigned to the plurality of performance parts. Further comprising
The second control means requests the performance time of the repetitive part indicated by the first time information stored in the second storage means to be indicated by the second time information stored in the second storage means. If it has been more than 2 times the operating time of the exercise motion, when by outputting the repeated part by said output means, characterized in that to output an image movement operation repeatedly is request is made more than once The information processing apparatus according to any one of claims 1 to 5. Second storage means for storing first time information indicating each performance time of the plurality of performance parts and second time information indicating each operation time of the plurality of exercise motions assigned to the plurality of performance parts. When,
Third storage means for storing, for each exercise operation, voice information indicating a voice that supports the exercise operation;
The second control means requests the performance time of the repetitive part indicated by the first time information stored in the second storage means to be indicated by the second time information stored in the second storage means. If it is less than twice the long and the operating time than the operating time of the exercise operation, when by outputting the repeated part by said output means, it said repeatedly by the specifying accepted by said accepting means 6. The sound output from the voice information corresponding to the requested motion motion and the video image of the motion motion requested to be repeated are sequentially output by the output means. The information processing apparatus described in 1. A fourth storage means for storing tempo information indicating the original tempo of the music;
The first control means is a video showing a plurality of performance parts and a plurality of movements associated with each of the plurality of performance parts according to the tempo indicated by the tempo information stored in the fourth storage means. And according to the performance order ,
The second control means, according to the tempo slower than the tempo indicated by the tempo information stored in the fourth storage means, by the output means, the repeat part and the repeat according to the designation received by the accepting means. There requested exercise motion information processing apparatus according to any one of claims 1 to 7, characterized in that to output the video to be performed.   The information processing apparatus according to claim 1, wherein the information processing apparatus is a karaoke apparatus. An information processing method executed by an information processing apparatus,
Performance part information indicating the performance order of a plurality of performance parts constituting a musical piece, a plurality of motion information indicating a plurality of movements associated with each of the plurality of performance parts, and repetition among the plurality of performance parts and repeatable performance part information indicating the performance parts can be played, and the music information representing the music on the basis of the exercise motion the music information stored in the storage means for storing the image information indicating an image to be performed The output means outputs the plurality of performance parts according to the performance order indicated by the performance part information stored in the storage means, and associates the performance parts output by the output means among the plurality of performance parts. The motion image indicated by the motion information stored in the storage means as the motion motion that is stored is stored in the storage means. Based on the image information, a first control step of Ru is output by the output means,
When the first control step and said plurality of performance parts are sequentially output to the output unit, a reception step of receiving designation of exercise motion where the repetition of the plurality of motion operation is required,
Of the performance part of said receiving step by the specification after playing parts being output Ri by said output means when the accepted playback order is determined, the repeatable performance part information stored in said storage means but a setting step of the performance parts shown to be possible repeatedly played, sets the repetition part repeated,
The output means outputs the performance part set as the repeat part by the setting step , and the motion motion indicated by the motion information associated with the performance part set as the repeat part in the storage means by continuously output of the video to be performed, said repeated part set in the setting step, by simultaneously said output means and a video repeatedly requested Ru movement operation is performed by the specifying accepted by said accepting step A second control step for outputting;
An information processing method comprising: In the computer of the information processing device,
Performance part information indicating the performance order of a plurality of performance parts constituting a musical piece, a plurality of motion information indicating a plurality of movements associated with each of the plurality of performance parts, and repetition among the plurality of performance parts and repeatable performance part information indicating the performance parts can be played, and the music information representing the music on the basis of the exercise motion the music information stored in the storage means for storing the image information indicating an image to be performed The output means outputs the plurality of performance parts according to the performance order indicated by the performance part information stored in the storage means, and associates the performance parts output by the output means among the plurality of performance parts. The motion image indicated by the motion information stored in the storage means as the motion motion that is stored is stored in the storage means. Based on the image information, a first control step of Ru is output by the output means,
When the first control step and said plurality of performance parts are sequentially output to the output unit, a reception step of receiving designation of exercise motion where the repetition of the plurality of motion operation is required,
Of the performance part of said receiving step by the specification after playing parts being output Ri by said output means when the accepted playback order is determined, the repeatable performance part information stored in said storage means but a setting step of the performance parts shown to be possible repeatedly played, sets the repetition part repeated,
The output means outputs the performance part set as the repeat part by the setting step , and the motion motion indicated by the motion information associated with the performance part set as the repeat part in the storage means by continuously output of the video to be performed, said repeated part set in the setting step, by simultaneously said output means and a video repeatedly requested Ru movement operation is performed by the specifying accepted by said accepting step A second control step for outputting;
A program characterized by having executed.