JP6163755B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to a technical field for generating exercise content for supporting exercise performed by a user while listening to music.

  For example, Patent Literature 1 discloses a technique for generating exercise content by determining music corresponding to a plurality of exercise operations determined by a user according to the exercise operation. On the other hand, Patent Literature 2 discloses a technique for generating athletic content by determining an athletic motion corresponding to a component of a music according to the component of the music. The generated exercise content is displayed on a display as an image on which an exercise operation is performed, or is output from a speaker as sound of music, for example.

JP 2011-45477 A JP 2012-65966 A

  When a user exercises while listening to music, it is conceivable that the user's exercise level is increased from the beginning to the end of the song, and sound matching the exercise level is output. As a result, the user's mood rises toward the end of the music, so that when the music ends, the user can finish the exercise with a sense of fulfillment. Here, there is a demand for the user to exercise while listening to a plurality of pieces of music continuously. In this case, when one music is finished and the next music is started, the exercise level that has been increased returns to the original low level. Thereby, since the output voice is adjusted to a low exercise level, the mood of the uplifted user is lowered. Therefore, the user cannot finish the exercise with a sense of fulfillment.

  The present invention has been made in view of the above points, and when the user exercises while listening to a plurality of music pieces, the information processing apparatus and information processing that enable the user to finish the exercise with a sense of fulfillment It is an object to provide a method and a program.

In order to solve the above-mentioned problem, the invention according to claim 1 is characterized in that a first storage means for storing a plurality of pieces of music information indicating a plurality of pieces of music composed of a plurality of performance parts, and a storage in the first storage means. The first exercise level for each song is set so that the first exercise level of the user who exercises in response to the output of the plurality of song information is sequentially increased as the plurality of song information is sequentially output. A second storage means for storing first level information; and a sound that supports a user who exercises and is different from a song, and is at least one of a narration explaining exercise, a shout, and a sound effect that enhances mood more Starring constituting a third storage means for storing a plurality of sound information to be output by the sound output means when said plurality of music information to a sound information indicating a sound are sequentially output, the music A fourth storage unit stores a plurality of pieces of second level information in which the second exercise level is set for each performance part so that the second exercise level of the user exercising along with the music sequentially increases as the parts are sequentially output. Fifth memory that stores storage information, a plurality of performance parts constituting the plurality of music pieces, and list information indicating the movements assigned to the plurality of performance parts constituting the plurality of music pieces in association with each other. And a first setting means for setting the first exercise level for each music piece based on the first level information stored in the second storage means, and for the music piece set with the first exercise level. The second exercise level according to the first exercise level is such that the second exercise level of the user exercising together increases sequentially as the plurality of performance parts constituting the music are sequentially output. And setting means for setting the first motion level to set the motion level of each performance part, out of the fourth storage means a plurality of the second level information stored in, set by the setting means wherein Second setting means for setting the second exercise level for each performance part indicated by the list information stored in the fifth storage means based on the second level information that matches the first exercise level; The sound information that matches the second exercise level set by the second setting means among the plurality of sound information stored in the storage means is stored in the fifth storage means for each of the plurality of music pieces . Determining means for determining for each performance part indicated by the list information .

According to a second aspect of the present invention, the third storage means is the first sound information indicating the narration and a sound for raising the mood, and indicates at least one of the shout and the sound effect. Second sound information is stored, and the determining means determines at least one of the first sound information and the second sound information stored in the third storage means, and the second motion The sound information is determined such that the higher the level, the higher the output priority of the second sound information with respect to the first sound information.

According to a third aspect of the present invention, the information processing device is a karaoke device, and the plurality of pieces of music information stored in the first storage unit are sequentially output by the sound output unit and output by the sound output unit. Control means for outputting the sound information determined by the determining means to the music being played is output by the sound output means.

The invention according to claim 4 is an information processing method executed by the information processing apparatus, and is stored in a first storage unit that stores a plurality of pieces of music information indicating a plurality of pieces of music composed of a plurality of performance parts. The first exercise level for each song is set so that the first exercise level of the user who exercises according to the output of the plurality of song information is sequentially increased as the plurality of song information is sequentially outputted. Based on the first level information stored in the second storage means for storing one level information, the first setting step sets the first exercise level for each music piece, and the first exercise level is set. The second exercise level corresponding to the first exercise level is increased so that the second exercise level of the user exercising according to the song increases sequentially as the plurality of performance parts constituting the song are sequentially output. A setting step of setting the first motion level for setting the Le for each performance part, as the second movement level sequentially increases in accordance with a plurality of performance parts constituting the music piece are sequentially output, performance parts Among the plurality of second level information stored in the fourth storage means for storing a plurality of second level information in which the second exercise level for each is set, the first exercise level set by the setting step is set. List information indicating, in association with each other, a plurality of performance parts constituting the plurality of music pieces and an exercise motion assigned to each of the plurality of performance parts constituting the plurality of music pieces based on the matching second level information a second setting step of setting the second movement level of each performance part of the list information stored in the fifth storage means for storing indicates, Yu exercising The sound information is a sound that supports the music and is different from the music, and is sound information indicating at least one of narration, shout and sound effects to explain the movement, and the plurality of music information are sequentially output. The sound information that matches the second exercise level set by the second setting step among the plurality of sound information stored in the third storage means that stores a plurality of sound information to be output by the sound output means when And determining for each performance part indicated by the list information stored in the fifth storage means for each of the plurality of music pieces.

According to a fifth aspect of the present invention, the plurality of pieces of music information stored in the first storage means for storing a plurality of pieces of music information indicating a plurality of pieces of music composed of a plurality of performance parts is stored in the computer of the information processing apparatus. First level information in which the first exercise level is set for each song is stored so that the first exercise level of the user exercising according to the output sequentially increases as the plurality of pieces of song information are sequentially output. 2 is a first setting step in which the first exercise level is set for each music piece based on the first level information stored in the storage means, and the user exercises in accordance with the music set with the first exercise level. The second movement level corresponding to the first movement level is set for each performance part so that the second movement level increases sequentially as a plurality of performance parts constituting the music are sequentially output. A setting step of setting the first motion level for setting, the music piece such that the second movement level sequentially increases in accordance with a plurality of performance parts constituting are sequentially output, for each performance part and the second movement The second level information that matches the first exercise level set by the setting step among the plurality of second level information stored in the fourth storage means that stores a plurality of second level information set with levels. A fifth storage for storing list information indicating the plurality of performance parts constituting the plurality of pieces of music and the exercise motions assigned to each of the plurality of performance parts constituting the plurality of pieces of music in association with each other. sound support and a second setting step of setting the second movement level of each performance part indicated by the list information stored in the unit, the user exercising Sound output means that is different from the music and is sound information indicating at least one of narration, shout and sound effects to explain the movement, and when the plurality of music information are sequentially output the sound that match the second movement level set by said second setting step of the plurality of the sound information stored sound information to be output to the third storage means for storing a plurality Accordingly, the plurality of music A determination step for determining each performance part indicated by the list information stored in the fifth storage means .

According to the invention described in claim 1, 4 or 5 , the exercise level increases as the performance part changes. In addition, as the music changes, the exercise level rises and a support voice that matches the exercise level is output. Therefore, the user can finish the exercise with a sense of fulfillment.

Further, according to the invention of claim 1, 4 or 5, in each song, support voice that fits movement level set for performance part that is being output is output. Therefore, the user's mood can be raised even in one piece of music, and the user can finish exercise with a sense of fulfillment.

According to the second aspect of the invention, the first support voice can be preferentially output when the exercise level is low, and the second support audio can be preferentially output as the exercise level becomes high. Therefore, at the beginning of the exercise, the user can be made to learn the exercise motion. Also, at the end of the exercise, the user's mood can be raised.

It is a figure showing an example of outline composition of exercise content generation system 1 of one embodiment. (A) And (B) is a graph which shows an example of the relationship between the reproduction | regeneration position of an exercise | movement content, and an exercise | movement level, (C) is a figure which shows the example of the content of a music level allocation table | surface. (A) And (B) is a graph which shows an example of the relationship between the reproduction | regeneration position of an exercise | movement content, and an exercise | movement level, (C) is a figure which shows the example of the content of the part level allocation table | surface. 5 is a flowchart illustrating a processing example of a CPU 51 of the output terminal 5.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, embodiment described below is embodiment at the time of applying this invention to the exercise content production | generation system which produces | generates the exercise content for supporting exercise. The exercise content includes video and audio for supporting exercise.

[1. Configuration of Exercise Content Generation System 1]
First, the configuration of the exercise content generation system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a schematic configuration example of an exercise content generation system 1 according to the present embodiment. As shown in FIG. 1, the exercise content generation system 1 includes a distribution server 2 and one or more output terminals 5. The distribution server 2 and the output terminal 5 can be connected via the network 10. The network 10 includes, for example, the Internet. A database 3 is connected to the distribution server 2. Information relating to exercise and information relating to music are registered in the database 3. The distribution server 2 distributes information registered in the database 3 to the output terminal 5 periodically or in response to a request from the output terminal 5.

  The output terminal 5 is a terminal device installed in the facility 4, for example. The output terminal 5 is an example of an information processing apparatus of the present invention. The output terminal 5 is used by a user 41 of the facility 4. The facility 4 may be a sports facility, for example. The user 41 receives an exercise lesson at the sports facility. The exercise lesson is a lesson composed of a plurality of exercise movements. The output terminal 5 in this case may be a personal computer, for example. The facility 4 may be a karaoke store, for example. In the karaoke store, the user 41 sings karaoke music. The output terminal 5 in this case is a karaoke apparatus, for example. Hereinafter, a case where the facility 4 is a sports facility will be described as an example. Differences between sports facilities and karaoke stores will be described as appropriate.

  The output terminal 5 can be connected to the monitor 57. The monitor 57 may be a display device including a plurality of speakers 64 and a display 67. In this case, the output terminal 5 can be connected to the display 67. The output terminal 5 can be connected to a speaker 64. The speaker 64 is an example of an audio output unit of the present invention. When the output terminal 5 outputs an audio signal to the monitor 57, music or the like is output from the speaker 64. When the output terminal 5 outputs a video signal to the monitor 57, an exercise video or the like is displayed on the display 67. The motion video is a moving image that shows a figure 83 performing a motion motion. The figure 83 is a virtual object in the form of, for example, a person, an animal, a virtual creature, or a robot. The figure 83 is arranged in a three-dimensional virtual space. The output terminal 5 outputs a signal so that the music output from the speaker 64 and the movement of the figure 83 displayed on the display 67 are synchronized. Outputting music and motion video is an example of outputting motion content. The user 41 can exercise while watching the figure 83 displayed on the display 67 while listening to the music output from the speaker 64. When the facility 4 is a karaoke store, the display 67 displays, for example, a figure 83 that performs a dance operation corresponding to a karaoke song. In this case, the user 41 can dance while watching the figure 83 displayed on the display 67 while singing along with the music output from the speaker 64. The operator 42 can operate the output terminal 5 using the remote controller 66 or the like. The user 41 and the operator 42 may be the same person. When the facility 4 is a sports facility, the operator 42 may be an instructor, for example.

[2. Exercise level, support voice]
The exercise content output by the monitor 57 when an exercise lesson is performed includes music, exercise video, and support audio. The support voice is a voice for supporting the user 41 who exercises. The exercise content includes, for example, a plurality of music pieces. Each of the plurality of music pieces is composed of a plurality of performance parts. An exercise motion is assigned to each of a plurality of performance parts constituting each of a plurality of music pieces. When the facility 4 is a sports facility, a gymnastic action or a dance action can be assigned to the performance part as an exercise action. The gymnastic exercise is, for example, an exercise performed for promoting health, strengthening physical strength, strengthening muscle strength, and the like. Examples of gymnastic exercises include aerobic exercise, anaerobic exercise, and stretching. Examples of the aerobic exercise include march and front lunge. Examples of the anaerobic exercise include a shoulder press and a chest press. Examples of stretching exercises include upper arm stretching and neck stretching. The dance motion is a motion that is choreographed to the music to dance to the music. When the facility 4 is a karaoke facility, a dance operation is assigned to the performance part. The output terminal 5 causes the speaker 64 to sequentially output a plurality of music pieces included in the exercise content. When outputting one piece of music, the output terminal 5 outputs a plurality of performance parts in the order of performance parts according to the composition of the music. For example, performance parts are output in the order of A melody, B melody, rust, and the like. When any of the performance parts is output from the speaker 64, the output terminal 5 causes the display 67 to display an exercise image in which the figure 83 performs the exercise operation assigned to the output performance part.

  The output terminal 5 outputs music and at the same time outputs support voice through the speaker 64. Support voice includes exercise narration and uplifting voice. The exercise narration is a voice for instructing an exercise performed by the user 41. For example, the exercise narration may be a voice that explains the motion movement or a voice that instructs the user 41.

  The uplifting voice is a voice for raising the mood of the user 41. When the user 41 listens to the uplifting voice, it is expected that the mood of the user 41 is raised. The exercise of the user 41 becomes active when the mood of the user 41 is raised. Thereby, the user 41 can enjoy exercise. The uplifting voice may be a voice that prompts the user 41 to speak in accordance with the music. The user 41 is urged by the uplifting voice and utters, so that the user 41 feels uplifted and exercise becomes active. Thereby, the user 41 can enjoy exercise. When a plurality of users 41 perform exercise lessons at the same time, a sense of unity is born when the plurality of users 41 utter the same voice. When a sense of unity is born, the atmosphere of the user 41 is raised.

  Examples of the uplifting voice include a shout voice, a singing suggestion voice, and a sound effect sound. As a shout, for example, there are “Yay”, “High”, and the like. The shout is a good match because it is output in time with the tempo of the song. In addition, the user 41 who has listened to the shout can utter the same shout following the shout. The singing suggestion sound is a sound that urges the singing of the music being output. As the singing suggestion sound, for example, there is a sound for instructing singing such as “Now, let's sing”. In addition, there is a voice that sings the lyrics of a song as a singing suggestion voice. The user 41 who has listened to the singing suggestion voice can sing by being sung by the singing suggestion voice, or can sing in the same manner as the singing suggestion voice. By singing, the user 41 can easily grasp the rhythm of the movement. The excitement sound effect is a sound for further raising the mood of the user 41 who is uplifted. The excitement sound effect may be a sound that further urges the singing user 41 to sing. Examples of the exciting sound effect include applause, clapping, cheering and the like. The clapping time is output as a match for the music tempo. By outputting the excitement sound when the user 41 is singing, the user 41 can be encouraged to sing with a louder voice. When the singing suggestion sound or the exciting sound effect is output, the display 67 may display a telop of the lyrics of the music being output. Thereby, the user 41 can be further urged to sing.

  The output terminal 5 determines the support voice to be output based on the exercise level of the user 41 during the exercise lesson. The exercise level indicates the activity or intensity of the user 41's exercise. For example, there is a tendency for exercise to become active as the user 41 feels high. Also, as the user 41 gets used to the exercise while exercising, the exercise tends to become active. Also, if you get used to the exercise, you can afford to speak to the user 41. The output terminal 5 determines the support voice that matches the exercise level. The support voice suitable for the exercise level is, for example, a support audio suitable for raising the mood of the user 41 exercising with the activity indicated by the exercise level. The output terminal 5 may determine a plurality of types of support voices for one exercise level.

  Based on the exercise level, the output terminal 5 determines which one of exercise narration and uplifting sound is to be preferentially output. The output terminal 5 determines to output at least one of exercise narration and uplifting sound for each exercise level. When the exercise level is low, there is a probability that the user 41 is not accustomed to the exercise operation. Therefore, the output terminal 5 outputs the exercise narration with priority over the uplifting voice. When the exercise level is high, there is a probability that the user 41 is accustomed to the exercise operation. Therefore, the output terminal 5 gives priority to the uplifted voice over the exercise narration. That is, the output terminal 5 determines the support voice to be output so that the higher the exercise level, the higher the output priority of the uplifted voice relative to the output priority of the exercise narration.

  When the output terminal 5 determines the uplifting voice as the support voice to be output, the output terminal 5 determines the uplifting voice that matches the exercise level from the shout, the utterance suggestion sound, and the excitement sound effect. The exercise level at which the shout is output is basically lower than the exercise level at which the utterance suggestion sound is output. The reason is, for example, that the generation time of shout is basically shorter than the singing time of lyrics. At a stage where the user 41 does not feel so high, the user 41 utters more easily than the lyrics. The exercise level at which the utterance suggestion sound is output is basically lower than the exercise level at which the excitement sound is output. As the reason, for example, the excitement sound effect is a voice that further urges the user 41 to sing.

Examples of support voices output for each exercise level are shown below.
・ Exercise level 1: Exercise narration only ・ Exercise level 2: Exercise narration, shout ・ Exercise level 3: Exercise narration, singing suggestion voice (voice to instruct singing)
・ Exercise level 4: exercise narration, excitement sound effect ・ Exercise level 5: singing suggestion sound (voice to sing), excitement effect sound At exercise level 1, only exercise narration is output, so exercise narration is better than uplifting voice Will be output with priority. At exercise levels 2-4, the uplifting voice is given priority over exercise narration. For example, when the output timing of the motion narration and the output timing of the uplifting sound overlap, the output terminal 5 outputs only the uplifting sound. At the exercise level 5, only the uplifting sound is output, so the uplifting sound is output with priority over the motion narration. In this example, there are five levels of exercise. The number of stages of the exercise level may be 4 stages or less, or 6 stages or more. Further, a combination of support sounds different from this example may be determined for one exercise level.

  The output terminal 5 determines a plurality of exercise levels used for determining the support voice for one exercise lesson. The output terminal 5 determines an exercise level for each of a plurality of songs included in the exercise content. Specifically, the output terminal 5 determines the exercise level for each song so that the exercise level gradually increases as a plurality of songs included in the exercise content are sequentially output. The exercise level determined for each piece of music is an example of the first exercise level in the present invention.

  FIGS. 2A and 2B are graphs showing an example of the relationship between the exercise content playback position and the exercise level. The playback position is a temporal position from the start of playback of exercise content. As shown in FIG. 2A, a plurality of songs are output in the order of songs A, B, C, and D. As shown in FIG. 2A, the level L1 is set for the music piece A. For music B, level L2 higher than level L1 is set. A level L3 higher than the level L2 is set for the music piece C. A level L4 higher than the level L3 is set for the music piece D.

  As shown in FIG. 1, a plurality of music level assignment tables are registered in the database 3. The output terminal 5 sets an exercise level for each song according to the song level assignment table downloaded from the distribution server 2. The music level assignment table is a table in which the exercise level for each music is set. The music level assignment table is an example of first level information in the present invention. In the song level assignment table, the exercise level for each song is set so that the exercise level gradually increases as a plurality of songs are sequentially output. FIG. 2C is a diagram showing an example of the contents of the music level assignment table. As shown in FIG. 2C, each song level assignment table stores the number of songs, the exercise level for each song, and the name indicating the rising type in association with each other. The number of songs is the number of songs to which the song level assignment table corresponds. The exercise level for each music piece is set by the number indicated by the number of music pieces. The rising type indicates a mode in which the exercise level increases as a plurality of pieces of music are sequentially output.

  In the database 3, song level assignment tables corresponding to various numbers of songs are registered. Thereby, the output terminal 5 can appropriately set the exercise level for the exercise content with various numbers of songs. A plurality of music level assignment tables with different ascending types may be registered for one music number. Examples of the ascending type include a proportional type, a first half ascending type, and a second half ascending type. The proportional type is an ascending type in which the exercise level is proportional to the musical performance order. The latter-half ascending type is an ascending type in which the exercise level rises exponentially with respect to the performance order of the music. The first half ascent type is an ascending type in which the exercise level rises logarithmically with respect to the performance order of the music. FIG. 2A is a graph when the ascending type is a proportional type. FIG. 2B is a graph when the ascending type is the first half ascending type. Even if the basic ascending type is the same, a plurality of music level assignment tables with different degrees of increase in the exercise level may be registered. The output terminal 5 selects one of the music level assignment tables from a plurality of music level assignment tables based on a predetermined condition. Thereby, the output terminal 5 can change a raise type. For example, the output terminal 5 may select an ascending type music level assignment table designated by the user 41.

  In the example shown in FIGS. 2 (A) to 2 (C), the exercise level increases step by step in the entire plurality of music pieces included in the exercise content. However, the exercise level may be increased step by step only with some continuous two or more songs among the plurality of songs included in the exercise content. For example, it is assumed that nine pieces of music are included in the exercise content. In a plurality of music pieces in which the performance order is from the first to the third, the exercise level increases step by step. In a plurality of music pieces in which the performance order is fourth to seventh, for example, the exercise level may not change. In a plurality of music pieces in the performance order from the eighth to the ninth, for example, the exercise level may be lowered step by step.

  The output terminal 5 that has set the exercise level for each song may determine the support voice that matches the exercise level for each song. As the exercise lesson progresses, the exercise level increases each time the output music changes. Therefore, the support voice is output so that the mood of the user 41 gradually increases as the exercise lesson progresses. Then, when the output of the music with the highest exercise level is completed, the exercise lesson ends. That is, the exercise lesson ends with the user 41 feeling at the highest level. Therefore, the user 41 can finish the exercise lesson with a sense of fulfillment.

  The output terminal 5 that has set the exercise level for each piece of music may determine the exercise level for each performance part. The output terminal 5 determines an exercise level for each of a plurality of performance parts constituting the song in each of a plurality of songs included in the exercise content. Specifically, the output terminal 5 determines the exercise level for each performance part so that the exercise level increases stepwise as the plurality of performance parts are sequentially output. The output terminal 5 sets an exercise level for each performance part according to the exercise level set for the music. In this case, the exercise level set for the music is information for setting the exercise level for each performance part. The exercise level determined for each performance part is an example of the second exercise level in the present invention.

  FIGS. 3A and 3B are graphs showing an example of the relationship between the playback position of exercise content and the exercise level. As shown in FIG. 3A, each of the music pieces A, B, C, and D includes parts a, b, c, and d. In music A, levels L1, L2, L3, and L4 are set for parts a, b, c, and d, respectively. In music B, levels L2, L3, L4, and L5 are set for parts a, b, c, and d, respectively. When the output music is switched, the exercise level is temporarily lowered. However, the minimum exercise level of the performance part in the music B is higher than the minimum exercise level of the performance part in the music A. Further, the average value of the exercise levels of the plurality of performance parts constituting the music B is higher than the average value of the exercise levels of the plurality of performance parts constituting the music A. The reason is that each exercise level of a plurality of performance parts constituting the song is set according to the exercise level set for the song. For example, the output terminal 5 may set the exercise level for each performance part so that the average value of the exercise levels of a plurality of performance parts constituting the song matches the exercise level set for the song. . In this case, the exercise level set for the music indicates the overall exercise level of one music. Similarly, for the music pieces C and D, an exercise level for each performance part is set. The output terminal 5 sets the exercise level for each song according to the song level assignment table. Therefore, the overall exercise level of one music changes according to the music level assignment table. Further, the manner of increasing the overall exercise level of a plurality of songs changes according to the song level assignment table. FIG. 3A shows an example in which a music level assignment table is used in which the exercise level is set so that the exercise level increases one step at a time. FIG. 3B shows an example in which a music level assignment table in which the exercise level is set so that the exercise level is increased by two stages is used.

  As shown in FIG. 1, a plurality of part level assignment tables are registered in the database 3. The output terminal 5 sets an exercise level for each performance part for each of the plurality of pieces of music according to the part level assignment table that matches the exercise level set for the piece of music among the plurality of part level assignment tables. The part level assignment table is an example of second level information in the present invention. The part level assignment table is a table in which the exercise level for each performance part is set. In the part level assignment table, the exercise level for each performance part is set so that the exercise level gradually increases as a plurality of performance parts constituting the music are sequentially output. FIG. 3C shows an example of the contents of the part level assignment table. As shown in FIG. 3C, each part level assignment table stores an average level and an exercise level for each performance part in association with each other. The average level is an average value of the exercise levels of a plurality of performance parts.

  In the database 3, part level assignment tables corresponding to various average levels are registered. Thus, the output terminal 5 can appropriately set the exercise level according to the part level assignment table that matches the exercise level set for the music. The output terminal 5 may select any part level assignment table from a plurality of part level assignment tables based on a predetermined condition. Thereby, a change can be attached to a raise type. For example, every time an exercise lesson is started, the output terminal 5 may randomly select a part level assignment table from a part level assignment table that matches the exercise level set for the music. FIG. 3C shows a part level assignment table in which the ascending type is a proportional type. A part level assignment table of the first half ascent type or the second half ascent type may be registered. When a plurality of part level assignment tables are registered for one average level, for example, in one part level assignment table, the exercise levels of all performance parts may be the same. If the average level is the lowest level 1 as the exercise level, the exercise level of all performance parts must be 1. Therefore, an exercise level less than 1 may be set for some performance parts. For example, 0.5, 1 and 1.5 may be set for A melody, B melody and rust, respectively. A method for determining the support voice in this case will be described later. Alternatively, the exercise level for each song may be set only in the range of level 2 or higher in the song level assignment table. In addition, the exercise level may be increased stepwise by only two or more consecutive performance parts among a plurality of performance parts included in the music. This is the same as the case where the setting of the exercise level for each music is described.

  The output terminal 5 that has set the exercise level for each piece of music may determine, for each performance part, the support voice that matches the exercise level set for each performance part. Every time the performance part output in one piece of music changes, the exercise level increases. Therefore, the support voice is output so that the mood of the user 41 gradually increases as one piece of music progresses. Therefore, when one piece of music ends, the user 41 can feel a sense of fulfillment according to the exercise level at that time. Also, every time the output music changes, the overall exercise level of one music increases. Therefore, the user 41 can finish the exercise lesson with a sense of fulfillment. Determining the support sound that matches the exercise level of each of the plurality of performance parts that make up the song is equivalent to determining the support sound that matches the overall exercise level of the song set for the song. As described above, it is assumed that 0.5, 1, 1.5, etc. are set for A melody, B melody, and rust, respectively. In this case, the output terminal 5 may determine the support voice corresponding to level 1 for all of the A melody, B melody, and chorus, for example. On the other hand, the output terminal 5 may change the assignment of the exercise motion to the performance part. Specifically, the output terminal 5 changes the exercise operation so that the burden on the body of the user 41 is changed by the exercise operation. The reason is, for example, that the exercise of the user 41 tends to become active or the mood of the user 41 tends to rise as the user 41 performs an exercise operation with a large load. The output terminal 5 does not change the assignment of the motion movement to the B melody. On the other hand, the output terminal 5 changes the assignment of the exercise motion to the A melody and the chorus. The output terminal 5 assigns to the A melody an exercise motion that requires a smaller load than the exercise motion load originally assigned to the A melody. The output terminal 5 assigns to the rust an exercise motion that requires a larger load than the exercise motion load originally assigned to the rust.

[3. Configuration of each device]
Next, the configuration of each device included in the athletic content generation system will be described with reference to FIG.

[3-1. Configuration of distribution server 2]
As shown in FIG. 1, the distribution server 2 includes a CPU 21, a ROM 22, a RAM 23, a bus 24, an I / O interface 25, a display control unit 26, a disk drive 28, a network communication unit 30, and an HDD (hard disk drive) 37. . The CPU 21 is connected to the ROM 22, the RAM 23, the bus 24, and the I / O interface 25 via the bus 24. The CPU 21 controls each unit of the distribution server 2 by executing a program stored in the ROM 22 or the HDD 37. Connected to the I / O interface 25 are a database 3, a display control unit 26, a disk drive 28, a network communication unit 30, a keyboard 31, a mouse 32, and an HDD 37. The CPU 21 accesses the database 3 via the I / O interface 25. The display control unit 26 outputs a video signal to the monitor 57 based on the control of the CPU 21. The disk drive 28 writes data to and reads data from the recording medium 29. The network communication unit 30 performs control for the distribution server 2 to connect to the network 10. The HDD 37 stores an OS, various control programs, and the like.

  In the database 3, data such as motion data, music data, music level assignment table, part level assignment table, exercise narration data, uplifting voice data, and support voice assignment table are registered. Motion data is registered for each movement. The motion data is data that defines the motion motion of the figure 83 in the three-dimensional virtual space. The motion data is data for displaying the motion motion of the figure 83 on the display 67. The motion data includes the coordinates of each part of the body of the figure 83 according to the progress of the motion movement. The motion data is registered in association with the motion information. The motion information is identification information indicating an exercise motion. Examples of motion information indicating a gymnastic operation include “half squat” and “march”. Examples of motion information indicating the dance motion include “A melody of song X”, “B melody of song X”, “rust of song X”, “A melody of song Y”, and the like.

  The music data is performance data for outputting music from the speaker 64. The music data is an example of music information in the present invention. The music data may be, for example, data in MIDI (Musical Instrument Digital Interface) format. The song data includes information such as song ID, song name, artist name, original tempo, composition of performance part of song, lyrics and the like. The music ID is music identification information. In addition, the music data defines timing for switching performance parts, display timing of lyrics telop, timing to change the color of lyrics telop, and the like. For example, when the music data is data in the MIDI format, the music data can include a meta message in addition to the MIDI message as actual performance data. Examples of the meta message include a marker message indicating a performance part and a lyrics message. Therefore, a part ID for identifying a performance part and lyrics can be described in the music data as a message. For example, a music sequencer described later is installed in the output terminal 5. The output terminal 5 reproduces the music data by executing the music sequencer, and outputs a read message when reading a meta message or the like from the music data. For example, the timing at which the marker message is output is the timing at which the performance part indicated by the marker message is started. In the present embodiment, the marker message is referred to as a performance part start message. The performance part start message is a message notifying the start of performance of the performance part.

  The motion narration data is sound data for outputting motion narration by the speaker 64. The motion narration data is an example of the first audio information in the present invention. The motion narration data may be WAV format (RIFF Waveform Audio Format) data. The exercise narration data is registered for each exercise operation. One or more pieces of motion narration data are registered for one piece of motion information. The number of motion narration data is determined according to the number of motion narration output during motion motion. The motion narration data includes a narration ID and corresponding motion information. The narration ID is identification information indicating exercise narration. The motion narration data includes output timing information. The output timing information indicates the timing at which exercise narration is output while exercise operation is performed. For example, the output terminal 5 generates a synchronization message at predetermined time intervals by executing a music sequencer. The output timing information may be, for example, the number of times the synchronization message is output from the start of playback of the performance part associated with the exercise operation until the output timing of exercise narration.

  The uplifting voice data is an example of the second voice information in the present invention. The uplifting voice data is voice data for outputting uplifting voice through the speaker 64. The uplifting voice data may be WAV format data. For each performance part of the music, the uplifting voice data of the shout voice, the singing suggestion voice and the excitement sound effect are registered. The uplifting voice data includes the uplifting voice ID, the music ID of the corresponding music, the part ID, and the item type. The part ID is identification information indicating a performance part. The item type is information indicating whether the uplifting voice is a shout voice, a singing suggestion voice, or a rising sound effect. Moreover, the uplifting voice data includes output timing information. The output timing information indicates the timing at which the uplifting sound is output while the performance part of the corresponding music is being output. The output timing information may be, for example, the number of times the synchronization message is output from the start of reproduction of the corresponding performance part until the output timing of the uplifting sound comes.

  The support voice assignment table is a table showing the support voice output corresponding to the exercise level for each exercise level. Specifically, in the support voice assignment table, for each exercise level, an exercise level and an audio type are registered in association with each other. The voice type indicates whether the support voice is an exercise narration, a shout voice, a singing suggestion voice, or an excitement sound effect. A plurality of voice types may be associated with one exercise level.

[3-2. Configuration of output terminal 5]
As shown in FIG. 1, the output terminal 5 includes a CPU 51, a ROM 52, a RAM 53, a bus 54, an I / O interface 55, a display control unit 56, a disk drive 58, a network communication unit 60, an audio output unit 63, and a signal receiving unit. 65 and HDD 7. The CPU 51 is connected to the ROM 52, the RAM 53, the bus 54, and the I / O interface 55 via the bus 54. The CPU 51 controls each unit of the output terminal 5 by executing a program stored in the ROM 52 or the HDD 7. Connected to the I / O interface 55 are an HDD 7, a display control unit 56, an audio output unit 63, a disk drive 58, a network communication unit 60, a keyboard 61, a mouse 62, a microphone 68, and a signal receiving unit 65. The display control unit 56 outputs a video signal to the monitor 57 based on the control of the CPU 51. The audio output unit 63 outputs an audio signal to the monitor 57 based on the control of the CPU 51. The disk drive 58 writes and reads data to and from the recording medium 59. The signal receiving unit 65 receives a signal output from the remote controller 66. The remote controller 66 is for the operator 42 to operate the output terminal 5.

  The HDD 7 is an example of the first storage unit, the second storage unit, the third storage unit, the fourth storage unit, and the fifth storage unit of the present invention. The HDD 7 stores motion data, music data, music level assignment table, part level assignment table, exercise narration data, uplifting sound data, support sound assignment table, and the like distributed from the distribution server 2. The HDD 7 stores lesson information. The lesson information is list information that defines the structure of an exercise lesson. For example, the output terminal 5 generates lesson information. The lesson information includes the number of songs, a plurality of song IDs, a plurality of performance part IDs, and a plurality of motion information. The number of songs is the number of songs included in the exercise content. The music ID indicates a music included in the exercise content. A plurality of music IDs are arranged in the order of music performance. The performance part ID indicates a performance part constituting the music included in the exercise content. A plurality of performance part IDs are set for each music ID. The plurality of performance part IDs are arranged in the order of performance part performance. The motion information indicates the motion motion assigned to the performance part. The motion information is associated with the part ID of the performance part to which the motion motion indicated by the motion information is assigned. The details of the process of playing the exercise content based on the lesson information will be described later.

  The HDD 7 further stores various programs such as an OS, an exercise support program, a 3D engine, and a music sequencer. The exercise support program is a program for supporting the exercise of the user 41. The exercise support program causes the CPU 51 as a computer to execute at least a setting step and a determination step. The 3D engine is a program for generating an image obtained by projecting a figure 83 that moves in a three-dimensional virtual space onto a two-dimensional plane based on motion data. The process of generating an image includes projective transformation, clipping, hidden surface removal, shading, texture mapping, and the like. The CPU 51 executes the 3D engine and sequentially generates still images. The CPU 51 sequentially outputs the generated still image to the display control unit 56, whereby a motion image is displayed on the display 67.

  The music sequencer is a program for reproducing music data. The CPU 51 generates a sound signal corresponding to the music data by executing the music sequencer. Further, the CPU 51 generates various messages (events) by executing the music sequencer. As the message, for example, there is a message generated at a predetermined time interval according to the tempo. This message is called a MIDI clock or a synchronization message. Examples of the message include a performance part start message and a lyrics message. As a message, there is a performance end message. The performance end message is a message indicating the end of the performance of the entire music.

  Various programs may be downloaded from the server such as the distribution server 2 via the network 10, for example. Various programs may be recorded on the recording medium 59 and read via the disk drive 58. The 3D engine and the music sequencer may be dedicated hardware instead of a program. The output terminal 5 may include a 3D engine or a music sequencer as hardware.

  The CPU 51 outputs an audio signal corresponding to the music data to the audio output unit 63 and outputs a video signal corresponding to the generated image from the display control unit 56 according to the set tempo. The CPU 51 synchronizes the output timing of the music audio signal and the output timing of the motion video signal based on the synchronization message. As a result, a figure 83 that performs an exercise motion in synchronization with the music output from the speaker 64 is displayed on the display 67. Further, the CPU 51 specifies the output timing of the support voice based on the synchronization message. The CPU 51 mixes the audio signal of the music data and the audio signal of the port audio. Then, the CPU 51 causes the audio output unit 63 to output the mixed audio signal. Further, the CPU 51 specifies the display timing of the lyrics telop, the timing for changing the color of the lyrics telop, and the like based on the lyrics message. Then, the CPU 51 causes the display control unit 56 to output a video signal in which lyrics telop is superimposed on the motion video.

[4. Operation of Exercise Content Generation System 1]
Next, the operation of the exercise content generation system 1 will be described with reference to FIG. FIG. 4 is a flowchart illustrating a processing example of the CPU 51 of the output terminal 5. The process shown in FIG. 4 is started, for example, when the output terminal 5 is turned on. The CPU 51 determines whether or not the user 41 or 42 has requested power OFF (step S1). At this time, if the CPU 51 determines that power-off is not requested (step S1: NO), the CPU 51 proceeds to step S2. In step S <b> 2, the CPU 51 displays a list of exercise lessons on the display 67 based on the lesson information stored in the HDD 7. Next, the CPU 51 determines whether or not the user 41 or 42 has selected any exercise lesson (step S2). At this time, if the CPU 51 determines that an exercise lesson has not been selected (step S2: NO), the CPU 51 proceeds to step S1. On the other hand, if the CPU 51 determines that an exercise lesson has been selected (step S2: YES), the CPU 51 proceeds to step S3.

  In step S3, the CPU 51 acquires the number of songs from the lesson information of the selected exercise lesson. Next, the CPU 51 acquires a song level assignment table corresponding to the number of songs from the HDD 7 (step S4). Then, the CPU 51 causes the display 67 to display a list of ascending type names set in the acquired music level assignment table. Next, the CPU 51 determines whether or not the user 41 or 42 has selected any rising type (step S5). At this time, if the CPU 51 determines that the ascending type is not selected (step S5: NO), the process proceeds to step S5. On the other hand, if the CPU 51 determines that the ascending type has been selected (step S5: YES), the CPU 51 proceeds to step S6.

  In step S6, the CPU 51 sets the performance order I to 1. Next, the CPU 51 determines whether or not the performance order I is equal to or less than the number of songs (step S7). At this time, if the CPU 51 determines that the performance order I is not less than or equal to the number of songs (step S7: NO), the CPU 51 proceeds to step S12. On the other hand, when the CPU 51 determines that the performance order I is equal to or less than the number of songs (step S7: YES), the CPU 51 proceeds to step S8.

  In step S <b> 8, the CPU 51 assigns an exercise level corresponding to the I-th song to the I-th song in the performance order. Specifically, the CPU 51 obtains the song ID of the song whose performance order is the Ith song from the lesson information. Further, the CPU 51 obtains an exercise level corresponding to the I-th song from the selected ascending type song level assignment table. Then, the CPU 51 stores the acquired music ID and exercise level in the RAM 53 in association with each other.

  Next, the CPU 51 obtains a part level assignment table that matches the exercise level set for the I-th musical piece in the performance order (step S9). Specifically, the CPU 51 acquires from the HDD 7 a part level assignment table in which the exercise level of the I-th musical piece in the performance order is set as the average level. When there are a plurality of part level assignment tables in which the same average level is set, the CPU 51 acquires a part level assignment table at random from the plurality of part level assignment tables. However, the CPU 51 sets the lowest exercise level set in the part level assignment table acquired this time to be higher than the lowest exercise level set in the performance part that constitutes the music piece whose performance order is (I-1) th. To do.

  Next, the CPU 51 assigns an exercise level to each of a plurality of performance parts constituting the music piece whose performance order is the Ith (step S10). Specifically, the CPU 51 obtains a plurality of part IDs corresponding to the music ID of the music piece whose performance order is the I-th music from the lesson information. For each part ID, the CPU 51 acquires the exercise level corresponding to the part ID from the part level assignment table. Then, the CPU 51 causes the RAM 53 to store the music ID, part ID, and exercise level of the music having the performance order I in association with each other. Next, the CPU 51 adds 1 to the performance order I (step S11). Next, the CPU 51 proceeds to step S7.

  In step S12, the CPU 51 determines whether to play exercise content. When the user 41 or 42 performs an operation for canceling the reproduction, the CPU 51 determines not to reproduce the exercise content (step S12: NO). In this case, the CPU 51 proceeds to step S1. On the other hand, when the user 41 or 42 performs an operation for executing reproduction, the CPU 51 determines to reproduce the exercise content (step S12: YES). In this case, the CPU 51 proceeds to step S13.

  In step S13, the CPU 51 reproduces the exercise content. Specifically, the CPU 51 obtains the song ID of the song with the first performance order from the lesson information of the selected exercise lesson. The CPU 51 acquires music data corresponding to the acquired music ID from the HDD 7. Then, the CPU 51 causes the audio output unit 63 to output the audio signal of the music with the first performance order to the speaker 64 based on the music data. When receiving the performance part start message from the music sequencer, the CPU 51 acquires the part ID from the performance part start message. From the lesson information, the CPU 51 acquires motion information corresponding to the part ID acquired from the performance part start message among the part IDs corresponding to the music ID of the output music. CPU51 produces | generates an exercise | movement image | video based on the motion data corresponding to the motion information acquired from the exercise lesson information. Then, the CPU 51 outputs the generated video signal of the motion video from the display control unit 56 to the display 67.

  Further, the CPU 51 acquires from the RAM 53 the exercise level corresponding to the acquired music ID and part ID among the exercise levels set for each performance part. Next, the CPU 51 acquires a voice type corresponding to the exercise level from the support voice assignment table. When the voice type indicates exercise narration, the CPU 51 acquires exercise narration data corresponding to the motion information from the HDD 7. The CPU 51 then outputs an audio signal of exercise narration from the audio output unit 63 to the speaker 64 based on the exercise narration data. When the voice type is not exercise narration, the CPU 51 acquires support voice data of the support voice indicated by the voice type from the support voice data corresponding to the music ID and the part ID. Then, the CPU 51 causes the audio output unit 63 to output an audio signal of the support audio to the speaker 64 based on the support audio data. Note that the CPU 51 may determine the support voice based on the exercise level set for each piece of music. In this case, the CPU 51 acquires from the RAM 53 the exercise level corresponding to the acquired song ID among the exercise levels determined for each song.

  When receiving the performance end message from the music sequencer, the output terminal 5 acquires the music ID of the music in the next performance order from the lesson information. Then, the CPU 51 performs the same process as the above process. When the reproduction of all the music is completed, the CPU 51 ends the reproduction of the exercise content. Then, the CPU 51 proceeds to step S1. In step S1, if the CPU 51 determines that power-off has been requested (step S1: YES), the CPU 51 ends the process shown in FIG.

  As described above, according to the present embodiment, the CPU 51 sets the exercise level for each song based on the song level assignment table. And CPU51 determines the sound support sound which suits the set exercise level among several support sounds for every music. Therefore, as the music changes, the exercise level rises and a support voice that matches the exercise level is output. Therefore, the user can finish the exercise with a sense of fulfillment.

  In the above embodiment, the information processing apparatus of the present invention is applied to the output terminal 5. However, the information processing apparatus of the present invention may be applied to the distribution server 2. For example, the distribution server 2 may previously generate audio data for each performance part and moving image data of an exercise video for each exercise operation based on the lesson information. When the exercise lesson is performed, the distribution server 2 transmits the audio data and the moving image data to the output terminal 5 by, for example, a streaming method. As a result, the distribution server 2 causes the output terminal 5 to output the music and display the motion video. Further, the information processing apparatus of the present invention may be applied to the output terminal 5 and the distribution server 2. The output terminal 5 and the distribution server 2 may perform processing in cooperation.

1 Exercise content generation system 2 Distribution server 3 Database 5 Output terminal 7 HDD
51 CPU
52 ROM
53 RAM
56 Display Control Unit 60 Network Communication Unit 63 Audio Output Unit 68 Microphone 57 Monitor 64 Speaker 67 Display

Claims (5)

First storage means for storing a plurality of pieces of music information indicating a plurality of pieces of music composed of a plurality of performance parts;
The first exercise level of a user who exercises in response to the output of the plurality of pieces of music information stored in the first storage means is sequentially increased as the plurality of pieces of music information are sequentially output. Second storage means for storing first level information in which one exercise level is set;
The sound information that is a sound that supports a user who is exercising and is different from the music, and is sound information indicating at least one of a narration explaining exercise, a shout, and a sound effect that enhances the mood, and the plurality of pieces of music information A third storage means for storing a plurality of sound information to be output by the sound output means when
The second exercise level set for each performance part is set so that the second exercise level of the user exercising along with the song increases sequentially as the plurality of performance parts constituting the song are sequentially output. Fourth storage means for storing a plurality of level information;
Fifth storage means for storing list information in which the plurality of performance parts constituting the plurality of music pieces and the exercise motions assigned to each of the plurality of performance parts constituting the plurality of music pieces are associated with each other;
A first setting means for setting the first exercise level for each piece of music based on the first level information stored in the second storage means, and exercise according to the piece of music for which the first exercise level is set; In order to set the second exercise level corresponding to the first exercise level for each performance part so that the second exercise level of the user who goes up gradually increases as the plurality of performance parts constituting the music are sequentially output Setting means for setting the first exercise level of
Of the plurality of second level information stored in the fourth storage means, stored in the fifth storage means based on the second level information that matches the first exercise level set by the setting means. Second setting means for setting the second exercise level for each performance part indicated by the list information;
Among the plurality of sound information stored in the third storage means, the sound information that matches the second exercise level set by the second setting means is stored in the fifth storage means for each of the plurality of music pieces. Determining means for determining for each performance part indicated by the stored list information ;
An information processing apparatus comprising: The third storage means stores the first sound information indicating the narration and the second sound information which is a sound for raising mood and which indicates at least one of the shout and the sound effect. And
The determining means determines at least one of the first sound information and the second sound information stored in the third storage means, and the first sound information increases as the second motion level increases. 2. The information processing apparatus according to claim 1, wherein the sound information is determined so that a priority of output of the second sound information with respect to is increased. The information processing device is a karaoke device,
The plurality of pieces of music information stored in the first storage means are sequentially output by the sound output means, and the sound information determined by the determination means for the music output by the sound output means is used as the sound. The information processing apparatus according to claim 1, further comprising a control unit that outputs the output unit. An information processing method executed by an information processing apparatus,
The first exercise level of a user who exercises in response to the output of the plurality of pieces of music information stored in a first storage unit that stores a plurality of pieces of music information indicating a plurality of pieces of music composed of a plurality of performance parts is the plurality of pieces. On the basis of the first level information stored in the second storage means for storing the first level information in which the first exercise level for each song is set so that the music information sequentially increases as the music information is sequentially output, It is a first setting step for setting the first exercise level for each piece of music, and the second exercise level of the user exercising according to the piece of music for which the first exercise level is set is a plurality of performance parts constituting the song A setting step for setting the first exercise level for setting the second exercise level corresponding to the first exercise level for each performance part so as to sequentially increase as the sound is output sequentially. And,
A fourth memory for storing a plurality of pieces of second level information in which the second movement level is set for each performance part so that the second movement level is sequentially increased as the plurality of performance parts constituting the music are sequentially output. A plurality of performance parts constituting the plurality of musical pieces based on the second level information that matches the first exercise level set in the setting step among the plurality of second level information stored in the means; , For each performance part indicated by the list information stored in the fifth storage means for storing list information indicating the movement and movement assigned to each of the plurality of performance parts constituting the plurality of pieces of music. A second setting step for setting two exercise levels;
A sound that supports a user who exercises and is different from the music, and is sound information that indicates at least one of narration, shout, and sound effects to explain the motion, and the plurality of pieces of music information are sequentially output. The sound that matches the second motion level set by the second setting step among the plurality of sound information stored in the third storage means that stores a plurality of sound information to be output by the sound output means when being Determining the information for each performance part indicated by the list information stored in the fifth storage means for each of the plurality of music pieces;
An information processing method comprising: In the computer of the information processing device,
The first exercise level of a user who exercises in response to the output of the plurality of pieces of music information stored in a first storage unit that stores a plurality of pieces of music information indicating a plurality of pieces of music composed of a plurality of performance parts is the plurality of pieces. On the basis of the first level information stored in the second storage means for storing the first level information in which the first exercise level for each song is set so that the music information sequentially increases as the music information is sequentially output, It is a first setting step for setting the first exercise level for each piece of music, and the second exercise level of the user exercising according to the piece of music for which the first exercise level is set is a plurality of performance parts constituting the song A setting step for setting the first exercise level for setting the second exercise level corresponding to the first exercise level for each performance part so as to sequentially increase as the sound is output sequentially. And,
A fourth memory for storing a plurality of pieces of second level information in which the second movement level is set for each performance part so that the second movement level is sequentially increased as the plurality of performance parts constituting the music are sequentially output. A plurality of performance parts constituting the plurality of musical pieces based on the second level information that matches the first exercise level set in the setting step among the plurality of second level information stored in the means; , For each performance part indicated by the list information stored in the fifth storage means for storing list information indicating the movement and movement assigned to each of the plurality of performance parts constituting the plurality of pieces of music. A second setting step for setting two exercise levels;
A sound that supports a user who exercises and is different from the music, and is sound information that indicates at least one of narration, shout, and sound effects to explain the motion, and the plurality of pieces of music information are sequentially output. The sound that matches the second motion level set by the second setting step among the plurality of sound information stored in the third storage means that stores a plurality of sound information to be output by the sound output means when being Determining the information for each performance part indicated by the list information stored in the fifth storage means for each of the plurality of music pieces;
A program characterized by having executed.

Images