JP5949687B2 - Information processing apparatus and program - Google Patents

Description

The present invention relates to a technical field of outputting exercise content for supporting exercise performed by a user while listening to music.

  2. Description of the Related Art Conventionally, a technique for assigning an exercise motion to each of a plurality of performance parts constituting a music is known. For example, Patent Document 1 discloses a technique for allocating an exercise operation of an exercise type corresponding to the type of a performance part to the performance part.

JP 2012-65966 A

  In order to increase the efficiency of the generation of exercise content, it is conceivable to automatically determine the exercise operation assigned to each performance part from a plurality of exercise operations prepared in advance. However, in the conventional technique, although the motion motion suitable for each performance part can be assigned, the connection between the motion motion and the motion motion has not been considered. For this reason, there is a case in which exercise content having a sense of incongruity in the connection of exercise motion is generated.

  The present invention has been made in view of the above points, and provides an information processing apparatus and program capable of automatically allocating exercise motion to each performance part so that the connection of exercise motion becomes natural. This is the issue.

  In order to solve the above-mentioned problem, the invention according to claim 1 is configured to store music information indicating music composed of a plurality of performance parts and first attribute information indicating attributes of the plurality of performance parts. 1 storage means, a plurality of movement information indicating a plurality of movements, a second attribute information indicating an attribute of a performance part that can use the plurality of movement information, and a connection attribute indicating a connection attribute of the plurality of movement information Second storage means for storing information in association with each other, and the second operation information corresponding to the second attribute information that matches the first attribute information of the first performance part included in the plurality of performance parts. A first search means for searching from the storage means; and a next output of the first performance part corresponding to the connection attribute information matching the connection attribute information of the motion information searched by the first search means Second performance par Based on search results from the second storage means for searching for the operation information corresponding to the second attribute information that matches the first attribute information, and the search results of the first search means and the second search means. And generating means for generating list information indicating a plurality of movements suitable for the plurality of performance parts.

According to a second aspect of the present invention, the connection attribute information stored in the second storage means indicates a front connection attribute and a back connection attribute of the motion information, and the second search means is the first search. The second performance corresponding to the connection attribute information indicating the previous connection attribute that matches the back connection attribute indicated by the connection attribute information of the motion information retrieved by the means and in the next output order of the first performance part The operation information corresponding to the second attribute information that matches the first attribute information of the part is searched from the second storage unit, and the connection attribute information of the operation information searched by the second search unit indicates The second attribute information that corresponds to the connection attribute information indicating the front connection attribute that matches the back connection attribute and matches the first attribute information of the third performance part in the next output order of the second performance part. The operation corresponding to Further comprising third search means for searching for information from the second storage means, wherein the generation means generates the list information based on search results of the first search means, the second search means and the third search means. It is characterized by doing.

  According to a third aspect of the present invention, the narration information indicating the narration that supports the motor motion is associated with the plurality of motion information, and how many beats before the start of the motor motion is output. A third storage means for storing beat information; and a timing of outputting the narration information when the music information is output based on the beat information stored in the third storage means, And second generation means for generating timing information indicating the output timing of the narration information corresponding to the exercise motion indicated by the list information generated by the generation means.

  According to a fourth aspect of the present invention, the first storage means further stores first tempo information indicating the tempo of the music, and the second storage means stores second tempo information indicating the tempo of the exercise action. Further, the first search means is closest to the tempo indicated by the first tempo information stored in the first storage means among the plurality of second tempo information stored in the second storage means. The motion information corresponding to the second tempo information indicating the tempo is searched, and the second search means matches the second tempo that matches the second tempo information of the motion information searched by the first search means. The operation information corresponding to the information is searched, and the music information stored in the first storage unit is output by the output unit according to the tempo indicated by the second tempo information of the operation information searched by the first search unit. Out Characterized in that it further comprises control means for.

  According to a fifth aspect of the present invention, the first storage means stores the first attribute information indicating the number of beats of a performance part, and the second storage means stores the second attribute indicating the number of beats of an exercise action. The information is stored, and the first search means and the second search means search for the action information indicating an exercise action having a beat number that matches the beat number of the performance part.

  According to a sixth aspect of the present invention, there is provided a plurality of movement information indicating a plurality of movements, second attribute information indicating attributes of a performance part that can use the plurality of movement information, and a connection attribute of the plurality of movement information From the second storage means for storing the association attribute information indicating the music information, the music information indicating the music composed of a plurality of performance parts and the first attribute information indicating the attributes of the plurality of performance parts are stored. The operation information corresponding to the second attribute information that is the first attribute information stored in the first storage means and matches the first attribute information of the first performance part included in the plurality of performance parts. A first search step for searching, and a first output step corresponding to the connection attribute information that matches the connection attribute information of the motion information searched in the first search step and in the next output order of the first performance part. 2 performance parts Based on the second search step of searching the operation information corresponding to the second attribute information that matches the first attribute information from the second storage means, and the search results of the first search step and the second search step And a generation step of generating list information indicating a plurality of athletic movements suitable for the plurality of performance parts.

  According to the first, second, or sixth aspect of the present invention, an exercise operation having a connection attribute that matches the connection attribute of the exercise operation assigned to the previous performance part is assigned to the next performance part. For this reason, it is possible to automatically assign an exercise operation to each performance part so that the connection of the exercise operation becomes natural.

  According to the third aspect of the present invention, it is possible to output a narration corresponding to an exercise operation prior to the start of the exercise operation.

  According to the fourth aspect of the present invention, it is possible to perform an exercise operation according to the tempo of the music at a tempo close to the tempo of the music.

  According to the fifth aspect of the present invention, it is possible to assign an exercise motion that matches the beat number of the performance part to the performance part.

It is a figure showing an example of outline composition of exercise content generation system 1 of one embodiment. (A) is a figure which shows the structural example of an exercise | movement operation | movement, (B) is a figure which shows the example of allocation of component ID. (A) is a figure which shows the structural example of a components table, (B) is a figure which shows the structural example of a connection operation | movement table, (C) is a figure which shows the structural example of an exercise genre table, (D) is a figure which shows an example of the content of a narration timing file, (E) is a figure which shows an example of the content of a sound effect timing file. (A) is a figure which shows the structural example of a music, (B)-(F) is a figure which shows an example of the update process of a components list table. (A) is a flowchart showing a processing example of a main process of the CPU 51 of the output terminal 5, (B) is a flowchart showing a processing example of a selection information acquisition process of the CPU 51 of the output terminal 5, and (C). FIG. 5 is a flowchart showing an example of exercise information generation processing of the CPU 51 of the output terminal 5, and (D) is a flowchart showing an example of reproduction processing of the CPU 51 of the output terminal 5. 10 is a flowchart illustrating a processing example of a parts list generation process of a CPU 51 of the output terminal 5.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, embodiment described below is embodiment at the time of applying this invention to the exercise content production | generation system which produces | generates the exercise content for supporting exercise. The exercise content includes video and audio for supporting exercise.

[1. Configuration of Exercise Content Generation System 1]
First, the configuration of the exercise content generation system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a schematic configuration example of an exercise content generation system 1 according to the present embodiment. As shown in FIG. 1, the exercise content generation system 1 includes a distribution server 2 and one or more output terminals 5. The distribution server 2 and the output terminal 5 can be connected via the network 10. The network 10 includes, for example, the Internet. A database 3 is connected to the distribution server 2. Information relating to exercise and information relating to music are registered in the database 3. The distribution server 2 distributes information registered in the database 3 to the output terminal 5 periodically or in response to a request from the output terminal 5.

  The output terminal 5 is a terminal device installed in the facility 4, for example. The output terminal 5 is an example of an information processing apparatus of the present invention. The output terminal 5 is used by a user 41 of the facility 4. The facility 4 may be a sports facility, for example. The user 41 receives an exercise lesson at the sports facility. An exercise lesson is a lesson composed of a plurality of exercises and singing. The output terminal 5 in this case may be a personal computer, for example.

  The output terminal 5 can be connected to the monitor 57. The monitor 57 may be a display device including a plurality of speakers 64 and a display 67. In this case, the output terminal 5 can be connected to the display 67. The output terminal 5 can be connected to a speaker 64. The speaker 64 is an example of the output means of the present invention. When the output terminal 5 outputs an audio signal to the monitor 57, music or the like is output from the speaker 64. When the output terminal 5 outputs a video signal to the monitor 57, an exercise video or the like is displayed on the display 67. The motion video is a moving image that shows a figure 83 that performs the motion. The figure 83 is a virtual object in the form of, for example, a person, an animal, a virtual creature, or a robot. The figure 83 is arranged in a three-dimensional virtual space. The output terminal 5 outputs a signal so that the music output from the speaker 64 and the movement of the figure 83 displayed on the display 67 are synchronized. Outputting music and motion video is an example of outputting motion content. The user 41 can exercise while watching the figure 83 displayed on the display 67 while listening to the music. The operator 42 can operate the output terminal 5 using the remote controller 66 or the like. The user 41 and the operator 42 may be the same person. When the facility 4 is a sports facility, the operator 42 may be an instructor, for example.

[2. Assignment of motor movement to performance part]
The exercise content output by the monitor 57 when an exercise lesson is performed includes at least music and an exercise video. The exercise content may include narration, sound effects, and the like. Details of narration and sound effects will be described later. The music is composed of a plurality of performance parts. The music is output from the speaker 64 in the order of performance parts according to the composition of the music. The order in which the performance parts are output is called the performance order. Each performance part may be, for example, a prelude, an A melody, a B melody, a chorus, an interlude or a posterior. A plurality of music pieces may be sequentially output from the speaker 64 in one exercise lesson. An exercise motion is assigned to each performance part constituting the music. The exercise operation is an operation for training the body, for example. Examples of the exercise operation include a gymnastic operation and a dance operation. The gymnastic exercise is, for example, an exercise performed for promoting health, strengthening physical strength, strengthening muscle strength, and the like. Examples of gymnastic exercises include aerobic exercise, anaerobic exercise, and stretching. The dance motion is a motion that is choreographed to the music to dance to the music. When outputting the exercise content, the output terminal 5 causes the display 67 to display an exercise image in which the figure 83 performs the exercise operation assigned to the performance part output by the speaker 64.

  As shown in FIG. 1, motion data is registered in the database 3. The motion data is data that defines the motion motion of the figure 83 in the three-dimensional virtual space. Further, the motion data is data for causing the figure 83 displayed on the display 67 to perform an exercise motion. The motion data includes the coordinates of each part of the body of the figure 83 according to the progress of the motion movement. Specifically, the motion data includes the coordinates of the body part of the figure 83 according to the progress of the motion movement in time series. The body part of the figure 83 is displayed according to the motion data along the time series, so that an image of the figure 83 that performs a predetermined exercise operation is displayed on the display 67. In the present embodiment, the output terminal 5 displays a three-dimensional image of the figure 83 on the display 67 as a motion image. However, the output terminal 5 may display a two-dimensional image of the figure 83. Each motion data has versatility, for example. For example, each motion data may be created in advance so that it can be used for various musical pieces. The output terminal 5 automatically determines a motion ID to be assigned to each performance part from among motion IDs that can identify a plurality of motion data registered in the database 3. The motion ID is associated with attribute information indicating a predetermined attribute and stored in a predetermined storage unit.

  If the attributes of the motion ID match the attributes of the music piece and the performance part, basically the motion ID can be assigned to the performance part. As attributes of the motion ID, for example, there are the number of beats indicating the length of the motion, the type of performance part that can be assigned, the tempo of the motion, and the like. As an attribute of the music, for example, there is a tempo. The performance part attributes include, for example, the number of beats and the performance part type. However, as described above, motion data is created so that it can be used for various musical pieces. For this reason, if the connection between consecutive motor movements is not taken into consideration, the motor content with a sense of incongruity in the connection of motor movements is generated. For example, a March motion ID is assigned to the prelude, and a squat motion ID is assigned to the A melody played after the prelude. In this case, the figure 83 displayed on the display 67 performs a march operation in the prelude. Thereafter, when the performance is switched from the prelude to the A melody, the operation of the figure 83 is suddenly switched from the march to the squat. It may be difficult for the user 41 exercising while looking at the displayed figure 83 to naturally shift the exercise operation from the march to the squat.

  Therefore, in the present embodiment, a connection attribute is defined for the motion ID indicating each motion data so that the motion is naturally connected. This embodiment will be described using an example in which a connection attribute is defined for a component ID associated with a motion ID. Note that a connection attribute may be defined for the motion ID instead of the component ID. For example, each motion data may be created in advance so that an image of the figure 83 that sequentially executes the front connection operation, the main operation, and the back connection operation is displayed. The main operation is an operation mainly performed in the motion data. For example, the number of beats of the main operation is longer than the number of beats of the front connection operation and the back connection operation. The pre-joining operation is an exercise operation performed in the last part when a performance part in the order of performance is output before a performance part to which a part ID indicating motion data or a motion ID is assigned. The post-joining operation is an exercise operation performed at the last part of the performance part to which the component ID indicating the motion data or the motion ID is assigned. The sum of the number of beats of the main operation and the number of beats of the connecting operation matches the number of beats of the performance part to which the component ID can be assigned.

  The connection attribute is a kind of component ID attribute. The connection attribute may be a kind of attribute of motion ID. As connection attributes, there are a front connection attribute and a back connection attribute. The previous connection attribute indicates the content of the previous connection operation. The back connection attribute indicates the content of the back connection operation. For example, assume that the front joining operation is a march, the main operation is a front lunge, and the back joining operation is a step. In this case, the front connection attribute indicates a march, and the rear connection attribute indicates a step.

  Motion data is created so that the front connection operation and the main operation are naturally connected, and the main operation and the back connection operation are naturally connected. For example, an acceleration sensor for acquiring the coordinates of a body part in a three-dimensional space is attached to a body such as an instructor. For example, acceleration sensors are attached to wrists, elbows, shoulders, bases of feet, knees, ankles, and the like. An instructor or the like performs an exercise operation composed of a front connecting operation, a main operation, and a rear connecting operation. Based on the acceleration information detected by the acceleration sensor, for example, a predetermined device acquires the coordinates of each body part when exercise motion is performed at predetermined time intervals. Then, based on the acquired coordinates, motion data is created. The predetermined device may be, for example, the output terminal 5, the distribution server 2, or the like.

  FIG. 2A is a diagram showing a configuration example of a motion operation called front lunge A. FIG. The front connecting operation, main operation, and rear connecting operation of the front lunge A are a march, a front lunge, and a step, respectively. Front lunge A is a motion action for a performance part of 64 beats. In the example of FIG. 2A, the number of beats of the front lunge of the main operation is 60, and the number of beats of the step of the front joint operation and the step of the back joint operation is 4, respectively. Note that the number of beats of the front connecting operation and the rear connecting operation may be any number of beats. Further, the front connecting operation, the main operation, and the rear connecting operation may be different motion operations. In addition, at least two of the front connection operation, the main operation, and the rear connection operation may be the same exercise operation. The motion data indicated by the component ID assigned to the first performance part among the plurality of performance parts constituting the music piece may be created so that only the main operation and the back connection operation are displayed. Also, the motion data indicated by the component ID assigned to the performance part to be played last may be created so that only the video of the front connection operation and the main operation is displayed.

  The output terminal 5 first searches for a component ID that can be assigned to the first performance part in the performance order. Specifically, the output terminal 5 searches for a component ID having an attribute that matches the attribute of the first performance part. Next, the output terminal 5 searches for a part ID that can be assigned to the second performance part. At this time, the output terminal 5 considers the connection attribute. Specifically, the output terminal 5 is a component ID having a front connection attribute that matches the rear connection attribute that can be assigned to the first performance part, and matches the attribute of the second performance part. Search for a component ID having an attribute. Next, the output terminal 5 searches for a part ID that can be assigned to the third performance part. Specifically, the output terminal 5 is a component ID having a front connection attribute that matches the back connection attribute of the component ID that can be assigned to the second performance part, and matches the attribute of the third performance part. Search for a component ID having an attribute. The output terminal 5 similarly searches for the component ID for the fourth and subsequent performance parts.

  The output terminal 5 generates a parts list based on the part ID search result for each performance part. The parts list is information that defines the structure of an exercise lesson. Specifically, the component list indicates a plurality of component IDs that match a plurality of performance parts constituting the music. In the parts list, a performance part ID, a part ID, and the like are stored for each performance part. The performance part ID is performance part identification information. For example, the performance part ID may indicate the performance order of performance parts identified from a plurality of performance parts constituting the music. The component ID is identification information for identifying motion data. For example, the motion motion is identified by the component ID. The component ID and the performance part ID of the performance part to which the component ID is assigned are associated with each other and stored in the component list. The component ID is an example of operation information in the present invention. For example, instead of the component ID, a motion ID or motion data may be used as the operation information of the present invention.

  FIG. 2B is a diagram illustrating an example of component ID assignment. In FIG. 2B, a certain musical piece includes performance parts 1 to 3. The performance part 1 is the first performance part, the performance part 2 is the second performance part, and the performance part 3 is the third performance part. The performance part 1 has 32 beats. The output terminal 5 assigns, for example, a component ID associated with the motion ID of March B to the performance part 1. March B is a 32-beat movement. The main operation and the back-joining operation of March B are both March. Therefore, the trailing attribute of March B indicates March. The performance part 2 has 64 beats. The output terminal 5 assigns to the performance part 2 a part ID whose front connection attribute indicates march among the part IDs associated with the motion ID indicating the 64-beat motion. For example, the part ID of the front lunge A shown in FIG. The March, which is the post-joining operation of the March B, and the March, which is the pre-joining operation of the front lunge A, are basically the same operation. The performance part 3 has 32 beats. The trailing attribute of the front lunge A indicates a step. The output terminal 5 assigns to the performance part 2 a component ID whose front connection attribute indicates a step among the component IDs associated with the motion ID indicating the 32-beat motion. For example, a component ID associated with the motion ID of squat C is assigned. The squat C front splicing operation and main operation are step and squat, respectively. The step that is the connecting operation of the front lunge A and the step that is the connecting operation of the squat C are basically the same operation.

  Assume that exercise content is generated based on the assignment result shown in FIG. In this case, while the exercise content is being output, while the 32 beats of the performance part 1 are being output, the output terminal 5 causes the display 67 to display a video on which the figure 83 performs a March based on the motion data of March B. Note that, during the last four beats of the performance part 1, the output terminal 5 may cause the display 67 to display a video for performing a march based on the motion data of the front range A. Further, when motion data is generated from an actual motion of a human by using an acceleration sensor or the like, there is a case where a shift occurs between the march of the marching B's back-joining operation and the front-running A's front-joining motion. Therefore, the output terminal 5 may display on the display 67 an image for performing an intermediate operation between the March B back-joining operation March and the Front Range A front-joining operation March using both motion data. Good.

  Next, when the first 60 beats of the performance part 2 are output, the output terminal 5 displays a video for performing the front lunge based on the motion data of the front lunge A. When the performance part 1 is switched to the performance part 2, the figure 83 is displayed so as to be naturally connected from the march to the front lunge. The reason is that the connection attribute of the part ID of the March B and the front connection attribute of the part ID of the front range A indicate the same march. When the figure 83 starts the front lunge, which is the main operation of the front lunge A, the motion data of the front lunge A is created in advance so that the front lunge, which is the main motion, is naturally connected from the marching, which is the front linkage operation. . When the last four beats of the performance part 2 are being output, the output terminal 5 displays a video for performing the step based on the motion data of the front lunge A, for example. Next, when the performance part 3 is being output, the output terminal 5 displays a video for performing the squat based on the motion data of the squat C. When switching from the front lunge to the step and when switching from the step to the squat, the figure 83 is displayed so as to be connected naturally. In this way, the motion movement from the front lunge A to the squat C is naturally connected.

  Next, information used for assigning a component ID and generating a component list will be described. In order to generate a parts list, an HDD (hard disk drive) 7 of the output terminal 5 stores a parts table, a joining operation table, an exercise genre table, and the like. FIG. 3A is a diagram illustrating a configuration example of a component table. The component table is table information that defines component attributes, connection attributes, and the like. The component table includes a component ID, component name, performance part type, beat number, exercise tempo, front connection attribute ID, back connection attribute ID, genre ID, motion ID, narration timing ID, sound effect timing ID, and the like. Stored for each.

  The component ID is identification information that can identify motion data. The part name is a name of the motion motion indicated by the motion data. The performance part type is a type of performance part to which a component ID can be assigned. In FIG. 3A, for example, ptypes 1 to 5 are stored as performance part types. For example, ptype1 may be a prelude, ptype2 may be an A melody + rust, ptype3 may be an interlude, ptype4 may be an A melody + B melody, and ptype5 may be a posterior. The beat number indicates the length of the movement. The number of beats stored in the parts table is an example of second attribute information in the present invention.

  The exercise tempo is a tempo at which an exercise operation is performed. For example, a plurality of exercise tempos are predetermined. For example, the exercise tempo may be determined at intervals of a predetermined number of beats. In the example of FIG. 3A, the parts table indicates that motion data corresponding to 128 BPM, motion data corresponding to 144 BPM, and the like are registered. Each motion data is created in advance so that an image in which the figure 83 exercises at any one of a plurality of exercise tempos is displayed. In the database 3, motion data corresponding to each of a plurality of exercise tempos is registered for each performance part type. The parts table stores an exercise tempo corresponding to the motion data. The tempo stored in the parts table is an example of second tempo information in the present invention.

  The front connection attribute ID is identification information indicating the front connection attribute. The back connection attribute ID is identification information indicating a back connection attribute. FIG. 3B is a diagram illustrating a configuration example of the splicing operation table. The splicing operation table is table information that defines splicing attributes. In the splicing operation table, splicing operation IDs are stored. In FIG. 3B, for example, c1 to c5 are stored as the connection operation ID. For example, c1 is a march, c2 is a step, c3 is a stance, c4 is a squat, and c5 is upright. The front connection attribute ID and the back connection attribute ID are examples of connection attribute information in the present invention. For example, a plurality of front connection attribute IDs or a plurality of back connection attribute IDs may be stored in association with one component ID.

  The genre ID is identification information of the genre of the exercise to which the exercise motion belongs. FIG. 3C is a diagram illustrating a configuration example of the exercise genre table. The exercise genre table is table information that defines an exercise genre. Genre ID is stored in the exercise genre table. In FIG. 3C, for example, j1, j2, etc. are stored as genre IDs. For example, j1 is an aerobic exercise and j2 is an adjustment exercise. The motion ID is identification information of motion data. The component ID and the motion ID basically correspond one to one. For example, only one of a component ID and a motion ID may be stored in the component table. The narration timing ID and sound effect timing ID will be described later.

  Next, a method for generating a component list when the component table shown in FIG. FIG. 4A is a diagram illustrating a configuration example of a music piece. As shown in FIG. 4A, the music piece X is composed of performance parts 1-8. The output terminal 5 determines an exercise tempo when reproducing exercise content based on the tempo of the music. The music is output according to the exercise tempo, and the display 67 displays a figure 83 that moves according to the exercise tempo. As described above, motion data corresponding to each of a plurality of predetermined exercise tempos is registered. The output terminal 5 determines the tempo closest to the tempo of the music among the plurality of exercise tempos as the exercise tempo used for reproducing the exercise content. For example, it is assumed that the exercise tempo is defined as a multiple of 16 BPM, and the tempo of the music X is 125 BPM. In this case, 128 BPM is determined as the exercise tempo used for reproducing the exercise content. Also, the exercise genre is determined. For example, the operator 42 may select the exercise genre, or the output terminal 5 may determine the exercise genre. For example, it is assumed that aerobic exercise is selected as the exercise genre.

  4B to 4F are diagrams illustrating an example of the update process of the parts list table. The parts list table is table information for storing one or more parts lists being generated. Information on each line of the parts list table corresponds to a parts list. Each column of the parts list table corresponds to a performance part. The output terminal 5 searches the component table for a component ID corresponding to an attribute that matches the attribute of the performance part 1 and the attribute of the music piece X. Retrieving the component ID from the component table is retrieving motion data indicated by the component ID from the HDD 7. The performance part attributes are the performance part type and the number of beats, and the performance part type and the number of beats of the performance part 1 are ptype1 and 32. The attributes of the music are tempo and exercise genre, and the tempo and exercise genre of music X are 128 BPM and aerobic exercise. Accordingly, the output terminal 5 searches the part table for the part ID corresponding to ptype1, 32 beats, 128 BPM, and aerobic exercise as a candidate part ID. In the parts table, the part IDs of the exercise operations 1-1 to 1-3 correspond to ptype1, 32 beats, 128 BPM, and aerobic exercise. The output terminal 5 generates a parts list table in which the performance part 1 is associated with the retrieved part ID. FIG. 4B is an example of a component list table storing component IDs of performance candidate 1 assignment candidates. As shown in FIG. 4B, the component IDs of the motion operations 1-1 to 1-3 are stored in the first columns of the first to third rows of the component list table.

  The performance part type and the number of beats of performance part 2 are ptype2 and 64. Accordingly, the output terminal 5 searches the part table for the part ID corresponding to ptype2, 64 beats, 128 BPM, and aerobic exercise as an assignment candidate part ID. In the parts table, the part IDs of the exercise operations 2-4 to 2-9 correspond to ptype2, 64 beats, 128 BPM, and aerobic exercise. At this time, the output terminal 5 searches the component table for the component ID corresponding to the front connection attribute ID that matches the back connection attribute ID of the exercise operations 1-1 to 1-3. The back connection attribute ID of the exercise operation 1-1 matches the front connection attribute ID of the exercise operations 2-4 and 2-5. Therefore, the output terminal 5 adds one row for storing the component ID of the exercise operation 1-1 to the component list table. The output terminal 5 stores the component ID of the exercise operation 2-4 in the second column of one of the two rows storing the component ID of the exercise operation 1-1. The output terminal 5 stores the component ID of the exercise operation 2-5 in the second column of the other row of the two rows storing the component ID of the exercise operation 1-1. The back connection attribute ID of the exercise action 1-2 matches the front connection attribute ID of the exercise actions 2-6 and 2-7. Further, the back connection attribute ID of the exercise action 1-3 matches the front connection attribute ID of the exercise actions 2-8 and 2-9. The output terminal 5 performs the same process as the exercise operation 1-1 for the exercise operations 1-2 and 1-3. Then, the parts list table is updated as shown in FIG. At this time, the number of rows in the parts list table is six.

  The performance part type and the number of beats of performance part 3 are ptype3 and 32. Accordingly, the output terminal 5 searches the part table for the part ID corresponding to ptype3, 32 beats, 128 BPM, and aerobic exercise as an assignment candidate part ID. The part IDs of the exercise operations 3-1 and 3-2 correspond to ptype3, 32 beats, 128 BPM, and aerobic exercise. At this time, the output terminal 5 searches the component table for the component ID corresponding to the front connection attribute ID that matches the back connection attribute ID of the exercise operations 2-4 to 2-9. The back connection attribute ID of the exercise operation 2-4 matches the front connection attribute ID of the exercise operation 3-1. Therefore, the output terminal 5 stores the component ID of the exercise operation 3-1 in the third column of the row storing the component ID of the exercise operation 2-4. The back link attribute ID of the exercise motions 2-5, 2-6, and 2-8 matches the front link attribute ID of the motion motion 3-2. Therefore, the output terminal 5 stores the component ID of the exercise operation 3-1 in the third column of each row storing the component IDs of the exercise operations 2-5, 2-6, and 2-8. There is no component ID corresponding to the front connection attribute ID that matches the back connection attribute ID of the motion motion 2-7. Further, there is no component ID corresponding to the front connection attribute ID that matches the back connection attribute ID of the exercise motion 2-9. Therefore, the output terminal 5 deletes the respective rows storing the component IDs of the exercise operation 2-7 and the exercise operation 2-9 from the component list table. Then, the parts list table is updated as shown in FIG.

  The performance part type and the number of beats of the performance part 4 are ptype4 and 32. Accordingly, the output terminal 5 searches the part table for the part ID corresponding to ptype4, 32 beats, 128 BPM, and aerobic exercise. The part IDs of the exercise operations 4-1 and 4-2 correspond to ptype4, 32 beats, 128 BPM, and aerobic exercise. At this time, the output terminal 5 searches the component table for the component ID corresponding to the front connection attribute ID that matches the back connection attribute ID of the exercise operations 3-1 and 3-2. The trailing attribute ID of the exercise motion 3-1 matches the front linkage attribute ID of the exercise motion 4-1, and the trailing attribute ID of the exercise motion 3-2 matches the front linkage attribute ID of the exercise motion 4-2. To do. The output terminal 5 updates the parts list table based on the search result as shown in FIG.

  The performance part type and the number of beats of performance part 5 are ptype2 and 32. ptype2 is also a performance part type of performance part 2. In other words, for the performance part having the same performance part type as the performance part 5, the allocation candidate part ID has already been searched. In this case, the output terminal 5 determines only the searched component IDs as allocation candidates. In other words, the output terminal 5 performs the same exercise operation when performance parts of the same type are output. The reason for this is to promote the improvement of the exercise operation by causing the user 41 to repeatedly perform the same exercise operation. Specifically, only when the front connection attribute ID of the performance part 2 assignment candidate matches the rear connection attribute ID of the performance part 4 assignment candidate, the output terminal 5 sets the performance part 2 assignment candidate as the performance part. 5 allocation candidates are determined. Note that the output terminal 5 assigns a part ID that is different from the performance part 2 assignment candidate among the part IDs whose front connection attribute ID matches the back connection attribute ID of the performance part 4 assignment candidate to the performance part 5 assignment candidate. You may decide to.

  The first row of the parts list table stores the part IDs of the exercise action 1-1, the exercise action 2-4, the exercise action 3-1, and the exercise action 4-1. The back link attribute ID of the exercise motion 4-1 matches the front link attribute ID of the motion motion 2-4. Therefore, the output terminal 5 stores the component ID of the exercise operation 2-4 in the fifth column of the first row in the component list table. The second row of the parts list table stores the part IDs of the exercise action 1-1, the exercise action 2-5, the exercise action 3-2, and the exercise action 4-2. The back link attribute ID of the exercise motion 4-2 does not match the front link attribute ID of the motion motion 2-5. Therefore, the output terminal 5 deletes the second row. The third row of the parts list table stores the part IDs of the exercise action 1-2, the exercise action 2-6, the exercise action 3-2, and the exercise action 4-2. The back link attribute ID of the motion motion 4-2 matches the front link attribute ID of the motion motion 2-6. Therefore, the output terminal 5 stores the component ID of the motion operation 2-6 in the fifth column of the third row in the component list table. The fourth row of the parts list table stores the part IDs of the exercise action 1-3, the exercise action 2-8, the exercise action 3-2, and the exercise action 4-2. The back link attribute ID of the exercise motion 4-2 does not match the front link attribute ID of the motion motion 2-8. Therefore, the output terminal 5 deletes the fourth row.

  The output terminal 5 also updates the parts list table for the performance parts 6 to 8 in the same manner as described above. Then, the parts list table is updated as shown in FIG. In this way, a parts list indicating a plurality of movements suitable for a plurality of performance parts constituting the music piece X is generated. The number of rows in the parts list table shown in FIG. 4 (F) is two. Therefore, two parts lists are generated. When a plurality of parts lists are generated, for example, the user may select a parts list used for playing the exercise content, or the output terminal 5 may automatically select them.

[3. Narration and sound effect output timing]
The output terminal 5 can include voices such as narration and sound effects that support the exercise motion of the user 41 in the exercise content. The narration explains, for example, an exercise operation or instructs how to move the body. The sound effect may be, for example, a sound that is output in accordance with a human movement when performing a motion. For example, a sound of a fist hitting an object or a sound of a fist cutting the wind may be output in accordance with the punching operation. The sound effect may be, for example, a clapping sound, a clapping sound, a cheering sound, and the like.

  The HDD 7 of the output terminal 5 stores narration data, sound effect data, a narration timing file, and a sound effect timing file. Narration data is audio data for outputting narration. The sound effect data is sound data for outputting a sound effect. The narration timing file is a file indicating the output timing of the narration. The narration timing file is an example of beat information in the present invention. The sound effect timing file is a file indicating the output timing of the sound effect. Narration data, sound effect data, a narration timing file, and a sound effect timing file corresponding to the movement are created in advance for each movement.

  FIG. 3D shows an example of the contents of the narration timing file. In the narration timing file, the beat number and the narration data path are set in association with each other. The number of beats is the number of beats that elapse after the output of the corresponding performance part is started until the output of the narration is started. When the beat number is 0, the output terminal 5 starts outputting the narration simultaneously with the start of the output of the corresponding performance part. When the beat number is a positive value, the output terminal 5 starts outputting narration when the time corresponding to the beat number has elapsed after the output of the corresponding performance part has started. When the beat number is a negative value, the output terminal 5 starts outputting narration before the time corresponding to the beat number before the output of the corresponding performance part is started. The reason why the negative value is set is that it is necessary to output a narration corresponding to the motion motion before the motion motion assigned to the corresponding performance part is performed. The path is a character string indicating the location of the narration data in the HDD 7.

  In the example of FIG. 3D, four narration data are reproduced. First, playback of narration data 1 is started 8 beats before the start of output of the corresponding performance part. In addition, the reproduction of the narration data 2 is started after one beat has elapsed since the output of the corresponding performance part is started. In addition, the reproduction of the narration data 3 is started after 9 beats have passed since the output of the corresponding performance part is started. In addition, the reproduction of the narration data 4 is started after 13 beats have passed since the output of the corresponding performance part is started.

  FIG. 3E shows an example of the contents of a sound effect timing file. In the sound effect timing file, the beat number and the sound effect data path are set in association with each other. The number of beats and the meaning of the pass are basically the same as in the case of the narration timing file. For example, a negative number of beats may not be set in the sound effect timing file.

  The narration timing ID stored in the parts table shown in FIG. 3A is identification information of a narration timing file corresponding to the motion motion. The sound effect timing ID stored in the parts table is identification information of a sound effect timing file corresponding to the exercise operation.

[4. Configuration of each device]
Next, the configuration of each device included in the athletic content generation system will be described with reference to FIG.

[4-1. Configuration of distribution server 2]
As shown in FIG. 1, the distribution server 2 includes a CPU 21, ROM 22, RAM 23, bus 24, I / O interface 25, display control unit 26, disk drive 28, network communication unit 30, and HDD 37. The CPU 21 is connected to the ROM 22, RAM 23, and I / O interface 25 via the bus 24. The CPU 21 controls each unit of the distribution server 2 by executing a program stored in the ROM 22 or the HDD 37. Connected to the I / O interface 25 are a database 3, a display control unit 26, a disk drive 28, a network communication unit 30, a keyboard 31, a mouse 32, and an HDD 37. The CPU 21 accesses the database 3 via the I / O interface 25. The display control unit 26 outputs a video signal to the monitor 27 based on the control of the CPU 21. The disk drive 28 writes data to and reads data from the recording medium 29. The network communication unit 30 performs control for the distribution server 2 to connect to the network 10. The HDD 37 stores an OS, various control programs, and the like.

  The database 3 includes data such as music data, motion data, parts table, splicing operation table, exercise genre table, narration data, narration timing file, sound effect data, sound effect timing file, chorus data, lyrics data, title image data, etc. Is registered.

  The music data is performance data for outputting music from the speaker 64. The music data may be, for example, data in MIDI (Musical Instrument Digital Interface) format. The song data includes information such as the song ID, song name, artist name, original tempo, and composition of the performance part of the song. The music ID is music identification information. The original tempo is an example of first tempo information in the present invention. In addition, the music data defines the timing of switching performance parts. For example, if the music data is data in the MIDI format, the music data can include a meta event in addition to the MIDI event as actual performance data. Examples of the meta event include a performance part start event. The performance part start event is an event that notifies the performance start of the performance part. The performance part start event includes the performance part part ID, performance part type, beat number, and the like. The number of beats included in the performance part start event is an example of first attribute information in the present invention. The music data is an example of music information in the present invention.

  The motion data is registered in association with the motion ID. The motion data may be registered in association with the component ID, for example. The data format of the narration data and sound effect data may be, for example, WAV (RIFF waveform Audio Format), AAC (Advanced Audio Coding), MP3 (MPEG Audio Layer-3), or the like. The narration timing file is registered in association with the narration timing ID. The sound effect timing file is registered in association with the sound effect timing ID.

  The chorus data is sound data for outputting chorus sound. The chorus data is stored in association with the song ID of the song to which the chorus corresponds and the chorus timing information. The chorus timing information indicates the output timing of the chorus. The lyrics data is data for displaying lyrics telop. The lyric data includes, for example, lyric text, text display timing, and the like. The lyric data is stored in association with the music ID of the music corresponding to the lyrics. The title image data is image data for displaying an image of a title corresponding to the music. The title image data is stored in association with the music ID of the music corresponding to the title image.

[4-2. Configuration of output terminal 5]
As shown in FIG. 1, the output terminal 5 includes a CPU 51, a ROM 52, a RAM 53, a bus 54, an I / O interface 55, a display control unit 56, a disk drive 58, a network communication unit 60, an audio output unit 63, and a signal receiving unit. 65 and HDD 7. The CPU 51 is connected to the ROM 52, RAM 53, and I / O interface 55 via the bus 54. The CPU 51 has a clock function and a timer function. The CPU 51 controls each unit of the output terminal 5 by executing a program stored in the ROM 52 or the HDD 7. Connected to the I / O interface 55 are an HDD 7, a display control unit 56, an audio output unit 63, a disk drive 58, a network communication unit 60, a keyboard 61, a mouse 62, and a signal receiving unit 65. The display control unit 56 outputs a video signal to the monitor 57 based on the control of the CPU 51. The audio output unit 63 outputs an audio signal to the monitor 57 based on the control of the CPU 51. The disk drive 58 writes and reads data to and from the recording medium 59. The signal receiving unit 65 receives a signal output from the remote controller 66. The remote controller 66 is for the operator 42 to operate the output terminal 5.

  The HDD 7 is an example of a first storage unit, a second storage unit, and a third storage unit of the present invention. The first storage unit, the second storage unit, and the third storage unit may be the same storage device, or may be different storage devices. In the HDD 7, music data distributed from the distribution server 2, motion data, parts table, splicing operation table, exercise genre table, narration data, narration timing file, sound effect data, sound effect timing file, chorus data, lyrics data, Data such as title image data is stored. Also, the HDD 7 stores the generated parts list.

  The HDD 7 further stores various programs such as an OS, an exercise support program, a 3D engine, and a music sequencer. The exercise support program is a program for supporting the exercise of the user 41. The exercise support program causes the CPU 51 as a computer to execute at least a first search step, a second search step, and a generation step. The 3D engine is a program for generating an image obtained by projecting a figure 83 that moves in a three-dimensional virtual space onto a two-dimensional plane based on motion data. The process of generating an image includes projective transformation, clipping, hidden surface removal, shading, texture mapping, and the like. The CPU 51 executes the 3D engine and sequentially generates still images. The CPU 51 sequentially outputs the generated still image to the display control unit 56, whereby a motion image is displayed on the display 67.

  The music sequencer is a program for reproducing music data. The CPU 51 generates a sound signal corresponding to the music data by executing the music sequencer. Further, the CPU 51 generates various events by executing the music sequencer. As an event, for example, there is an event that occurs at a predetermined time interval according to the tempo. This event is called a MIDI clock or synchronization event. As an event, for example, there is a performance part start event.

  Various programs may be downloaded from the server such as the distribution server 2 via the network 10, for example. Various programs may be recorded on the recording medium 59 and read via the disk drive 58. The 3D engine and the music sequencer may be dedicated hardware instead of a program. The output terminal 5 may include a 3D engine or a music sequencer as hardware.

  The CPU 51 outputs an audio signal corresponding to the music data to the audio output unit 63 and outputs a video signal corresponding to the generated image from the display control unit 56 according to the set tempo. Based on the synchronization event, the CPU 51 synchronizes the output timing of the music audio signal and the output timing of the motion video signal. As a result, a figure 83 that performs an exercise motion in synchronization with the music output from the speaker 64 is displayed on the display 67.

[5. Operation of Exercise Content Generation System 1]
Next, operations of the exercise content generation system 1 will be described with reference to FIGS. FIG. 5A is a flowchart illustrating a processing example of the main processing of the CPU 51 of the output terminal 5. For example, the operator 42 performs an operation for starting an exercise lesson with the remote controller 66 or the like. Then, the CPU 51 starts main processing.

  As shown in FIG. 5A, the CPU 51 executes selection information acquisition processing (step S1). In the selection information acquisition process, the CPU 51 acquires information necessary for generating a parts list. Details of the selection information acquisition process will be described later. Next, the CPU 51 executes a parts list generation process (step S2). In the parts list generation process, the CPU 51 generates a parts list. Details of the parts list generation processing will be described later. Next, the CPU 51 executes exercise information generation processing (step S3). In the exercise information generation process, the CPU 51 generates exercise information based on the generated parts list. The exercise information is information used for reproducing exercise content. The exercise information indicates the timing when the output of video and audio included in the exercise content is started when the music is being output. Examples of video and audio whose output timing is indicated by exercise information include exercise video, narration, sound effects, chorus, lyrics, and title images. The output timing may be indicated by a playback position, for example. The reproduction position is a time that has elapsed since the reproduction of the music included in the exercise content is started. The exercise information includes, for example, a plurality of records. Each record indicates a path and a reproduction position. The path is a data path used for video or audio output. Examples of data used for video or audio output include motion data, narration data, sound effect data, chorus data, lyrics data, title image data, and the like. The playback position indicates the timing at which video or audio is output. Details of the exercise information generation process will be described later. Next, the CPU 51 executes a reproduction process (step S4). In the reproduction process, the CPU 51 reproduces the exercise content based on the generated exercise information. Details of the reproduction process will be described later. CPU51 complete | finishes a main process, after finishing the process of step S4.

  FIG. 5B is a flowchart illustrating a processing example of selection information acquisition processing of the CPU 51 of the output terminal 5. As shown in FIG. 5B, the CPU 51 acquires music information (step S11). Specifically, the CPU 51 determines the music used for the exercise lesson. For example, the operator 42 may select a song, and the CPU 51 may accept a selection result input by the operator 42. CPU51 acquires music ID of the determined music. Further, the CPU 51 acquires the original tempo of the music and the performance part start event of each performance part constituting the music from the music data of the determined music.

  Next, the CPU 51 determines an exercise tempo used for reproducing exercise content (step S12). For example, the CPU 51 determines a tempo closest to the original tempo of the music among a plurality of predetermined exercise tempos as an exercise tempo used for reproducing the exercise content. For example, assume that a plurality of exercise tempos are stored in the HDD 7. The CPU 51 acquires each exercise tempo from the HDD 7. For each acquired exercise tempo, the CPU 51 calculates the difference between the exercise tempo and the original tempo of the music. Then, the CPU 51 determines the exercise tempo with the smallest difference as the exercise tempo used for reproducing the exercise content.

  Next, the CPU 51 determines an exercise genre (step S13). For example, the operator 42 may select an exercise genre and the CPU 51 may accept the selection result. When finishing the process of step S13, the CPU 51 ends the selection information acquisition process.

  FIG. 6 is a flowchart illustrating a processing example of the parts list generation processing of the CPU 51 of the output terminal 5. As shown in FIG. 6, the CPU 51 sets the performance order N to 1 (step S41). Next, based on the performance part start event acquired by the selection information acquisition process, the CPU 51 has the same performance part type as the performance part of the performance order N among the performance parts of the performance order 1 to the performance order N-1. It is determined whether or not there is a certain performance part (step S42). At this time, if the CPU 51 determines that there is a performance part having the same performance part type as the performance part in the performance order N (step S42: YES), the CPU 51 proceeds to step S50. On the other hand, when the CPU 51 determines that there is no performance part having the same performance part type as the performance part N in the performance order (step S42: NO), the CPU 51 proceeds to step S43. The CPU 51 also proceeds to step S43 when the performance order N is 1.

  In step S43, the CPU 51 performs the selected exercise genre, the performance part type of the performance part in the performance order N, the number of beats of the performance part in the performance order N, the exercise genre that matches the determined exercise tempo, the performance part type, and the beat. The component ID corresponding to the number and tempo is searched from the component table. Next, the CPU 51 determines whether or not the performance order N is greater than 1 (step S44). At this time, if the CPU 51 determines that the performance order N is greater than 1 (step S44: YES), the CPU 51 proceeds to step S45. On the other hand, if the CPU 51 determines that the performance order N is not greater than 1 (step S44: NO), the CPU 51 proceeds to step S49.

  In step S45, the CPU 51 sets the row number K of the parts list table to 1. Next, based on the component table, the CPU 51 selects a pre-connection that matches the post-connection attribute ID corresponding to the component ID of the performance part assignment candidate K in the performance order N-1 from the component IDs retrieved in step S43. A part ID corresponding to the attribute ID is searched (step S46). The part ID of the performance part assignment candidate K in the performance order N-1 is the part ID stored in the (N-1) th column of the Kth row in the parts list table. Next, the CPU 51 adds 1 to the row number K (step S47). Next, the CPU 51 determines whether or not the row number K is equal to or less than the row number R (step S48). The number of rows R is the number of rows in the parts list table at the current time. At this time, if the CPU 51 determines that the line number K is equal to or less than the number of lines R (step S48: YES), the CPU 51 proceeds to step S46. On the other hand, if the CPU 51 determines that the line number K is not less than the number of lines R, that is, the line number K is greater than R (step S48: NO), the CPU 51 proceeds to step S49.

  In step S49, the CPU 51 updates the parts list table. When the performance order N is 1, the CPU 51 generates a component list table that stores the component ID searched in step S43. When the performance order N is 2 or more, the CPU 51 updates the parts list based on the search result of step S46. Specifically, when the component ID is retrieved in step S46, the CPU 51 stores the retrieved component ID in the Nth column of the corresponding row. When a plurality of component IDs are retrieved for one row, the CPU 51 adds a row having the same content to the component list table. Then, the CPU 51 stores a plurality of retrieved component IDs in a plurality of rows. When the component ID is not searched in step S46, the CPU 51 deletes the corresponding line from the component list. After completing the process in step S49, the CPU 51 proceeds to step S57.

  In step S50, the CPU 51 sets the line number K to 1. Next, the CPU 51 acquires information corresponding to the searched component ID as a candidate for assignment to a performance part having the same performance part type as the performance part in the performance order N (step S51). Specifically, the CPU 51 acquires the searched component ID from the column corresponding to the performance part having the same performance part type as the performance part in the performance order N in the Kth row of the component list table. Next, the CPU 51 acquires a previous connection attribute ID corresponding to the acquired component ID from the component table.

  Next, the CPU 51 determines whether or not the back connection attribute ID corresponding to the component ID of the performance part assignment candidate K in the performance order N-1 matches the front connection attribute ID corresponding to the searched component ID. (Step S52). At this time, if the CPU 51 determines that the back connection attribute ID matches the front connection attribute ID (step S52: YES), the CPU 51 proceeds to step S53. On the other hand, if the CPU 51 determines that the back connection attribute ID does not match the front connection attribute ID (step S52: NO), the CPU 51 proceeds to step S54.

  In step S53, the CPU 51 stores the searched component ID obtained in step S51 in the Nth column of the Kth row in the component list table. Next, the CPU 51 proceeds to step S55. In step S54, the CPU 51 deletes the Kth row from the parts list. Next, the CPU 51 proceeds to step S55. In step S55, the CPU 51 adds 1 to the row number K. Next, the CPU 51 determines whether or not the row number K is equal to or less than the row number R (step S56). At this time, if the CPU 51 determines that the line number K is equal to or less than the number of lines R (step S56: YES), the CPU 51 proceeds to step S51. On the other hand, if the CPU 51 determines that the line number K is not less than or equal to the line number R, that is, the line number K is greater than the line number R (step S56: NO), the CPU 51 proceeds to step S57.

  In step S57, the CPU 51 changes the number of rows R to the number of rows in the updated parts list table. Next, the CPU 51 adds 1 to the performance order N (step S58). Next, the CPU 51 determines whether or not the performance order N is equal to or less than the total number of performance parts constituting the selected music piece (step S59). At this time, if the CPU 51 determines that the performance order N is less than or equal to the total number of performance parts (step S59: YES), the CPU 51 proceeds to step S42. On the other hand, when the CPU 51 determines that the performance order N is not less than or equal to the total number of performance parts, that is, the performance order N is larger than the total number of performance parts (step S59: NO), the CPU 51 proceeds to step S60. In step S <b> 60, the CPU 51 selects a component list used for generating exercise information from the component lists generated in the component list table. For example, the operator 42 may select. When finishing the process of step S60, the CPU 51 ends the parts list generation process.

  FIG. 5C is a flowchart illustrating a processing example of exercise information generation processing of the CPU 51 of the output terminal 5. As shown in FIG. 5C, the CPU 51 generates basic motion information based on the parts list (step S21). The basic motion information is motion information indicating the timing at which each output of motion video, narration, and sound effects is started. The basic exercise information is an example of timing information of the present invention. For example, the CPU 51 calculates a playback position at which playback of each performance part is started based on the exercise tempo and the number of beats included in the performance part start event acquired in the selection information acquisition process. Next, the CPU 51 acquires the component ID assigned to each performance part from the component list. Next, the CPU 51 acquires the motion ID, narration timing ID, and sound effect timing ID corresponding to the acquired component ID from the component table. Next, the CPU 51 obtains a motion data path corresponding to the motion ID. Next, the CPU 51 generates, for each performance part, a record including a playback position of the performance part and a motion data path corresponding to the component ID assigned to the performance part for each performance part. Next, the CPU 51 acquires a narration timing file corresponding to the narration timing ID from the HDD 7. Next, the CPU 51 calculates a reproduction position where reproduction of narration data is started based on the narration timing file and the reproduction position of the performance part. Next, the CPU 51 generates a record including the reproduction position of the narration data and the narration data path for each narration data. Further, the CPU 51 generates, for each sound effect data, a record including the reproduction position of the sound effect data and the path of the sound effect data based on the sound effect timing file. The contents of this process are basically the same as in the case of narration data. The CPU 51 generates basic exercise information including these generated records.

  A specific example will be described. For example, assume that a component ID is assigned to each of performance parts 1 to 3 as shown in FIG. The exercise tempo is assumed to be 128 BPM. In this case, the length of one beat is about 0.47 seconds. Since the performance order of the performance part 1 is first, the reproduction position where the output of the performance part 1 starts is 0 second. The performance order of performance part 2 is second, and the performance part 1 has 32 beats. Therefore, the reproduction position where the output of the performance part 2 starts is about 15.04 seconds. The performance order of the performance part 3 is third, and the performance part 2 has 64 beats. Therefore, 96 beats elapse before the performance part 3 starts to output. Therefore, the reproduction position where the output of the performance part 3 starts is about 45.12 seconds. Accordingly, the playback positions at which the display of motion images using the motion data of March B, Front Range A, and Squat C are started at 0 seconds, 15.04 seconds, and 45.12 seconds, respectively. Further, it is assumed that the narration timing file shown in FIG. 3D is a file corresponding to the front range A. In this case, the output of narration 1 is started 8 beats before the output of performance part 2 is started. Therefore, the reproduction position where the reproduction of narration 1 is started is about 11.28 seconds. One beat after the start of performance part 2 output, narration 2 output is started. Therefore, the playback position where playback of narration 2 is started is 15.51 seconds. 9 beats after the start of performance part 2 output, the output of narration 3 is started. Therefore, the playback position where playback of narration 3 is started is 19.27 seconds. The narration 4 starts to be output 13 beats after the output of the performance part 3 is started. Therefore, the playback position where playback of narration 4 is started is 21.15 seconds.

  Next, the CPU 51 generates music dedicated exercise information (step S22). The music-specific exercise information is exercise information indicating the timing at which output of each of the chorus, lyrics, and title image is started. For example, the CPU 51 acquires chorus data, chorus timing information, and lyrics data corresponding to the song ID of the selected song from the HDD 7. Based on the chorus data and the chorus timing information, the CPU 51 generates a record including a playback position where chorus data playback is started and a chorus data path. Further, the CPU 51 generates a record including the reproduction position where the display of the lyrics telop is started and the path of the lyrics data based on the lyrics data. Further, the CPU 51 generates a record including, for example, a preset reproduction position and a title image data path. CPU51 produces | generates the music exclusive exercise | movement information containing these records.

  Next, the CPU 51 combines the basic exercise information and the music-specific exercise information to generate final exercise information (step S23). When finishing the process in step S23, the CPU 51 ends the exercise information generation process.

  FIG. 5D is a flowchart illustrating a processing example of the reproduction processing of the CPU 51 of the output terminal 5. As shown in FIG. 5D, the CPU 51 changes the tempo of the selected music from the original tempo to the exercise tempo determined by the selection information acquisition process (step S31).

  Next, the CPU 51 reproduces the exercise content based on the final exercise information (step S32). Specifically, the CPU 51 acquires the current time from the clock function. The CPU 51 sets the acquired current time as the music data reproduction start time. Next, the CPU 51 reproduces the music data by the music sequencer based on the music data of the selected music. As a result, the CPU 51 causes the speaker 64 to output music. At this time, the CPU 51 outputs the music according to the exercise tempo determined in the selection information acquisition process.

  When the reproduction of the music data is started, the CPU 51 updates the time elapsed from the reproduction start time of the music data as the current reproduction position of the music as needed. Each time the playback position is updated, the CPU 51 searches for a record including the current playback position from the exercise information. The CPU 51 performs processing according to the retrieved record. For example, when a record including a path of motion data is searched, the CPU 51 starts playback of a motion video based on motion data corresponding to the path. At this time, the CPU 51 sequentially generates still images of the main operation and sequentially outputs the still images to the display control unit 56. Next, the CPU 51 sequentially generates still images for the back-joining operation, and sequentially outputs the still images to the display control unit 56. As a result, the CPU 51 displays the motion video on the display 67. When a record including a narration data path is found, the CPU 51 starts reproducing the narration data corresponding to the path. As a result, the CPU 51 causes the speaker 64 to output a narration. When a record including a sound effect data path is searched, the CPU 51 starts to reproduce sound effect data corresponding to the path. As a result, the CPU 51 causes the speaker 64 to output a sound effect. When a record including a path of chorus data is searched, the CPU 51 starts reproduction of chorus data corresponding to the path. When a record including a path of lyrics data is searched, the CPU 51 displays a telop of lyrics on the display 67 based on the lyrics data corresponding to the path. When a record including the title image data path is searched, the CPU 51 displays the title image on the display 67 based on the title image data corresponding to the path. When the reproduction of the music data ends, the CPU 51 ends the reproduction process.

  As described above, according to the present embodiment, the CPU 51 searches for the component ID corresponding to the attribute whose performance order matches the attribute of the first performance part. Further, the CPU 51 corresponds to a connection attribute that matches the connection attribute of the component ID searched for the first performance part in the performance order, and corresponds to an attribute that matches the attribute of the second performance part in the performance order. Search for the component ID. Therefore, it is possible to automatically assign a component ID to each performance part so that the connection of the movement is natural.

  In the above embodiment, the output terminal 5 first searches for a component ID that can be assigned to the first performance part in the performance order. However, the output terminal 5 may first search for a component ID that can be assigned to a performance part different from the first performance part in the performance order. Thereafter, the output terminal 5 may search for the assignable component IDs in the order of performance from the performance part in the performance order next to the performance part for which the assignable component ID has been searched.

  In the above embodiment, the information processing apparatus of the present invention is applied to the output terminal 5. However, the information processing apparatus of the present invention may be applied to the distribution server 2. For example, the distribution server 2 may generate a parts list and exercise information. Further, the distribution server 2 may generate audio data and moving image data based on the exercise information. The audio data in this case is data for outputting music, narration, sound effects, chorus, and the like. The moving image data is data for displaying exercise videos, lyrics, and the like. When the exercise lesson is performed, the distribution server 2 transmits the audio data and the moving image data to the output terminal 5 by, for example, a streaming method. As a result, the distribution server 2 causes the output terminal 5 to output the music and display the motion video. Further, the information processing apparatus of the present invention may be applied to the output terminal 5 and the distribution server 2. The output terminal 5 and the distribution server 2 may perform processing in cooperation.

1 Exercise content generation system 2 Distribution server 3 Database 5 Output terminal 7 HDD
51 CPU
56 Display Control Unit 63 Audio Output Unit

Claims (6)

First storage means for storing music information indicating music composed of a plurality of performance parts and first attribute information indicating attributes of the plurality of performance parts;
Associating a plurality of motion information indicating a plurality of movements, second attribute information indicating attributes of a performance part that can use the plurality of motion information, and connection attribute information indicating a connection attribute of the plurality of motion information Second storage means for storing
First search means for searching the operation information corresponding to the second attribute information corresponding to the first attribute information of the first performance part included in the plurality of performance parts from the second storage means;
The first attribute of the second performance part corresponding to the connection attribute information that matches the connection attribute information of the motion information searched by the first search means and in the next output order of the first performance part. Second search means for searching the operation information corresponding to the second attribute information that matches information from the second storage means;
Generating means for generating list information indicating a plurality of athletic movements suitable for the plurality of performance parts based on the search results of the first search means and the second search means;
An information processing apparatus comprising: The connection attribute information stored in the second storage means indicates a front connection attribute and a back connection attribute of the motion information;
The second search means corresponds to the connection attribute information indicating a front connection attribute that matches a back connection attribute indicated by the connection attribute information of the motion information searched by the first search means, and the first search means Searching the second storage means for the action information corresponding to the second attribute information that matches the first attribute information of the second performance part in the next output order of the performance part;
Corresponding to the connection attribute information indicating the previous connection attribute that matches the back connection attribute indicated by the connection attribute information of the motion information searched by the second search means, and in the next output order of the second performance part Further comprising third search means for searching the action information corresponding to the second attribute information corresponding to the first attribute information of the third performance part from the second storage means,
The information processing apparatus according to claim 1, wherein the generation unit generates the list information based on search results of the first search unit, the second search unit, and the third search unit. Third memory for storing narration information indicating narration supporting exercise motion and beat information indicating how many beats before the start of the exercise motion is output in association with the plurality of motion information Means,
The timing of outputting the narration information when the music information is output based on the beat information stored in the third storage means, the list information generated by the generating means indicating the timing Second generation means for generating timing information indicating a timing of output of the narration information corresponding to a motion action;
The information processing apparatus according to claim 1, further comprising: The first storage means further stores first tempo information indicating the tempo of the music,
The second storage means further stores second tempo information indicating the tempo of the exercise operation,
The first search means indicates the tempo closest to the tempo indicated by the first tempo information stored in the first storage means among the plurality of second tempo information stored in the second storage means. Searching for the motion information corresponding to the second tempo information;
The second search means searches for the motion information corresponding to the second tempo information that matches the second tempo information of the motion information searched by the first search means;
The apparatus further comprises control means for outputting the music information stored in the first storage means by the output means in accordance with the tempo indicated by the second tempo information of the motion information searched by the first search means. The information processing apparatus according to any one of claims 1 to 3. The first storage means stores the first attribute information indicating the number of beats of a performance part,
The second storage means stores the second attribute information indicating the number of beats of exercise motion,
The said 1st search means and the said 2nd search means search the said movement information which shows the exercise | movement action of the beat number which corresponds to the beat number of a performance part, Either of Claim 1 thru | or 4 characterized by the above-mentioned. The information processing apparatus described. Associating a plurality of motion information indicating a plurality of movements, second attribute information indicating attributes of a performance part that can use the plurality of motion information, and connection attribute information indicating a connection attribute of the plurality of motion information Stored in the first storage means for storing the music information indicating the music composed of a plurality of performance parts and the first attribute information indicating the attributes of the plurality of performance parts. A first search step of searching for the motion information corresponding to the second attribute information which is first attribute information and matches the first attribute information of the first performance part included in the plurality of performance parts;
The first attribute of the second performance part corresponding to the splicing attribute information that matches the splicing attribute information of the motion information searched in the first searching step and in the next output order of the first performance part. A second search step for searching the operation information corresponding to the second attribute information matching the information from the second storage means;
Based on the search results of the first search step and the second search step, a generation step of generating list information indicating a plurality of movements suitable for the plurality of performance parts;
A program that causes a computer to execute.

Images