JP5949688B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to a technical field of outputting exercise content for supporting exercise performed by a user while listening to music.

  2. Description of the Related Art Conventionally, a technique for assigning an exercise motion to each of a plurality of performance parts constituting a music is known. For example, Patent Document 1 discloses a technique for allocating an exercise operation of an exercise type corresponding to the type of a performance part to the performance part.

JP 2012-65966 A

  In order to increase the efficiency of the generation of exercise content, it is conceivable to automatically determine the exercise operation assigned to each performance part from a plurality of exercise operations prepared in advance. At this time, there is a demand for automatically combining a motion motion dedicated to music and a general motion motion in order to give each music a characteristic in motion. However, in the conventional technique, although a motion motion suitable for each performance part can be assigned, the connection between a dedicated motion motion and a general motion motion has not been considered. For this reason, there is a case in which exercise content having a sense of incongruity in the connection of exercise motion is generated.

  The present invention has been made in view of the above points, and makes it possible to automatically assign a dedicated motion motion and a general motion motion to each performance part so that the connection of the motion motion becomes natural. It is an object to provide an information processing apparatus and a program.

In order to solve the above-mentioned problem, the invention according to claim 1 is a first storage means for storing music information indicating music composed of a plurality of performance parts, and a first motion operation dedicated to the music. Second storage means for storing movement information and first connection attribute information indicating connection attributes of the first movement information in association with each other, and a plurality of general motion movements that can be performed on various music pieces Third storage means for storing second motion information and second connection attribute information indicating connection attributes of the plurality of motion information in association with each other, and a candidate to be assigned to any one of the plurality of performance parts. First search means for searching for the first action information from the second storage means, and the second connection attribute information that matches the first connection attribute information of the first action information searched by the first search means. The second operation information corresponding to At least one of the first performance part that is output before the performance part for which the first motion information is retrieved and the second performance part that is output after the performance part for which the first motion information is retrieved. A plurality of exercises performed when the music information is output based on second search means for searching from the third storage means as candidates to be assigned, and search results of the first search means and the second search means; And generating means for generating list information indicating.

  According to a second aspect of the present invention, the first search means searches for the first action information that can be assigned to a performance part that is output first among the plurality of performance parts, and the first search means determines the first movement information. And determining means for determining whether or not the first motion information has been searched, wherein the first search means performs the first performance output when the determination means does not determine that the first motion information has been searched. The second motion information that can be assigned to a part is searched from the third storage means, and the second search means is the first connection attribute information of the first motion information searched by the first search means or the Candidates for assigning the second action information corresponding to the second connection attribute information that matches the second connection attribute information of the second action information to the performance part that is output next to the performance part that is output first. And characterized in that the search.

  According to a third aspect of the present invention, the first search means searches for a performance part to which the first action information can be assigned among the plurality of performance parts, and the second search means searches for the first performance part. And the second performance part that matches the first connection attribute information of the first motion information searched by the first search means as a candidate to be assigned to the performance parts not searched by the first search means. The second motion information corresponding to the second connection attribute information is searched.

  According to a fourth aspect of the present invention, there is provided narration information indicating narration supporting exercise motion in association with the first motion information and the plurality of second motion information, and how many beats before the start of the motion motion Fourth storage means for storing beat information indicating whether or not to output narration information; and based on the beat information stored in the fourth storage means, the narration information when the music information is output Second generation means for generating timing information indicating the output timing of the narration information corresponding to the plurality of exercise operations indicated by the list information generated by the generation means; It is characterized by that.

According to a fifth aspect of the present invention, there is provided a first operation indicating a dedicated motion operation for the music indicated by the music information stored in a first storage means for storing music information indicating a music composed of a plurality of performance parts. The second storage means for storing information and first connection attribute information indicating the connection attribute of the first motion information in association with each other, the first to be a candidate to be assigned to any one of the plurality of performance parts. A first search step for searching for motion information, a plurality of second motion information indicating a plurality of general-purpose motions that can be performed with various music pieces, and a second connection attribute information indicating a connection attribute of the plurality of motion information The second operation corresponding to the second connection attribute information that matches the first connection attribute information of the first operation information searched in the first search step from the third storage means for storing the information in association with each other. Information before As a candidate to be assigned to at least one of the first performance part output before the performance part for which the first motion information has been searched and the second performance part output after the performance part for which the first motion information has been searched. A second search step for searching, and a generation step for generating list information indicating a plurality of exercise operations performed when the music information is output based on the search results of the first search step and the second search step And making the computer execute.

  According to the invention described in claim 1 or 5, the general-purpose exercise motion having the connection attribute that matches the connection attribute of the dedicated exercise motion assigned to the performance part is the same as that of the performance part to which the dedicated exercise motion is assigned. It is assigned to at least one of the previous performance part and the performance part next to the performance part to which the dedicated movement is assigned. Therefore, a dedicated exercise operation and a general exercise operation can be automatically assigned to each performance part so that the connection between the exercise operations becomes natural.

  According to the second aspect of the present invention, it is possible to assign exercise motions in the order of output of performance parts.

  According to the third aspect of the present invention, dedicated movements can be assigned to many performance parts.

  According to the fourth aspect of the present invention, it is possible to output narration corresponding to the motion motion prior to the start of the motion motion.

It is a figure showing an example of outline composition of exercise content generation system 1 of one embodiment. (A) is a figure which shows the structural example of an exercise | movement operation | movement, (B) is a figure which shows the example of allocation of component ID. (A) is a figure which shows the structural example of a general purpose component table, (B) is a figure which shows the structural example of a dedicated component table, (C) is a figure which shows the structural example of a joining operation | movement table. (D) is a figure which shows the structural example of an exercise genre table, (E) is a figure which shows an example of the content of a narration timing file, (F) is an example of the content of a sound effect timing file. FIG. (A) is a figure which shows the structural example of a music, (B)-(G) is a figure which shows an example of the update process of a components list table. (A) is a flowchart showing a processing example of a main process of the CPU 51 of the output terminal 5, (B) is a flowchart showing a processing example of a selection information acquisition process of the CPU 51 of the output terminal 5, and (C). FIG. 5 is a flowchart showing an example of exercise information generation processing of the CPU 51 of the output terminal 5, and (D) is a flowchart showing an example of reproduction processing of the CPU 51 of the output terminal 5. 10 is a flowchart illustrating a processing example of a parts list generation process of a CPU 51 of the output terminal 5. 10 is a flowchart illustrating a processing example of a parts list generation process of a CPU 51 of the output terminal 5.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, embodiment described below is embodiment at the time of applying this invention to the exercise content production | generation system which produces | generates the exercise content for supporting exercise. The exercise content includes video and audio for supporting exercise.

[1. Configuration of Exercise Content Generation System 1]
First, the configuration of the exercise content generation system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a schematic configuration example of an exercise content generation system 1 according to the present embodiment. As shown in FIG. 1, the exercise content generation system 1 includes a distribution server 2 and one or more output terminals 5. The distribution server 2 and the output terminal 5 can be connected via the network 10. The network 10 includes, for example, the Internet. A database 3 is connected to the distribution server 2. Information relating to exercise and information relating to music are registered in the database 3. The distribution server 2 distributes information registered in the database 3 to the output terminal 5 periodically or in response to a request from the output terminal 5.

  The output terminal 5 is a terminal device installed in the facility 4, for example. The output terminal 5 is an example of an information processing apparatus of the present invention. The output terminal 5 is used by a user 41 of the facility 4. The facility 4 may be a sports facility, for example. The user 41 receives an exercise lesson at the sports facility. An exercise lesson is a lesson composed of a plurality of exercises and singing. The output terminal 5 in this case may be a personal computer, for example.

  The output terminal 5 can be connected to the monitor 57. The monitor 57 may be a display device including a plurality of speakers 64 and a display 67. In this case, the output terminal 5 can be connected to the display 67. The output terminal 5 can be connected to a speaker 64. When the output terminal 5 outputs an audio signal to the monitor 57, music or the like is output from the speaker 64. When the output terminal 5 outputs a video signal to the monitor 57, an exercise video or the like is displayed on the display 67. The motion video is a moving image that shows a figure 83 that performs the motion. The figure 83 is a virtual object in the form of, for example, a person, an animal, a virtual creature, or a robot. The figure 83 is arranged in a three-dimensional virtual space. The output terminal 5 outputs a signal so that the music output from the speaker 64 and the movement of the figure 83 displayed on the display 67 are synchronized. Outputting music and motion video is an example of outputting motion content. The user 41 can exercise while watching the figure 83 displayed on the display 67 while listening to the music. The operator 42 can operate the output terminal 5 using the remote controller 66 or the like. The user 41 and the operator 42 may be the same person. When the facility 4 is a sports facility, the operator 42 may be an instructor, for example.

[2. Assignment of motor movement to performance part]
The exercise content output by the monitor 57 when an exercise lesson is performed includes at least music and an exercise video. The exercise content may include narration, sound effects, and the like. Details of narration and sound effects will be described later. The music is composed of a plurality of performance parts. The music is output from the speaker 64 in the order of performance parts according to the composition of the music. The order in which the performance parts are output is called the performance order. Each performance part may be, for example, a prelude, an A melody, a B melody, a chorus, an interlude or a posterior. A plurality of music pieces may be sequentially output from the speaker 64 in one exercise lesson. An exercise motion is assigned to each performance part constituting the music. The exercise operation is an operation for training the body, for example. Examples of the exercise operation include a gymnastic operation and a dance operation. The gymnastic exercise is, for example, an exercise performed for promoting health, strengthening physical strength, strengthening muscle strength, and the like. Examples of gymnastic exercises include aerobic exercise, anaerobic exercise, and stretching. The dance motion is a motion that is choreographed to the music to dance to the music. When outputting the exercise content, the output terminal 5 causes the display 67 to display an exercise image in which the figure 83 performs the exercise operation assigned to the performance part output by the speaker 64.

  As shown in FIG. 1, motion data is registered in the database 3. The motion data is data that defines the motion motion of the figure 83 in the three-dimensional virtual space. Further, the motion data is data for causing the figure 83 displayed on the display 67 to perform an exercise motion. The motion data includes the coordinates of each part of the body of the figure 83 according to the progress of the motion movement. Specifically, the motion data includes the coordinates of the body part of the figure 83 according to the progress of the motion movement in time series. The body part of the figure 83 is displayed according to the motion data along the time series, so that an image of the figure 83 that performs a predetermined exercise operation is displayed on the display 67. In the present embodiment, the output terminal 5 displays a three-dimensional image of the figure 83 on the display 67 as a motion image. However, the output terminal 5 may display a two-dimensional image of the figure 83. The output terminal 5 automatically determines a motion ID to be assigned to each performance part from among motion IDs that can identify a plurality of motion data registered in the database 3. The motion ID is associated with attribute information indicating a predetermined attribute and stored in a predetermined storage unit.

  There are two types of exercise motions: dedicated motion motions and general motion motions. The dedicated motion motion is a motion motion dedicated to a predetermined music piece. That is, the dedicated exercise operation is an exercise operation that can be performed when predetermined music is output. The dedicated movement operation may include, for example, a specific operation that matches a predetermined music piece. For example, the dedicated exercise motion may include a dance motion corresponding to a predetermined music piece. In the database 3, for example, motion data of a corresponding dedicated movement may be registered for each piece of music. The general exercise motion is an exercise motion that can be performed with various musical pieces. The output terminal 5 can assign a plurality of exercise motions including a dedicated exercise motion and a general exercise motion to a plurality of performance parts constituting the music. Thereby, a characteristic can be given to an exercise | movement for every music. On the other hand, it is only necessary to create motion data of a dedicated exercise motion for at least one of a plurality of performance parts constituting the music. Therefore, the burden of creating motion data can be reduced.

  If the attributes of the motion ID match the attributes of the music piece and the performance part, basically the motion ID can be assigned to the performance part. As attributes of the motion ID, for example, there are the number of beats indicating the length of the motion, the type of performance part that can be assigned, the tempo of the motion, and the like. As an attribute of the music, for example, there is a tempo. The performance part attributes include, for example, the number of beats and the performance part type. However, as described above, the motion data of the general exercise motion is created so that it can be used for various musical pieces. For this reason, if the connection between consecutive motor movements is not taken into consideration, the motor content with a sense of incongruity in the connection of motor movements is generated. For example, a March motion ID is assigned to the prelude, and a squat motion ID is assigned to the A melody played after the prelude. In this case, the figure 83 displayed on the display 67 performs a march operation in the prelude. Thereafter, when the performance is switched from the prelude to the A melody, the operation of the figure 83 is suddenly switched from the march to the squat. It may be difficult for the user 41 exercising while looking at the displayed figure 83 to naturally shift the exercise operation from the march to the squat.

  There is a similar problem when combining a dedicated motion motion and a general motion motion. If a motion ID of a dedicated exercise motion is assigned to all of the plurality of performance parts constituting the music, motion data of the dedicated exercise motion may be created in advance so that the dedicated exercise motions are naturally connected. However, when combining the dedicated motion motion and the general motion motion, it is necessary to consider the connection between the dedicated motion motion and the general motion motion.

  Therefore, in the present embodiment, a connection attribute is defined for the motion ID indicating each motion data so that the motion is naturally connected. This embodiment will be described using an example in which a connection attribute is defined for a component ID associated with a motion ID. Note that a connection attribute may be defined for the motion ID instead of the component ID. For example, each motion data may be created in advance so that an image of the figure 83 that sequentially executes the front connection operation, the main operation, and the back connection operation is displayed. The main operation is an operation mainly performed in the motion data. For example, the number of beats of the main operation is longer than the number of beats of the front connection operation and the back connection operation. In the case of a dedicated exercise operation, the main operation includes an operation dedicated to music. In the case of a general motion operation, the main operation is a general motion. The pre-joining operation is an exercise operation performed in the last part when a performance part in the order of performance is output before a performance part to which a part ID indicating motion data or a motion ID is assigned. The post-joining operation is an exercise operation performed at the last part of the performance part to which the component ID indicating the motion data or the motion ID is assigned. In both cases of the dedicated motion operation and the general motion operation, the front joint operation and the back joint operation are general motions. The sum of the number of beats of the main operation and the number of beats of the connecting operation matches the number of beats of the performance part to which the component ID can be assigned. The connection attribute is a kind of component ID attribute. The connection attribute may be a kind of attribute of motion ID. As connection attributes, there are a front connection attribute and a back connection attribute. The previous connection attribute indicates the content of the previous connection operation. The back connection attribute indicates the content of the back connection operation. For example, assume that the front joining operation is a march, the main operation is a front lunge, and the back joining operation is a step. In this case, the front connection attribute indicates a march, and the rear connection attribute indicates a step.

  Motion data is created so that the front connection operation and the main operation are naturally connected, and the main operation and the back connection operation are naturally connected. For example, an acceleration sensor for acquiring the coordinates of a body part in a three-dimensional space is attached to a body such as an instructor. For example, acceleration sensors are attached to wrists, elbows, shoulders, bases of feet, knees, ankles, and the like. An instructor or the like performs an exercise operation composed of a front connecting operation, a main operation, and a rear connecting operation. Based on the acceleration information detected by the acceleration sensor, for example, a predetermined device acquires the coordinates of each body part when exercise motion is performed at predetermined time intervals. Then, based on the acquired coordinates, motion data is created. The predetermined device may be, for example, the output terminal 5, the distribution server 2, or the like.

  FIG. 2A is a diagram showing a configuration example of a motion operation called front lunge A. FIG. The front lunge A is, for example, a general motion operation. The front connecting operation, main operation, and rear connecting operation of the front lunge A are a march, a front lunge, and a step, respectively. Front lunge A is a motion action for a performance part of 64 beats. In the example of FIG. 2A, the number of beats of the front lunge of the main operation is 60, and the number of beats of the step of the front joint operation and the step of the back joint operation is 4, respectively. Note that the number of beats of the front connecting operation and the rear connecting operation may be any number of beats. Further, the front connecting operation, the main operation, and the rear connecting operation may be different motion operations. In addition, at least two of the front connection operation, the main operation, and the rear connection operation may be the same exercise operation. The motion data indicated by the component ID assigned to the first performance part among the plurality of performance parts constituting the music piece may be created so that only the main operation and the back connection operation are displayed. Also, the motion data indicated by the component ID assigned to the performance part to be played last may be created so that only the video of the front connection operation and the main operation is displayed.

  The output terminal 5 first searches for a part ID that can be assigned to the first performance part in the performance order as an assignment candidate for the first performance part. Specifically, the output terminal 5 searches for a component ID having an attribute that matches the attribute of the first performance part. Next, the output terminal 5 searches for a part ID that can be assigned to the second performance part as an assignment candidate for the second performance part. At this time, the output terminal 5 considers the connection attribute. Specifically, the output terminal 5 is a component ID having a front connection attribute that matches the rear connection attribute that can be assigned to the first performance part, and matches the attribute of the second performance part. Search for a component ID having an attribute. Next, the output terminal 5 searches for a part ID that can be assigned to the third performance part as an assignment candidate for the third performance part. Specifically, the output terminal 5 is a component ID having a front connection attribute that matches the back connection attribute of the component ID that can be assigned to the second performance part, and matches the attribute of the third performance part. Search for a component ID having an attribute. The output terminal 5 similarly searches for the component ID for the fourth and subsequent performance parts.

  When searching for a part ID that can be assigned to each performance part, the output terminal 5 first searches for a part ID that can be assigned from among the part IDs of the dedicated exercise motion as an assignment candidate. If there is no assignable dedicated motion motion part ID, the output terminal 5 next searches the assignable part ID as a candidate for assignment from the general motion motion part IDs. That is, the output terminal 5 preferentially assigns the part ID for the dedicated motion operation. Specifically, the output terminal 5 searches for the part ID of the dedicated motion operation corresponding to the attribute that matches the attribute of the performance part. When the part ID of the dedicated movement is retrieved, the output terminal 5 assigns the retrieved part ID of the dedicated movement to the performance part. When the part ID for the dedicated movement is not searched, the output terminal 5 searches for the part ID for the general movement corresponding to the attribute that matches the attribute of the performance part. Then, the output terminal 5 assigns the searched general-purpose motion part ID to the performance part.

  The output terminal 5 generates a parts list based on the part ID search result for each performance part. The parts list is information that defines the structure of an exercise lesson. Specifically, the component list indicates a plurality of component IDs that match a plurality of performance parts constituting the music. In the parts list, a performance part ID, a part ID, and the like are stored for each performance part. The performance part ID is performance part identification information. For example, the performance part ID may indicate the performance order of performance parts identified from a plurality of performance parts constituting the music. The component ID is identification information for identifying motion data. For example, the motion motion is identified by the component ID. The component ID and the performance part ID of the performance part to which the component ID is assigned are associated with each other and stored in the component list. The component ID is an example of first operation information and second operation information in the present invention. For example, instead of the component ID, a motion ID or motion data may be used as the first operation information and the second operation information of the present invention.

  FIG. 2B is a diagram illustrating an example of component ID assignment. In FIG. 2B, a certain musical piece includes performance parts 1 to 3. The performance part 1 is the first performance part, the performance part 2 is the second performance part, and the performance part 3 is the third performance part. The performance part 1 has 32 beats. The output terminal 5 assigns, for example, a component ID associated with the motion ID of March B to the performance part 1. March B is a 32-beat movement. The main operation and the back-joining operation of March B are both March. Therefore, the subsequent attribute of the part ID of March B indicates March. The performance part 2 has 64 beats. The output terminal 5 assigns to the performance part 2 a part ID whose front connection attribute indicates march among the part IDs associated with the motion ID indicating the 64-beat motion. For example, the part ID of the front lunge A shown in FIG. The March, which is the post-joining operation of the March B, and the March, which is the pre-joining operation of the front lunge A, are basically the same operation. The performance part 3 has 32 beats. The trailing attribute of the front lunge A indicates a step. The output terminal 5 assigns to the performance part 2 a component ID whose front connection attribute indicates a step among the component IDs associated with the motion ID indicating the 32-beat motion. For example, a component ID associated with the motion ID of squat C is assigned. The squat C front splicing operation and main operation are step and squat, respectively. The step that is the connecting operation of the front lunge A and the step that is the connecting operation of the squat C are basically the same operation.

  Assume that exercise content is generated based on the assignment result shown in FIG. In this case, while the exercise content is being output, while the 32 beats of the performance part 1 are being output, the output terminal 5 causes the display 67 to display a video on which the figure 83 performs a March based on the motion data of March B. Note that, during the last four beats of the performance part 1, the output terminal 5 may cause the display 67 to display a video for performing a march based on the motion data of the front range A. Further, when motion data is generated from an actual motion of a human by using an acceleration sensor or the like, there is a case where a shift occurs between the march of the marching B's back-joining operation and the front-running A's front-joining motion. Therefore, the output terminal 5 may display on the display 67 an image for performing an intermediate operation between the March B back-joining operation March and the Front Range A front-joining operation March using both motion data. Good.

  Next, when the first 60 beats of the performance part 2 are output, the output terminal 5 displays a video for performing the front lunge based on the motion data of the front lunge A. When the performance part 1 is switched to the performance part 2, the figure 83 is displayed so as to be naturally connected from the march to the front lunge. The reason is that the connection attribute of the part ID of the March B and the front connection attribute of the part ID of the front range A indicate the same march. When the figure 83 starts the front lunge, which is the main operation of the front lunge A, the motion data of the front lunge A is created in advance so that the front lunge, which is the main motion, is naturally connected from the marching, which is the front linkage operation. . When the last four beats of the performance part 2 are being output, the output terminal 5 displays a video for performing the step based on the motion data of the front lunge A, for example. Next, when the performance part 3 is being output, the output terminal 5 displays a video for performing the squat based on the motion data of the squat C. When switching from the front lunge to the step and when switching from the step to the squat, the figure 83 is displayed so as to be connected naturally. In this way, the motion movement from the front lunge A to the squat C is naturally connected.

  Next, information used for assigning a component ID and generating a component list will be described. In order to generate the parts list, the HDD (hard disk drive) 7 of the output terminal 5 stores a general-purpose parts table, a dedicated parts table, a splicing operation table, an exercise genre table, and the like. FIG. 3A is a diagram illustrating a configuration example of the general-purpose component table. The component table is table information that defines component attributes, connection attributes, and the like. The general-purpose component table is a component table corresponding to a general-purpose motion operation. The general-purpose component table includes a component ID, a component name, a performance part type, a beat number, an exercise tempo, a front connection attribute ID, a back connection attribute ID, a genre ID, a motion ID, a narration timing ID, a sound effect timing ID, and the like. Stored for each part ID of the motion motion.

  The component ID is identification information that can identify motion data. The part name is a name of the motion motion indicated by the motion data. For example, in FIG. 3A, the component name of general purpose 1-1 represents the general purpose motion operation 1-1. The performance part type is a type of performance part to which a component ID can be assigned. In FIG. 3A, for example, ptypes 1 to 5 are stored as performance part types. For example, ptype1 may be a prelude, ptype2 may be an A melody + rust, ptype3 may be an interlude, ptype4 may be an A melody + B melody, and ptype5 may be a posterior. The beat number indicates the length of the movement.

  The exercise tempo is a tempo at which an exercise operation is performed. For example, a plurality of exercise tempos are predetermined. For example, the exercise tempo may be determined at intervals of a predetermined number of beats. In the example of FIG. 3A, the parts table indicates that motion data corresponding to 128 BPM, motion data corresponding to 144 BPM, and the like are registered. Each motion data is created in advance so that an image in which the figure 83 exercises at any one of a plurality of exercise tempos is displayed. In the database 3, motion data corresponding to each of a plurality of exercise tempos is registered for each performance part type. The parts table stores an exercise tempo corresponding to the motion data.

  The front connection attribute ID is identification information indicating the front connection attribute. The back connection attribute ID is identification information indicating a back connection attribute. FIG. 3C is a diagram illustrating a configuration example of the splicing operation table. The splicing operation table is table information that defines splicing attributes. In the splicing operation table, splicing operation IDs are stored. In FIG. 3C, for example, c1 to c5 are stored as the connection operation ID. For example, c1 is a march, c2 is a step, c3 is a stance, c4 is a squat, and c5 is upright. The front connection attribute ID and the back connection attribute ID stored in the general-purpose component table are examples of second connection attribute information in the present invention. For example, a plurality of front connection attribute IDs or a plurality of back connection attribute IDs may be stored in association with one component ID.

  The genre ID is identification information of the genre of the exercise to which the exercise motion belongs. FIG. 3D is a diagram illustrating a configuration example of the exercise genre table. The exercise genre table is table information that defines an exercise genre. Genre ID is stored in the exercise genre table. In FIG. 3D, for example, j1, j2, etc. are stored as genre IDs. For example, j1 is an aerobic exercise and j2 is an adjustment exercise. The motion ID stored in the general-purpose component table is identification information of motion data of general-purpose exercise motion. The component ID and the motion ID basically correspond one to one. For example, only one of a component ID and a motion ID may be stored in the component table. The narration timing ID and sound effect timing ID will be described later.

  FIG. 3B is a diagram illustrating a configuration example of the dedicated component table. The dedicated parts table is a parts table corresponding to a dedicated motion operation. The dedicated part table includes a part ID, a part name, a music ID, a performance part type, a beat number, an exercise tempo, a front connection attribute ID, a rear connection attribute ID, a genre ID, a motion ID, a narration timing ID, a sound effect timing ID, and the like. Are stored for each part ID of the dedicated motion operation. The music ID is identification information of the music to which the dedicated exercise motion corresponds. The motion ID stored in the dedicated component table is identification information of motion data of the dedicated motion operation. Other information is the same as the information stored in the general-purpose component table. The front connection attribute ID and the back connection attribute ID stored in the dedicated component table are examples of first connection attribute information in the present invention. For example, a plurality of front connection attribute IDs or a plurality of back connection attribute IDs may be stored in association with one component ID.

  Next, a method for generating a parts list when the parts table shown in FIGS. 3A and 3B is used will be described. FIG. 4A is a diagram illustrating a configuration example of a music piece. As shown in FIG. 4A, the music piece X is composed of performance parts 1-8. The output terminal 5 determines an exercise tempo when reproducing exercise content based on the tempo of the music. The music is output according to the exercise tempo, and the display 67 displays a figure 83 that moves according to the exercise tempo. As described above, motion data corresponding to each of a plurality of predetermined exercise tempos is registered. The output terminal 5 determines the tempo closest to the tempo of the music among the plurality of exercise tempos as the exercise tempo used for reproducing the exercise content. For example, it is assumed that the exercise tempo is defined as a multiple of 16 BPM, and the tempo of the music X is 125 BPM. In this case, 128 BPM is determined as the exercise tempo used for reproducing the exercise content. Also, the exercise genre is determined. For example, the operator 42 may select the exercise genre, or the output terminal 5 may determine the exercise genre. For example, it is assumed that aerobic exercise is selected as the exercise genre.

  4B to 4G are diagrams illustrating an example of the update process of the parts list table. The parts list table is table information for storing one or more parts lists being generated. Information on each line of the parts list table corresponds to a parts list. Each column of the parts list table corresponds to a performance part. The output terminal 5 searches the component table for a component ID corresponding to an attribute that matches the attribute of the performance part 1 and the attribute of the music piece X. Retrieving the component ID from the component table is retrieving motion data indicated by the component ID from the HDD 7. The performance part attributes are the performance part type and the number of beats, and the performance part type and the number of beats of the performance part 1 are ptype1 and 32. The attributes of the music are tempo and exercise genre, and the tempo and exercise genre of music X are 128 BPM and aerobic exercise. Accordingly, the output terminal 5 searches the part table for the part ID corresponding to ptype1, 32 beats, 128 BPM, and aerobic exercise as a candidate part ID. At this time, the output terminal 5 first searches from the dedicated component table. However, the dedicated component table does not store component IDs corresponding to ptype1, 32 beats, 128 BPM, and aerobic exercise. Therefore, the output terminal 5 next searches from the general-purpose component table. In the general-purpose component table, component IDs of general-purpose exercise operations 1-1 to 1-3 are stored as component IDs corresponding to ptype1, 32 beats, 128 BPM, and aerobic exercise. The output terminal 5 generates a parts list table in which the performance part 1 is associated with the retrieved part ID. FIG. 4B is an example of a component list table storing component IDs of performance candidate 1 assignment candidates. As shown in FIG. 4B, the component IDs of the general exercise operations 1-1 to 1-3 are stored in the first columns of the first to third rows of the component list table.

  The performance part type and the number of beats of performance part 2 are ptype2 and 64. Therefore, the output terminal 5 first searches the dedicated part table for the part ID corresponding to ptype2, 64 beats, 128 BPM, and aerobic exercise as a candidate part ID. In the dedicated component table, the component ID of the dedicated exercise operation 1 corresponds to ptype2, 64 beats, 128 BPM, and aerobic exercise. At this time, the output terminal 5 searches the dedicated component table for the component IDs corresponding to the front connection attribute IDs that match the general purpose motion operations 1-1 to 1-3. The back-connection attribute ID of the general exercise motion 1-1 matches the front-connection attribute ID of the dedicated motion motion 1. Therefore, the output terminal 5 stores the component ID of the dedicated exercise operation 1 in the second column of the row storing the component ID of the general exercise operation 1-1. There is no component ID corresponding to the front connection attribute ID that matches the back connection attribute ID of the general-purpose motion operation 1-2. There is no component ID corresponding to the front connection attribute ID that matches the rear connection attribute ID of the general-purpose motion operation 1-3. Therefore, the output terminal 5 deletes the respective rows storing the component IDs of the general exercise operation 1-2 and the exercise operation 1-3 from the component list table. Then, the parts list table is updated as shown in FIG.

  The performance part type and the number of beats of performance part 3 are ptype3 and 32. Accordingly, the output terminal 5 searches the part table for the part ID corresponding to ptype3, 32 beats, 128 BPM, and aerobic exercise as an assignment candidate part ID. At this time, the output terminal 5 searches the component table for a component ID corresponding to the front connection attribute ID that matches the rear connection attribute ID of the dedicated exercise motion 1. The dedicated part table does not store the part ID corresponding to ptype 3, 32 beats, 128 BPM, and aerobic exercise. In the general-purpose component table, component IDs of general-purpose exercise operations 3-1 and 3-2 are stored as component IDs corresponding to ptype 3, 32 beats, 128 BPM, and aerobic exercise. The back splicing operation ID of the dedicated motion motion 1 matches the front splicing motion ID of the general motion motion 3-1. The back splicing operation ID of the dedicated motion motion 1 does not match the front splicing motion ID of the general motion motion 3-2. Therefore, the output terminal 5 stores the component ID of the general exercise operation 3-1 in the third column of the row storing the component ID of the dedicated exercise operation 1. Then, the parts list table is updated as shown in FIG.

  The performance part type and the number of beats of the performance part 4 are ptype4 and 32. Accordingly, the output terminal 5 searches the part table for the part ID corresponding to ptype4, 32 beats, 128 BPM, and aerobic exercise. At this time, the output terminal 5 searches the component table for the component ID corresponding to the front connection attribute ID that matches the rear connection attribute ID of the general exercise operation 3-1. The dedicated part table does not store the part ID corresponding to ptype 4, 32 beats, 128 BPM, and aerobic exercise. In the general-purpose component table, component IDs of general-purpose exercise operations 4-1 and 4-2 are stored as component IDs corresponding to ptype 4, 32 beats, 128 BPM, and aerobic exercise. The back joint attribute ID of the general exercise operation 3-1 matches the front connection attribute ID of the general exercise operations 4-1 and 4-2. Therefore, the output terminal 5 adds one row for storing the component IDs of the general exercise operation 1-1, the dedicated exercise operation 1, and the general exercise operation 3-1. The output terminal 5 stores the component ID of the general motion operation 4-1 in the second column of one of the two rows. Further, the output terminal 5 stores the component ID of the general motion operation 4-2 in the second column of the other row of the two rows. Then, the parts list table is updated as shown in FIG.

  The performance part type and the number of beats of performance part 5 are ptype2 and 32. ptype2 is also a performance part type of performance part 2. In other words, for the performance part having the same performance part type as the performance part 5, the allocation candidate part ID has already been searched. In this case, the output terminal 5 determines only the searched component IDs as allocation candidates. In other words, the output terminal 5 performs the same exercise operation when performance parts of the same type are output. The reason for this is to promote the improvement of the exercise operation by causing the user 41 to repeatedly perform the same exercise operation. Specifically, only when the front connection attribute ID of the performance part 2 assignment candidate matches the rear connection attribute ID of the performance part 4 assignment candidate, the output terminal 5 sets the performance part 2 assignment candidate as the performance part. 5 allocation candidates are determined. Note that the output terminal 5 assigns a part ID that is different from the performance part 2 assignment candidate among the part IDs whose front connection attribute ID matches the back connection attribute ID of the performance part 4 assignment candidate to the performance part 5 assignment candidate. You may decide to.

  The first row of the parts list table stores the component IDs of general-purpose motion operation 1-1, dedicated motion motion 1, general-purpose motion motion 3-1, and general-purpose motion motion 4-1. The post-connection attribute ID of the general-purpose motion operation 4-1 matches the front connection attribute ID of the dedicated motion operation 1. Therefore, the output terminal 5 stores the component ID of the dedicated exercise operation 1 in the fifth column of the first row in the component list table. The second row of the parts list table stores the component IDs of the general motion operation 1-1, the dedicated motion operation 1, the general motion operation 3-1, and the general motion operation 4-2. The post-connection attribute ID of the general exercise operation 4-2 and the front connection attribute ID of the dedicated exercise operation 1 do not match. Therefore, the output terminal 5 deletes the second row. Then, the parts list table is updated as shown in FIG.

  The output terminal 5 also updates the parts list table for the performance parts 6 to 8 in the same manner as described above. Then, the parts list table is updated as shown in FIG. In this way, a parts list indicating a plurality of movements suitable for a plurality of performance parts constituting the music piece X is generated. The number of rows in the parts list table shown in FIG. 4 (G) is one. Therefore, one part list is generated. When the number of rows in the parts list table is a plurality of lines, a plurality of parts lists are generated. In this case, for example, the user may select a parts list used for playing the exercise content, or the output terminal 5 may automatically select it.

[3. Narration and sound effect output timing]
The output terminal 5 can include voices such as narration and sound effects that support the exercise motion of the user 41 in the exercise content. The narration explains, for example, an exercise operation or instructs how to move the body. The sound effect may be, for example, a sound that is output in accordance with a human movement when performing a motion. For example, a sound of a fist hitting an object or a sound of a fist cutting the wind may be output in accordance with the punching operation. The sound effect may be, for example, a clapping sound, a clapping sound, a cheering sound, and the like.

  The HDD 7 of the output terminal 5 stores narration data, sound effect data, a narration timing file, and a sound effect timing file. Narration data is audio data for outputting narration. The sound effect data is sound data for outputting a sound effect. The narration timing file is a file indicating the output timing of the narration. The narration timing file is an example of beat information in the present invention. The sound effect timing file is a file indicating the output timing of the sound effect. Narration data, sound effect data, a narration timing file, and a sound effect timing file corresponding to the movement are created in advance for each movement.

  FIG. 3E shows an example of the contents of the narration timing file. In the narration timing file, the beat number and the narration data path are set in association with each other. The number of beats is the number of beats that elapse after the output of the corresponding performance part is started until the output of the narration is started. When the beat number is 0, the output terminal 5 starts outputting the narration simultaneously with the start of the output of the corresponding performance part. When the beat number is a positive value, the output terminal 5 starts outputting narration when the time corresponding to the beat number has elapsed after the output of the corresponding performance part has started. When the beat number is a negative value, the output terminal 5 starts outputting narration before the time corresponding to the beat number before the output of the corresponding performance part is started. The reason why the negative value is set is that it is necessary to output a narration corresponding to the motion motion before the motion motion assigned to the corresponding performance part is performed. The path is a character string indicating the location of the narration data in the HDD 7.

  In the example of FIG. 3E, four narration data are reproduced. First, playback of narration data 1 is started 8 beats before the start of output of the corresponding performance part. In addition, the reproduction of the narration data 2 is started after one beat has elapsed since the output of the corresponding performance part is started. In addition, the reproduction of the narration data 3 is started after 9 beats have passed since the output of the corresponding performance part is started. In addition, the reproduction of the narration data 4 is started after 13 beats have passed since the output of the corresponding performance part is started.

  FIG. 3F shows an example of the contents of a sound effect timing file. In the sound effect timing file, the beat number and the sound effect data path are set in association with each other. The number of beats and the meaning of the pass are basically the same as in the case of the narration timing file. For example, a negative number of beats may not be set in the sound effect timing file.

  The narration timing ID stored in the parts table shown in FIG. 3A is identification information of a narration timing file corresponding to the motion motion. The sound effect timing ID stored in the parts table is identification information of a sound effect timing file corresponding to the exercise operation.

[4. Configuration of each device]
Next, the configuration of each device included in the athletic content generation system will be described with reference to FIG.

[4-1. Configuration of distribution server 2]
As shown in FIG. 1, the distribution server 2 includes a CPU 21, ROM 22, RAM 23, bus 24, I / O interface 25, display control unit 26, disk drive 28, network communication unit 30, and HDD 37. The CPU 21 is connected to the ROM 22, RAM 23, and I / O interface 25 via the bus 24. The CPU 21 controls each unit of the distribution server 2 by executing a program stored in the ROM 22 or the HDD 37. Connected to the I / O interface 25 are a database 3, a display control unit 26, a disk drive 28, a network communication unit 30, a keyboard 31, a mouse 32, and an HDD 37. The CPU 21 accesses the database 3 via the I / O interface 25. The display control unit 26 outputs a video signal to the monitor 27 based on the control of the CPU 21. The disk drive 28 writes data to and reads data from the recording medium 29. The network communication unit 30 performs control for the distribution server 2 to connect to the network 10. The HDD 37 stores an OS, various control programs, and the like.

  Database 3 includes music data, motion data, general-purpose component table, dedicated component table, splicing operation table, exercise genre table, narration data, narration timing file, sound effect data, sound effect timing file, chorus data, lyrics data, title Data such as image data is registered.

  The music data is performance data for outputting music from the speaker 64. The music data may be, for example, data in MIDI (Musical Instrument Digital Interface) format. The song data includes information such as the song ID, song name, artist name, original tempo, and composition of the performance part of the song. The music ID is music identification information. In addition, the music data defines the timing of switching performance parts. For example, if the music data is data in the MIDI format, the music data can include a meta event in addition to the MIDI event as actual performance data. Examples of the meta event include a performance part start event. The performance part start event is an event that notifies the performance start of the performance part. The performance part start event includes the performance part part ID, performance part type, beat number, and the like. The music data is an example of music information in the present invention.

  The motion data is registered in association with the motion ID. The motion data may be registered in association with the component ID, for example. The data format of the narration data and sound effect data may be, for example, WAV (RIFF waveform Audio Format), AAC (Advanced Audio Coding), MP3 (MPEG Audio Layer-3), or the like. The narration timing file is registered in association with the narration timing ID. The sound effect timing file is registered in association with the sound effect timing ID.

  The chorus data is sound data for outputting chorus sound. The chorus data is stored in association with the song ID of the song to which the chorus corresponds and the chorus timing information. The chorus timing information indicates the output timing of the chorus. The lyrics data is data for displaying lyrics telop. The lyric data includes, for example, lyric text, text display timing, and the like. The lyric data is stored in association with the music ID of the music corresponding to the lyrics. The title image data is image data for displaying an image of a title corresponding to the music. The title image data is stored in association with the music ID of the music corresponding to the title image.

[4-2. Configuration of output terminal 5]
As shown in FIG. 1, the output terminal 5 includes a CPU 51, a ROM 52, a RAM 53, a bus 54, an I / O interface 55, a display control unit 56, a disk drive 58, a network communication unit 60, an audio output unit 63, and a signal receiving unit. 65 and HDD 7. The CPU 51 is connected to the ROM 52, RAM 53, and I / O interface 55 via the bus 54. The CPU 51 has a clock function and a timer function. The CPU 51 controls each unit of the output terminal 5 by executing a program stored in the ROM 52 or the HDD 7. Connected to the I / O interface 55 are an HDD 7, a display control unit 56, an audio output unit 63, a disk drive 58, a network communication unit 60, a keyboard 61, a mouse 62, and a signal receiving unit 65. The display control unit 56 outputs a video signal to the monitor 57 based on the control of the CPU 51. The audio output unit 63 outputs an audio signal to the monitor 57 based on the control of the CPU 51. The disk drive 58 writes and reads data to and from the recording medium 59. The signal receiving unit 65 receives a signal output from the remote controller 66. The remote controller 66 is for the operator 42 to operate the output terminal 5.

  The HDD 7 is an example of a first storage unit, a second storage unit, a third storage unit, and a fourth storage unit of the present invention. The first storage unit, the second storage unit, the third storage unit, and the fourth storage unit may be the same storage device or may be different storage devices. In the HDD 7, music data distributed from the distribution server 2, motion data, general-purpose component table, dedicated component table, splicing operation table, exercise genre table, narration data, narration timing file, sound effect data, sound effect timing file, chorus Data such as data, lyric data, and title image data is stored. Also, the HDD 7 stores the generated parts list.

  The HDD 7 further stores various programs such as an OS, an exercise support program, a 3D engine, and a music sequencer. The exercise support program is a program for supporting the exercise of the user 41. The exercise support program causes the CPU 51 as a computer to execute at least a first search step, a second search step, and a generation step. The 3D engine is a program for generating an image obtained by projecting a figure 83 that moves in a three-dimensional virtual space onto a two-dimensional plane based on motion data. The process of generating an image includes projective transformation, clipping, hidden surface removal, shading, texture mapping, and the like. The CPU 51 executes the 3D engine and sequentially generates still images. The CPU 51 sequentially outputs the generated still image to the display control unit 56, whereby a motion image is displayed on the display 67.

  The music sequencer is a program for reproducing music data. The CPU 51 generates a sound signal corresponding to the music data by executing the music sequencer. Further, the CPU 51 generates various events by executing the music sequencer. As an event, for example, there is an event that occurs at a predetermined time interval according to the tempo. This event is called a MIDI clock or synchronization event. As an event, for example, there is a performance part start event.

  Various programs may be downloaded from the server such as the distribution server 2 via the network 10, for example. Various programs may be recorded on the recording medium 59 and read via the disk drive 58. The 3D engine and the music sequencer may be dedicated hardware instead of a program. The output terminal 5 may include a 3D engine or a music sequencer as hardware.

  The CPU 51 outputs an audio signal corresponding to the music data to the audio output unit 63 and outputs a video signal corresponding to the generated image from the display control unit 56 according to the set tempo. Based on the synchronization event, the CPU 51 synchronizes the output timing of the music audio signal and the output timing of the motion video signal. As a result, a figure 83 that performs an exercise motion in synchronization with the music output from the speaker 64 is displayed on the display 67.

[5. Operation of Exercise Content Generation System 1]
Next, operations of the exercise content generation system 1 will be described with reference to FIGS. FIG. 5A is a flowchart illustrating a processing example of the main processing of the CPU 51 of the output terminal 5. For example, the operator 42 performs an operation for starting an exercise lesson with the remote controller 66 or the like. Then, the CPU 51 starts main processing.

  As shown in FIG. 5A, the CPU 51 executes selection information acquisition processing (step S1). In the selection information acquisition process, the CPU 51 acquires information necessary for generating a parts list. Details of the selection information acquisition process will be described later. Next, the CPU 51 executes a parts list generation process (step S2). In the parts list generation process, the CPU 51 generates a parts list. Details of the parts list generation processing will be described later. Next, the CPU 51 executes exercise information generation processing (step S3). In the exercise information generation process, the CPU 51 generates exercise information based on the generated parts list. The exercise information is information used for reproducing exercise content. The exercise information indicates the timing when the output of video and audio included in the exercise content is started when the music is being output. Examples of video and audio whose output timing is indicated by exercise information include exercise video, narration, sound effects, chorus, lyrics, and title images. The output timing may be indicated by a playback position, for example. The reproduction position is a time that has elapsed since the reproduction of the music included in the exercise content is started. The exercise information includes, for example, a plurality of records. Each record indicates a path and a reproduction position. The path is a data path used for video or audio output. Examples of data used for video or audio output include motion data, narration data, sound effect data, chorus data, lyrics data, title image data, and the like. The playback position indicates the timing at which video or audio is output. Details of the exercise information generation process will be described later. Next, the CPU 51 executes a reproduction process (step S4). In the reproduction process, the CPU 51 reproduces the exercise content based on the generated exercise information. Details of the reproduction process will be described later. CPU51 complete | finishes a main process, after finishing the process of step S4.

  FIG. 5B is a flowchart illustrating a processing example of selection information acquisition processing of the CPU 51 of the output terminal 5. As shown in FIG. 5B, the CPU 51 acquires music information (step S11). Specifically, the CPU 51 determines the music used for the exercise lesson. For example, the operator 42 may select a song, and the CPU 51 may accept a selection result input by the operator 42. CPU51 acquires music ID of the determined music. Further, the CPU 51 acquires the original tempo of the music and the performance part start event of each performance part constituting the music from the music data of the determined music.

  Next, the CPU 51 determines an exercise tempo used for reproducing exercise content (step S12). For example, the CPU 51 determines a tempo closest to the original tempo of the music among a plurality of predetermined exercise tempos as an exercise tempo used for reproducing the exercise content. For example, assume that a plurality of exercise tempos are stored in the HDD 7. The CPU 51 acquires each exercise tempo from the HDD 7. For each acquired exercise tempo, the CPU 51 calculates the difference between the exercise tempo and the original tempo of the music. Then, the CPU 51 determines the exercise tempo with the smallest difference as the exercise tempo used for reproducing the exercise content.

  Next, the CPU 51 determines an exercise genre (step S13). For example, the operator 42 may select an exercise genre and the CPU 51 may accept the selection result. When finishing the process of step S13, the CPU 51 ends the selection information acquisition process.

  6 and 7 are flowcharts showing a processing example of the parts list generation processing of the CPU 51 of the output terminal 5. As shown in FIG. 6, the CPU 51 sets the performance order N to 1 (step S41). Next, based on the performance part start event acquired by the selection information acquisition process, the CPU 51 has the same performance part type as the performance part of the performance order N among the performance parts of the performance order 1 to the performance order N-1. It is determined whether or not there is a certain performance part (step S42). At this time, if the CPU 51 determines that there is a performance part having the same performance part type as the performance part in the performance order N (step S42: YES), the CPU 51 proceeds to step S67. On the other hand, when the CPU 51 determines that there is no performance part having the same performance part type as the performance part N in the performance order (step S42: NO), the CPU 51 proceeds to step S43. The CPU 51 also proceeds to step S43 when the performance order N is 1.

  In step S <b> 43, the CPU 51 determines whether or not the dedicated component table stores the song ID of the selected song and the component ID of the dedicated exercise operation corresponding to the performance part type of the performance part in the performance order N. At this time, if the CPU 51 determines that the part ID of the corresponding dedicated motion motion is stored (step S43: YES), the CPU 51 proceeds to step S44. On the other hand, if the CPU 51 determines that the part ID of the corresponding dedicated motion operation is not stored (step S43: NO), the CPU 51 proceeds to step S61.

  In step S44, the CPU 51 matches the music ID of the selected music, the selected exercise genre, the performance part type of the performance part in the performance order N, the beat number of the performance part in the performance order N, and the determined exercise tempo. A component ID corresponding to the music ID, exercise genre, performance part type, beat number, and tempo is searched from the dedicated component table. Next, the CPU 51 determines whether or not the performance order N is greater than 1 (step S45). At this time, if the CPU 51 determines that the performance order N is greater than 1 (step S45: YES), the CPU 51 proceeds to step S46. On the other hand, if the CPU 51 determines that the performance order N is not greater than 1 (step S45: NO), the CPU 51 proceeds to step S50.

  In step S46, the CPU 51 sets the row number K of the parts list table to 1. Next, the CPU 51, based on the dedicated component table, before matching the back connection attribute ID corresponding to the component ID of the performance part assignment candidate K in the performance order N-1 from the component IDs searched in step S44. A component ID corresponding to the connection attribute ID is searched (step S47). The part ID of the performance part assignment candidate K in the performance order N-1 is the part ID stored in the (N-1) th column of the Kth row in the parts list table. Next, the CPU 51 adds 1 to the row number K (step S48). Next, the CPU 51 determines whether or not the row number K is equal to or less than the row number R (step S49). The number of rows R is the number of rows in the parts list table at the current time. At this time, if the CPU 51 determines that the row number K is equal to or less than the row number R (step S49: YES), the CPU 51 proceeds to step S47. On the other hand, if the CPU 51 determines that the line number K is not less than the number of lines R, that is, the line number K is greater than R (step S49: NO), the CPU 51 proceeds to step S50.

  In step S50, the CPU 51 determines whether or not the corresponding component ID has been searched. At this time, if the CPU 51 determines in step S44 or S47 that the component ID has not been searched (step S50: NO), the CPU 51 proceeds to step S61. On the other hand, when the CPU 51 determines that the component ID is searched in step S44 when the performance order N is 1 (step S50: YES), the CPU 51 proceeds to step S51. Further, when the CPU 51 determines that the component ID is searched in step S47 when the performance order N is 2 or more (step S50: YES), the CPU 51 proceeds to step S51.

  As shown in FIG. 7, in step S61, the CPU 51 performs an exercise that matches the selected exercise genre, the performance part type of the performance part in the performance order N, the beat number of the performance part in the performance order N, and the determined exercise tempo. A component ID corresponding to the genre, performance part type, beat number, and tempo is searched from the general component table. Next, the CPU 51 determines whether or not the performance order N is greater than 1 (step S62). At this time, if the CPU 51 determines that the performance order N is greater than 1 (step S62: YES), the CPU 51 proceeds to step S63. On the other hand, when the CPU 51 determines that the performance order N is not greater than 1 (step S62: NO), the CPU 51 proceeds to step S51.

  In step S63, the CPU 51 sets the row number K of the parts list table to 1. Next, the CPU 51, based on the general-purpose component table, before matching the back connection attribute ID corresponding to the component ID of the performance part assignment candidate K in the performance order N-1 from the component IDs searched in step S61. A component ID corresponding to the connection attribute ID is searched (step S64). Next, the CPU 51 adds 1 to the line number K (step S65). Next, the CPU 51 determines whether or not the row number K is less than or equal to the row number R (step S66). At this time, if the CPU 51 determines that the row number K is equal to or less than the row number R (step S66: YES), the CPU 51 proceeds to step S64. On the other hand, if the CPU 51 determines that the line number K is not less than or equal to the number of lines R, that is, the line number K is greater than R (step S66: NO), the CPU 51 proceeds to step S51.

  In step S67, the CPU 51 sets the line number K to 1. Next, the CPU 51 obtains information corresponding to the searched component ID as a candidate for assignment to a performance part having the same performance part type as the performance part in the performance order N (step S68). Specifically, the CPU 51 acquires the searched component ID from the column corresponding to the performance part having the same performance part type as the performance part in the performance order N in the Kth row of the component list table. Next, the CPU 51 acquires a previous connection attribute ID corresponding to the acquired component ID from the component table.

  Next, the CPU 51 determines whether or not the back connection attribute ID corresponding to the component ID of the performance part assignment candidate K in the performance order N-1 matches the front connection attribute ID corresponding to the searched component ID. (Step S69). At this time, if the CPU 51 determines that the back connection attribute ID matches the front connection attribute ID (step S69: YES), the CPU 51 proceeds to step S70. On the other hand, if the CPU 51 determines that the back connection attribute ID does not match the front connection attribute ID (step S69: NO), the CPU 51 proceeds to step S71.

  In step S70, the CPU 51 stores the searched component ID obtained in step S68 in the Nth column of the Kth row in the component list table. Next, the CPU 51 proceeds to step S72. In step S71, the CPU 51 deletes the Kth row from the parts list. Next, the CPU 51 proceeds to step S72. In step S72, the CPU 51 adds 1 to the row number K. Next, the CPU 51 determines whether or not the row number K is equal to or less than the row number R (step S73). At this time, if the CPU 51 determines that the line number K is equal to or less than the number of lines R (step S73: YES), the CPU 51 proceeds to step S68. On the other hand, if the CPU 51 determines that the line number K is not less than or equal to the line number R, that is, the line number K is greater than the line number R (step S73: NO), the CPU 51 proceeds to step S52.

  As shown in FIG. 6, in step S51, the CPU 51 updates the parts list table. When the performance order N is 1, the CPU 51 generates a component list table that stores the component ID searched in step S44 or S61. When the performance order N is 2 or more, the CPU 51 updates the parts list table based on the search result of step S47 or S64. Specifically, when the component ID is retrieved in step S47 or S64, the CPU 51 stores the retrieved component ID in the Nth column of the corresponding row. When a plurality of component IDs are retrieved for one row, the CPU 51 adds a row having the same content to the component list table. Then, the CPU 51 stores a plurality of retrieved component IDs in a plurality of rows. When the component ID is not searched in step S47 or S64, the CPU 51 deletes the corresponding line from the component list. After finishing the process of step S51, the CPU 51 proceeds to step S52.

  In step S52, the CPU 51 changes the number of rows R to the number of rows in the updated parts list table. Next, the CPU 51 adds 1 to the performance order N (step S53). Next, the CPU 51 determines whether or not the performance order N is equal to or less than the total number of performance parts constituting the selected music piece (step S54). At this time, if the CPU 51 determines that the performance order N is less than or equal to the total number of performance parts (step S54: YES), the CPU 51 proceeds to step S42. On the other hand, if the CPU 51 determines that the performance order N is not less than the total number of performance parts, that is, the performance order N is larger than the total number of performance parts (step S54: NO), the CPU 51 proceeds to step S55. In step S55, the CPU 51 selects a parts list used for generating exercise information from the parts list generated in the parts list table. For example, the operator 42 may select. When finishing the process in step S55, the CPU 51 ends the parts list generation process.

  FIG. 5C is a flowchart illustrating a processing example of exercise information generation processing of the CPU 51 of the output terminal 5. As shown in FIG. 5C, the CPU 51 generates basic motion information based on the parts list (step S21). The basic motion information is motion information indicating the timing at which each output of motion video, narration, and sound effects is started. The basic exercise information is an example of timing information of the present invention. For example, the CPU 51 calculates a playback position at which playback of each performance part is started based on the exercise tempo and the number of beats included in the performance part start event acquired in the selection information acquisition process. Next, the CPU 51 acquires the component ID assigned to each performance part from the component list. Next, the CPU 51 acquires the motion ID, narration timing ID, and sound effect timing ID corresponding to the acquired component ID from the component table. Next, the CPU 51 obtains a motion data path corresponding to the motion ID. Next, the CPU 51 generates, for each performance part, a record including a playback position of the performance part and a motion data path corresponding to the component ID assigned to the performance part for each performance part. Next, the CPU 51 acquires a narration timing file corresponding to the narration timing ID from the HDD 7. Next, the CPU 51 calculates a reproduction position where reproduction of narration data is started based on the narration timing file and the reproduction position of the performance part. Next, the CPU 51 generates a record including the reproduction position of the narration data and the narration data path for each narration data. Further, the CPU 51 generates, for each sound effect data, a record including the reproduction position of the sound effect data and the path of the sound effect data based on the sound effect timing file. The contents of this process are basically the same as in the case of narration data. The CPU 51 generates basic exercise information including these generated records.

  A specific example will be described. For example, assume that a component ID is assigned to each of performance parts 1 to 3 as shown in FIG. The exercise tempo is assumed to be 128 BPM. In this case, the length of one beat is about 0.47 seconds. Since the performance order of the performance part 1 is first, the reproduction position where the output of the performance part 1 starts is 0 second. The performance order of performance part 2 is second, and the performance part 1 has 32 beats. Therefore, the reproduction position where the output of the performance part 2 starts is about 15.04 seconds. The performance order of the performance part 3 is third, and the performance part 2 has 64 beats. Therefore, 96 beats elapse before the performance part 3 starts to output. Therefore, the reproduction position where the output of the performance part 3 starts is about 45.12 seconds. Accordingly, the playback positions at which the display of motion images using the motion data of March B, Front Range A, and Squat C are started at 0 seconds, 15.04 seconds, and 45.12 seconds, respectively. Further, it is assumed that the narration timing file shown in FIG. In this case, the output of narration 1 is started 8 beats before the output of performance part 2 is started. Therefore, the reproduction position where the reproduction of narration 1 is started is about 11.28 seconds. One beat after the start of performance part 2 output, narration 2 output is started. Therefore, the playback position where playback of narration 2 is started is 15.51 seconds. 9 beats after the start of performance part 2 output, the output of narration 3 is started. Therefore, the playback position where playback of narration 3 is started is 19.27 seconds. The narration 4 starts to be output 13 beats after the output of the performance part 3 is started. Therefore, the playback position where playback of narration 4 is started is 21.15 seconds.

  Next, the CPU 51 generates music dedicated exercise information (step S22). The music-specific exercise information is exercise information indicating the timing at which output of each of the chorus, lyrics, and title image is started. For example, the CPU 51 acquires chorus data, chorus timing information, and lyrics data corresponding to the song ID of the selected song from the HDD 7. Based on the chorus data and the chorus timing information, the CPU 51 generates a record including a playback position where chorus data playback is started and a chorus data path. Further, the CPU 51 generates a record including the reproduction position where the display of the lyrics telop is started and the path of the lyrics data based on the lyrics data. Further, the CPU 51 generates a record including, for example, a preset reproduction position and a title image data path. CPU51 produces | generates the music exclusive exercise | movement information containing these records.

  Next, the CPU 51 combines the basic exercise information and the music-specific exercise information to generate final exercise information (step S23). When finishing the process in step S23, the CPU 51 ends the exercise information generation process.

  FIG. 5D is a flowchart illustrating a processing example of the reproduction processing of the CPU 51 of the output terminal 5. As shown in FIG. 5D, the CPU 51 changes the tempo of the selected music from the original tempo to the exercise tempo determined by the selection information acquisition process (step S31).

  Next, the CPU 51 reproduces the exercise content based on the final exercise information (step S32). Specifically, the CPU 51 acquires the current time from the clock function. The CPU 51 sets the acquired current time as the music data reproduction start time. Next, the CPU 51 reproduces the music data by the music sequencer based on the music data of the selected music. As a result, the CPU 51 causes the speaker 64 to output music. At this time, the CPU 51 outputs the music according to the exercise tempo determined in the selection information acquisition process.

  When the reproduction of the music data is started, the CPU 51 updates the time elapsed from the reproduction start time of the music data as the current reproduction position of the music as needed. Each time the playback position is updated, the CPU 51 searches for a record including the current playback position from the exercise information. The CPU 51 performs processing according to the retrieved record. For example, when a record including a path of motion data is searched, the CPU 51 starts playback of a motion video based on motion data corresponding to the path. At this time, the CPU 51 sequentially generates still images of the main operation and sequentially outputs the still images to the display control unit 56. Next, the CPU 51 sequentially generates still images for the back-joining operation, and sequentially outputs the still images to the display control unit 56. As a result, the CPU 51 displays the motion video on the display 67. When a record including a narration data path is found, the CPU 51 starts reproducing the narration data corresponding to the path. As a result, the CPU 51 causes the speaker 64 to output a narration. When a record including a sound effect data path is searched, the CPU 51 starts to reproduce sound effect data corresponding to the path. As a result, the CPU 51 causes the speaker 64 to output a sound effect. When a record including a path of chorus data is searched, the CPU 51 starts reproduction of chorus data corresponding to the path. When a record including a path of lyrics data is searched, the CPU 51 displays a telop of lyrics on the display 67 based on the lyrics data corresponding to the path. When a record including the title image data path is searched, the CPU 51 displays the title image on the display 67 based on the title image data corresponding to the path. When the reproduction of the music data ends, the CPU 51 ends the reproduction process.

  As described above, according to the present embodiment, the CPU 51 searches for a part ID of a dedicated exercise motion that is a candidate to be assigned to any one of a plurality of performance parts constituting a music piece. Further, the CPU 51 uses the general exercise motion component ID corresponding to the connection attribute that matches the connection attribute of the searched dedicated exercise motion component ID as the candidate for assignment of the dedicated motion motion component ID before the performance part. The performance part to be output and the part ID of the dedicated motor movement are searched as assignment candidates of at least one of the performance parts output next to the performance part searched as the assignment candidate. Therefore, a dedicated motion motion component ID and a general motion motion component ID can be automatically assigned to each performance part so that the connection of motion motion becomes natural.

  Next, a modified example will be described. In the above embodiment, the output terminal 5 searches for the component IDs that are candidates for assignment of each performance part from the first performance part in the performance order. However, the output terminal 5 searches for a part ID of a dedicated exercise motion that is a candidate for assignment to all of the performance parts that can be assigned a part ID of a dedicated motion motion among a plurality of performance parts constituting the music. Also good. Then, the output terminal 5 outputs the performance part output before the performance part for which the part ID of the dedicated exercise motion is searched, and the performance part output next to the performance part for which the part ID of the dedicated motion movement is searched. Among them, the part ID of the general exercise motion may be searched as a candidate for assigning a performance part for which the component ID of the dedicated motion motion has not been searched. At this time, the output terminal 5 outputs the part ID of the general motion motion having the back connection attribute that matches the front connection attribute of the dedicated motor motion before the performance part for which the part ID of the dedicated motor motion is searched. Search as part assignment candidates. Further, the output terminal 5 outputs the performance ID that is output next to the performance part for which the component ID of the dedicated motion motion is retrieved, with the component ID of the general motion motion having the front link attribute that matches the post-connection attribute of the dedicated motion motion. Search as a candidate for assignment.

  Next, a method for generating a parts list when the parts table shown in FIGS. 3A and 3B is used will be described. The exercise tempo is 128 BPM and the exercise genre is aerobic exercise. First, the output terminal 5 searches the performance parts 1 to 8 for all performance parts to which a part ID for dedicated exercise motion can be assigned. Specifically, the output terminal 5 searches the dedicated component table for the component ID of the dedicated movement corresponding to the attribute that matches the attribute of the performance part for each performance part. When the output terminal 5 determines that the component ID of the dedicated motion operation corresponding to the attribute that matches the attribute of the performance part is stored in the dedicated component table, the component ID of the dedicated motion operation can be assigned to the performance part. . When the output terminal 5 determines that the part ID of the dedicated motion motion corresponding to the attribute that matches the attribute of the performance part is not stored in the dedicated part table, the part ID of the dedicated motion motion cannot be assigned to the performance part. . Attributes include, for example, performance part type and beat number. The performance IDs 2 and 5 can be assigned with the part IDs of the dedicated movements 1 and 2. For the other performance parts, there is no part ID for dedicated motion that can be assigned. The output terminal 5 generates a parts list table including rows in which the part IDs of the dedicated motion motion 1 are stored in the second and fifth columns.

  Next, the output terminal 5 searches for allocation candidates for the performance part 1, for example. The front connection attribute ID of the part ID of the dedicated exercise motion 1 that is a candidate for the performance part 2 matches the rear connection attribute ID of the component ID of the general motion operation 1-1. Therefore, the output terminal 5 stores the component ID of the general exercise operation 1-1 in the first column of the component list table. Next, the output terminal 5 searches for allocation candidates for the performance part 3, for example. The succeeding attribute ID of the part ID of the dedicated movement action 1 that is a candidate for the performance part 2 matches the preceding attribute ID of the part ID of the part ID of the general movement action 3-1. Therefore, the output terminal 5 stores the component ID of the general motion operation 3-1 in the third column of the component list table. Next, the output terminal 5 searches for allocation candidates for the performance part 4, for example. The front connection attribute ID of the part ID of the dedicated movement motion 1 that is a candidate for the performance part 5 matches the rear connection attribute ID of the part ID of the general movement movement 4-1. Further, the back-join attribute ID of the component ID of the general exercise motion 3-1 matches the front link attribute ID of the component ID of the general exercise motion 4-1. Therefore, the output terminal 5 stores the component ID of the general exercise operation 4-1 in the fourth column of the component list table. Next, the output terminal 5 searches for allocation candidates for the performance part 6, for example. The performance part type of performance part 6 matches the performance part type of performance part 3. Further, the post-connection attribute ID of the part ID of the dedicated exercise action 1 that is an assignment candidate of the performance part 5 matches the front connection attribute ID of the part ID of the general-purpose exercise action 3-1 that is an assignment candidate of the performance part 3. Therefore, the output terminal 5 stores the component ID of the general exercise operation 3-1 in the sixth column of the component list table. The output terminal 5 similarly searches for allocation candidates for the performance parts 7 and 8.

  In the above embodiment, the information processing apparatus of the present invention is applied to the output terminal 5. However, the information processing apparatus of the present invention may be applied to the distribution server 2. For example, the distribution server 2 may generate a parts list and exercise information. Further, the distribution server 2 may generate audio data and moving image data based on the exercise information. The audio data in this case is data for outputting music, narration, sound effects, chorus, and the like. The moving image data is data for displaying exercise videos, lyrics, and the like. When the exercise lesson is performed, the distribution server 2 transmits the audio data and the moving image data to the output terminal 5 by, for example, a streaming method. As a result, the distribution server 2 causes the output terminal 5 to output the music and display the motion video. Further, the information processing apparatus of the present invention may be applied to the output terminal 5 and the distribution server 2. The output terminal 5 and the distribution server 2 may perform processing in cooperation.

1 Exercise content generation system 2 Distribution server 3 Database 5 Output terminal 7 HDD
51 CPU
56 Display Control Unit 63 Audio Output Unit

Claims (5)

First storage means for storing music information indicating music composed of a plurality of performance parts;
Second storage means for storing first motion information indicating exercise motion dedicated to the music and first connection attribute information indicating a connection attribute of the first motion information in association with each other;
Third storage means for storing a plurality of second movement information indicating a plurality of general-purpose movements that can be performed with various music pieces and a second connection attribute information indicating a connection attribute of the plurality of movement information in association with each other. When,
First search means for searching the first storage information from the second storage means for candidates to be assigned to any one of the plurality of performance parts;
The second action information corresponding to the second connection attribute information that matches the first connection attribute information of the first action information searched by the first search means is used as the performance for which the first action information is searched. A search is made from the third storage means as a candidate to be assigned to at least one of the first performance part output before the part and the second performance part output next to the performance part for which the first motion information is searched. 2 search means;
Generating means for generating list information indicating a plurality of exercise operations performed when the music information is output based on the search results of the first search means and the second search means;
An information processing apparatus comprising: The first search means searches for the first motion information that can be assigned to a performance part that is output first among the plurality of performance parts,
A determination unit for determining whether the first operation information has been searched by the first search unit;
If the determination means does not determine that the first action information has been searched, the first search means stores from the third storage means the second action information that can be assigned to the performance part that is output first. Search
The second search means includes the second connection attribute information that matches the first connection attribute information of the first action information searched by the first search means or the second connection attribute information of the second action information. The information processing apparatus according to claim 1, wherein the second motion information corresponding to is searched as a candidate to be assigned to a performance part that is output next to the performance part that is output first. The first search means searches for a performance part to which the first motion information can be assigned among the plurality of performance parts,
The second search means is the first action searched by the first search means as a candidate to be assigned to a performance part that is not searched by the first search means among the first performance part and the second performance part. The information processing apparatus according to claim 1, wherein the second operation information corresponding to the second connection attribute information that matches the first connection attribute information of information is searched. Corresponding to the first motion information and the plurality of second motion information, the narration information indicating narration that supports the motor motion, and the beat indicating the number of beats before the start of the motor motion is output. Fourth storage means for storing information;
The timing of outputting the narration information when the music information is output based on the beat information stored in the fourth storage means, and the list information generated by the generating means indicates the timing Second generation means for generating timing information indicating the timing of output of the narration information corresponding to a plurality of movements;
The information processing apparatus according to claim 1, further comprising: First motion information indicating exercise motion dedicated to the music indicated by the music information stored in the first storage means for storing music information indicating the music composed of a plurality of performance parts, and the first motion information A first search step of searching for the first motion information that is a candidate to be assigned to any one of the plurality of performance parts from the second storage means that stores the first connection attribute information indicating the connection attributes in association with each other. When,
Third storage means for storing a plurality of second movement information indicating a plurality of general-purpose movements that can be performed with various music pieces and a second connection attribute information indicating a connection attribute of the plurality of movement information in association with each other. The first motion information is searched for the second motion information corresponding to the second connection attribute information that matches the first connection attribute information of the first motion information searched in the first search step. A second search step for searching as candidates to be assigned to at least one of the first performance part output before the performance part and the second performance part output after the performance part for which the first motion information has been searched; ,
A generation step of generating list information indicating a plurality of exercise operations performed when the music information is output based on search results of the first search step and the second search step;
A program that causes a computer to execute.

Images