JP5928361B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to a technical field for generating exercise content for supporting exercise performed by a user while listening to music.

  For example, Patent Literature 1 discloses a technique for generating exercise content by determining music corresponding to a plurality of exercise operations determined by a user according to the exercise operation. On the other hand, Patent Literature 2 discloses a technique for generating athletic content by determining an athletic motion corresponding to a component of a music according to the component of the music. The generated exercise content is displayed on a display as an image on which an exercise operation is performed, or is output from a speaker as sound of music, for example.

JP 2011-45477 A JP 2012-65966 A

  There are cases where a user performs an exercise by composing an exercise by combining a plurality of exercise motions, and assigning music composed of a plurality of performance parts to the configured exercise. A plurality of performance parts constituting a musical piece are sequentially assigned to each of the plurality of movements. In this case, there is a desire to end the exercise at the rust portion by deciding the last exercise operation among a plurality of exercise operations constituting the exercise and putting a pose. The determined pose is, for example, a pose that closes the end of exercise. However, there are cases where the number of exercise motions constituting the exercise does not match the number of performance parts constituting the music assigned to the exercise. Therefore, the last exercise operation may not be completed at the rust portion. For this reason, the last movement cannot be raised and finished.

  The present invention has been made in view of the above points, and provides an information processing apparatus, an information processing method, and a program capable of ending up and ending the last exercise operation among a plurality of exercise operations with music. The task is to do.

  In order to solve the above-mentioned problem, the invention according to claim 1 is a list information indicating a plurality of movements and a piece of music assigned to the plurality of movements and composed of a plurality of performance parts. Storage means for storing, acquisition means for acquiring the number of exercise motions to which the music is assigned based on the list information stored in the storage means, and the number of exercise motions acquired by the acquisition means A comparison means for comparing the number of performance parts constituting the music, and a result of the comparison by the comparison means that the number of the movement movements is greater than the number of the performance parts, as a result of the comparison by the comparison means. First determination means for determining a number of times corresponding to a difference from the number of parts as a first number of times to repeat a predetermined performance part among the plurality of performance parts, and the first number of times determined by the first determination means If the number of the performance parts is greater than the number of the movements as a result of the comparison by the second determination means for determining to perform the predetermined performance part and the comparison means, the number of the performance parts and the Third determination means for determining the number of times corresponding to the difference from the number of exercise movements as a second number of repetitions of a predetermined exercise movement among the plurality of movement movements; and the second determination section determined by the third determination means. And fourth determination means for determining to execute the predetermined motion operation for the number of times.

  According to a second aspect of the present invention, the storage means includes the plurality of movement operations each of which includes a movement of a predetermined number of beats, and the length of each performance part is the predetermined number of beats. The list information indicating the music composed of a plurality of performance parts is stored, and the second determining means has the predetermined number of beats for the first number of times determined by the first determining means. The predetermined performance part is determined to be played, and the fourth determination unit is configured to perform the predetermined movement operation including the predetermined number of beats for the second number of times determined by the third determination unit. It is characterized by deciding to execute.

  The invention according to claim 3 is characterized in that the first determining means preferentially determines the A melody part among the plurality of performance parts as a repeated performance part.

  The invention according to claim 4 is an information processing method executed by the information processing apparatus, and is composed of a plurality of movements and a piece of music assigned to the plurality of movements and a plurality of performance parts. An acquisition step of acquiring the number of exercise motions to which the music piece is assigned based on the list information stored in storage means for storing list information indicating the music piece, and the number of exercise motions acquired by the acquisition step And a comparison step for comparing the number of performance parts constituting the music, and, as a result of the comparison by the comparison step, if the number of the motion movements is larger than the number of the performance parts, the number of the movement movements and the A first determination step of determining a number of times corresponding to a difference from the number of performance parts as a first number of repetitions of a predetermined performance part among the plurality of performance parts; and the first determination step. As a result of the comparison by the second determination step for determining that the predetermined performance part is to be performed for the first number of times determined by the step and the comparison step, the number of the performance parts is greater than the number of the movement actions. If there are many, a third determination step of determining the number of times corresponding to the difference between the number of the performance parts and the number of the movements as a second number of repetitions of a predetermined movement among the plurality of movements; And a fourth determination step of determining to execute the predetermined exercise motion for the second number of times determined by the three determination steps.

  According to a fifth aspect of the present invention, list information indicating a plurality of movements and a piece of music that is assigned to the plurality of movements and includes a plurality of performance parts is stored in a computer of the information processing apparatus. Based on the list information stored in the storage means for storing, an acquisition step of acquiring the number of exercise motions to which the music is assigned, the number of exercise motions acquired by the acquisition step, and the music are configured A comparison step for comparing the number of performance parts, and a comparison between the number of performance parts and the number of performance parts when the number of the motion movements is greater than the number of performance parts as a result of the comparison in the comparison step Is determined by a first determination step for determining a first number of times to repeat a predetermined performance part among the plurality of performance parts, and the first determination step. When the number of the performance parts is greater than the number of the movements as a result of the comparison by the second determination step for determining to perform the predetermined performance part for the first number of times and the comparison step, the performance The number of times corresponding to the difference between the number of parts and the number of exercise motions is determined by a third determination step of determining a second number of repetitions of a predetermined motion motion among the plurality of motion motions, and the third determination step And a fourth determination step of determining to execute the predetermined motion operation for the second number of times.

  According to the first, fourth, or fifth aspect of the present invention, when the number of movements does not match the number of performance parts, the number of times that a predetermined performance part or a predetermined movement is repeated is determined. Then, based on the determined number of times, the performance order of the performance parts or the execution order of the movement is adjusted. Thus, the last performance part can be played when the last movement is performed. For this reason, the last movement can be finished with music.

  According to the second aspect of the present invention, it is possible to match the timing at which the last exercise operation is finished with the timing at which the last performance part is finished.

  According to the invention described in claim 3, it is possible to prevent the flow of music from becoming unnatural due to repeated performance of a specific performance part.

It is a figure showing an example of outline composition of exercise content generation system 1 of this embodiment. (A) And (B) is a figure which shows the structural example of an exercise lesson. (A) thru | or figure (C) are figures which show an example of adjustment of exercise | movement or a music. 6 is a flowchart illustrating an example of adjustment processing performed by a CPU 51 of the output terminal 5. 4 is a flowchart illustrating a processing example of motion extraction processing by a CPU 51 of the output terminal 5.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, embodiment described below is embodiment at the time of applying this invention to the exercise content production | generation system which produces | generates the exercise content for supporting exercise. The exercise content includes video and audio for supporting exercise.

[1. Configuration of Exercise Content Generation System 1]
First, the configuration of the exercise content generation system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a schematic configuration example of an exercise content generation system 1 according to the present embodiment. As shown in FIG. 1, the exercise content generation system 1 includes a distribution server 2 and one or more output terminals 5. The distribution server 2 and the output terminal 5 can be connected via the network 10. The network 10 includes, for example, the Internet. A database 3 is connected to the distribution server 2. Information relating to exercise and information relating to music are registered in the database 3. The distribution server 2 distributes information registered in the database 3 to the output terminal 5 periodically or in response to a request from the output terminal 5.

  The output terminal 5 is a terminal device installed in the facility 4, for example. The output terminal 5 is an example of an information processing apparatus of the present invention. The output terminal 5 is used by a user 41 of the facility 4. The facility 4 may be a sports facility, for example. The user 41 receives an exercise lesson at the sports facility. The exercise lesson is a lesson composed of a plurality of exercise movements. The output terminal 5 in this case may be a personal computer, for example.

  The output terminal 5 can be connected to the monitor 57. The monitor 57 may be a display device that includes a plurality of speakers 64 and a display 67. In this case, the output terminal 5 can be connected to the display 67. The output terminal 5 can be connected to a speaker 64. When the output terminal 5 outputs an audio signal to the monitor 57, music or the like is output from the speaker 64. When the output terminal 5 outputs a video signal to the monitor 57, an exercise video or the like is displayed on the display 67. The motion video is a moving image that shows a figure 83 performing a motion motion. The figure 83 is a virtual object in the form of, for example, a person, an animal, a virtual creature, or a robot. The figure 83 is arranged in a three-dimensional virtual space. The output terminal 5 outputs a signal so that the music output from the speaker 64 and the movement of the figure 83 displayed on the display 67 are synchronized. Outputting music and motion video is an example of outputting motion content. The user 41 can exercise while watching the figure 83 displayed on the display 67 while listening to the music output from the speaker 64. The operator 42 can operate the output terminal 5 using the remote controller 66 or the like. The user 41 and the operator 42 may be the same person. When the facility 4 is a sports facility, the operator 42 may be an instructor, for example.

[2. Adjustment of music and movement]
FIG. 2A is a diagram illustrating a configuration example of an exercise lesson. As shown in FIG. 2A, an exercise lesson is composed of one or more exercises. Each movement is composed of a plurality of movements. Examples of the exercise motion include aerobic exercise, anaerobic exercise, and stretching. Examples of the aerobic exercise include march and front lunge. Examples of the anaerobic exercise include a shoulder press and a chest press. Examples of stretching exercises include upper arm stretching and neck stretching. Two or more exercise operations may be the same among a plurality of exercise operations constituting one exercise. Each movement is composed of 32 counts of movement. For example, one motor motion is constituted by combining a series of motions of 8 beats. As shown in FIG. 1, motion data is registered in the database 3. The motion data is data that defines the motion motion of the figure 83 in the three-dimensional virtual space. The motion data is data for displaying the motion motion of the figure 83 on the display 67. Motion data is generated in advance so that the motion of the figure 83 displayed on the display 67 is a 32 count motion.

  Of the plurality of exercise operations constituting one exercise, the exercise operation to be performed last includes a decision pose operation. The determined pose is, for example, a pose that closes the end of exercise. For example, if the last motion motion is a march, the first 31 count motion of the last motion motion may be a march motion and the last 1 count motion may be a decision pose motion. The movement of the fixed pose may be composed of movements of 2 counts or more. The exercise operation 5 and the exercise operation 9 shown in FIG. 2A each include a determined pose operation.

  One piece of music is assigned to each exercise. That is, one piece of music is assigned to a plurality of exercises that constitute one exercise. The music assigned to the exercise is a song output when the exercise is performed. That is, the music assigned to the exercise is a song output from the speaker 64 when an exercise video in which the figure 83 performs the exercise is displayed on the display 67. The music is composed of a plurality of performance parts. When outputting one piece of music, the output terminal 5 outputs a plurality of performance parts in the order of performance parts according to the composition of the music. For example, performance parts are output in the order of intro, A melody, B melody, rust, A melody, B melody, rust and the like. Each performance part constituting the music piece is configured with a length of 32 count units. For example, one performance part is formed by combining four measures of 8 beats. The performance part count may be a multiple of 32, such as 64, 96, or the like. In this case, the performance part is divided into a plurality of performance parts by 32 counts for convenience. For example, when there are 64 counts of rust, it is divided into a first half 32 count rust 1 and a second half 32 count rust 2. As shown in FIG. 1, music data is registered in the database 3. The music data is performance data for outputting music from the speaker 64. The music data is generated in advance so that the length of each performance part constituting the music is 32 counts.

  The exercise lesson may include, for example, at least one of an opening and a finish. The opening indicates a state where an exercise lesson starts. The opening is inserted at the beginning of the exercise lesson. The finish indicates a state in which the exercise lesson ends. The finish is inserted at the end of the exercise lesson. FIG. 2B is a diagram illustrating another configuration example of the exercise lesson. As shown in FIG. 2B, the exercise lesson may include a break. The break indicates a state where the exercise is resting. Breaks are inserted between exercises. In the opening, break, or finish, the output terminal 5 may display, for example, a video notifying the start, break, or end of an exercise lesson on the display 67 and may output a predetermined BGM by the speaker 64.

  The configuration of the exercise lesson may be determined by the instructor, for example, by operating the output terminal 5 by the instructor. For example, the instructor arbitrarily selects a plurality of exercise operations. Next, the instructor arbitrarily selects music to be assigned to the selected plurality of exercise motions. Alternatively, the output terminal 5 may automatically select an arbitrary music piece. A plurality of exercise motions to which one music is assigned constitutes one exercise. The instructor performs these operations for the desired number of exercises.

  When the user 41 performs an exercise lesson, one performance part is assigned to each of the exercise operations constituting the exercise lesson. Specifically, when the user 41 is performing a certain motion that constitutes a certain exercise, any performance part that constitutes the music assigned to that exercise is output. As described above, each movement is composed of 32 counts, and the music is composed of 32 count performance parts. The output terminal 5 sequentially displays motion images of a plurality of exercise motions on the display 67 and sequentially outputs a plurality of performance parts constituting the music by the speaker 64. Accordingly, when an exercise image of one exercise operation is displayed, only one performance part is output. Note that the number of movements and performance parts may not be 32. If the count number of the motor motion and the count number of the performance part match, one performance part is assigned to one motor motion. In addition, the count number of the motion motion and the count number of the performance part may not match. For example, it is assumed that the count number of a certain movement is smaller than the count number of the assigned performance part. In this case, for example, when the display of the motion image of the motion motion is completed, the output terminal 5 may end the output of the performance part assigned to the motion motion. And the output terminal 5 may start the display of the exercise | movement image | video of the exercise | movement exercise | movement performed next, and the output of the performance part of the next performance order.

  By the way, for each exercise, there is a desire to put a pose at the end of the exercise and finish the exercise at the chorus part. In order to meet the demand, the last motion motion among the plurality of motion motions constituting the motion includes a determined pose, and the last performance part among the plurality of performance parts constituting the music is chorus. Here, the number of motions constituting one motion is referred to as the number of motions. In addition, the number of performance parts constituting one musical piece is referred to as the number of parts. When the number of motions of a certain motion matches the number of parts of music assigned to that motion, the last chorus is assigned to the last motion motion. Therefore, the user 41 can perform a determined pause when the last chorus part is output. Thereby, the last exercise | movement can be enlivened with music and can be ended.

  However, the number of motions and the number of parts may not always match. The reason is that music is assigned regardless of the number of motions of exercise. In this case, the last chorus is not assigned to the last movement. Therefore, the output terminal 5 compares the number of motions of the exercise with the number of music parts assigned to the exercise. As a result of the comparison, if the number of motions does not match the number of parts, the output terminal 5 adjusts either exercise or music. Specifically, when the number of motions is greater than the number of parts, the output terminal 5 determines the number of times corresponding to the difference between the number of motions and the number of parts as the number of times a predetermined performance part is repeated among a plurality of performance parts constituting the music. To decide. This number is called the part repetition number. The number of part repetitions is an example of a first number in the present invention. Then, the output terminal 5 determines to play the predetermined performance part for the number of part repetitions between the predetermined performance part and the performance part in the performance order next to the predetermined performance part. On the other hand, when the number of parts is greater than the number of motions, the output terminal 5 determines the number of times corresponding to the difference between the number of parts and the number of motions, and the number of times of repeating a predetermined motion motion among a plurality of motion motions constituting the motion. To do. This number is called the number of motion repetitions. The number of motion repetitions is an example of the second number of times in the present invention. Then, the output terminal 5 determines to execute the predetermined exercise operation for the number of times of motion return between the predetermined exercise operation and the exercise operation in the execution order next to the predetermined exercise operation.

  FIGS. 3A to 3C are diagrams illustrating specific examples of exercise or music adjustment. FIG. 3A shows an example in which the number of motions is greater than the number of parts. As shown in FIG. 3A, the music is composed of an intro, A melody, B melody, chorus 1 and chorus 2. Therefore, the number of parts is 5. The exercise is composed of exercise operations 1 to 6. Therefore, the number of motions is 6. In this case, the output terminal 5 determines the number of part repetitions. Specifically, the output terminal 5 determines the number of part repetitions such that the number of motions = the number of parts + the number of part repetitions.

  Also, the output terminal 5 determines, for example, a performance part that repeats the A melody with priority. This is because the flow of music is suppressed from becoming unnatural rather than repeating a performance part different from A melody. In the example of FIG. 3A, it is determined that the A melody is repeated once. The output terminal 5 changes the composition of the musical performance part in the exercise lesson. Specifically, the output terminal 5 determines to play the A melody between the A melody and the B melody for the determined number of part repetitions. As a result, the A melody is output continuously by the number of part repetitions + 1 times, and then the B melody is output. Therefore, the chorus 2 is assigned to the exercise action 6 including the determined pose. Since the count number of the exercise motion and the count number of the performance part coincide with each other, the chorus 2 can be assigned to the exercise motion 6 only by determining the part repetition times.

  For example, the A melody may be played a plurality of times, for example, because the music is composed of an intro, A melody, B melody, rust, A melody, B melody, rust and the like. In this case, the output terminal 5 may determine, for example, the A melody played first as a repeated performance part. Alternatively, the output terminal 5 may determine any A melody different from the A melody played first as a performance part to be repeated. When the number of part repetitions is 2 or more, the output terminal 5 may determine, for example, to repeat the A melody played first for the number of part repetitions. Alternatively, the output terminal 5 may decide to repeat a plurality of A melody. And the output terminal 5 may determine the frequency | count of repeating each A melody so that the total of the frequency | count of repetition may become part repetition frequency. Alternatively, the output terminal 5 may decide to repeat the A melody and the B melody. Then, the output terminal 5 may determine the number of repetitions of the A melody and the number of repetitions of the B melody so that the total number of repetitions becomes the number of part repetitions.

  Note that the output terminal 5 may determine, for example, that the predetermined performance part is performed for the number of part repetitions between the predetermined performance part and the performance part in the performance order before the predetermined performance part. .

  FIG. 3B shows an example where the number of parts is greater than the number of motions. As shown in FIG. 3B, the music is composed of an intro, A melody, A melody, B melody, chorus 1 and chorus 2. Therefore, the number of parts is six. The exercise is composed of exercise operations 1 to 5. Therefore, the number of motions is 5. In this case, the output terminal 5 determines the number of motion repetitions. Specifically, the output terminal 5 determines the number of motion repetitions such that the number of parts = the number of motions + the number of motion repetitions.

  Depending on the exercise action, there is an exercise action that cannot be smoothly repeated when the user 41 tries to repeat. For this reason, an exercise operation that can be repeated is determined in advance. A motion that can be repeated is called a repeatable motion. The output terminal 5 determines a repeatable motion as a repeated exercise operation among a plurality of exercise operations constituting the exercise. For example, in the example of FIG. 3B, when the exercise operation 2 is a repeatable motion, the output terminal 5 determines to repeat the exercise operation 2 once. The output terminal 5 changes the configuration of exercise. Specifically, after the exercise motion determined to be repeated, it is determined to execute the determined motion motion to be repeated for the determined number of motion repetitions. In the example of FIG. 3B, one exercise operation 2 is inserted between the exercise operation 2 and the exercise operation 3. Therefore, the chorus 2 is assigned to the exercise action 5 including the determined pose. Since the count number of the motion motion and the count number of the performance part match, it is possible to assign the chorus 2 to the motion motion 5 only by determining the number of motion repetitions.

  When there are a plurality of repeatable motions, the output terminal 5 may determine an arbitrary repeatable motion as a repeated motion operation. When the number of motion repetitions is 2 or more, the output terminal 5 may determine, for example, to repeat only one of the repeatable motions among the plurality of repeatable motions. Alternatively, the output terminal 5 may decide to repeat a plurality of repeatable motions. Then, the output terminal 5 may determine the number of times each repeatable motion is repeated so that the total number of repetitions becomes the number of motion repetitions.

  Note that the output terminal 5 may determine, for example, to execute the predetermined exercise operation for the number of times of motion return between the predetermined exercise operation and the exercise operation in the execution order before the predetermined exercise operation. .

  FIG. 3C shows another example where the number of parts is greater than the number of motions. The composition of each piece of music and exercise is the same as that shown in FIG. There is a case where there is no repeatable motion among a plurality of motion motions constituting the motion. In this case, the output terminal 5 deletes performance parts by the number of times of motion repetition from performance parts other than the last performance part among the plurality of performance parts constituting the music. For example, the output terminal 5 deletes the performance parts for the number of motion repetitions according to the performance order from the first performance part in the performance order. The reason is to prevent the last performance part from being deleted. However, the output terminal 5 does not delete the intro. In the example of FIG. 3C, one A melody is deleted.

  Note that the repeatable motion may not be defined. And the output terminal 5 may determine arbitrary exercise | movement operation from the some exercise | movement operation | movement which comprises exercise | movement to the exercise operation which repeats.

[3. Configuration of each device]
Next, the configuration of each device included in the athletic content generation system will be described with reference to FIG.

[3-1. Configuration of distribution server 2]
As shown in FIG. 1, the distribution server 2 includes a CPU 21, a ROM 22, a RAM 23, a bus 24, an I / O interface 25, a display control unit 26, a disk drive 28, a network communication unit 30, and an HDD (hard disk drive) 37. . The CPU 21 is connected to the ROM 22, the RAM 23, the bus 24, and the I / O interface 25 via the bus 24. The CPU 21 controls each unit of the distribution server 2 by executing a program stored in the ROM 22 or the HDD 37. Connected to the I / O interface 25 are a database 3, a display control unit 26, a disk drive 28, a network communication unit 30, a keyboard 31, a mouse 32, and an HDD 37. The CPU 21 accesses the database 3 via the I / O interface 25. The display control unit 26 outputs a video signal to the monitor 57 based on the control of the CPU 21. The disk drive 28 writes data to and reads data from the recording medium 29. The network communication unit 30 performs control for the distribution server 2 to connect to the network 10. The HDD 37 stores an OS, various control programs, and the like.

  Data such as motion data, music data, and repeatable motion information is registered in the database 3. The motion data includes the coordinates of each part of the body of the figure 83 according to the progress of the motion movement. For each motion motion, motion data for motion motion including a determined pose and motion data for motion motion not including the determined pose are registered. For example, motion data for a motion motion including a determined pose is generated so that the first 31 count motion is a normal motion motion and the last 1 count motion is a determined pose motion. The motion data includes identification information indicating whether the motion data includes a determined pose or whether the motion data does not include the determined pose. The motion data is registered in association with the motion information. The motion information is identification information indicating an exercise motion. Note that motion information is defined for convenience for each of the opening, break, and finish.

  The music data may be, for example, data in MIDI (Musical Instrument Digital Interface) format. The song data includes information such as song ID, song name, artist name, original tempo, composition of performance part of song, lyrics and the like. The music ID is music identification information. The music data defines timing for switching performance parts, display timing of lyrics telop, timing to change the color of lyrics telop, and the like. For example, when the music data is data in the MIDI format, the music data can include a meta message in addition to the MIDI message as actual performance data. Examples of the meta message include a marker message indicating a performance part and a lyrics message. Therefore, a part ID for identifying a performance part and lyrics can be described in the music data as a message. For example, a music sequencer described later is installed in the output terminal 5. The output terminal 5 reproduces the music data by executing the music sequencer, and outputs a read message when reading a meta message or the like from the music data. For example, the timing at which the marker message is output is the timing at which the performance part indicated by the marker message is started.

  The repeatable motion information is information indicating a repeatable motion. For example, the specific motion information is a list of motion information of repeatable motion.

[3-2. Configuration of output terminal 5]
As shown in FIG. 1, the output terminal 5 includes a CPU 51, a ROM 52, a RAM 53, a bus 54, an I / O interface 55, a display control unit 56, a disk drive 58, a network communication unit 60, an audio output unit 63, and a signal receiving unit. 65 and HDD 7. The CPU 51 is connected to the ROM 52, the RAM 53, the bus 54, and the I / O interface 55 via the bus 54. The CPU 51 controls each unit of the output terminal 5 by executing a program stored in the ROM 52 or the HDD 7. Connected to the I / O interface 55 are an HDD 7, a display control unit 56, an audio output unit 63, a disk drive 58, a network communication unit 60, a keyboard 61, a mouse 62, a microphone 68, and a signal receiving unit 65. The display control unit 56 outputs a video signal to the monitor 57 based on the control of the CPU 51. The audio output unit 63 outputs an audio signal to the monitor 57 based on the control of the CPU 51. The disk drive 58 writes and reads data to and from the recording medium 59. The signal receiving unit 65 receives a signal output from the remote controller 66. The remote controller 66 is for the operator 42 to operate the output terminal 5.

  The HDD 7 is an example of a storage unit in the present invention. The HDD 7 stores motion data, music data, repeatable motion information, and the like distributed from the distribution server 2. The HDD 7 stores lesson information. The lesson information is lesson information that defines the composition of an exercise lesson. For example, the output terminal 5 generates lesson information based on the operation of the operator 42. The lesson information is an example of list information in the present invention.

  The lesson information includes a plurality of motion information, a plurality of exercise tempos, and one or more music IDs. Each of the plurality of pieces of motion information indicates any one of an exercise operation, an opening, a break, and a finish constituting the exercise lesson. Here, the movement, opening, break, and finish are collectively called for convenience for the sake of convenience. The pieces of motion information are arranged in the order of execution of the operations. The exercise tempo is set for each motion information. The exercise tempo represents the speed at which the user 41 performs the exercise operation indicated by the corresponding motion information. For example, the instructor may set an exercise tempo for each exercise operation. Alternatively, the exercise tempo may be predetermined for each exercise operation. Each music ID is associated with motion information of two or more exercise motions among a plurality of motion information included in the lesson information. One music ID is associated with a plurality of pieces of motion information whose execution order is continuous. The music ID indicates a music assigned to a plurality of movements indicated by a plurality of corresponding motion information. A plurality of movements indicated by a plurality of pieces of motion information associated with the same music ID constitute one movement. The details of the process of playing the exercise content based on the lesson information will be described later.

  The HDD 7 further stores various programs such as an OS, an exercise support program, a 3D engine, and a music sequencer. The exercise support program is a program for supporting the exercise of the user 41. The exercise support program causes the CPU 51 as a computer to execute at least an acquisition step, a comparison step, a first determination step, a second determination step, a second determination step, and a third determination step. The 3D engine is a program for generating an image obtained by projecting a figure 83 that moves in a three-dimensional virtual space onto a two-dimensional plane based on motion data. The process of generating an image includes projective transformation, clipping, hidden surface removal, shading, texture mapping, and the like. The CPU 51 executes the 3D engine and sequentially generates still images. The CPU 51 generates moving image data from a plurality of still images that are sequentially generated. The CPU 51 sequentially outputs the still images included in the moving image data to the display control unit 56, whereby the motion video is displayed on the display 67.

  The music sequencer is a program for reproducing music data. The CPU 51 generates a sound signal corresponding to the music data by executing the music sequencer. Further, the CPU 51 generates various messages (events) by executing the music sequencer. As the message, for example, there is a message generated at a predetermined time interval according to the tempo. This message is called a MIDI clock or a synchronization message. Examples of the message include a performance end message and a lyrics message. The performance end message is a message indicating the end of the performance of the entire music.

  Various programs may be downloaded from the server such as the distribution server 2 via the network 10, for example. Various programs may be recorded on the recording medium 59 and read via the disk drive 58. The 3D engine and the music sequencer may be dedicated hardware instead of a program. The output terminal 5 may include a 3D engine or a music sequencer as hardware.

  The CPU 51 outputs an audio signal corresponding to the music data to the audio output unit 63 and outputs a video signal corresponding to the generated image from the display control unit 56 according to the set tempo. The CPU 51 synchronizes the output timing of the music audio signal and the output timing of the motion video signal based on the synchronization message. As a result, a figure 83 that performs an exercise motion in synchronization with the music output from the speaker 64 is displayed on the display 67.

[4. Operation of Exercise Content Generation System 1]
Next, the operation of the exercise content generation system 1 will be described with reference to FIGS. 4 and 5. FIG. 4 is a flowchart illustrating a processing example of the adjustment processing of the CPU 51 of the output terminal 5. The user 41 or the operator 42 operates the output terminal 5 to select desired exercise content and instruct to start an exercise lesson. Then, the CPU 51 of the output terminal 5 acquires lesson information of the selected exercise content from the HDD 7. Then, the CPU 51 executes adjustment processing. In the adjustment process, the CPU 51 executes a motion extraction process (step S1). In the exercise extraction process, the CPU 51 extracts an exercise composed of a plurality of exercise operations based on the lesson information.

  FIG. 5 is a flowchart showing a processing example of the motion extraction processing of the CPU 51 of the output terminal 5. The CPU 51 sets i indicating the order of the exercises constituting the exercise lesson indicated by the lesson information to 1. Further, the CPU 51 sets 1 to j indicating the execution order of the actions constituting the exercise lesson indicated by the lesson information. In addition, the CPU 51 sets a counter for exercise i to 0 (step S21). The exercise i is the i-th exercise among the exercises constituting the exercise lesson. For example, in FIG. 2B, exercise 1 is the first exercise and exercise 2 is the second exercise. The counter indicates the number of exercise operations currently specified in the exercise extraction process among the exercise operations constituting the exercise i. The counter is zero because there is no motor motion identified at this time. Next, the CPU 51 determines whether j is equal to or less than the total number of motions (step S22). The total number of motions is the number of motion information included in the lesson information acquired from the HDD 7. At this time, if the CPU 51 determines that j is equal to or less than the total number of motions (step S22: YES), the CPU 51 proceeds to step S23.

  In step S <b> 23, the CPU 51 acquires the motion information of the operation j from the lesson information acquired from the HDD 7. The action j is the jth action among the actions constituting the exercise lesson. For example, in FIG. 2B, the opening is operation 1. The motion motion 1 is motion 2. The motion motion 2 is motion 3. The motion motion 3 is motion 4. The motion motion 4 is motion 5. The motion motion 5 is motion 6. The break is operation 7. The motion motion 6 is motion 8. The motion motion 7 is motion 9. The motion motion 8 is motion 10. The motion motion 9 is motion 11. The finish is operation 12. Next, the CPU 51 determines whether or not the operation j is an exercise operation based on the acquired motion information (step S24). Opening, breaking and finishing are not motor movements. At this time, if the CPU 51 determines that the operation j is an exercise operation (step S24: YES), the CPU 51 proceeds to step S27. On the other hand, when the CPU 51 determines that the operation j is not an exercise operation (step S24: NO), the CPU 51 proceeds to step S25.

  In step S25, the CPU 51 determines whether the operation j is a break based on the acquired motion information. At this time, if the CPU 51 determines that the operation j is a break (step S25: YES), the CPU 51 proceeds to step S26. In step S26, the CPU 51 adds 1 to i. The reason is that the exercise changes at the break. Next, the CPU 51 sets the number of motions of exercise i to zero. Next, the CPU 51 proceeds to step S32. On the other hand, if the CPU 51 determines that the operation j is not a break (step S25: NO), the CPU 51 proceeds to step S32.

  In step S27, the CPU 51 determines whether or not the counter of exercise i is greater than zero. At this time, if the CPU 51 determines that the counter is greater than 0 (step S27: YES), the CPU 51 proceeds to step S29. On the other hand, when the CPU 51 determines that the counter is 0 (step S27: NO), the CPU 51 proceeds to step S28. In step S28, the CPU 51 acquires the music ID corresponding to the motion information of the operation j from the lesson information. Next, the CPU 51 stores the acquired music ID in the RAM 53. In addition, the CPU 51 initializes a motion list for exercise i. The motion list is a list of motion information. Specifically, the CPU 51 stores an empty motion list, i, and the acquired music ID in the RAM 53 in association with each other. Next, the CPU 51 proceeds to step S31.

  In step S29, the CPU 51 acquires the music ID corresponding to the motion information of the operation j from the lesson information. Then, the CPU 51 determines whether or not the acquired music ID and the music ID currently stored in the RAM 53 are the same. At this time, if the CPU 51 determines that the music IDs are the same (step S29: YES), the CPU 51 proceeds to step S31. In this case, the motion j is a motion motion constituting the motion i. On the other hand, when the CPU 51 determines that the music IDs are not the same (step S29: NO), the CPU 51 proceeds to step S30. In this case, the motion j is a motion motion that constitutes the motion i + 1. In step S30, the CPU 51 adds 1 to i. Next, the CPU 51 sets the exercise i counter to zero. Next, the CPU 51 proceeds to step S28.

  In step S31, the CPU 51 adds the exercise action j to the exercise i. For example, the CPU 51 adds the acquired motion information to the motion list of the exercise i. In addition, the CPU 51 adds 1 to the counter of motion i. Next, the CPU 51 proceeds to step S32. In step S32, the CPU 51 adds 1 to j. Next, the CPU 51 proceeds to step S22.

  If it is determined in step S27 that the counter is 0, the motion j is the first motion i. The music associated with each motion motion constituting the motion i is the same as each other. Therefore, the CPU 51 stores the song ID of the song associated with the first motion of exercise i in step S28. The reason for this is that in step S29, the music associated with the first motion motion of exercise i and the music associated with the motion motion executed after the first motion motion of motion i. This is to determine whether or not they are the same. After that, if the result of determination in step S29 is that the music pieces are the same, the exercise operation to be executed later is an exercise operation constituting exercise i. Therefore, in step S31, the CPU 51 adds the exercise operation to be executed later to the exercise i, and adds 1 to the counter of the exercise i. On the other hand, when the music is different, the exercise operation to be executed later is not an exercise operation constituting the exercise i. The exercise operation to be executed later is the first exercise operation among the exercise operations constituting the exercise i + 1. Therefore, the CPU 51 adds the first motion motion of motion i + 1 to motion i + 1 by the processing of steps S30, S28, and S31, and sets the counter of motion i + 1 to 1. Moreover, CPU51 memorize | stores music ID of the music matched with the 1st exercise | movement motion of exercise | movement i + 1. In this way, the CPU 51 identifies the exercise operation that constitutes the exercise for each exercise. And CPU51 counts the number of motions of each exercise | movement with a counter.

  In step S22, when the CPU 51 determines that j is larger than the total number of motions (step S22: NO), the motion extraction process is terminated. The CPU 51 acquires the number of motions of each exercise based on the lesson information by the exercise extraction process. That is, the current motion counter is determined as the number of motions.

  When the exercise extraction process ends, the CPU 51 sets the current i as the number of exercises constituting the exercise lesson. Further, the CPU 51 generates a copy of the lesson information acquired from the HDD 7. Further, the CPU 51 generates a copy of the music data corresponding to the music ID included in the lesson information. The CPU 51 performs the processing after step S2 shown in FIG. 4 using the generated copy. The CPU 51 sets i to 1 (step S2). Next, the CPU 51 determines whether i is equal to or less than the number of exercises (step S3). At this time, if the CPU 51 determines that i is equal to or less than the number of exercises (step S3: YES), the CPU 51 proceeds to step S4.

  In step S <b> 4, the CPU 51 calculates the difference X by subtracting the number of music parts assigned to the exercise i from the number of motions of the exercise i. The CPU 51 obtains the number of parts by the method described below. CPU51 acquires music ID corresponding to i. Next, the CU 51 searches for the part ID from the copy of the music data corresponding to the music ID. Next, the CPU 51 counts the number of retrieved part IDs and calculates the number of parts.

  Next, the CPU 51 determines whether or not the difference X is 0 (step S5). At this time, if the CPU 51 determines that the difference X is 0 (step S5: YES), the CPU 51 proceeds to step S11. On the other hand, when the CPU 51 determines that the difference X is not 0 (step S5: NO), the CPU 51 proceeds to step S6. In step S6, the CPU 51 determines whether or not the difference X is greater than zero. At this time, if the CPU 51 determines that the difference X is greater than 0 (step S6: YES), the CPU 51 proceeds to step S7. On the other hand, if the CPU 51 determines that the difference X is not greater than 0 (step S6: NO), the CPU 51 proceeds to step S8.

  In step S <b> 7, the CPU 51 inserts X pieces of A melody into the music assigned to the exercise i. Specifically, the CPU 51 specifies the setting position of the part ID indicating the A melody and the setting position of the part ID of the performance part in the performance order next to the A melody in the copy of the music data corresponding to the acquired music ID. To do. Thereby, CPU51 specifies the data part corresponding to A melody from music data. Next, the CPU 51 adds X identified data portions to the copy of the music data. At this time, the CPU 51 inserts the specified data portion immediately before the part ID of the performance part in the performance order next to the A melody. Thus, the CPU 51 determines X as the number of part repetitions. Then, the CPU 51 determines to play the A melody by the number of part repetitions between the A melody and the performance part in the next performance order of the A melody. Next, the CPU 51 proceeds to step S11.

  In step S <b> 8, the CPU 51 determines whether or not there is a repeatable motion among the plurality of motion operations constituting the motion i. Specifically, the CPU 51 determines whether any motion information registered in the motion list of exercise i is registered in the repeatable motion information registered in the HDD 7. When any motion information registered in the list is registered in the repeatable motion information, the CPU 51 determines that there is a repeatable motion (step S8: YES). In this case, the CPU 51 proceeds to step S9. If any motion information registered in the list is not registered in the repeatable motion information, the CPU 51 determines that there is no repeatable motion (step S8: NO). In this case, the CPU 51 proceeds to step S10.

  In step S9, the CPU 51 inserts minus X repeatable motions into the motion i. Specifically, the CPU 51 adds minus X pieces of motion information of the repeatable motion to the copied lesson information. At this time, the CPU 51 inserts between the motion information of the repeatable motion set from the beginning in the copied lesson information and the motion information of the motion operation in the execution order next to the repeatable motion. Thus, the CPU 51 determines minus X as the number of motion repetitions. Then, the CPU 51 determines to execute the repeatable motion for the number of times of motion repetition between the repeatable motion and the motion operation in the execution order next to the repeatable motion. Next, the CPU 51 proceeds to step S11.

  In step S10, the CPU 51 deletes minus X performance parts from the beginning of the music except for the intro. Specifically, the CPU 51 specifies the setting position of each part ID from the copy of the music data corresponding to the acquired music ID. Thereby, CPU51 specifies the data part corresponding to each performance part from music data. Next, the CPU 51 deletes minus X data portions from the copy of the music data. At this time, the CPU 51 deletes minus X data portions continuously from the data portion corresponding to the first performance part in the performance order. However, the CPU 51 does not delete the data portion corresponding to the intro. Next, the CPU 51 proceeds to step S11.

  In step S11, the CPU 51 adds 1 to i. Next, the CPU 51 proceeds to step S3. In step S3, if the CPU 51 determines that i is greater than the number of exercises (step S3: NO), the adjustment process is terminated.

  When the adjustment process is completed, the CPU 51 reproduces the exercise content based on the copied lesson information and the copied music data. Specifically, the CPU 51 sets 1 to i. Next, the CPU 51 acquires the motion information of the first operation in the execution order from the copied lesson information. When the acquired motion information indicates an opening, the CPU 51 causes the display 67 to display an image corresponding to the opening. In addition, the CPU 51 causes the speaker 64 to output BGM corresponding to the opening. When the CPU 51 outputs BGM for a predetermined time, the CPU 51 acquires motion information of the next operation in the execution order.

  When the acquired motion information indicates an exercise motion, the CPU 51 acquires an exercise tempo and a music ID corresponding to the acquired motion information. Next, the CPU 51 stores the acquired music ID in the RAM 53 as a music ID indicating the music being reproduced. Next, the CPU 51 reproduces a copy of the music data corresponding to the acquired music ID according to the acquired exercise tempo. Thereby, the CPU 51 causes the audio output unit 63 to output the audio signal of the music indicated by the acquired music ID to the speaker 64. Further, the CPU 51 acquires motion data for exercise that does not include the determined pose among the motion data corresponding to the acquired motion information. Then, the CPU 51 causes the video signal of the motion video to be output from the display control unit 56 to the display 67 based on the acquired motion data. At this time, the CPU 51 outputs a video signal according to the acquired exercise tempo.

  When the output of the video signal of the motion video of one motion motion is completed, the CPU 51 acquires motion information of the motion in the next execution order. When the acquired motion information indicates an exercise motion, the CPU 51 acquires an exercise tempo and a music ID corresponding to the acquired motion information. Next, the CPU 51 determines whether or not the acquired music ID matches the music ID stored in the RAM 53. When the acquired music ID matches the music ID stored in the RAM 53, the CPU 51 continues to reproduce the music data. At this time, the CPU 51 reproduces the music data according to the newly acquired exercise tempo. Further, the CPU 51 determines whether or not the exercise operation indicated by the acquired motion information is the last exercise operation of the exercise i based on the number of motions of the exercise i. If it is not the last exercise motion of the exercise i, the CPU 51 acquires motion data for exercise operation that does not include the determined pose among the motion data corresponding to the acquired motion information. When it is the last exercise motion of the exercise i, the CPU 51 acquires motion data for exercise operation including the determined pose among the motion data corresponding to the acquired motion information. The CPU 51 causes the video signal of the motion video to be output from the display control unit 56 to the display 67 based on the acquired motion data. At this time, the CPU 51 outputs a video signal according to the acquired exercise tempo. The movement is a 32 count movement and the length of the music is 32 counts. Therefore, when the movement of the figure 83 displayed on the display 67 is switched, the performance part output by the speaker 64 is also switched.

  When the acquired music ID does not match the music ID stored in the RAM 53, the CPU 51 adds 1 to i. Next, the CPU 51 stores the acquired music ID in the RAM 53. Next, the CPU 51 reproduces a copy of the music data corresponding to the acquired music ID according to the acquired exercise tempo. Further, the CPU 51 causes the display control unit 56 to output a video signal of the motion video to the display 67 based on motion data for motion that does not include the determined pose corresponding to the acquired motion information. At this time, the CPU 51 outputs a video signal according to the acquired exercise tempo.

  When the acquired motion information indicates a break or finish, the CPU 51 causes the display 67 to display an image corresponding to the break or finish. Further, the CPU 51 causes the speaker 64 to output BGM corresponding to the break or finish.

  The CPU 51 acquires all the motion information from the copied lesson information, and when the process corresponding to the acquired motion information is completed, the reproduction of the exercise content is ended.

  As described above, according to the present embodiment, when the number of motions is larger as a result of the comparison between the number of motions and the number of parts, the CPU 51 calculates the number of times corresponding to the difference between the number of motions and the number of parts. Determine the number of repetitions. Then, the CPU 51 determines to play the predetermined performance part for the number of part repetitions between the predetermined performance part and the performance part in the next performance order of the predetermined performance part. When the number of parts is larger, the CPU 51 determines the number of motion repetitions as the number of times corresponding to the difference between the number of parts and the number of motions. Then, the CPU 51 determines to execute the predetermined exercise operation for the number of times of motion return between the predetermined exercise operation and the exercise operation in the execution order next to the predetermined exercise operation. Thus, the last performance part can be played when the last movement is performed. For this reason, the last movement can be finished with music.

  In the above embodiment, the information processing apparatus of the present invention is applied to the output terminal 5. However, the information processing apparatus of the present invention may be applied to the distribution server 2. For example, the distribution server 2 may execute the exercise extraction process and the adjustment process based on the lesson information. And the delivery server 2 may produce | generate the audio | voice audio | voice data and the moving image data of the exercise | movement video for every exercise | movement motion beforehand based on the result of an exercise | movement extraction process and an adjustment process. When the exercise lesson is performed, the distribution server 2 transmits the audio data and the moving image data to the output terminal 5 by, for example, a streaming method. As a result, the distribution server 2 causes the output terminal 5 to output the music and display the motion video. Further, the information processing apparatus of the present invention may be applied to the output terminal 5 and the distribution server 2. The output terminal 5 and the distribution server 2 may perform processing in cooperation.

1 Exercise content generation system 2 Distribution server 3 Database 5 Output terminal 7 HDD
51 CPU
52 ROM
53 RAM
56 Display Control Unit 60 Network Communication Unit 63 Audio Output Unit 57 Monitor 64 Speaker 67 Display

Claims (5)

Storage means for storing list information indicating a plurality of athletic movements and music pieces assigned to the plurality of athletic movements and composed of a plurality of performance parts;
Obtaining means for obtaining the number of exercise motions to which the music is assigned based on the list information stored in the storage means;
Comparison means for comparing the number of movements acquired by the acquisition means with the number of performance parts constituting the music;
As a result of the comparison by the comparison means, if the number of the movement movements is larger than the number of the performance parts, the number of times corresponding to the difference between the number of the movement movements and the number of the performance parts is calculated as the number of the performance parts. First determining means for determining a first number of times to repeat a predetermined performance part;
Second determining means for determining to play the predetermined performance part for the first number of times determined by the first determining means;
As a result of the comparison by the comparison means, when the number of the performance parts is larger than the number of the movement actions, the number of times corresponding to the difference between the number of the performance parts and the number of the movement actions is set as the number of the movement actions. A third determining means for determining the second number of times to repeat a predetermined motion,
Fourth determination means for determining to execute the predetermined exercise motion for the second number of times determined by the third determination means;
An information processing apparatus comprising: The storage means is composed of the plurality of athletic motions each of which is a motion of a predetermined number of beats, and the plurality of performance parts whose length of each performance part is the predetermined number of beats. Storing the list information indicating the music,
The second determining means determines to play a predetermined performance part having the predetermined beat number for the first number of times determined by the first determining means,
The fourth deciding means decides to execute the predetermined movement operation constituted by the movement of the predetermined beat number for the second number of times determined by the third deciding means. The information processing apparatus according to claim 1.   3. The information processing apparatus according to claim 1, wherein the first determination unit preferentially determines an A melody part among the plurality of performance parts as a repeated performance part. 4. An information processing method executed by an information processing apparatus,
Based on the list information stored in the storage means for storing list information indicating a plurality of athletic movements and music pieces that are assigned to the plurality of athletic movements and are composed of a plurality of performance parts, An obtaining step for obtaining the number of movements to which the music is assigned;
A comparison step of comparing the number of movements acquired by the acquisition step with the number of performance parts constituting the music;
As a result of the comparison in the comparison step, when the number of the motor movements is larger than the number of the performance parts, the number of times corresponding to the difference between the number of the motor movements and the number of the performance parts is calculated as the number of the performance parts. A first determination step of determining a first number of times to repeat a predetermined performance part;
A second determination step for determining to play the predetermined performance part for the first number of times determined in the first determination step;
As a result of the comparison in the comparison step, when the number of the performance parts is greater than the number of the movement actions, the number of times corresponding to the difference between the number of the performance parts and the number of the movement movements is determined as the number of the movement movements. A third determination step of determining a second number of times to repeat a predetermined exercise action;
A fourth determination step for determining to execute the predetermined motion operation for the second number of times determined by the third determination step;
An information processing method comprising: In the computer of the information processing device,
Based on the list information stored in the storage means for storing list information indicating a plurality of athletic movements and music pieces that are assigned to the plurality of athletic movements and are composed of a plurality of performance parts, An obtaining step for obtaining the number of movements to which the music is assigned;
A comparison step of comparing the number of movements acquired by the acquisition step with the number of performance parts constituting the music;
As a result of the comparison in the comparison step, when the number of the motor movements is larger than the number of the performance parts, the number of times corresponding to the difference between the number of the motor movements and the number of the performance parts is calculated as the number of the performance parts. A first determination step of determining a first number of times to repeat a predetermined performance part;
A second determination step for determining to play the predetermined performance part for the first number of times determined in the first determination step;
As a result of the comparison in the comparison step, when the number of the performance parts is greater than the number of the movement actions, the number of times corresponding to the difference between the number of the performance parts and the number of the movement movements is determined as the number of the movement movements. A third determination step of determining a second number of times to repeat a predetermined exercise action;
A fourth determination step for determining to execute the predetermined motion operation for the second number of times determined by the third determination step;
A program characterized by having executed.

Images