JP2014046019A - Information processor, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically change presentation of a virtual object using a video according to whether it is a lessen making a point of a movement or a lessen making a point of music.SOLUTION: An information processor includes: determination means for determining whether a movement lesson performed according to display of a video and output of music for performing a movement operation using a virtual object disposed a three-dimensional virtual space is a first movement lessen making a point of movement more than music or a second movement lessen making a point of music more than movement; first control means for causing predetermined display means to display a video obtained by taking a picture of the movement operation of the virtual object with a first virtual camera and a video obtained by taking a picture of the same movement operation as the movement operation photographed by the first virtual camera with a second virtual camera disposed at a position different from the position of the first virtual camera when the movement lessen is determined to be the first movement lessen by the determination means; and second control means for causing the display means to display videos obtained by taking pictures of a plurality of virtual objects performing the same movement operation with the first virtual camera when the movement lessen is determined to be the second movement lessen by the determination means.

Description

  The present invention relates to a technical field for generating a motion image in which a virtual object placed in a three-dimensional virtual space performs a motion as content for supporting a motion performed by a user while listening to music.

  For example, Patent Literature 1 discloses a technique for generating exercise content by determining music corresponding to a plurality of exercise operations determined by a user according to the exercise operation. On the other hand, Patent Literature 2 discloses a technique for generating athletic content by determining an athletic motion corresponding to a component of a music according to the component of the music.

JP 2011-45477 A JP 2012-65966 A

  The generated exercise content is displayed on a display as a video or output from a speaker as music, for example. The user can perform an exercise lesson that combines a plurality of exercise operations by performing an exercise operation in accordance with the output exercise content. As an exercise lesson, for example, an exercise lesson in which music corresponding to a plurality of exercise operations is determined in accordance with the exercise operation can be considered. This exercise lesson is considered to be an exercise lesson that emphasizes exercise rather than music. When a user attaches importance to exercise, there is a desire to exercise while watching the detailed motion of the exercise on a video. On the other hand, as an exercise lesson, for example, an exercise lesson in which an exercise operation corresponding to a component of a song is determined according to the component of the song can be considered. This exercise lesson is considered to be an exercise lesson that emphasizes music rather than exercise. When a user places importance on music, there is a desire to enjoy the exercise according to the music rather than seeing the detailed movement of the exercise. However, with the conventional technology, it is not possible to automatically change the representation of the virtual object based on the video depending on whether the lesson is focused on exercise or the lesson focused on music.

  The present invention has been made in view of the above points, and information that can automatically change the representation of a virtual object by video depending on whether it is an exercise-oriented lesson or a music-oriented lesson. It is an object to provide a processing device, an information processing method, and a program.

  In order to solve the above-mentioned problem, the invention according to claim 1 is an exercise lesson that is performed in accordance with display of a video for performing exercise and output of music using a virtual object arranged in a three-dimensional virtual space. Determining means for determining whether the exercise lesson is a first exercise lesson in which exercise is more important than music or a second exercise lesson in which music is more important than exercise; When it is determined that it is one exercise lesson, an image obtained by copying the exercise operation by the virtual object with the first virtual camera and the same exercise operation as the exercise operation copied by the first virtual camera are the first exercise lesson. A first control means for displaying on a predetermined display means an image taken by a second virtual camera arranged at a position different from the position of the virtual camera, and the exercise lesson is a second exercise lesson by the determination means. is there When it is determined, characterized in that it comprises a second control means for displaying an image taken of a plurality of the virtual object that performs the same motion operation by the first virtual camera on the display unit.

  According to a second aspect of the present invention, when the chorus part is output among the plurality of performance parts constituting the musical piece, the second control means outputs the plurality of virtual objects that perform the same movement operation to the first part. When the video captured by the virtual camera is displayed and a performance part that is different from the rust portion is output, the virtual object that performs a motion action with a predetermined exercise load applied to the body as the plurality of virtual objects; and The virtual object which performs the exercise | movement operation | movement which a load smaller than a predetermined exercise load applies to the body is displayed by the first virtual camera.

  According to a third aspect of the present invention, when the chorus part is output among the plurality of performance parts constituting the music, the second control means is more effective than when the performance part different from the chorus part is output. The number of the virtual objects displayed on the display means is increased.

  According to a fourth aspect of the present invention, the second control means outputs the number of the virtual objects displayed on the display means when the chorus part is output in the performance parts constituting the music. It is characterized by increasing each time it is done.

  The invention according to claim 5 allows the position of the first virtual camera to be changed when a performance part different from the chorus part is output among the performance parts constituting the music piece in the second exercise lesson. And a permission unit, wherein the second control unit determines the position of the at least one virtual object when the display positions of the at least two virtual objects overlap according to the position of the first virtual camera. It changes to the position according to the position of this virtual camera.

  According to a sixth aspect of the present invention, the determination means outputs the music according to the first exercise lesson in which the exercise lesson is output in accordance with a tempo suitable for the user's exercise and the original tempo of the song. The second exercise lesson is determined.

  The invention according to claim 7 is an information processing method executed by the information processing apparatus, according to a display of a video for performing a motion and a music output using a virtual object arranged in a three-dimensional virtual space A determination step of determining whether the exercise lesson performed is a first exercise lesson in which exercise is more important than music or a second exercise lesson in which music is more important than exercise; When it is determined that the exercise lesson is the first exercise lesson, an image obtained by copying the exercise motion of the virtual object with the first virtual camera and the same motion as the exercise motion copied by the first virtual camera A first control step for displaying on a predetermined display means an image captured by a second virtual camera disposed at a position different from the position of the first virtual camera; and A second control step of displaying, on the display means, images obtained by copying the plurality of virtual objects performing the same exercise motion with the first virtual camera when it is determined that the dynamic lesson is the second exercise lesson; It is characterized by including.

  According to an eighth aspect of the present invention, an exercise lesson is performed in accordance with display of a video for performing an exercise operation and output of music using a virtual object placed in a three-dimensional virtual space on a computer included in the information processing apparatus. Determining whether the first exercise lesson in which exercise is more important than music or the second exercise lesson in which music is more important than exercise; and the determination means determines whether the exercise lesson is the exercise lesson. When it is determined that it is the first exercise lesson, the first exercise camera has an image obtained by copying the exercise operation of the virtual object with the first virtual camera, and the same exercise operation as the exercise operation copied with the first virtual camera. A first control step for displaying on a predetermined display means an image captured by a second virtual camera arranged at a position different from the position of the virtual camera, and the exercise lesson by the determination step When it is determined that the second exercise lesson is performed, a second control step is executed for causing the display means to display images obtained by copying the plurality of virtual objects performing the same exercise operation with the first virtual camera. It is characterized by that.

  According to the first, seventh, or eighth aspect of the invention, in an exercise lesson that emphasizes exercise, images of the same exercise operation by a virtual object viewed from various viewpoints are displayed. Therefore, the user can see the exercise motion in detail. On the other hand, in an exercise lesson that focuses on music, videos of a plurality of virtual objects performing the same exercise are displayed. It is expected that the user's mood will be enhanced by seeing a plurality of virtual objects in which the user performs the same exercise motion. Therefore, the user can enjoy exercise according to the music. In this way, depending on whether it is a lesson focused on exercise or a lesson focused on music, it is possible to automatically change the representation of the virtual object by the video.

  According to the second aspect of the present invention, since a plurality of virtual images that perform the same exercise motion are displayed in the climax portion that rises in the music, the mood of the user can be raised along with the excitement of the music. . In at least some performance parts of performance parts different from the chorus part, a plurality of virtual objects having different exercise loads of exercise motions to be performed are displayed. Therefore, the user can exercise while viewing a video of a virtual object that performs an exercise operation according to his / her exercise skill among a plurality of virtual objects.

  According to the third aspect of the present invention, since the number of virtual objects performing exercise motion is increased in the climax portion of the music, the user's mood can be further increased.

  According to the fourth aspect of the present invention, the closer the music is to the end, the higher the user's mood can be.

  According to the fifth aspect of the present invention, it is possible to display images from various viewpoints by changing the position of the virtual camera in a performance part different from the chorus part. Therefore, the user can see the exercise motion in detail. When the position of the virtual camera is changed, the display position of the virtual object may overlap. Even in that case, the position of the virtual object is changed according to the position of the virtual camera. Therefore, it is possible to prevent the display positions of the virtual objects from overlapping.

It is a figure showing an example of outline composition of exercise support system 1 of one embodiment. 3 is a diagram illustrating an example of a state of a three-dimensional virtual space 90. FIG. (A1) to (A3) are diagrams illustrating an example of an exercise image of an exercise-oriented lesson, and (B1) to (B3) are diagrams illustrating an example of an exercise image of a music-oriented lesson. (A) is a figure which shows an example of motion data, (B) is a figure which shows the structural example of viewpoint information, (C) is a figure which shows the structural example of the exercise lesson information of an exercise-oriented lesson. Yes, (D) is a diagram showing a configuration example of exercise lesson information of a music-oriented lesson. This is a motion video output control process of the CPU 51 of the output terminal 5. This is a motion video output control process of the CPU 51 of the output terminal 5. This is a motion video output control process of the CPU 51 of the output terminal 5.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to an exercise support system that automatically generates exercise content for supporting exercise. The exercise content includes video and audio for supporting exercise.

[1. Configuration of Exercise Support System 1]
First, the configuration of the exercise support system 1 of the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a schematic configuration example of an exercise support system 1 of the present embodiment. As shown in FIG. 1, the exercise support system 1 includes a distribution server 2 and one or more output terminals 5. The distribution server 2 and the output terminal 5 can be connected via the network 10. The network 10 includes, for example, the Internet. A database 3 is connected to the distribution server 2. Information relating to exercise and information relating to music are registered in the database 3. The distribution server 2 distributes information registered in the database 3 to the output terminal 5 periodically or in response to a request from the output terminal 5.

  The output terminal 5 is a terminal device installed in the facility 4, for example. The output terminal 5 is an example of an information processing apparatus of the present invention. The output terminal 5 may be a personal computer, for example. The facility 4 is, for example, a sports facility. The output terminal 5 is used by a user 41 of the facility 4. The output terminal 5 can be connected to the monitor 57. The monitor 57 may be a display device including a plurality of speakers 64 and a display 67. In this case, the output terminal 5 can be connected to the display 67. The output terminal 5 can be connected to a speaker 64. The display 67 is an example of display means of the present invention. When the output terminal 5 outputs the audio signal to the monitor 57, the speaker 64 outputs the music or the instructor's voice. When the output terminal 5 outputs a video signal to the monitor 57, an exercise video or the like is displayed on the display 67. The exercise image is an image in which a figure 83 performing an exercise operation is projected. The figure 83 is a virtual object in the form of, for example, a person, an animal, a virtual creature, or a robot. The output terminal 5 outputs a signal so that the music output from the speaker 64 and the movement of the figure 83 displayed on the display 67 are synchronized. One or more users 41 can exercise while watching the figure 83 displayed on the display 67 while listening to the music output from the speaker 64. The operator 42 can operate the output terminal 5 using the remote controller 66 or the like. The operator 42 is, for example, an instructor.

[2. Exercise lesson]
The user 41 selects an exercise lesson when exercising using the output terminal 5. An exercise lesson is a lesson composed of one or more exercises. The display 67 displays a figure 83 that performs an exercise operation in the order according to the selected exercise lesson. The types of exercise lessons that can be selected by the user 41 include exercise-oriented lessons and music-oriented lessons. The exercise-oriented lesson is an example of the first exercise lesson of the present invention. The music-oriented lesson is an example of the second exercise lesson of the present invention.

[2-1. Exercise-focused lessons]
Exercise lessons are exercise lessons where exercise is more important than music. The exercise-oriented lesson is mainly aimed at training the user 41's body. In exercise-oriented lessons, music is output according to the tempo at which exercise is performed. When determining the content of an exercise-oriented lesson, for example, an exercise operation is selected prior to the music. For example, the user 41 or the operator 42 selects a desired exercise motion. Then, for example, the music is selected according to the selected exercise action or the exercise tempo of the selected exercise action. The exercise tempo represents the speed at which the user 41 performs an exercise operation. For example, the user 41 sets an exercise tempo for each exercise operation. In the exercise-focused lesson, music is output from the speaker 64 at a playback speed according to the exercise tempo. In addition, a motion image of the figure 83 performing the motion motion at a speed according to the motion tempo is displayed on the display 67. Therefore, the user 41 exercises according to the exercise tempo. By setting an exercise tempo suitable for the exercise operation of the user 41, the user 41 can perform an effective exercise. In the exercise-oriented lesson, only some performance parts are repeatedly output among the plurality of performance parts constituting the music. For example, the chorus portion of the music is repeatedly output, or the intro portion and the chorus portion are repeatedly output.

  The exercise operation that can be selected in the exercise-oriented lesson is, for example, a gymnastic operation. The gymnastic exercise is, for example, an exercise performed for promoting health, strengthening physical strength, strengthening muscle strength, and the like. Examples of gymnastic exercises include aerobic exercise, anaerobic exercise, and stretching. Examples of the aerobic exercise include march and front lunge. Examples of the anaerobic exercise include a shoulder press and a chest press. Examples of stretching exercises include upper arm stretching and neck stretching.

[2-2. Music-focused lesson]
The music-oriented lesson is an exercise lesson in which music is more important than exercise. In the music-oriented lesson, the user 41 can be trained. However, it is more important for the user 41 to enjoy exercise. In music-oriented lessons, music is output according to the original tempo of the music. When determining the content of a music-oriented lesson, for example, the music is selected prior to the exercise operation. For example, the user 41 or the operator 42 selects a desired music piece. For example, the user 41 or the operator 42 selects a desired exercise motion. And an exercise | movement action is selected for every performance part of the selected music. In the music-oriented lesson, the music is output from the speaker 64 at a playback speed according to the tempo suitable for the music. The tempo suitable for the music is, for example, the original tempo of the music. In addition, a motion image of the figure 83 performing a motion motion at a speed according to the tempo suitable for the music is displayed on the display 67. In the music-oriented lesson, the music is output in the order of the parts according to the composition of the music. For example, music is output in the order of intro, A melody, B melody, rust, A melody, B melody, rust, interlude, rust, ending, and the like. The user 41 can enjoy the music by exercising while listening to the music output according to the composition of the music at a tempo suitable for the music. Enjoying music leads to enjoying exercise. The intro and ending need not be output.

  There are a gymnastics operation and a dance operation corresponding to the music as exercise motions that can be selected in the music-oriented lesson. The dance motion is a motion that is choreographed to the music to dance to the music. For example, a dance action is selected in the chorus part of the music, and a gymnastic action is selected in a performance part different from the chorus part. Dance performance may be selected for performance parts other than the chorus part of the music. The user 41 can enjoy exercise by dancing according to the music. Moreover, the user 41 can raise the mood of the user 41 when the user 41 dances the dance corresponding to the chorus part in the chorus part of the music.

[3. 3D virtual space]
Next, a three-dimensional virtual space 90 used for generating a motion image will be described with reference to FIG. In the exercise support system 1, the output terminal 5 generates an exercise image in which the figure 83 arranged in the three-dimensional virtual space 90 performs an exercise operation by 3DCG (3 Dimensional Computer Graphics). FIG. 2 is a diagram illustrating an example of the state of the three-dimensional virtual space 90. As shown in FIG. 2, one or more figures 83 are arranged in the three-dimensional virtual space 90. In the three-dimensional virtual space 90, one or more virtual cameras are arranged. The virtual camera captures an image in the three-dimensional virtual space 90. The virtual camera represents a viewpoint and a line-of-sight direction for copying an object in the three-dimensional virtual space 90 onto a projection plane. The image on the projection surface becomes the motion image. The position of the virtual camera corresponds to the viewpoint. The virtual camera is usually aimed at the figure 83.

  The position of the virtual camera can be changed. For example, the position of the virtual camera can be changed to any one of L1 to L17 in FIG. In addition, any of the virtual camera positions L1 to L17 may be determined according to the exercise operation. The position where the virtual camera can be arranged may be determined in advance, for example. Viewpoints L1 to L17 indicate positions where virtual cameras can be arranged. The viewpoint L1 is located in front of the figure 83.

  There are a main camera 91 and a sub camera 92 as virtual cameras. The main camera 91 is a virtual camera that is always arranged. The default position of the main camera 91 is the viewpoint L1. The sub camera 92 is a virtual camera arranged as necessary. In the example of FIG. 2, any of the viewpoints L2 to L17 excluding the viewpoint L1 where the main camera 91 is arranged is set as the sub camera 92. A plurality of sub cameras 92 may exist. The main camera 91 is an example of a first virtual camera of the present invention. The sub camera 92 is an example of a second virtual camera of the present invention.

[4. Exercise video]
Next, the details of the motion video will be described with reference to FIG. In the exercise support system 1, the expression of the figure 83 in the exercise video differs between the exercise-oriented lesson and the music-oriented lesson.

[4-1. Exercise-focused lessons]
It is important that the user 41 learns the exercise motion in the exercise-oriented lesson mainly for physical training. Therefore, there is a demand that the user 41 wants to see the motion motion of the figure 83 in detail. There may be a complex motion, a motion that is difficult to remember, a particularly important motion, etc. in a series of motions in one motion motion. In the exercise-oriented lesson, while such an operation is performed, the area on the display 67 where the figure 83 is displayed is divided into two areas. In the two areas, an image in which the same figure 83 viewed from different viewpoints moves is displayed. The user 41 can see the figure 83 viewed from a plurality of viewpoints. Therefore, since the user 41 can see the exercise motion in detail, it is possible to promote the acquisition of the exercise motion.

  FIGS. 3A1 to 3A3 are diagrams illustrating an example of an exercise image of an exercise-oriented lesson. For example, FIG. 3 (A1) is an exercise image in which one figure 83 is stretching the back. This motion video is a video shot by the main camera arranged at the viewpoint L1. Thereafter, when a complex motion starts in back stretching, the area of the screen is divided into an area 95 and an area 96 as shown in FIG. In the area 95, an image captured by the main camera arranged at the viewpoint L1 is displayed. In the area 96, for example, an image captured by a sub camera arranged at the viewpoint L3 is displayed. The figure 83 is displayed in any area. Thereafter, when the complicated operation of back stretching is finished, the division of the screen area is finished. Then, as shown in FIG. 3 (A3), only the video imaged by the main camera arranged at the viewpoint L1 is displayed.

  The examples described so far are examples in which the same figure arranged in the same three-dimensional virtual space is copied from virtual cameras of different viewpoints. However, for example, different figures arranged in different three-dimensional virtual spaces may perform the same motion movement. And the image which each copied the figure by the separate virtual camera arrange | positioned in a separate three-dimensional virtual space may be displayed on a separate area | region. In this case, each virtual camera may be arranged so that the relative positions from the figure to be photographed are different from each other.

[4-2. Music-focused lesson]
In a music-oriented lesson for enjoying exercise, a plurality of figures 83 are arranged in the same three-dimensional virtual space 90. Then, a motion image obtained by copying the plurality of figures 83 with the main camera 91 is displayed. Therefore, the user 41 can raise the mood of the user 41 by looking at the plurality of figures 83 in the same space. Thereby, the user 41 can enjoy exercise.

  In the music-oriented lesson, for example, a gymnastic operation is performed in a performance part different from the chorus part of the music. When the user 41 performs a gymnastic operation, the user 41 wants to perform an effective exercise for training the body. However, in the music-oriented lesson, the user 41 exercises according to the original tempo of the music. If the tempo of the music is not suitable for the user 41, the user 41 may not be able to perform effective exercise. Therefore, when a performance part associated with an exercise action is output, the display 67 may display a plurality of figures 83 that perform exercise actions with different loads on the body. The user 41 can perform an effective exercise by exercising while watching the figure 83 that performs an exercise operation suitable for the exercise skill of the user 41 among the plurality of figures 83.

  FIG. 3 (B1) to FIG. 3 (B3) are diagrams illustrating an example of an exercise image of a music-oriented lesson. FIG. 3 (B1) is a motion image when the A melody portion is output. As shown in FIG. 3 (B1), the display 67 displays a figure 83A and a figure 83B. The figure 83A is a figure that performs a general motion operation. The figure 83B is a figure that performs a reduced exercise motion. The content of basic exercise motion is the same between general exercise motion and reduced exercise motion. For example, it is assumed that a march is performed in the A melody portion. In this case, both the general exercise operation performed by the figure 83A and the reduced exercise operation performed by the figure 83B are march. The general exercise operation is an exercise operation in which a predetermined load is applied to the body. The general exercise operation is an exercise operation performed by the figure 83 in the case of exercise-oriented lessons. On the other hand, the reduced exercise operation is an exercise operation that has a smaller load on the body than a general exercise operation. Therefore, the reduced exercise operation is a simple exercise operation than the general exercise operation. For example, as shown in FIG. 3 (B1), the reduced exercise motion has a smaller limb swing width than the general exercise motion. FIG. 3 (B2) is a motion image when the B melody portion is output. Also in this case, a figure 83A that performs a general exercise operation and a figure 83B that performs a reduced exercise operation are displayed. Note that three or more figures 83 that perform exercises with different loads on the body may be displayed. Also, a figure 83 that performs a general exercise operation and a figure 83 that performs an exercise operation with a greater load on the body than the general exercise operation may be displayed on the display 67.

  When a performance part different from the chorus part is being output, the output terminal 5 allows the position of the main camera 91 to be changed by operating the remote controller 66. Depending on the position of the main camera 91, the display positions of the figure 83A and the figure 83B may overlap in the motion video. The display position is the position of the image of the figure 83 on the screen of the display 67. When the display positions overlap, at least a part of the video of either the figure 83A or the figure 83B is not displayed on the display 67 due to hidden surface removal in 3DCG. Therefore, the user 41 cannot see at least a part of any of the movements of the figure 83A and the figure 83B. Therefore, the user 41 may not be able to see the exercise motion in detail. Therefore, the output terminal 5 changes the position of at least one of the video of the figure 83A and the video of the figure 83B on the projection plane corresponding to the viewpoint of the main camera 91. For example, default world coordinates of positions serving as the centers of gravity of the figures 83A and 83B may be determined in advance. World coordinates are coordinates indicating a position in the three-dimensional virtual space 90. For example, when the images of the figure 83A and the figure 83B do not overlap when the images of the figure 83A and the figure 83B are projected on the projection plane of the main camera 91 at the default world coordinates, the output terminal 5 does not change the position of the picture on the projection plane. . On the other hand, for example, when the images on the projection plane of the main camera 91 overlap each other, the output terminal 5 changes the position of the image on the projection plane. For example, for each of the viewpoints L1 to L17, the positions of the images of the figures 83A and 83B on the projection plane may be determined in advance. For example, the world coordinates of the center of gravity of the figure 83A in the three-dimensional virtual space and the world coordinates of the center of gravity of the figure 83B in the three-dimensional virtual space 90 are projected onto the projection plane corresponding to the viewpoint where the main camera 91 is arranged. Thus, world coordinates are converted into coordinates on the projection plane. The coordinates of the centers of gravity of the figures 83A and 83B on the projection plane are set so that the distance between the coordinates of the figure 83A and the coordinates of the figure 83B on the projection plane is equal to or greater than a predetermined threshold. For example, assuming all operations of the figure 83A and the figure 83B, the threshold value is set so that the image of the figure 83A and the image of the figure 83B do not overlap on the projection plane.

  In the chorus portion of the music, a plurality of figures 83 that perform the same exercise motion are displayed. When a plurality of figures 83 perform the same movement, a sense of unity is born. By creating a sense of unity, the mood of the user 41 can be raised. Therefore, the user 41 can enjoy exercise.

  FIG. 3 (B3) is a motion image when the rust portion is output. As shown in FIG. 3 (B3), five figures 83 that perform the same movement are displayed. Thus, the number of figures 83 displayed when the chorus part is output may be larger than the number of figures 83 displayed when a performance part different from the chorus part is output. Also, the number of figures 83 may increase each time the rust portion is output repeatedly. For example, five figures 83 are displayed when the first chorus part is output, and seven figures 83 are displayed when the second chorus part is output. The initial value of the number of figures 83 and the number that the figure 83 increases each time the chorus part is output are arbitrary.

  When switching from the output of the performance part different from the chorus part to the output of the chorus part, the output terminal 5 may or may not return the position of the main camera 91 to the viewpoint L1. Further, the output terminal 5 may permit the change of the position of the main camera 91 when the rust portion is being output. The output terminal 5 may change or change the position of the figure 83 according to the position of the main camera 91 when the display positions of at least two figures 83 overlap when the rust portion is output. You don't have to.

[5. Configuration of each device]
Next, the configuration of each device included in the exercise support system will be described with reference to FIGS. 1 and 4.

[5-1. Configuration of distribution server 2]
As shown in FIG. 1, the distribution server 2 includes a CPU 21, a ROM 22, a RAM 23, a bus 24, an I / O interface 25, a display control unit 26, a disk drive 28, a network communication unit 30, and an HDD (hard disk drive) 37. . The CPU 21 is connected to the ROM 22, the RAM 23, the bus 24, and the I / O interface 25 via the bus 24. The CPU 21 controls each unit of the distribution server 2 by executing a program stored in the ROM 22 or the HDD 37. Connected to the I / O interface 25 are a database 3, a display control unit 26, a disk drive 28, a network communication unit 30, a keyboard 31, a mouse 32, and an HDD 37. The CPU 21 accesses the database 3 via the I / O interface 25. The display control unit 26 outputs a video signal to the monitor 27 based on the control of the CPU 21. The disk drive 28 writes data to and reads data from the recording medium 29. The network communication unit 30 performs control for the distribution server 2 to connect to the network 10. The HDD 37 stores an OS, various control programs, and the like.

  In the database 3, data such as motion data, music data, viewpoint information, and figure position information are registered. FIG. 4A is a diagram illustrating an example of motion data. The motion data is data that defines the motion motion of the figure 83 in the three-dimensional virtual space 90. The motion data is data for displaying the motion motion of the figure 83 on the display 67. The motion data includes the coordinates of each part of the body of the figure 83 according to the progress of the motion movement. The motion data is registered in association with the motion information. The motion information is identification information indicating an exercise motion. As shown in FIG. 4A, there are motion data for general exercise motion and motion data for reduced exercise motion as motion data for gymnastic motion. Examples of motion information indicating a gymnastic action include “half squat” and “march”. Examples of motion information indicating the dance motion include “A melody of song X”, “B melody of song X”, “rust of song X”, “A melody of song Y”, and the like. The motion data of the dance motion exists for each performance part of the music.

  The music data is performance data for outputting music from the speaker 64. The music data may be, for example, data in MIDI (Musical Instrument Digital Interface) format. The song data includes information such as song ID, song name, artist name, original tempo, composition of performance part of song, lyrics and the like. The music ID is music identification information. In addition, the music data defines timing for switching performance parts, display timing of lyrics telop, timing to change the color of lyrics telop, and the like. For example, when the music data is data in the MIDI format, the music data can include a meta message in addition to the MIDI message as actual performance data. Examples of the meta message include a marker message indicating a performance part and a lyrics message. Therefore, a part ID for identifying a performance part and lyrics can be described in the music data as a message. For example, a music sequencer described later is installed in the output terminal 5. The output terminal 5 reproduces the music data by executing the music sequencer, and outputs a read message when reading a meta message or the like from the music data. For example, the timing at which the marker message is output is the timing at which the performance part indicated by the marker message is started. In the present embodiment, the marker message is referred to as a performance part start message. The performance part start message is a message notifying the start of performance of the performance part. Further, for example, the timing when the lyrics message is output is the display timing of the lyrics.

  The viewpoint information is information that determines the position and shooting angle of the virtual camera in the exercise-focused lesson. The viewpoint information is registered for each movement. FIG. 4B is a diagram illustrating a configuration example of viewpoint information. As shown in FIG. 4B, the viewpoint information includes motion information of the corresponding motion motion. The viewpoint information includes one or more pieces of divided viewpoint information. The divided viewpoint information is set for each elapsed time range. Each divided viewpoint information includes an elapsed time range and a screen division flag. The elapsed time is the time that has elapsed since the start of the exercise operation. The elapsed time defined in the viewpoint information indicates, for example, the elapsed time when the exercise tempo is 60 bpm. Therefore, the actual elapsed time becomes longer or shorter depending on the exercise tempo. For example, if the elapsed time when the exercise tempo is 60 bpm is 1 second, the elapsed time when the exercise tempo is 120 bpm is changed to 0.5 seconds. “None” or “Yes” is set in the screen division flag. “None” indicates that the motion video screen is not divided, and “Yes” indicates that the motion video screen is divided into two regions 95 and 96. The divided viewpoint information in which the screen division flag is set to “none” includes the position information of the main camera 91. The divided viewpoint information in which the screen division flag is set to “present” includes position information of the main camera 91 and the sub camera 92. The position information is, for example, the viewpoint ID of one of the viewpoints L1 to L17. The viewpoint ID is identification information that can identify each viewpoint in the 3D space. The position and shooting angle of the virtual camera in the three-dimensional virtual space 90 are determined in advance by the viewpoint. The shooting angle indicates, for example, the direction in which the virtual camera is pointed from the viewpoint. That is, the shooting angle indicates the direction of the line of sight for capturing an object in the three-dimensional virtual space 90 on the projection plane. For example, the shooting angle may be represented by a vector. Note that, when the position of the main camera 91 is always fixed at the viewpoint L1, the viewpoint information may not include the position information of the main camera 91. Further, the viewpoint information may include coordinates and a shooting angle as position information of the virtual camera.

  The figure position information is information indicating the position of the figure 83 in the three-dimensional virtual space 90 according to the position of the virtual camera in the three-dimensional virtual space 90. Specifically, in the figure position information, the viewpoint ID, the world coordinates of the figure 83A, and the world coordinates of the figure 83B are set in association with each viewpoint.

[5-2. Configuration of output terminal 5]
As shown in FIG. 1, the output terminal 5 includes a CPU 51, a ROM 52, a RAM 53, a bus 54, an I / O interface 55, a display control unit 56, a disk drive 58, a network communication unit 60, an audio output unit 63, and a signal receiving unit. 65 and HDD 7. The CPU 51 is connected to the ROM 52, RAM 53, bus 54, and I / O interface 55 via the bus 54. The CPU 51 controls each unit of the output terminal 5 by executing a program stored in the ROM 52 or the HDD 7. Connected to the I / O interface 55 are an HDD 7, a display control unit 56, an audio output unit 63, a disk drive 58, a network communication unit 60, a keyboard 61, a mouse 62, a microphone 68, and a signal receiving unit 65. The display control unit 56 outputs a video signal to the monitor 57 based on the control of the CPU 51. The audio output unit 63 outputs an audio signal to the monitor 57 based on the control of the CPU 51. The disk drive 58 writes and reads data to and from the recording medium 59. The signal receiving unit 65 receives a signal output from the remote controller 66. The remote controller 66 is for the operator 42 to operate the output terminal 5.

  The HDD 7 stores motion data, music data, viewpoint information, figure position information, etc. distributed from the distribution server 2. In addition, exercise lesson information is stored in the HDD 7. FIG. 2 is a diagram illustrating a configuration example of exercise lesson information. The exercise lesson information is information that defines the structure of the exercise lesson. The output terminal 5 generates exercise lesson information.

  FIG. 4C is a diagram illustrating a configuration example of exercise lesson information of exercise-oriented lessons. The exercise lesson information of the exercise-oriented lesson includes one or more motion information. The motion information is arranged in the order in which the exercise operation is performed. The exercise lesson information of the exercise-oriented lesson may include a plurality of the same motion information. In the exercise lesson information, motion information, exercise tempo, and music ID are associated with each exercise operation. The music ID is identification information indicating a music. The music ID associated with the motion information indicates the music that is output when performing the exercise motion indicated by the motion information. As described above, actually, only some performance parts of the music are output. Note that the same music piece may be associated with a plurality of movements.

  When the exercise-oriented lesson is performed, the CPU 51 acquires motion information, exercise tempo, and music ID from the exercise lesson information of the exercise-oriented lesson. The CPU 51 acquires music data corresponding to the music ID acquired from the exercise lesson information. Then, the CPU 51 reproduces the music data according to the exercise tempo acquired from the exercise lesson information. Further, the CPU 51 generates an exercise video based on the motion data corresponding to the motion information acquired from the exercise lesson information, and causes the display 67 to display the generated exercise video.

  FIG. 4D is a diagram illustrating a configuration example of exercise lesson information of a music-focused lesson. The exercise lesson information of the music-oriented lesson includes one music ID. The music ID indicates a music that is output while the music-oriented lesson is being performed. The exercise lesson information of the music-oriented lesson includes a plurality of part IDs. The plurality of part IDs indicate the configuration of the performance part of the music indicated by the music ID. The plurality of part IDs are arranged in the order of performance of the performance parts. In the exercise lesson information of the music-oriented lesson, the part ID and the motion information are associated with each performance part. The motion information associated with the part ID indicates an exercise operation performed when the performance part indicated by the part ID is output. Basically, the chorus part is associated with the dance action of the chorus part. Also, a gymnastic action is associated with a performance part different from the chorus part. The same performance part may be played more than once. In this case, the same motion information is associated with the part ID of the same performance part. Accordingly, the same movement is performed in the same performance part. In addition, even if it is the same performance part, exercise | movement movement may differ according to the frequency | count of performance.

  When the music-focused lesson is started, the CPU 51 acquires the music ID from the exercise lesson information of the music-focused lesson. The CPU 51 acquires music data corresponding to the music ID acquired from the exercise lesson information. Then, the CPU 51 reproduces the music data according to the original tempo set in the music data. When receiving the performance part start message from the music sequencer, the CPU 51 acquires motion information corresponding to the part ID included in the performance part start message from the exercise lesson information. The CPU 51 generates an exercise video based on the motion data corresponding to the motion information acquired from the exercise lesson information, and causes the display 67 to display the generated exercise video.

  In common with exercise lessons and music lessons, exercise lesson information includes lesson ID, lesson name, lesson type, and the like. The lesson ID is identification information of an exercise lesson. The lesson type is information indicating whether the exercise lesson is an exercise lesson or a music lesson.

  The HDD 7 further stores various programs such as an OS, an exercise support program, a 3D engine, and a music sequencer. The exercise support program is a program for supporting the exercise of the user 41. The exercise support program causes the CPU 51 as a computer to execute at least the determination step, the first control step, and the second control step. The 3D engine is a program for generating an image obtained by projecting a figure 83 that moves in a three-dimensional virtual space onto a two-dimensional plane based on motion data. The process of generating an image includes projective transformation, clipping, hidden surface removal, shading, texture mapping, and the like. The CPU 51 executes the 3D engine and sequentially generates still images. The CPU 51 sequentially outputs the generated still image to the display control unit 56, so that the motion video is displayed on the display 67 as a moving image.

  The music sequencer is a program for reproducing music data. The CPU 51 generates a sound signal corresponding to the music data by executing the music sequencer. Further, the CPU 51 generates various messages by executing the music sequencer. As the message, for example, there is a message generated at a predetermined time interval according to the tempo. This message is called a MIDI clock or a synchronization message. Examples of the message include a performance part start message and a lyrics message. The performance part start message of the chorus part is called the chorus start message. A performance part start message that is output when the performance of the chorus part ends and the performance of another performance part starts is called a chorus end message.

  Various programs may be downloaded from the server such as the distribution server 2 via the network 10, for example. Various programs may be recorded on the recording medium 59 and read via the disk drive 58. The 3D engine and the music sequencer may be dedicated hardware instead of a program. The output terminal 5 may include a 3D engine or a music sequencer as hardware.

  The CPU 51 outputs an audio signal corresponding to the music data to the audio output unit 63 and outputs a video signal corresponding to the generated image from the display control unit 56 according to the set tempo. The CPU 51 synchronizes the output timing of the music audio signal and the output timing of the motion video signal based on the synchronization message. As a result, a figure 83 that performs an exercise motion in synchronization with the music output from the speaker 64 is displayed on the display 67. Further, the CPU 51 detects the performance part where the performance part is switched and the performance is started based on the performance part start message. The CPU 51 can detect the change of the exercise operation by detecting the change of the performance part of the music.

[6. Operation of Exercise Support System 1]
Next, the operation of the exercise support system 1 will be described with reference to FIGS. 5 to 7 show the motion video output control processing of the CPU 51 of the output terminal 5. The operator 42 operates the keyboard 61 and the mouse 62 and selects execution of the exercise lesson. Then, the CPU 51 causes the display 67 to display a list of exercise lessons based on the exercise lesson information stored in the HDD 7. The operator 42 selects a desired exercise lesson from the list. Then, the motion video output control process is started.

  As shown in FIG. 5, the CPU 51 determines whether or not the type of exercise lesson selected is a music-focused lesson (step S1). Specifically, the CPU 51 determines whether the type of exercise lesson is a music-oriented lesson based on the lesson type included in the exercise lesson information corresponding to the exercise lesson selected by the operator 42. At this time, if the CPU 51 determines that the type of exercise lesson is an exercise-oriented lesson (step S1: NO), the CPU 51 proceeds to step S2. On the other hand, when the CPU 51 determines that the type of exercise lesson is a music-oriented lesson (step S1: YES), the CPU 51 proceeds to step S31. When an exercise lesson is selected, an exercise lesson is started.

  In step S2, the CPU 51 starts a music reproduction process by the music sequencer. Therefore, the CPU 51 waits until the first synchronization message is output from the music sequencer (step S3). When the first synchronization message is output, the CPU 51 determines whether or not a time corresponding to one frame has elapsed since the previous motion image still image was drawn by 3DCG (step S4). For example, when the frame rate is 60 fps, the time for one frame is 1/60 second. When it is determined that the time for one frame has not elapsed (step S4: NO), the CPU 51 performs the determination in step S4 again. On the other hand, when the CPU 51 determines that the time for one frame has elapsed (step S4: YES), the CPU 51 proceeds to step S5.

  In step S5, the CPU 51 obtains an accurate elapsed frame. The elapsed frame is the number of frames that have elapsed since the start of one exercise operation. For example, if 66/60 seconds have elapsed, the elapsed frame is 1.1.

  Next, the CPU 51 determines whether or not the reproduction of all music pieces by the music sequencer is finished (step S6). For example, when the reproduction of one music piece is completed in the reproduction process in the music sequencer, the CPU 51 acquires the music piece ID corresponding to the motion information of the next exercise operation from the exercise lesson information. The CPU 51 performs music reproduction processing based on the music data corresponding to the acquired music ID. Then, the CPU 51 determines that the reproduction of all the music pieces is finished when the reproduction process of the music pieces corresponding to all the music IDs set in the exercise lesson information is finished. At this time, if the CPU 51 determines that the reproduction of all the music is finished (step S6: YES), the motion video output control process is finished. On the other hand, if the CPU 51 determines that the reproduction of all the songs is not finished (step S6: NO), the CPU 51 proceeds to step S7.

  In step S7, the CPU 51 determines whether there is a screen division of the motion video. Specifically, the CPU 51 specifies the motion information of the current exercise motion from the exercise lesson information of the selected exercise lesson. The motion information corresponding to the music ID of the music currently being played back is the current motion motion information. The CPU 51 specifies the range of elapsed time corresponding to the elapsed frame from the viewpoint information corresponding to the specified motion information. Then, the CPU 51 makes a determination based on the screen division flag corresponding to the specified elapsed time. If the CPU 51 determines that there is no screen division (step S7: NO), the CPU 51 proceeds to step S8. On the other hand, if the CPU 51 determines that there is a screen division (step S7: YES), the CPU 51 proceeds to step S11.

  In step S8, the CPU 51 sets the position of the main camera 91 to the viewpoint L1. Next, the CPU 51 performs a drawing process for the figure 83 (step S9). Specifically, the CPU 51 identifies motion data of general exercise motion corresponding to the motion information of the current exercise motion. The CPU 51 specifies the current world coordinates of each part of the body of the figure 83 based on the specified motion data and the elapsed frame. The CPU 51 draws the still image of the figure 83 by 3DCG in the drawing area secured in the RAM 53 based on the world coordinates of each part of the body of the figure 83 and the world coordinates and shooting angle of the main camera 91. Next, the CPU 51 draws the background of the motion video in the drawing area (step S10). In this way, the CPU 51 generates a motion image still image. The CPU 51 proceeds to step S18.

  In step S11, the CPU 51 divides the drawing area into two. Next, the CPU 51 sets the main camera 91 (step S12). Specifically, the CPU 51 acquires position information of the main camera 91 corresponding to the elapsed time range corresponding to the elapsed frame from the viewpoint information. Next, the CPU 51 draws the figure 83 in the first drawing area of the two drawing areas (step S13). Next, the CPU 51 draws a background in the first drawing area (step S14). The processing contents of steps S13 and S14 are the same as the processing contents of steps S9 and S10.

  Next, the CPU 51 sets the sub camera 92 (step S15). Specifically, the CPU 51 acquires position information of the sub camera 92 corresponding to the elapsed time range corresponding to the elapsed frame from the viewpoint information. Next, the CPU 51 draws the figure 83 in the second drawing area of the two drawing areas (step S16). Next, the CPU 51 draws a background in the second drawing area (step S17). The processing contents of steps S16 and S17 are basically the same as the processing contents of steps S9 and S10. However, in step S <b> 16, the CPU 51 draws the figure 83 based on the world coordinates and shooting angle of the sub camera 92. The CPU 51 generates a motion image still image by connecting and synthesizing images drawn in the two drawing areas. The CPU 51 proceeds to step S18.

  In step S <b> 18, the CPU 51 outputs the generated still image to the display control unit 56. As a result, the CPU 51 displays the motion video on the display 67. Next, the CPU 51 proceeds to step S4.

  In step S31, the CPU 51 sets the rust flag to FALSE as shown in FIG. The CPU 51 stores the rust flag in the RAM 53. The rust flag is information indicating whether or not the rust portion is being reproduced. Next, the CPU 51 starts a music reproduction process by the music sequencer (step S32). Next, the CPU 51 waits until the first synchronization message is output (step S33).

  Next, the CPU 51 determines whether or not the operator 42 has requested to change the viewpoint of the main camera 91 (step S34). The operator 42 can request to change the viewpoint by operating the remote controller 66 or the like. At this time, if the CPU 51 determines that there is no viewpoint change request (step S34: NO), the CPU 51 proceeds to step S38. On the other hand, when the CPU 51 determines that a viewpoint change request has been made (step S34: YES), the CPU 51 proceeds to step S35.

  In step S35, the CPU 51 changes the position of the main camera 91 in response to the change request. Next, the CPU 51 determines whether or not the rust flag is TRUE (step S36). At this time, if the CPU 51 determines that the rust flag is not TRUE (step S36: NO), the CPU 51 proceeds to step S38. On the other hand, when the CPU 51 determines that the rust flag is TRUE (step S36: YES), the CPU 51 proceeds to step S37.

  In step S37, the CPU 51 changes the position of at least one of the figures 83A and 83B. Specifically, the CPU 51 acquires the world coordinates of the figures 83A and 83B corresponding to the viewpoint ID of the changed viewpoint from the figure position information. Then, the CPU 51 changes the current world coordinates of the figures 83A and 83B stored in the RAM 53 to the world coordinates corresponding to the viewpoint ID. In the step S37, when the images on the projection plane of the virtual camera at the changed viewpoint position overlap, based on the world coordinates of the center of gravity of the changed figures 83A and 83B, as described above, The figure 83A and the figure 83B are drawn and displayed at a position where the image of the figure 83B does not overlap. Next, the CPU 51 proceeds to step S38.

  In step S38, the CPU 51 determines whether or not a chorus start message has been received from the music sequencer. At this time, if the CPU 51 determines that it has not received the chorus start message (step S38: NO), it proceeds to step S43. On the other hand, if the CPU 51 determines that the rust start message has been received (step S38: YES), the CPU 51 proceeds to step S39.

  In step S39, the CPU 51 determines whether or not the number of reception of the chorus start message is two or more at this time. At this time, if the CPU 51 determines that the number of reception of the chorus start message is not two or more (step S39: NO), the CPU 51 proceeds to step S40. On the other hand, if the CPU 51 determines that the number of reception of the chorus start message is two or more (step S39: YES), the CPU 51 proceeds to step S41.

  In step S40, the CPU 51 sets an initial value for the number of figures. Next, the CPU 51 proceeds to step S42. The figure number is the number of figures 83 displayed when the rust portion is output. The initial value for the number of figures is, for example, 3 or more. In step S41, the CPU 51 adds a predetermined number to the number of figures. The predetermined number is a number greater than zero. Next, the CPU 51 proceeds to step S42. In step S42, the CPU 51 sets TRUE to the rust flag. Next, the CPU 51 proceeds to step S43.

  In step S43, the CPU 51 determines whether or not a chorus end message has been received from the music sequencer. At this time, if the CPU 51 determines that the rust end message has not been received (step S43: NO), the process proceeds to step S51. On the other hand, if the CPU 51 determines that the rust end message has been received (step S43: YES), the CPU 51 proceeds to step S44. In step S44, the CPU 51 sets FALSE to the chorus flag. Next, the CPU 51 proceeds to step S51.

  In step S51, as shown in FIG. 7, the CPU 51 determines whether or not a time corresponding to one frame has elapsed since the previous still image of the motion image was drawn by 3DCG. At this time, when it is determined that the time for one frame has not elapsed (step S51: NO), the CPU 51 performs the determination in step S51 again. On the other hand, if the CPU 51 determines that the time for one frame has elapsed (step S51: YES), the CPU 51 proceeds to step S52.

  In step S52, the CPU 51 obtains an accurate elapsed frame. Next, the CPU 51 determines whether or not the music reproduction by the music sequencer is finished (step S53). For example, an end message is described in the music data. The end message is a message indicating the end of the performance of the entire music. When the CPU 51 receives an end message from the music sequencer, the CPU 51 determines that the reproduction of the music has ended. At this time, if the CPU 51 determines that the reproduction of the music is to end (step S53: YES), the CPU 51 ends the motion video output control process. On the other hand, when the CPU 51 determines that the reproduction of music is not finished (step S53: NO), the CPU 51 proceeds to step S54.

  In step S54, the CPU 51 determines whether or not the rust flag is TRUE. At this time, if the CPU 51 determines that the rust flag is not TRUE (step S54: NO), the CPU 51 proceeds to step S55. On the other hand, when the CPU 51 determines that the rust flag is TRUE (step S54: YES), the CPU 51 proceeds to step S59.

  In step S55, the CPU 51 sets the position in the three-dimensional virtual space of the figure 83A that performs the general motion operation. Specifically, the CPU 51 sets the world coordinates of the center of gravity of the figure 83A stored in the RAM 53 as coordinates indicating the current position of the figure 83A in the three-dimensional virtual space 90. Next, the CPU 51 draws the figure 83A (step S56). Specifically, the CPU 51 specifies motion information corresponding to the performance part currently output from the exercise lesson information of the selected exercise lesson. CPU51 specifies the motion data of the general exercise | movement action corresponding to the specified motion information. The CPU 51 specifies the current world coordinates of each part of the body of the figure 83A based on the specified motion data, the elapsed frame, and the world coordinates of the center of gravity of the figure 83. The CPU 51 draws the still image of the figure 83A in the drawing area secured in the RAM 53 based on the world coordinates of the center of gravity of the figure 83A, the world coordinates of each part of the body, and the world coordinates and shooting angle of the main camera 91. To do. Next, the CPU 51 sets the position of the figure 83B that performs the reduced exercise motion (step S57). Specifically, the CPU 51 sets the world coordinates of the center of gravity of the figure 83B stored in the RAM 53 as coordinates indicating the current position of the figure 83B in the three-dimensional virtual space 90. Next, the CPU 51 draws the figure 83B (step S58). The processing content of step S58 is basically the same as the processing content of step S56. However, the CPU 51 performs drawing based on the motion data of the reduced exercise motion. Next, the CPU 51 proceeds to step S64.

  In step S59, the CPU 51 sets 1 to the index N. Next, the CPU 51 sets the position of the Nth figure 83 in the three-dimensional virtual space 90 (step S60). For example, the position of each figure 83 in the three-dimensional virtual space 90 is predetermined according to the number of figures. Next, the CPU 51 draws an Nth figure 83. The processing content of step S61 is basically the same as the processing content of step S56. However, the CPU 51 performs drawing based on the motion data of the movement of the chorus part.

  Next, the CPU 51 adds 1 to the index N (step S62). Next, the CPU 51 determines whether or not the value of the index N is larger than the number of figures (step S63). At this time, if the CPU 51 determines that the value of the index N is equal to or less than the number of figures (step S63: NO), the CPU 51 proceeds to step S60. On the other hand, when the CPU 51 determines that the value of the index N is larger than the number of figures (step S63: YES), the CPU 51 proceeds to step S64.

  In step S64, the CPU 51 draws a background in the drawing area. Next, the CPU 51 outputs a still image of the motion video generated in the drawing area to the display control unit 56 (step S65). As a result, the CPU 51 displays the motion video on the display 67. Next, the CPU 51 proceeds to step S34.

  As described above, according to the present embodiment, the CPU 51 determines whether the exercise lesson is an exercise-oriented lesson or a music-oriented lesson. When the CPU 51 determines that the exercise lesson is an exercise-oriented lesson, the image of the exercise motion of the figure 83 taken by the main camera 91 and the exercise operation identical to the exercise operation taken by the main camera 91 are displayed on the main camera 91. An image taken by the sub camera 92 arranged at a position different from the position is displayed on the display 67. When the CPU 51 determines that the exercise lesson is a music-oriented lesson, the CPU 67 causes the display 67 to display an image of the figure 83 performing the same exercise operation. Therefore, the expression of the figure 83 can be automatically changed depending on whether the lesson is focused on exercise or lesson focused on music.

  In the above embodiment, the information processing apparatus of the present invention is applied to the output terminal 5. However, the information processing apparatus of the present invention may be applied to the distribution server 2. For example, when exercise lesson information is generated, the distribution server 2 may previously generate moving image data of exercise video based on the exercise lesson information. When the exercise lesson is performed, the distribution server 2 transmits the moving image data to the output terminal 5 in a streaming manner. As a result, the distribution server 2 displays the motion video on the output terminal 5.

1 exercise support system 2 distribution server 3 database 5 output terminal 7 HDD
51 CPU
52 ROM
53 RAM
56 Display Control Unit 60 Network Communication Unit 63 Audio Output Unit 68 Microphone 57 Monitor 64 Speaker 67 Display

Claims (8)

The exercise lesson that is performed according to the display of the image and the output of the music using the virtual object arranged in the three-dimensional virtual space, the first exercise lesson where the exercise is more important than the music, and the exercise Determining means for determining whether the music is a second exercise lesson in which music is important;
When the determination means determines that the exercise lesson is the first exercise lesson, an image obtained by exercising the exercise by the virtual object with the first virtual camera and an exercise by the first virtual camera A first control means for displaying on a predetermined display means an image obtained by copying the same motion movement with a second virtual camera arranged at a position different from the position of the first virtual camera;
When the determination means determines that the exercise lesson is the second exercise lesson, the display means displays on the display means an image obtained by copying the plurality of virtual objects performing the same exercise operation with the first virtual camera. Two control means;
An information processing apparatus comprising:   The second control means displays an image obtained by copying the plurality of virtual objects performing the same movement with the first virtual camera when a chorus part is output among the plurality of performance parts constituting the music piece. When the performance part different from the chorus part is output, the virtual object that performs a motion action on the body with a predetermined exercise load and a load smaller than the predetermined exercise load are output as the plurality of virtual objects. The information processing apparatus according to claim 1, wherein an image obtained by copying the virtual object that performs an exercise motion on the body with the first virtual camera is displayed.   The second control unit is configured to display the virtual part displayed on the display unit when a chorus part is output among a plurality of performance parts constituting the music, rather than when a performance part different from the chorus part is output. The information processing apparatus according to claim 1, wherein the number of objects is increased.   The second control means increases the number of the virtual objects displayed on the display means when the chorus part is output in the performance parts constituting the music every time the chorus part is outputted. The information processing apparatus according to any one of claims 1 to 3. A permission means for permitting a change of the position of the first virtual camera when a performance part different from the chorus part is output among performance parts constituting the music piece in the second exercise lesson;
When the display position of at least two virtual objects overlaps according to the position of the first virtual camera, the second control means sets the position of at least one virtual object to the position of the first virtual camera. The information processing apparatus according to claim 1, wherein the information processing apparatus is changed to a position corresponding to the information processing apparatus.   In the determination means, the exercise lesson is any one of the first exercise lesson in which the music is output according to the tempo at which the exercise is operated and the second exercise lesson in which the music is output according to the original tempo of the song. 6. The information processing apparatus according to claim 1, wherein it is determined whether or not there is any. An information processing method executed by an information processing apparatus,
The exercise lesson that is performed according to the display of the image and the output of the music using the virtual object arranged in the three-dimensional virtual space, the first exercise lesson where the exercise is more important than the music, and the exercise A determination step for determining whether the music is a second exercise lesson in which music is important;
When the determination means determines that the exercise lesson is the first exercise lesson, an image obtained by exercising the exercise by the virtual object with the first virtual camera and an exercise by the first virtual camera A first control step of displaying on a predetermined display means a video image of a second virtual camera arranged at a position different from the position of the first virtual camera with the same motion movement as
When it is determined in the determination step that the exercise lesson is the second exercise lesson, the display means displays a plurality of virtual objects that perform the same exercise operation on the display means. Two control steps;
An information processing method comprising: In the computer included in the information processing device,
The exercise lesson that is performed according to the display of the image and the output of the music using the virtual object arranged in the three-dimensional virtual space, the first exercise lesson where the exercise is more important than the music, and the exercise A determination step for determining whether the music is a second exercise lesson in which music is important;
When the determination means determines that the exercise lesson is the first exercise lesson, an image obtained by exercising the exercise by the virtual object with the first virtual camera and an exercise by the first virtual camera A first control step of displaying on a predetermined display means a video image of a second virtual camera arranged at a position different from the position of the first virtual camera with the same motion movement as
When it is determined in the determination step that the exercise lesson is the second exercise lesson, the display means displays a plurality of virtual objects that perform the same exercise operation on the display means. Two control steps;
A program characterized by having executed.

Images