JP2016071433A - Content generation device, content generation method, content generation program, and content generation system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To eliminate discontinuity in a character behavior and facilitate content generation.SOLUTION: The content generation device according to one aspect of the present invention comprises: an information acquisition unit for acquiring the music information of a music content, the beat information of the music of the music content, virtual camera operation information corresponding to the operation of a virtual camera, and character information including character behavior information indicating the behavior of a character included in the music content; a content generation unit for generating a music content for each rhythm on the basis of the music information, the virtual camera operation information, and the character information associated with the beat information, each of the music information, the virtual camera operation information, and the character information being associated with the beat information for each rhythm including one or more beats based on the beat information, the content generation unit generating the music content so that the operation of the virtual camera in the music content is switched for each rhythm.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a content generation device, a content generation method, a content generation program, and a content generation system.

  Conventionally, in an animation movie or a video game, synchronized playback in which an image synchronized with music sound is reproduced in synchronization with the music sound is widely known.

  In this regard, Patent Document 1 registers a plurality of motion data for each motion of a character, and compresses or compresses the motion data to synchronize with the tempo information based on tempo information obtained from music data. There is described a character dance action display device capable of displaying a dance with a rhythmic character by expanding and reproducing the character.

Japanese Patent Laid-Open No. 10-319957

  In the character dance movement display device described in Patent Document 1, the character can be continuously moved in accordance with the music in the music content. For example, the character raises the right hand at the end of a certain time signature, and the next time signature In dance content in which the character raises his left hand at the start, the discontinuity of the character's motion may be noticeable. In addition, in order to eliminate the discontinuity of the character's movement in the dance content, a method of interpolating the appearance at the start of the next time can be considered, but each time the interpolation is performed, the timing of the interpolation and the time signature There was a restriction that it was necessary to synchronize the start.

  The present invention has been made in view of such circumstances, and it can be one of the objects to eliminate discontinuity of character movement and facilitate content generation.

  A content generation device according to one aspect of the present invention includes music information of music content, beat information of music of the music content, virtual camera operation information corresponding to the operation of the virtual camera, and characters included in the music content. An information acquisition unit for acquiring character information including character motion information indicating motion, and the music information, virtual camera motion information, and character information for each time signature including one or more beats based on the beat information. A content generation unit that generates music content for each time signature based on the music information, the virtual camera operation information, and the character information, each of which is associated with the beat information. The content generation unit is configured such that the operation of the virtual camera in the music content is the time signature. To produce music content to switch to.

  A content generation method according to one aspect of the present invention includes music information of music content, beat information of music of the music content, virtual camera operation information corresponding to the operation of the virtual camera, and characters included in the music content. Information acquisition step for acquiring character information including character motion information indicating motion; and for each time signature including one or more beats based on the beat information, the music information, the virtual camera motion information, and the character information A content generation step of generating music content for each time signature based on the music information, the virtual camera operation information, and the character information, each of which is associated with the beat information. The content generation step includes the step of the virtual camera in the music content. Create generates music content to switch to each of the beats.

  A content generation program according to an aspect of the present invention includes, in a computer, music information of music content, beat information of music of the music content, virtual camera operation information corresponding to operation of a virtual camera, and the music content. Character information including character motion information indicating the motion of the character to be acquired, an information acquisition function for acquiring, the music information for each time signature including one or more beats based on the beat information, the virtual camera motion information, and the A content generation function for generating each piece of music content for each time signature based on the music information, the virtual camera motion information, and the character information associated with the beat information. In the content generation function, the virtual content in the music content Operation of camera is, to realize a function of generating a music content to switch to each of the beats.

  A content generation system according to an aspect of the present invention is a content generation system including a content generation device and a playback device, wherein the content generation device includes music information of music content and a beat of the music of the music content. Information acquisition unit for acquiring information, virtual camera motion information corresponding to the motion of the virtual camera, and character information including character motion information indicating the motion of the character included in the music content, and one based on the beat information For each time signature including two or more beats, each of the music information, the virtual camera motion information, and the character information is associated with the beat information, the music information associated with the beat information, the virtual camera motion information, And content that generates music content for each time signature based on the character information. A generating unit; and a transmitting unit that transmits the generated music content to the playback device, wherein the content generating unit is configured so that the operation of the virtual camera in the music content is switched for each time signature. The playback device plays back the music content transmitted from the content generation device.

  In the present invention, “part”, “apparatus”, and “system” do not simply mean physical means, but the functions of the “part”, “apparatus”, and “system” are realized by software. This includes cases where Further, even if the functions of one “part”, “apparatus”, and “system” are realized by two or more physical means and apparatuses, two or more “parts”, “apparatus”, “system” The function may be realized by one physical means or apparatus.

  According to the present invention, by discontinuously switching the motion of the virtual camera (camera in the virtual world) for each time signature, the discontinuity of the motion of the character can be eliminated and content generation is facilitated. be able to.

1 is an overall configuration diagram of a content generation system according to an embodiment of the present invention. It is a block diagram which shows schematically the hardware constitutions of the content generation apparatus which concerns on embodiment of this invention. It is a block diagram of the content production | generation apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the beat information memorize | stored in the disc drive of the content generation apparatus which concerns on embodiment of this invention. FIG. 4A is a diagram illustrating an example in which a piece of music having music content is configured with a time signature including eight beats. FIG.4 (b) is a figure which shows the example by which the music with a music content is comprised with the time signature containing 16 beats. It is a figure which shows an example of the music information memorize | stored in the disk drive of the content generation apparatus which concerns on embodiment of this invention. FIG. 5A is a diagram illustrating an example of music information of a certain music part in a certain music. FIG. 5B is a diagram showing an example of music information of a music part in a music different from the music shown in FIG. It is a figure which shows an example of the camera operation information memorize | stored in the disk drive of the content generation apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the character information memorize | stored in the disc drive of the content generation apparatus which concerns on embodiment of this invention. FIG. 7A is a diagram showing an example of character information indicating a character ID and a character name. FIG. 7B is a diagram showing an example of character information indicating the character's dance motion ID and the character's dance motion name. FIG. 7C is a diagram showing an example of character information indicating the character dance position ID and the character dance position name. It is a figure which shows an example of the production | presentation information memorize | stored in the disc drive of the content generation apparatus which concerns on embodiment of this invention. FIG. 5 is a correspondence diagram schematically showing music information, camera motion information, effect information, and character information associated with each time signature according to an embodiment of the present invention. It is a figure which shows an example of the reproduction | regeneration screen of the music content reproduced | regenerated by the reproducing | regenerating apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the reproduction | regeneration condition of the music content reproduced | regenerated by the reproducing | regenerating apparatus which concerns on embodiment of this invention. FIG. 11A is a diagram showing an example of music content played at a certain time. FIG. 11B is a diagram showing an example of music content that is played back in the time signature next to the time signature in FIG. FIG.11 (c) is a figure which shows an example of the music content reproduced | regenerated in the time signature following the time signature of FIG.11 (b). It is a flowchart which shows an example of the reproduction | regeneration processing flow of the music content which concerns on embodiment of this invention.

  Embodiments of the present invention will be described below with reference to the drawings. However, the embodiment described below is merely an example, and there is no intention to exclude various modifications and technical applications that are not explicitly described below. In other words, the present invention can be implemented with various modifications (combining the embodiments, etc.) without departing from the spirit of the present invention. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. The drawings are schematic and do not necessarily match actual dimensions and ratios. In some cases, the dimensional relationships and ratios may be different between the drawings.

  FIG. 1 is an overall configuration diagram of a content generation system according to an embodiment of the present invention. As illustrated in FIG. 1, the content generation system 1 exemplarily includes a content generation device 3 that generates music content, a playback device 5 that reproduces music content generated by the content generation device 3, and a user operation. And an input device 9.

  The playback device 5 is a device that outputs images and outputs sound, and plays back music content. For example, the playback device 5 may be a television or computer display having a display and a speaker. The playback device 5 may be connected to the content generation device 3 by a wired cable or a wireless LAN (Local Area Network).

  The input device 9 is a device that transmits a control signal corresponding to operation information input by a user to the content generation device 3. In this embodiment, the input device 9 is configured to be capable of wireless communication with the content generation device 3. The input device 9 and the content generation device 3 establish a wireless connection by utilizing, for example, a Bluetooth (registered trademark) protocol. Note that the input device 9 and the content generation device 3 may be configured to transmit the control signal via a wired cable.

  The content generation device 3 is a device that generates music content. The content generation device 3 exhibits a content generation function by loading an application program for content generation. The content generation device 3 is a game machine, for example, and may be a personal computer or the like.

  Further, the content generation device 3 has a USB (Universal Serial Bus) terminal, can be connected to an external device such as a personal computer via the cable 7 and can acquire various information from the external device. Furthermore, the content generation device 3 has a media drive and is configured to acquire various types of information from a ROM medium. Furthermore, the content generation device 3 may be configured to acquire various types of information from an external server or the like via a network. In the present embodiment, the input device 9, the playback device 5, and the content generation device 3 are separate bodies, but they may be configured integrally. For example, the input device 9, the playback device 5, and the content generation device 3 may be configured as a mobile terminal device that executes content generation processing.

  FIG. 2 is a configuration diagram schematically showing a hardware configuration of the content generation apparatus according to the embodiment of the present invention. As shown in FIG. 2, the content generation device 3 exemplarily includes a wired / wireless interface 10, an antenna 11, a data processing unit 12, a memory 14, a hard disk drive 15, a disk drive 16, a recording medium attaching / detaching unit 18, and a control. The unit 100 is provided. Each of the above configurations is configured to input / output various information and data via the bus 19.

  The wired / wireless interface 10 is means for transmitting and receiving data by connecting to an external device by wire or wireless. The wired / wireless interface 10 is connected to an external device via the predetermined cable 7 described above, and acquires various types of information from the external device. The wired / wireless interface 10 is connected to the input device 9 using a predetermined wireless communication protocol. A control signal from the input device 9 is supplied to the control unit 100 via the antenna 11, the wired / wireless interface 10, and the bus 19. The wired / wireless interface 10 may be configured such that the wired interface unit and the wireless interface unit are integrated, or may be configured separately.

  The data processing unit 12 includes a frame memory that buffers video / audio data that constitutes content to be played back by the playback device 5.

  The memory 14 is configured as a RAM (Random Access Memory), and includes, for example, a main memory and a buffer memory.

  The hard disk drive 15 is an auxiliary storage device that stores various information and data. The hard disk drive 15 stores, for example, various information and data received via the wired / wireless interface 10, and stores various information and data read from the removable recording medium by the recording medium attaching / detaching unit 18 as described later.

  The disk drive 16 is a device that drives a read-only ROM disk and reads data. When the ROM disk is loaded, the disk drive 16 reads data stored in the ROM disk. The ROM disk is, for example, an optical disk or a magneto-optical disk.

  The recording medium attaching / detaching unit 18 is a device that reads data from the removable recording medium when the removable recording medium is loaded. Here, the dance game program in this embodiment may be recorded on a removable recording medium or a ROM disk, and may be configured to be installed from the recording medium attaching / detaching unit 18 or the disk drive 16 to the hard disk drive 15. . Further, the program may be acquired from an external server or the like via a network.

  The control unit 100 includes a CPU, and controls processing executed by each of the above components included in the content generation device 3. The control unit 100 is configured to include a plurality of processor cores in the CPU. Further, the control unit 100 includes a memory controller connected to the memory 14.

  FIG. 3 is a block diagram of the content generation apparatus according to the embodiment of the present invention. As shown in FIG. 3, the hard disk drive 15 of the content generation device 3 includes a storage unit, and the storage unit illustratively includes a beat information storage unit 20, a music information storage unit 22, and camera operation information. A storage unit 24, a character information storage unit 26, and an effect information storage unit 28 are provided. The control unit 100 of the content generation device 3 is functionally configured to include a reception unit 101, an information management unit 103, an information acquisition unit 105, a content generation unit 107, and a transmission unit 109. . The functional block is a functional block realized by the control unit 100 executing a predetermined software program.

  A memory | storage part is a block which memorize | stores the beat information, music information, camera operation information, character information, and effect information which are mentioned later exemplarily. For example, the storage unit stores each of beat information, music information, camera motion information, character information, and effect information without associating each other. The storage unit may store at least one of music information, camera motion information, character information, and effect information in association with beat information.

  The beat information storage unit 20 is a block that stores information (beat information) related to the beat of the music of the music content.

  FIG. 4 is a diagram illustrating an example of beat information stored in the disk drive of the content generation device according to the embodiment of the present invention. In particular, FIG. 4A is a diagram showing an example in which a piece of music with music content is composed of time signatures including eight beats. FIG.4 (b) is a figure which shows the example by which the music with a music content is comprised with the time signature containing 16 beats. Here, the “time signature” refers to a minimum unit constituting dance data.

  As shown to Fig.4 (a), a certain music is comprised by the continuous time signature containing 8 beats, and the time signature B1, B2, B3, B4, B5, B6, ... and music from the music start position. Continue to end position. Thus, a certain musical piece is composed of only a single time signature.

  As shown in FIG.4 (b), a certain music is comprised by the continuous time signature containing 16 beats, and continues from the music start position to the said time signature B11, B12, B13, ..., and a music end position. As described above, the musical piece shown in FIG. 4B is composed of a time signature including 16 beats twice the time signature shown in FIG. 4A (time signature including 8 beats).

  In this way, each information (each data) is modularized in units of 8 beats by configuring with the minimum number of beats (for example, 8 beats) and an integral multiple of the number of beats (for example, 16 beats, 24 beats, etc.). Since it is not necessary to consider music with mixed time signatures including various beats, dance content can be generated easily. In the present embodiment, the minimum number included in the time signature, which is the minimum unit constituting the dance data, is described as 8 beats, but the present invention is not limited to this and may be one or more beats.

  Returning to FIG. 3, the music information storage unit 22 stores the music information of the music content. The song information of the song content includes, for example, a song ID, song name, song tempo, song part ID, song part name, beat information, song lyrics data (text data), and audio data. The beat information may be, for example, beat information or time information in a certain music part, or may be beat information or time information in another unit of the music. The music information storage unit 22 stores the music information without being associated with each other, or stores a part of the music information in association with each other.

  For example, the music information storage unit 22 stores a music ID and a music name in association with each other, and stores a music part ID and a music part name in association with each other. In addition, the music information storage unit 22 may store, for example, a music part ID and a music part name in association with music lyrics data (text data) and audio data. In addition, as will be described later, the music information storage unit 22 may store the music information in association with each other as a music information table shown in FIG.

  FIG. 5 is a diagram showing an example of music information stored in the disk drive of the content generation device according to the embodiment of the present invention. In particular, FIG. 5A is a diagram illustrating an example of music information of a certain music part in a certain music. FIG. 5B is a diagram showing an example of music information of a music part in a music different from the music shown in FIG.

  Fig.5 (a) has shown the music information table of the music part P113 of the music T111. As shown in FIG. 5 (a), the table exemplarily includes “song ID”: T111, “song name”: song 111, “tempo”: 5, “part ID”: P113, “Part name”: A melody 002, “beat information”: 8 beats, lyrics (text) data, and audio data are included. The music information storage unit 22 includes “music ID”: T111, “music name”: music 111, “tempo”: 5, “part ID”: P113, “part name”: A melody 002, “ Beat information ": 8 beats, lyrics (text) data, and audio data are stored in association with each other. Regarding “tempo”, when the setting in the dance game according to the present embodiment is, for example, 10 for the fastest tempo and 1 for the slowest tempo, the “tempo” of the music (music part) in FIG. Since “tempo” is 5, it can be understood that it is moderate.

  FIG. 5B shows a music information table of the music part P313 of the music T231. As shown in FIG. 5B, the table includes, for example, “music ID”: T231, “music name”: music 231, “tempo”: 10, “part ID”: P313, “Part name”: B chorus 025, “beat information”: 16 beats, lyrics (text) data, and audio data. The music information storage unit 22 includes “music ID”: T231, “music name”: music 231, “tempo”: 10, “part ID”: P313, “part name”: B chorus 025, “ Beat information ": 16 beats, lyrics (text) data, and voice data are stored in association with each other. Since the tempo of the music (music part) in FIG. 5B is “tempo”: 10, it can be understood that the music has the fastest tempo in the dance game according to the present embodiment.

  Returning to FIG. 3, the camera operation information storage unit 24 stores the operation information of the virtual camera. The operation information of the virtual camera corresponds to viewpoint information corresponding to the viewpoint for the user to view the music content. Here, the viewpoint refers to a gaze point that is mainly where the user views the music content, or in which range the user mainly views the music content. It means the range to watch whether you are watching. This gaze range may be a part of the display on which the music content of the playback device 5 is displayed, or may be the entire display. In the present embodiment, the viewpoint for the user to view the music content (dance video) is related to the operation information of the virtual camera that captured the still image and / or video that constitutes the dance video, for example, the position information and direction of the virtual camera. Based on information.

  FIG. 6 is a diagram illustrating an example of camera operation information stored in the disk drive of the content generation apparatus according to the embodiment of the present invention. As shown in FIG. 6, the camera operation information storage unit 24 stores “operation ID” and “operation name” in association with each other as the camera operation information table. Specifically, as shown in FIG. 6, the camera operation information storage unit 24 has “operation ID”: M01 and “operation name”: fixed before, “operation ID”: M02 and “operation name”: left. Fixed, “Action ID”: M03 and “Action Name”: Fixed on the right, “Action ID”: M04 and “Action Name”: Fixed on top, “Action ID”: M05 and “Action Name”: Fixed on bottom, “Action ID”: M06 and “Action Name”: move from the center to the left, “Action ID”: M07 and “Action Name”: move from the center to the right, “Action ID”: M08 and “Action Name”: from the back “Action ID”: M09 and “Action Name”: Move from the left rear to the left front, “Action ID”: M10 and “Action Name”: Move from the right rear to the right front, “Action ID”: M11 and “ "Action Name": Pull from front to back, "Action ID": M12 and "Operation Name": draw from left front to left rear, "Operation ID": M13 and "Operation Name": pull to the right behind the right front, and stored in association with the.

  Regarding the “motion name”: “fixed before” in the camera motion information, a certain character appears in the music content as described later. For example, when a virtual camera is positioned in front of the character, the position Is fixed (see, for example, FIGS. 10 and 11). Further, regarding “motion ID”: “M11” and “motion name”: “pull from front to back”, for example, when the virtual camera is located in front of the character, it is pulled backward from that position (the position is used as a reference). As you move away from the character).

  Returning to FIG. 3, the character information storage unit 26 stores character information of one or more characters included (appearing) in the music content. Character information includes, for example, a character ID, a character name, a dance action ID indicating a character's dance action, a dance action name, a dance position (arrangement) ID indicating a character's dance position (arrangement), and a dance position (arrangement) name. including. The character information storage unit 26 stores the character information without being associated with each other, or stores a part of the character information in association with each other. As will be described later, the character information storage unit 26 may store the character information in association with each other as each table shown in FIG.

  FIG. 7 is a diagram showing an example of character information stored in the disk drive of the content generation device according to the embodiment of the present invention. In particular, FIG. 7A shows an example of a table configured by associating a character ID and a character name. FIG. 7B is a diagram showing an example of a table configured by associating a character's dance action ID and a character's dance action name. FIG. 7C is a diagram showing an example of a table configured by associating a character dance position ID and a character dance position name.

  As shown in FIG. 7A, the table of character ID and character name is illustratively “character ID”: C001 and “character name”: Otoha, “character ID”: C002 and “character name”: Kyoka. “Character ID”: C003 and “Character Name”: Kana Deco, “Character ID”: C004, “Character Name”: Nene, “Character ID”: C005, and “Character Name”: Aria are associated with each other. .

  As shown in FIG. 7B, the table of the character dance action ID and the character dance action name is illustratively “dance action ID”: D001 and “dance action name”: active 1, “dance action ID”. "D002 and" dance action name ": active 2," dance action ID ": D012 and" dance action name ": cute 2," dance action ID ": D013 and" dance action name ": cute 3," dance action " “ID”: D025 and “Dance action name”: Beauty 5 are associated with each other. Here, with respect to the “dance action name”, for example, the dance action of “active X (X is a number)” indicates an active dance action, for example, twisting the body strongly, shaking the arm vigorously, etc. An action that creates an active idea. In addition, the dance operation “Cute X (where X is a number)” refers to a dance operation that makes you feel cute.

  As shown in FIG. 7C, the table of the character dance position ID and the character dance position name is, for example, “dance position ID”: P001 and “dance position name”: position 001, “dance position ID”. ": P005 and" dance position name ": position 005," dance position ID ": P021 and" dance position name ": position 021," dance position ID ": P032 and" dance position name ": position 032," dance position " “ID”: P050 and “dance position name”: position 050 are associated with each other. Here, as described later, the “dance position” is information corresponding to a position set for a certain character in the arrangement of the plurality of characters when there are a plurality of characters, for example. (See FIGS. 10 and 11).

  Returning to FIG. 3, the effect information storage unit 28 stores information related to effects included in the music content (for example, special effects such as highlighting and sound effects).

  FIG. 8 is a diagram showing an example of effect information stored in the disk drive of the content generation device according to the embodiment of the present invention. As shown in FIG. 8, the effect information storage unit 28 stores “effect ID” and “effect name” in association with each other as an effect information table. Specifically, as shown in FIG. 8, the effect information storage unit 28 has “effect ID”: R001 and “effect name”: highlight 1, “effect ID”: R002 and “effect name”: highlight 2 “Production ID”: R003 and “Production name”: Emphasis display 3, “Production ID”: R004 and “Production name”: Emphasis display 4, “Production ID”: R005 and “Production name”: Emphasis display 5, “ "Production ID": R006 and "Production name": Highlighting 6, "Production ID": R101 and "Production name": Sound effect 1, "Production ID": R102 and "Production name": Sound effect 2, "Production ID" ": R103 and" Production name ": Sound effect 3," Production ID ": R104 and" Production name ": Sound effect 4," Production ID ": R105 and" Production name ": Sound effect 5 are stored in association with each other.

  Among the production information, “highlighting” is a character that dances in the music content (dance video, game) of the present embodiment as will be described later, and attracts the user's interest according to this dance or music. An effect of adding a display that increases the degree of excitement of the user. “Highlight display” is an additional display in which a large number of stars dance around the character in accordance with, for example, dance or music. The “sound effect” refers to, for example, an effect of adding a sound different from the music according to the dance excitement or an effect of temporarily increasing the volume of the music according to the dance excitement.

  Returning to FIG. 3, the receiving unit 101 is a block that receives various information and various signals from an external device. For example, the receiving unit 101 receives a control signal corresponding to operation information input from the input device 9 by the user.

  The information management unit 103 is a block that manages information recorded in the hard disk drive 15 of the content generation device 3. For example, the information management unit 103 manages to associate at least one of music information, virtual camera motion information, character information, and effect information stored in the storage unit with beat information. Specifically, the information management unit 103 manages each piece of music information, virtual camera operation information, character information, and effect information in association with beat information for each beat.

  FIG. 9 is an example of a correspondence diagram schematically showing music information, virtual camera motion information, effect information, and character information associated with each time signature according to the embodiment of the present invention. In FIG. 9, a music composed of continuous time signatures including eight beats and continuing from the music start position to the time signatures B1, B2, B3,... And the music end position will be described as an example. In addition, in FIG. 9, although the minimum number which a time signature contains is demonstrated with 8 beats, it is not limited to this and may be one or more beats. Moreover, the music may be comprised combining several different time signatures.

  As illustrated in FIG. 9, for example, the information management unit 103 manages music information, virtual camera motion information, effect information, and character information so as to be associated with each time signature. As shown in FIG. 9, music information 1I1, virtual camera motion information 1I2, performance information 1I3, and character information 1I4 are associated with 8 beats (first time) B1, music information 2I11, virtual camera motion information 2I12, performance information. 2I13 and character information 2I14 are associated with 8 beats (second time signature) B2, and music information 3I21, virtual camera motion information 3I22, effect information 3I23, and character information 3I24 are associated with 8 beats (third time signature) B3. As will be described later, the content generation unit 107 generates music content based on information associated with each time signature.

  The information management unit 103 is a block for editing information recorded in the hard disk drive 15 of the content generation device 3. Specifically, the information management unit 103 edits at least one of the managed music information, virtual camera operation information, effect information, and character information. For example, if the user wants to change the whole or part of the dance game video or music composition (for example, change a dance module with music to another module, change the number of characters that appear, and change other characters The information management unit 103 edits the information based on the user's instruction.

  The information acquisition unit 105 is a block that acquires information recorded in the hard disk drive 15 of the content generation device 3. Specifically, the information acquisition unit 105 stores information stored in each of the beat information storage unit 20, the music information storage unit 22, the camera motion information storage unit 24, the character information storage unit 26, and the effect information storage unit 28. To get.

  The content generation unit 107 is a block that generates music content. Specifically, the content generation unit 107 generates music content based on the information acquired by the information acquisition unit 105.

  The transmission unit 109 is a block that transmits various contents, information, and signals to an external device. Specifically, the transmission unit 109 transmits the music content generated by the content generation unit 107 to the playback device 5. Then, the playback device 5 plays back the music content from the content generation device 3.

  FIG. 10 is a diagram showing an example of a playback screen for music content played back by the playback apparatus according to the embodiment of the present invention. As shown in FIG. 10, the music content played by the playback device 5 is displayed on the display D1, and each user 200A, B, C is viewing the music content. In the music content, five female characters C dance, the lyrics T corresponding to the music are displayed, and a special effect R such that many stars are scattered is also applied.

  Further, the content generation unit 107 associates each piece of music information, virtual camera operation information, character information, and performance information with beat information for each time signature including one or more beats based on beat information, and associates the beat information with the beat information. Based on the received music information, virtual camera operation information, and character information, music content is generated for each time signature.

  Specifically, the content generation unit 107 associates each piece of music information, virtual camera motion information, and character information with beat information for each beat including one or more beats based on beat information, and associates the beat information with the beat information. Based on the received music information, virtual camera operation information, and character information, the music content is generated such that the operation of the virtual camera in the music content is switched for each beat. Since the production information is optional information, as described above, the content generation unit 107 may generate the music content without using the production information.

  Furthermore, the content generation unit 107 generates music content so that the operation of the last virtual camera in the time signature before the operation of the virtual camera is switched is different from the operation of the first virtual camera in the time signature immediately after the time signature. . Specifically, the control unit 100 determines that the content generation unit 107 has the operation of the last virtual camera in the time signature before the operation of the virtual camera is switched and the operation of the first virtual camera in the time signature immediately after the time signature. Control is performed so that the same virtual camera information cannot be selected.

  FIG. 11 is a diagram illustrating an example of a playback state of music content played back by the playback apparatus according to the embodiment of the present invention. 11A shows the music content played on the display D11 in time signature N (an integer equal to or greater than 1), and FIG. 11B shows the music content played on the display D12 in time signature N + 1. (C) shows the music content reproduced on the display D13 with the time signature N + 2. As shown in FIGS. 11 (a), (b), and (c), the operation of the virtual camera of the music content that is played for each time signature is switched. In this way, the content generation unit 107 associates at least each piece of music information, virtual camera motion information, and character information with each beat, and at least the music information and virtual camera motion information associated with the beat information. And based on character information, a music content is produced | generated so that operation | movement of the virtual camera in a music content may switch for every time signature.

  FIG. 12 is a flowchart showing an example of a music content playback processing flow according to the embodiment of the present invention.

  First, the following description will be made on the assumption that a predetermined process (such as log-in to a game) for the user 200 to start a dance game has ended in the present embodiment. As shown in FIG. 12, the user 200 first instructs the content generation device 3 to start editing various information such as music information via the input device 9 (step SP1).

  Next, the content generation device 3 executes editing and management of the information based on an instruction from the user 200 (step SP2).

  Next, the user 200 instructs the content generation device 3 to reproduce the music content (step SP3).

  Next, the content generation device 3 acquires information recorded on the hard disk drive 15 (step SP4). Next, music content is generated based on the acquired information (step SP5).

  Next, the content generation device 3 transmits the generated music content to the playback device 5 (step SP6). Next, the playback device 5 plays back the music content from the content generation device 3 (step SP7).

  As described above, according to the embodiment of the present invention, the dance camera is modularized by switching the virtual camera for each time signature. Further, in the present invention, each dance module is, for example, modularized dance content in a state where the character raised the right hand and a character raised the left hand for each time signature, which is managed and edited for each time signature. The And even if the dance content starts with the left-handed state right after the conventional state with the right-handed state, the character's motion Discontinuity can be eliminated, and content generation can be facilitated.

<Other variations>
In addition, each said embodiment is for making an understanding of this invention easy, and does not limit this invention and interpret it. The present invention can be changed / improved (for example, by combining the embodiments, omitting a part of the configuration of each embodiment) without departing from the spirit thereof, and the present invention includes equivalents thereof. It is. For example, the above-described processing steps can be executed in any order or in parallel as long as there is no contradiction in the processing contents.

  In addition, the playback apparatus according to the present embodiment is exemplified by a television or a computer display, but is not limited thereto, and may be, for example, a tablet terminal or a multimedia terminal.

1: Content generation system 3: Content generation device 5: Playback device 7: Cable 9: Input device 10: Wired / wireless interface 11: Antenna 12: Data processing unit 14: Memory 15: Hard disk drive 16: Disk drive 18: Recording medium Detachable unit 19: Bus 20: Beat information storage unit 22: Music information storage unit 24: Camera motion information storage unit 26: Character information storage unit 28: Production information storage unit 100: Control unit 101: Reception unit 103: Information management unit 105 : Information acquisition unit 107: Content generation unit 109: Transmission unit

Claims (7)

Music information of the music content, beat information of the music of the music content, virtual camera operation information corresponding to the operation of the virtual camera, character information including character operation information indicating the operation of the character included in the music content, An information acquisition unit for acquiring
For each time signature including one or more beats based on the beat information, each of the music information, the virtual camera operation information, and the character information is associated with the beat information, and the music information associated with the beat information, A content generation unit that generates music content for each time signature based on the virtual camera operation information and the character information;
The content generation unit generates the music content so that the operation of the virtual camera in the music content is switched for each time signature;
Content generation device. The content generation unit generates music content so that the operation of the last virtual camera in the time signature before the operation of the virtual camera is switched is different from the operation of the first virtual camera in the time signature immediately after the time signature.
The content generation apparatus according to claim 1. An information management unit for managing each piece of the music information, the virtual camera operation information, and the character information in association with the beat information for each beat;
The information management unit edits at least one of the managed music information, the virtual camera motion information, and the character information;
The content generation apparatus according to claim 1 or 2. A storage unit that stores at least one of the music information, the virtual camera operation information, and the character information in association with the beat information;
The content generation device according to any one of claims 1 to 3. Music information of the music content, beat information of the music of the music content, virtual camera operation information corresponding to the operation of the virtual camera, character information including character operation information indicating the operation of the character included in the music content, An information acquisition step for acquiring
For each time signature including one or more beats based on the beat information, each of the music information, the virtual camera operation information, and the character information is associated with the beat information, and the music information associated with the beat information, A content generation step for generating music content for each time signature based on the virtual camera operation information and the character information;
The content generation step generates the music content so that the operation of the virtual camera in the music content is switched for each time signature.
Content generation method. On the computer,
Music information of the music content, beat information of the music of the music content, virtual camera operation information corresponding to the operation of the virtual camera, character information including character operation information indicating the operation of the character included in the music content, An information acquisition function to acquire
For each time signature including one or more beats based on the beat information, each of the music information, the virtual camera operation information, and the character information is associated with the beat information, and the music information associated with the beat information, A content generation function for generating music content for each time signature based on the virtual camera operation information and the character information;
In the content generation function, a function of generating music content so that the operation of the virtual camera in the music content is switched for each time signature;
A content generation program for realizing A content generation system comprising a content generation device and a playback device,
The content generation device includes:
Music information of the music content, beat information of the music of the music content, virtual camera operation information corresponding to the operation of the virtual camera, character information including character operation information indicating the operation of the character included in the music content, An information acquisition unit for acquiring
For each time signature including one or more beats based on the beat information, each of the music information, the virtual camera operation information, and the character information is associated with the beat information, and the music information associated with the beat information, Based on the virtual camera operation information and the character information, a content generation unit that generates music content for each time signature,
A transmission unit that transmits the generated music content to the playback device,
The content generation unit generates the music content so that the operation of the virtual camera in the music content is switched for each time signature,
The playback device
Playing the music content transmitted from the content generation device;
Content generation system.