JP2009301477A - Content editing device, method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a content editing device, method and program, for accompanying a change in regeneration of a content, by carrying out an edition for a user to be hardly tired. <P>SOLUTION: This content editing device 1 includes a request content extracting part 11 for extracting a music content comprising a music data and an avator image arranged in a virtual space, from a music content DB 22, in response to reception of a regeneration request of the music content and an assignment of a background image, and for extracting the background image serving as a background of the virtual space, from a background DB 24, a three-dimensional space generating part 12 for a new virtual space by composing the extracted background image in the virtual space of the extracted music content, a music data changing part 13 for changing the music data, based on an echo sound set value corresponding to the extracted background image from the background DB 24, and a content regeneration part 18 for regenerating the changed music data, and the avator image arranged in the generated new virtual space. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a content editing apparatus, method, and program for editing content in which song data is associated with a virtual space.

2. Description of the Related Art Conventionally, a user plays back content such as music and video stored in a storage medium on a personal computer (PC) or the like. In addition, with the rapid spread of the Internet, content such as music and video that can be viewed on a web page is played by a user on a PC or the like. And a user reproduces | regenerates a favorite content to a user in order by producing and using the play list which memorize | stored the reproduction | regeneration order of several content. Thus, a playback device that spontaneously switches playlists to be played back from a plurality of playlists is disclosed (for example, Patent Document 1).
JP 2007-663370 A

  The playback device described in Patent Document 1 plays back digital data of content, but only controls the order of playback. Therefore, when the user repeatedly reproduces the content, the order of reproduction only changes. Therefore, the change given to the visual and auditory senses is scarce and the user is easily bored.

  Therefore, an object of the present invention is to provide a content editing apparatus, method, and program for performing editing on content that is difficult to be bored by a user who is accompanied by a change in the reproduction of the content.

  The present inventor has found a mechanism for changing the content by associating the video and music of the content, and has completed the present invention. Specifically, the present invention provides the following.

(1) a song content storage unit for storing song content comprising song data and an object arranged in a three-dimensional space;
A background storage unit that stores a background image displayed as a background of the three-dimensional space, and an echo sound setting value corresponding to the background image;
A request content extraction unit that extracts the song content from the song content storage unit and extracts the background image from the background storage unit in response to receiving the reproduction request for the song content and the designation of the background image;
A three-dimensional space generation unit that generates a new three-dimensional space by combining the background of the three-dimensional space of the song content extracted by the request content extraction unit using the extracted background image;
A song data changing unit for changing the song data based on the reverberation setting value corresponding to the extracted background image;
A content reproduction unit that reproduces the song data changed by the song data change unit and the object arranged in the new three-dimensional space generated by the three-dimensional space generation unit;
A content editing apparatus comprising:

  According to such a configuration of the present invention, the background of the song content composed of the object and song data arranged in the three-dimensional space is synthesized using the background image, and the three-dimensional space is generated and reproduced. In addition, it is possible to reproduce the content in which the music data is combined with a three-dimensional image. Also, since the song data is changed with the echo sound setting value corresponding to the background image and the content is played, the content image and the echo sound of the song to be played are associated with each other to provide an integrated content can do. Therefore, by changing the background image, editing that changes the user's vision and hearing can be performed on the content.

(2) A rhythm acquisition unit that acquires the rhythm of the song of the song data is provided,
The content reproduction unit synchronizes the object arranged in the new three-dimensional space with the rhythm acquired by the rhythm acquisition unit, and reproduces the object with an effect.
The content editing apparatus according to (1).

  According to such a configuration of the present invention, the rhythm of the song is acquired and the object is operated in synchronization with the rhythm. For example, the avatar image that is the object has an effect such as riding on the rhythm. The content can be played.

(3) a position switching unit that switches a reproduction position of the new three-dimensional space reproduced by the content reproduction unit;
The content reproduction unit synchronizes the switching by the position switching unit with the rhythm acquired by the rhythm acquisition unit, and switches and reproduces the reproduction position of the new three-dimensional space.
The content editing apparatus according to (2).

  According to such a configuration of the present invention, since the playback position of the camera is switched in synchronization with the rhythm of the song, it is possible to perform playback by changing the viewpoint of the content displayed in accordance with the rhythm.

(4) A light production unit that produces light for the new three-dimensional space reproduced by the content reproduction unit,
The content reproduction unit reproduces the new three-dimensional space by synchronizing the light effect by the light effect unit with the rhythm acquired by the rhythm acquisition unit.
The content editing apparatus according to (2) or (3).

  According to such a configuration of the present invention, since the light emission is switched in synchronization with the rhythm of the music, it is possible to reproduce the content with the change by performing the effect of the light changing according to the rhythm. it can.

(5) provided with an object rendering unit for rendering the object based on an operation input to the object arranged in the three-dimensional space;
The content reproduction unit arranges and reproduces the object effect-displayed by the object effect unit in the three-dimensional space;
The content editing apparatus according to any one of (1) to (4).

  According to such a configuration of the present invention, since the content is reproduced by displaying the object based on the operation input to the object, for example, it is possible to provide the content including movement and sound to the avatar image that is the object. It is possible to provide content that is more realistic.

(6) an object storage unit storing character information corresponding to the object;
The content reproduction unit reproduces the character information stored in the object storage unit in association with the corresponding object in the three-dimensional space;
The content editing device according to any one of (1) to (5).

  According to such a configuration of the present invention, it is possible to provide content that is displayed by associating character information with respect to the object.

(7) The object storage unit stores a plurality of pieces of character information corresponding to the object,
A display time calculation unit for calculating a display time for displaying the character information based on the reproduction time of the music data and the number of the character information;
The content reproduction unit sequentially switches the character information stored in the object storage unit and arranges the character information in the three-dimensional space in association with the object corresponding to the display time calculated by the display time calculation unit. Reproduce,
The content editing device according to (6).

  According to such a configuration of the present invention, when there are a plurality of character information corresponding to the object, the display time of the character information is calculated based on the reproduction time of the song data and the number of character information, It is possible to provide content that displays character information in association with an object within time.

(8) a song content storage unit for storing song content composed of song data and an object arranged in a three-dimensional space;
A background storage unit that stores a background image displayed as a background of the three-dimensional space, and an echo sound setting value corresponding to the background image;
A content editing apparatus equipped with
Extracting the song content from the song content storage unit and extracting the background image from the background storage unit in response to receiving the reproduction request of the song content and the designation of the background image;
Synthesizing the background of the extracted three-dimensional space of the song content using the extracted background image to generate a new three-dimensional space;
Changing the song data based on the reverberation setting value corresponding to the extracted background image;
Replaying the changed song data and the generated object placed in the new three-dimensional space;
Content editing method.

  (9) A content editing program for causing a computer to execute the steps of the method according to (8).

  According to the present invention, it is possible to cause a terminal to reproduce content in which music data is combined with a three-dimensional image. In addition, the content image and the reverberation sound of the song to be played are associated with each other, so that the integrated content can be provided, and editing that changes the visual and auditory sense of the user by changing the background image. Can be done on content.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. This is merely an example, and the technical scope of the present invention is not limited to this.

[Entire configuration of content editing system and functional configuration of content editing apparatus]
FIG. 1 is a diagram showing an overall configuration of a content editing system 100 and a functional configuration of the content editing apparatus 1 according to the present embodiment.

  The content editing system 100 includes a content editing device 1, a communication network 3, and a terminal 5. As shown in FIG. 1, a content editing apparatus 1 and a terminal 5 are communicably connected via a communication network 3 typified by a communication line such as the Internet.

  The content editing device 1 is, for example, a server, and the number of hardware is not limited, and may be configured by one or a plurality of hardware as necessary. In the case of a plurality of hardware, each hardware may be connected via the communication network 3. For example, the functions of the present embodiment may be realized by using separate servers (devices) for each function described later, and by linking the servers by transmitting and receiving signals between the servers.

  The content editing apparatus 1 includes a control unit 10 and a storage unit 20. The control unit 10 includes a requested content extraction unit 11, a three-dimensional space generation unit 12, a song data change unit 13, a rhythm acquisition unit 14, a position switching unit 15, a light effect unit 16, and an object effect unit 17. And a content reproduction unit 18. The storage unit 20 includes a song content database (hereinafter, the database is also referred to as a DB) 22, a background DB 24, an avatar DB 26, and a song DB 28. The contents of each DB will be described later.

  The requested content extraction unit 11 extracts the corresponding song content from the song content DB 22 in response to receiving a playback request for the song content to be played back on the terminal 5 from the terminal 5 together with the designation of the background image. Further, the requested content extraction unit 11 extracts a background image from the background DB 24. Here, the music content refers to music data and an avatar image (object) arranged in a virtual space (three-dimensional space). The song data may be one song or a plurality of songs associated with the playlist. The avatar image is an image of a character representing the user, and may be a plurality of images including the avatar image of the user of the terminal 5.

  The three-dimensional space generation unit 12 generates a virtual space in which an avatar image is arranged. The background of the virtual space is composed of images extracted from the background DB 24. The avatar image and the background image are combined to generate a new virtual space (new three-dimensional space). The song data changing unit 13 changes the song data based on the echo sound setting value stored in the background DB 24 corresponding to the background image.

  The rhythm acquisition unit 14 acquires the rhythm of the song in the song data. The rhythm of a song refers to the tempo of the song that can be measured by a metronome, for example. The position switching unit 15 switches the display position (playback position) in the virtual space transmitted to the terminal 5 and displayed on the terminal 5 in synchronization with the rhythm of the song. The light effect unit 16 changes the light effect in the virtual space in synchronization with the rhythm of the song. The object rendering unit 17 provides a motion effect to the user's avatar image displayed on the terminal 5 in response to an operation by the terminal 5. The content playback unit 18 replays the changed music data and the content including the avatar image, which has various effects in the new virtual space, to the terminal 5 so as to be played back on the terminal 5 that has received the content. To do.

  The terminal 5 is, for example, a personal computer (PC) including an input unit such as a keyboard and a mouse for a user to input an operation for reproducing the content and a display screen for displaying the content. Using the terminal 5, the user can view the content or input an operation on the user's own avatar image displayed on the content while viewing the content.

[Hardware Configuration of Content Editing Apparatus 1]
FIG. 2 is a diagram illustrating a hardware configuration of the content editing apparatus 1 according to the present embodiment. The server in which the present invention is implemented may be a standard server, and an example of the configuration is shown below.

  The content editing apparatus 1 includes a central processing unit (CPU) 1010 (a plurality of CPUs such as a CPU 1012 may be added in a multiprocessor configuration), a bus line 1005, a communication I / F (I / F: An interface) 1040, a main memory 1050, a BIOS (Basic Input Output System) 1060, a display device 1022, an I / O controller 1070, an input device 1100 such as a keyboard and a mouse, a hard disk 1074, an optical disk drive 1076, and a semiconductor memory 1078. The hard disk 1074, the optical disk drive 1076, and the semiconductor memory 1078 are collectively referred to as the storage unit 20.

  The control unit 10 is a part that controls the content editing apparatus 1 in an integrated manner, and by reading and executing various programs stored in the hard disk 1074 as appropriate, the control unit 10 cooperates with the above-described hardware and performs various types of the present invention. The function is realized.

  The communication I / F 1040 is a network adapter when the content editing apparatus 1 transmits / receives information to / from the terminal 5 (FIG. 1) via the communication network 3 (FIG. 1). The communication I / F 1040 may include a modem, a cable modem, and an Ethernet (registered trademark) adapter.

  The BIOS 1060 records a boot program executed by the CPU 1010 when the content editing apparatus 1 is started up, a program depending on the hardware of the content editing apparatus 1, and the like.

  The display device 1022 includes a display device such as a cathode ray tube display device (CRT) or a liquid crystal display device (LCD).

  The I / O controller 1070 can be connected to a storage unit 20 that is a storage device such as a hard disk 1074, an optical disk drive 1076, and a semiconductor memory 1078.

  The input device 1100 is for accepting input by the administrator of the content editing device 1.

  The hard disk 1074 stores various programs for causing the hardware to function as the content editing apparatus 1, programs for executing the functions of the present invention, and DB tables and records to be described later. The content editing apparatus 1 can also use an external hard disk (not shown) as an external storage device.

  As the optical disc drive 1076, for example, a DVD-ROM drive, a CD-ROM drive, a DVD-RAM drive, or a CD-RAM drive can be used. In this case, the optical disk 1077 corresponding to each drive is used. A program or data may be read from the optical disk 1077 by the optical disk drive 1076 and provided to the main memory 1050 or the hard disk 1074 via the I / O controller 1070.

  The computer referred to in the present invention refers to an information processing device including a storage device, a control unit, and the like. The content editing device 1 includes an information processing device including a storage unit 20, a control unit 10, and the like. The information processing apparatus is included in the concept of the computer of the present invention.

[Hardware configuration of terminal 5]
The terminal 5 has the same configuration as that of the content editing apparatus 1 described above. In the above-described example, an example realized by a so-called computer has been described. Furthermore, as long as the principle of the present invention can be applied, it may be realized by various terminals such as a mobile phone and a PDA (Personal Data Assistant).

[Example of virtual space]
3 and 4 are diagrams illustrating a virtual space displayed on the display screen of the terminal 5 according to the present embodiment.

  FIG. 3A shows data composed of a plurality of avatar images. A virtual space includes an avatar 34 that is an avatar image of the content creator, an avatar 35 that is an avatar image of a user who has viewed the content in the past, and an avatar 36 that is an avatar image of the user who is currently viewing the content. Is arranged. The avatar 34 is a video singing along with a song, and the avatar 35 and the avatar 36 are videos of viewers who listen to the song. On the other hand, FIG. 3B is an example of a background image stored in the background DB 24 and is a background image 33 of an indoor live house.

  FIG. 3C shows a new virtual space 30 in which the images of FIG. 3A and FIG. By combining FIG. 3A composed of a plurality of avatar images from avatar 34 to avatar 36 and FIG. 3B composed of background image 33, it is as if a plurality of avatar images are live shown by background image 33. You can show it to the user as if they were gathering in the house. In the case of this example, in the virtual space 30, the avatar 34 stands and sings on the stage of the background image 33 of the live house, and the avatar 35 and the avatar 36 are watching as other audiences. The user can feel as if he / she has tripped to the live house.

  Also, in the virtual space 30, a plurality of (in this example, three) cameras 31 (cameras 31A to 31C) and a plurality of (in this example, 14) lights 32 (lights 32A to 32D) are arranged. Has been. Then, the control unit 10 transmits the image of the virtual space 30 captured by the camera 31 to the terminal 5 as an image to be displayed on the display screen of the terminal 5. The light 32 outputs light downward (Z direction) toward the avatar 34 from above the stage, and outputs light toward the avatar 34 from the left and right direction (X direction) of the stage.

  FIG. 4 shows a new virtual space 30 in which a plurality of avatar images of avatars 36 to 36 shown in FIG. 3A are combined with a background image 39 different from FIG. As in FIG. 3C, the content creator's avatar 34, the user's avatar 35 who has viewed the content in the past, and the user's own avatar 36 who is currently viewing the content are arranged in the virtual space 30. Has been. The background image 39 is an example of a background image stored in the background DB 24 and indicates the background of the outdoor stage.

  In this way, even if the same avatar image is displayed, simply changing the background image to a different one can produce the feeling of being live in various places, so the user will not get bored An environment for enjoying content can be provided.

[Song Content DB 22 and Background DB 24]
FIG. 5 is a diagram showing the song content DB 22 and the background DB 24 stored in the storage unit 20 according to the present embodiment.

  FIG. 5A shows an example of the song content DB 22. The song content DB 22 is a database that associates a content ID with a song ID that identifies a song that constitutes the song content and an avatar ID that is displayed when the song corresponds to the song ID.

  The song content DB 22 has a content ID 22a, a song ID 22b, and an avatar ID 22c. As described above, the content ID 22a stores a symbol that uniquely indicates the content. This symbol may be appropriately given by the control unit 10 when the user stores content created by the user in the song content DB 22. The music ID 22b stores a symbol uniquely indicating the music. A plurality of song IDs may be associated with one content ID to form a playlist. The avatar ID 22c stores a symbol that identifies an avatar image. When the song content is reproduced by the terminal 5, the avatar ID of the user of the terminal 5 is added and stored in the avatar ID 22c corresponding to the song ID of the reproduced song.

  FIG. 5B shows an example of the background DB 24. The background DB 24 is a database that associates background image data with values related to reverberation using the background ID as key information.

  The background DB 24 includes a background ID 24a, a background name 24b, a background image 24c, and a reverberation sound setting value 24d. The background ID 24a stores a symbol that uniquely indicates the background image. The background name 24b stores a name indicating the background. The background image 24c stores background image data that actually forms a virtual space. For example, the background image 33 of FIG. 3B and the background image data of the background image 39 of FIG. 4 are stored. The reverberant set value 24d stores a value related to the reverberant sound corresponding to the background image. The reverberation sound is a numerical value of the sound reflected by the material of the object when the sound reaches the object. Here, a reverberation set value is used as a reference for applying a change in reverberation to music data with respect to the image indicated by the background image. For example, in indoors and outdoors, the sound is more likely to be reflected indoors, so the setting value of the reverberant sound becomes larger. The reflected sound setting value stores a value corresponding to the background image in advance, and is a value between 0 and 1.

[Flowchart of main processing]
FIG. 6 is a flowchart of the main process of the content editing apparatus 1 according to this embodiment. FIG. 7 is a diagram illustrating an example of a screen displayed on the terminal 5 according to the present embodiment.

  S1: Control unit 10 receives a music content reproduction request from terminal 5 together with a background image designation.

  Here, FIG. 7A is an example of a screen when the song content and the background image are designated on the terminal 5. A plurality of song contents are displayed on the display screen 40 of the terminal 5 so as to be selectable. In this example, image images 41 and 42 that are images of part of the music content are displayed. Further, below the image images 41 and 42, a plurality of background names each indicating a background image of the content and a button for the user to select on the right side thereof are shown.

  Returning to FIG. 6, S2: The requested content extraction unit 11 extracts the song content in the song content DB 22 for which the song content request has been made.

  S3: The requested content extraction unit 11 extracts the designated background image received in S1 from the background DB 24.

  S4: The three-dimensional space generation unit 12 generates the virtual space 30 by synthesizing the song content extracted in S2 and the background image extracted in S3. When the virtual space 30 is generated, the music content and the background image may be synthesized including the avatar 36 of the user of the terminal 5. Note that the synthesized song content may overwrite the original song content data.

  Here, FIG. 7B and FIG. 7C illustrate an example in which the virtual space 30 generated in S4 is displayed on the display screen 40 of the terminal 5. FIG. 7B shows a virtual space 30 in which the avatar 36 is synthesized from the background image 33 of the live house described in FIG. 3C and the avatar 34 with the camera 31A shown in FIG. 3C. A live image 45 is displayed. FIG. 7B is displayed when the button 43 is selected by the user in FIG. On the other hand, FIG. 7C shows a live image 46 in which the virtual space 30 obtained by combining the background image 39 of the outdoor stage described in FIG. 4 and the avatar 34 with the avatar 36 is captured by the camera 31A shown in FIG. Is displayed. FIG. 7C is displayed when the button 44 is selected by the user in FIG.

  Returning to FIG. 6, S <b> 5: The control unit 10 extracts the reverberation setting value corresponding to the background image extracted in S <b> 3 from the background DB 24.

  S6: The song data changing unit 13 changes the song data in the song content based on the reverberation setting value extracted in S5. In other words, the larger the reverberation setting value, the higher the degree of reverberation of the changed music data.

  S7: The control unit 10 performs BPM processing which will be described later.

  S8: The content reproduction unit 18 transmits the edited music content to the terminal 5 so that the edited music content can be reproduced.

  S9: The control unit 10 determines whether an operation request for the avatar image has been received from the terminal 5. When the operation request for the avatar image is received (S9: YES), the control unit 10 moves the process to S10. On the other hand, when the operation request for the avatar image is not received (S9: NO), the control unit 10 moves the process to S11.

  S10: The object effect unit 17 performs effect processing on the avatar image. The effect process for the avatar image will be described with reference to FIGS.

  S11: The control unit 10 determines whether or not the reproduction of the song content has ended. When the reproduction of the song content is finished (S11: YES), the control unit 10 finishes this process. On the other hand, when the reproduction of the song content has not ended (S11: NO), the control unit 10 moves the process to S7.

[Reverb sound settings]
FIG. 8 is a diagram for explaining reverberation setting values corresponding to the background image according to the present embodiment.

  In FIG. 8, time is shown on the X-axis, and values related to the reverberation sound are shown on the Y-axis, and the reverberation setting values shown in FIG. 5 (b) are shown as a graph shown in FIG. Can be displayed. For example, since the echo sound setting value 24d corresponding to IN02 of the background ID 24a in FIG. 3B is “0.987”, the degree of reverberation is the highest in the background image shown in FIG. In addition, the echo sound setting values related to the three background IDs illustrated in FIG. 3B have the lowest degree of echo of OUT01. Then, the degree of reverberation decreases with time, and finally does not resonate.

  Here, FIG. 7 will be specifically described as an example. FIG. 7B shows content in an indoor live house, and FIG. 7C shows content in an outdoor stage. Is more likely to respond than outdoors. The sound image 47 in FIG. 7B and the sound image 48 in FIG. 7C represent the degree of reverberation with a wavy line described after the note. As shown in FIG. 7, the reverberation sound is set higher in the indoor background image (FIG. 7B) and reverberates more greatly.

[BPM processing flowchart]
FIG. 9 is a flowchart of BPM processing in the content editing apparatus 1 according to the present embodiment. BPM (Beat Par Minute) refers to the beat speed of a song indicating the number of beats of the song per minute. In the BPM process, a process according to the beat of this song is performed.

  S21: The rhythm acquisition unit 14 acquires the beat (rhythm) of the song from the song data.

  S22: The control unit 10 adds the movement of the avatar image in synchronization with the acquired beat of the song.

  S23: The control unit 10 switches the positions of the cameras 31A to 31C in synchronization with the acquired beat of the song.

  S24: The control unit 10 blinks the lights 32A to 32D in synchronization with the acquired beat of the song. Thereafter, this process is terminated, and the process returns to FIG.

[Content playback example]
FIG. 10 is a diagram illustrating an example in which content is reproduced in synchronization with the rhythm according to the present embodiment.

  In FIG. 10A to FIG. 10C, the camera is switched in synchronization with the rhythm, and the content is displayed on the display screen 40 of the terminal 5. 10 (a) is taken from the camera 31A of FIG. 3 (c), FIG. 10 (b) is from the camera 31C of FIG. 3 (c), and FIG. 10 (c) is FIG. 3 (c). ) Of the camera 31B. Similarly, the lights 32A to 32D are switched ON / OFF for each light in synchronization with the rhythm. From the playback position display section 52 of the status bar 51 displayed on the display screen 40, it can be seen that the scenes of FIG. 10A to FIG.

  In this way, by displaying an image in which the camera is switched in synchronization with the rhythm of the music, it is possible to provide content with changes.

[Avatar DB 26 and song DB 28]
FIG. 11 is a diagram showing the avatar DB 26 and the song DB 28 stored in the storage unit 20 according to the present embodiment.

  FIG. 11A shows an example of the avatar DB 26. The avatar DB 26 is a database in which avatar ID, content ID, and music ID are associated with key information and information about the avatar and avatar attributes corresponding to the content.

  The avatar DB 26 includes an avatar ID 26a, avatar data 26b, a content ID 26c, a song ID 26d, a position 26e, and character information 26f. The avatar ID 26a stores a symbol that uniquely indicates the user specified by the avatar. The avatar data 26b stores image data of an avatar that is a character representing the user. The content ID 26c stores a symbol uniquely indicating the content, and the music ID 26d stores a symbol uniquely indicating the music. The position 26e stores the position information of the avatar image indicated by coordinates. The character information 26f stores character information such as the user's impressions and calls input from the terminal 5 by a user who is watching the music content in advance.

  FIG. 11B shows an example of the music DB 28. The song DB 28 is a database that associates song information with song IDs as key information.

  The song DB 28 has a song ID 28a, song data 28b, and a song length 28c. The music ID 28a stores a symbol that uniquely indicates the music. The song data 28b stores the song data itself. The reproduction time of the music data is stored in the music length 28c.

[Screen example during content playback]
12 and 13 are diagrams showing examples of screens during content playback displayed on the display screen 40 of the terminal 5 according to the present embodiment.

  A content player 50 for playing back content is displayed on the display screen 40 of the terminal 5. The content player 50 is displayed when the control unit 10 activates software for receiving information stored in the terminal 5, and displays the content on the display screen 40 of the terminal 5. The content player 50 has a content name display unit 53 that displays the content name of the content to be reproduced in the upper left. In this example, the content ID is displayed, but the content name may be stored in the song content DB 22 and displayed.

  A content display unit 55 is provided at the center of the content player 50 to display the content of the content being reproduced. In this example, a state in which live performance is performed in a virtual space is shown. A plurality of avatar images excluding the avatar 65 are displayed as a spectator. The spectator avatar image is an avatar image of a user who has viewed the song content in the past and an avatar image of the user who is currently viewing the avatar. On the avatar 61 to the avatar 63, a call and an impression are displayed as a balloon. The characters in the balloon are characters stored in the character information 26f of the avatar DB 26 described with reference to FIG. When there are a plurality of character information, the control unit 10 (display time calculation unit) of the content editing apparatus 1 sets the reproduction time stored in the song length 28c of the song DB 28 to the character information stored in the character information 26f. All character information is displayed during playback of the song. For example, as shown in FIG. 11, a song whose song ID 28 a is “A01” whose song length 28 c is “40” seconds is an avatar whose avatar ID 26 a is “AAA” in the avatar DB 26, There are four character information 26f. Therefore, the content can be changed by displaying these four character information for 10 seconds.

  Moreover, the avatar 64 is an avatar image of the user himself / herself whose user ID 54 is “XXX”, which is the user who is displaying the display screen 40 of FIG. Operation with respect to the avatar 64 which is a user's own avatar image can be performed with a mosh part. The content player 50 has a mosh selector 57 at the lower center portion of the status bar 51. In the mosh selection section 57, three operation buttons of mosh parts 57a, 57b and 57c are displayed. The mosh parts 57a, 57b, and 57c are parts (parts) prepared in advance for putting movement and voice into the user's avatar image. The user's avatar 64 displayed on the content display unit 55 is changed to the mosh parts by appropriately selecting (manipulating) the mosh parts 57a, 57b, and 57c according to the content reproduced on the display screen 40 of the terminal 5. It produces effects according to 57a, 57b, and 57c. FIG. 13 shows a screen after the user moves and selects the arrow 58 to the mosh part 57a in FIG. In FIG. 13, the avatar 64 looks like a banzai with his hands raised. Thus, by selecting the parts of the mosh selection unit 57, the user's avatar image displayed on the content display unit 55 of the display screen 40 produces an effect corresponding to the mosh parts 57a, 57b, 57c. It is possible to provide more realistic content including motion and sound in images.

  The content player 50 has a status bar 51 that displays the content status below the content display unit 55, and a playback position display unit 52 that indicates the current playback position is displayed on the left side of the status bar 51. . Further, the content player 50 has a time display unit 56 in the lower right portion of the status bar 51. The time display unit 56 displays the playback time of the entire content and the current playback time, and the playback time in the total time is associated with the location indicated by the playback position display unit 52 in the status bar 51. It has been.

  As mentioned above, although embodiment of this invention was described, this invention is not restricted to embodiment mentioned above. The effects described in the embodiments of the present invention are only the most preferable effects resulting from the present invention, and the effects of the present invention are limited to those described in the embodiments of the present invention. is not.

(Deformation)
In the present embodiment, a concert in a virtual space has been described as an example. However, content related to a theater or content created by a user may be used. Moreover, although the user's avatar image was displayed in order to produce that the user participated, it may be a character such as a mascot that identifies the user. Further, the mosh part shown in FIG. 12 is merely an example.

  In this embodiment, the cameras displayed at a plurality of positions are switched in synchronization with the rhythm of the song. However, the camera is switched so as to zoom in and zoom out with one camera. It may be a combination thereof.

  In this embodiment, the character information displayed as the content is stored in advance. However, for example, a character input field may be provided in the content player so that it can be input each time.

It is a figure which shows the whole structure of the content editing system which concerns on this embodiment, and the function structure of a content editing apparatus. It is a figure which shows the hardware constitutions of the content editing apparatus which concerns on this embodiment. It is a figure explaining the virtual space displayed on the display screen of the terminal concerning this embodiment. It is a figure explaining the original data of the music content displayed on the display screen of the terminal which concerns on this embodiment. It is a figure which shows the music content DB and background DB which are stored in the memory | storage part which concerns on this embodiment. It is a flowchart of the main process of the content editing apparatus which concerns on this embodiment. It is a figure which shows the example of a screen displayed with the terminal which concerns on this embodiment. It is a figure for demonstrating the echo sound setting value corresponding to the background image which concerns on this embodiment. It is a flowchart of the BPM process in the content editing apparatus which concerns on this embodiment. It is a figure which shows the example by which the content was reproduced | regenerated synchronizing with the rhythm which concerns on this embodiment. It is a figure which shows the avatar DB and music DB which are stored in the memory | storage part which concerns on this embodiment. It is a figure which shows the example of a screen at the time of the content reproduction | regeneration displayed on the display screen of the terminal which concerns on this embodiment. It is a figure which shows the example of a screen at the time of the content reproduction | regeneration displayed on the display screen of the terminal which concerns on this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Content editing apparatus 5 Terminal 10 Control part 11 Requested content extraction part 12 Three-dimensional space production | generation part 13 Song data change part 14 Rhythm acquisition part 15 Position switching part 16 Light effect part 17 Object effect part 18 Content reproduction part 20 Storage part 22 Music Content DB
24 Background DB
26 Avatar DB
28 songs DB
100 content editing system

Claims (9)

A song content storage unit for storing song content comprising song data and an object arranged in a three-dimensional space;
A background storage unit that stores a background image displayed as a background of the three-dimensional space, and an echo sound setting value corresponding to the background image;
A request content extraction unit that extracts the song content from the song content storage unit and extracts the background image from the background storage unit in response to receiving the reproduction request for the song content and the designation of the background image;
A three-dimensional space generation unit that generates a new three-dimensional space by combining the background of the three-dimensional space of the song content extracted by the request content extraction unit using the extracted background image;
A song data changing unit for changing the song data based on the reverberation setting value corresponding to the extracted background image;
A content reproduction unit that reproduces the song data changed by the song data change unit and the object arranged in the new three-dimensional space generated by the three-dimensional space generation unit;
A content editing apparatus comprising: A rhythm acquisition unit that acquires the rhythm of the song data;
The content reproduction unit synchronizes the object arranged in the new three-dimensional space with the rhythm acquired by the rhythm acquisition unit, and reproduces the object with an effect.
The content editing apparatus according to claim 1. A position switching unit that switches a reproduction position of the new three-dimensional space reproduced by the content reproduction unit;
The content reproduction unit synchronizes the switching by the position switching unit with the rhythm acquired by the rhythm acquisition unit, and switches and reproduces the reproduction position of the new three-dimensional space.
The content editing apparatus according to claim 2. A light production unit that produces light for the new three-dimensional space reproduced by the content reproduction unit;
The content reproduction unit reproduces the new three-dimensional space by synchronizing the light effect by the light effect unit with the rhythm acquired by the rhythm acquisition unit.
The content editing apparatus according to claim 2 or 3. Based on an operation input for the object arranged in the three-dimensional space, an object effect unit that effects display the object,
The content reproduction unit arranges and reproduces the object effect-displayed by the object effect unit in the three-dimensional space;
The content editing apparatus according to any one of claims 1 to 4. An object storage unit storing character information corresponding to the object;
The content reproduction unit reproduces the character information stored in the object storage unit in association with the corresponding object in the three-dimensional space;
The content editing apparatus according to any one of claims 1 to 5. The object storage unit stores a plurality of character information corresponding to the object,
A display time calculation unit for calculating a display time for displaying the character information based on the reproduction time of the music data and the number of the character information;
The content reproduction unit sequentially switches the character information stored in the object storage unit and arranges the character information in the three-dimensional space in association with the object corresponding to the display time calculated by the display time calculation unit. Reproduce,
The content editing apparatus according to claim 6. A song content storage unit for storing song content comprising song data and an object arranged in a three-dimensional space;
A background storage unit that stores a background image displayed as a background of the three-dimensional space, and an echo sound setting value corresponding to the background image;
A content editing apparatus equipped with
Extracting the song content from the song content storage unit and extracting the background image from the background storage unit in response to receiving the reproduction request of the song content and the designation of the background image;
Synthesizing the background of the extracted three-dimensional space of the song content using the extracted background image to generate a new three-dimensional space;
Changing the song data based on the reverberation setting value corresponding to the extracted background image;
Replaying the changed song data and the generated object placed in the new three-dimensional space;
Content editing method.   A content editing program for causing a computer to execute the steps of the method according to claim 8.

Images