JP2006039705A - Content creation device, content creation method, and content creation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device capable of easily creating various contents based on a scenario generated in compliance with an event. <P>SOLUTION: After selection of the desired scenario, a content creator inputs voice information and image information to a content creation terminal by means of a camera and a microphone. The inputted information is analyzed by an input information analysis means, and a parameter necessary for content creation is calculated. The value of the calculated parameter is reflected in the scenario, and contents are created based on the affected scenario. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a content creation device that creates content by combining computer graphics, images, and audio, and more particularly to a content creation device that creates content whose contents change according to the situation.

  E-mail is now one of the important communication tools that connect remote locations alongside telephones. In addition, with recent widening of communication networks, not only emails that use only text, but also those that include voice and images are increasing. More recently, it has become possible to create colorful and diverse emails by changing the size and color of characters and inserting images on mobile phones. Content created using this technology is available on the content manufacturer's website. A service has also been started that allows a user to easily send a colorful and fun mail to a partner simply by selecting a desired content and specifying a destination address.

However, since the above-mentioned service only uses content prepared in advance, for example, it is not possible to change the action of the character according to the situation (location, time, tone of music flowing in the background, etc.) It was. As a conventional technique for dealing with these problems, there is an “object display control system and recording medium” disclosed in Japanese Patent Application Laid-Open No. 2001-118084 (see Patent Document 1). This prior art will be described with reference to FIG. In the object display control system of FIG. 15, first, the volume level and the frequency level are calculated by analyzing the waveform data of the sound data input from the player 16 or the speaker & earphone 17 using the software main body 11. Based on the calculated data, movement information used for the dance animation of the character, such as choreography data and formation, is changed. Since the relationship between the volume level and the frequency level and the choreography data and formation at that time is determined in advance, the motion information to be used is changed according to the corresponding relationship.
JP 2001-118084 A

  However, in the above-described conventional technology, only a method for associating sound data with choreography and formation, that is, operation data is mentioned, and there is a problem that it is insufficient as a mechanism for creating various contents.

  Therefore, the present invention has been made in view of such a situation, and changes the contents reflecting the video, voice, whereabouts, etc. of the content creator himself, based on a scenario according to an event such as a birthday or New Year. Accordingly, it is an object to provide a content creation device capable of easily creating various contents.

  In order to solve the above-described problem, a content creation device according to claim 1 of the present invention analyzes input information receiving means for receiving information input by a content creator, information input by the content creator, Input information analysis means for determining parameters required for creation, and content creation means for creating the content scenario reflecting the determined parameter value and creating the content based on the scenario is there.

  A content creation device according to claim 2 of the present invention is the content creation device according to claim 1, wherein the information input by the content creator is a voice of the content creator.

  The content creation device according to claim 3 of the present invention is the content creation device according to claim 2, wherein the input information receiving means accepts the voice input of the content creator, and the input information analysis means Analyzing the volume characteristic and frequency characteristic of the sound, and creating content by creating a scenario reflecting at least one kind of index of the analyzed volume characteristic and frequency characteristic It is.

  The content creation device according to claim 4 of the present invention is the content creation device according to claim 1, wherein the information input by the content creator is a still image or a moving image taken by the content creator. It is.

  The content creation device according to claim 5 of the present invention is the content creation device according to claim 4, wherein the input information reception means accepts input of a moving image of the content creator, and the input information analysis means The amount of change between frames of the images constituting the input video is calculated, and the content creation means creates a scenario reflecting the calculated amount of change between frames of the images constituting the video, Is to create.

  The content creation device according to claim 6 of the present invention is the content creation device according to claim 1, wherein the input information receiving means accepts input of the content creator's voice and video, and the input information analysis means is Analyzing the volume characteristic and frequency characteristic of the input voice and calculating the amount of change between frames of the image constituting the input moving image, and the content creating means is configured to analyze the volume characteristic and frequency analyzed A content is created by creating a scenario reflecting at least one kind of index among the characteristics and the calculated amount of change between frames of the image constituting the moving image.

  The content creation device according to claim 7 of the present invention is the content creation device according to claim 1, further comprising position information acquisition means for acquiring a current position, wherein the content creation means is the acquired current A scenario reflecting the position is created to create content.

  The content creation device according to claim 8 of the present invention is the content creation device according to any one of claims 1 to 7, wherein the content scenario uses a predetermined descriptor. It is a metafile to be described.

  The content creation device according to claim 9 of the present invention is the content creation device according to claim 8, wherein the content creation means is described in the metafile by the value of the parameter determined by the input information analysis means. The branch destination of the conditional branch is determined.

  The content creation method according to claim 10 of the present invention includes an input information reception step for receiving information input by a content creator, and parameters necessary for content creation by analyzing the information input by the content creator. And a content creation step of creating a scenario of the content reflecting the determined value of the parameter and creating the content based on the scenario.

  A content creation system according to an eleventh aspect of the present invention is a content creation system configured by connecting a scenario content server that provides a material for creating content and a content creation terminal via a communication network. The scenario content server includes scenario holding means for holding a content scenario, distribution means for distributing the scenario, and the content creation terminal includes input information receiving means for receiving information input by a content creator. Analyzing the information input by the content creator and determining input information analysis means for determining parameters required for content creation, creating the scenario reflecting the determined parameter value, and based on the scenario Content creation means for creating the content Is shall.

  The content creation system according to claim 12 of the present invention is a content creation system configured by connecting an information input terminal and a content creation server via a communication network, and the information input terminal includes a content creation system. Information multiplexing means for encoding and then multiplexing information input by a user, data receiving / transmitting means for delivering the multiplexed information to the content creation server, and the content creation server holding a content scenario A scenario holding unit that performs the multiplexing and the decoding of the multiplexed information distributed from the information input terminal after separating the decoded information, analyzing the decoded information, and determining parameters necessary for creating the content And creating the scenario reflecting the value of the analyzed parameter, and the scenario Those with a content creating means for creating said content based.

  As described above, the content creation apparatus according to the present invention analyzes the information input by the content creator, the input information reception means for receiving information input by the content creator, and sets the parameters necessary for creating the content. Input information analyzing means for determining, and content creating means for creating a scenario of the content reflecting the value of the determined parameter and creating the content based on the scenario.

  Therefore, the content creator's face image, sound, and movement information can be reflected based on the scenario describing the content, and various contents can be easily created.

  The content creation device according to the present invention further includes position information acquisition means for acquiring a current position, and the content creation means creates a scenario reflecting the acquired current position and creates content. Features.

  Thus, the scenario can be changed according to the location where the content creation terminal is currently installed, and unique content can be easily generated.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
Hereinafter, a content creation device according to Embodiment 1 of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing an example of a configuration of a content creation device according to Embodiment 1 of the present invention.

  The content creation apparatus according to the first embodiment of the present invention includes a scenario / content server 10, a communication network 20, and a content creation terminal 30. The scenario / content server 10 includes scenario holding means 11 for storing a scenario describing the contents of the entire content, and content for storing various materials (hereinafter referred to as content parts) for creating content corresponding to each scenario. It comprises a parts holding means 12 and a delivery means 13 for receiving and transmitting data. The communication network 20 is a network such as the Internet for exchanging data between a server and a terminal. The content creation terminal 30 includes a data transmission / reception unit 31 for receiving and transmitting data, a scenario selection unit 32 for selecting a scenario used for content creation, and a content holding unit 33 for holding the created content and downloaded content parts. Content creation means 34 for creating content, input information reception means 36 for receiving input of information such as audio information 37 and video information 38 of the content creator, and input information analysis means for analyzing the input information 35. Hereinafter, the processing flow of the content creation device according to Embodiment 1 of the present invention will be described in detail.

  First, content in the present invention will be described. The content corresponds to events such as “birthday”, “wedding”, and “new year's card”, for example, and is acquired using a character created by computer graphics (hereinafter referred to as CG) or a camera. It is a set of a series of information that is created by combining music and voice (collectively these are content parts) acquired using still images, moving images, microphones, and the like. In addition, what describes the contents of the whole content, such as which content parts are combined at what timing and how, is called a scenario. FIG. 2 shows an example of content corresponding to the “birthday” event. In the content of FIG. 2, two CG characters are dancing around a large cake made with CG, and the text “Happy Birthday!” Along with the content creator's own video at the top of the screen. Is displayed. In addition, the message “Happy Birthday” will be heard from the speaker. Users can realize a variety of communication by sending this created content to their birthday friends.

  The scenario holding unit 11 holds a list of contents corresponding to various events. There may be only one type of content for each event, or there may be a plurality of contents. Hereinafter, this list is referred to as a content table. The content table is read from the scenario holding unit 11 and sent to the scenario selection unit 32 via the distribution unit 13, the communication network 20, and the data transmission / reception unit 31. The content creator refers to the transmitted content table and selects the content to be created. The selected information is transmitted to the scenario holding unit 11 via the communication network 20. When the scenario holding unit 11 acquires information on the selected content, the scenario corresponding to the content is read and transmitted to the content creation unit 34 via the distribution unit 13, the communication network 20, and the data receiving / transmitting unit 31.

  The method of describing the scenario is not particularly limited, but may be expressed in a format according to a scene description language such as MPEG-7, SMIL (Synchronized Multimedia Integration Language), XML (Extensible Markup Language). FIG. 3 shows an example of scenario description. As shown in FIG. 3, the scenario according to the first embodiment of the present invention is described by a descriptor (tag) enclosed in <> and a value or content surrounded by the tag. Hereinafter, the scenario shown in FIG. 3 will be described in detail.

  The <HappyBirthday> tag indicates that this scenario is content corresponding to “birthday”. <ID> is a descriptor for identifying the appearing content part, <ModelName> is the shape data file name of the CG object, and <Position> is an initial position where the shape data is arranged. <Animation> represents the start / end of the description relating to the animation, <StartTime> represents the start time of the animation, and <Anim> represents the file name of the animation data to be applied to the CG object. <Texture> represents the start / end of the description about the texture, and <TextName> represents the file name of the texture data to be mapped. Therefore, when the 6th to 16th lines in FIG. 3 are interpreted, the shape data file “Man.mdl” is read, the Pict.tex texture is mapped, and the position of [0.0 10.0 0.0] And start animation of Anim0.anim from 1.0 second. " From <when> on the 22nd line to <otherwise> on the 30th line represents a conditional branch. When the value of Momentum is 0 or more and less than 50, Anim1. If the animation data of anim is used and is 50 or more and less than 100, Anim2. anim, otherwise Anim3. It means using anim. The content of Momentum will be described later. <Effect> represents the start / end of the description about the effect, <Kind> represents the type of the effect, and <EffectAnim> represents the attribute of the effect to be used.

  When the content creator obtains the scenario from the scenario holding means 11, the audio information is next used by using a camera and a microphone (both shown as the input information receiving means 36 in FIG. 1) attached to the content creation terminal 30. 37 and video information 38 are input. For example, for a “birthday” event, a message “Happy Birthday” is input while waving at the camera. Hereinafter, the audio information and the video information input by the content creator are collectively referred to as a video message. The input video message is sent to the input information analyzing means 35 via the input information receiving means 36.

  In the scenario of FIG. 3, Momentum and VoicePitch are quantities determined based on a video message input by the user. Therefore, the conditional branch determination result changes according to information input by the user. As a result, various contents can be created by changing the attributes of animations and effects to be used. The input information analysis means 35 calculates these values from the video message.

  “Momentum” represents the amount of change (motion amount) of the video information of the video message created by the content creator. The method for calculating the momentum from the input video information 38 is not particularly limited, but for example, the following two methods are conceivable.

(Method using difference image)
In the method using a difference image, the amount of motion is calculated by obtaining a difference between frames of the image. Specifically, the following procedure is followed.

  (1) The total motion amount AMOUNT = 0.

  (2) The difference (P [j] [k] between the pixel value P [j] [k] in the j-th row and the k-th column of the I-th frame and the pixel value P ′ [j] [k] at the same position in the I-1th frame. k] −P ′ [j] [k]).

  (3) If the value calculated in (2) is not 0, 1 is added to AMOUNT. If 0, do nothing. In the example of FIG. 4, the hatched area is an area where 1 is added to AMOUNT.

  (4) The processes of (2) and (3) are executed for all pixels of all frames of video information.

  (5) Momentum = AMOUNT.

(Method using motion vectors)
In the method using a motion vector, an image constituting video information is divided into fixed-size blocks, a block having the highest correlation among the images constituting each block and the previous frame is obtained, and a movement vector to that block is obtained. Is used. Specifically, the following procedure is followed (see FIG. 5).

  (1) An image constituting video information is divided into fixed-size blocks (for example, blocks of 16 × 16 pixels).

  (2) The correlation between a certain block of the I-th frame and a partial region having the same size as the block of the image of the (1-1) -th frame is obtained by taking the difference square sum S of the pixels at the same position in the block. Then, the block that minimizes S is determined.

  (3) Assuming that the center coordinates of a block in the I frame are (Xc, Yc) and the center coordinates of the block in the I-1 frame having the highest correlation with the block are (Xrc, Yrc), the motion vector v is v = (vx, vy) = (Xc−Xrc, Yc−Yrc).

  (4) The magnitude of v | v | = sqrt (vx * vx + vy * vy) is obtained. Here, sqrt means taking a square root, and * represents a product.

  (5) The processes of (3) and (4) are executed in all blocks of all frames of the video message.

  (6) The sum of (5) is Momentum.

  VoicePitch represents the height (pitch) of audio information input by the content creator. The method for calculating VoicePitch from the input audio information 37 is not particularly limited, but there are, for example, the following two methods.

(Method using frequency peak value)
(1) The input voice information is converted into the frequency domain by Fourier transform or the like.

  (2) The power value of each frequency component is examined, and the frequency fp having the maximum power value is set as VoicePitch.

(Method using relative value of frequency)
In the method using the peak value of the frequency, for example, the value of VoicePitch is always low for a low voice creator. Therefore, in the method using the relative value of the frequency, the pitch information extracted by analyzing the audio information previously input by the content creator is recorded in the content holding unit 33. And the relative value with it is set to VoicePitch. Specifically, the following procedure is followed.

  (1) The input voice information is converted into the frequency domain.

  (2) The power value of each frequency component is examined, and the frequency fp having the maximum power value is obtained.

  (3) The previously extracted pitch information fpref recorded in the content holding unit 33 is read out and VoicePitch = fp / fpref is set.

  The values of Momentum and VoicePitch calculated by the above method are transmitted to the content creation means 34.

  The content creation means 34 creates content using the scenario sent from the scenario / content server 10 and the parameters determined by the input information analysis means 35. First, the processing of the part that is a conditional branch in the scenario is determined. For example, in the example of FIG. Animation data used for mdl is determined by Momentum, and the attribute of the effect is determined by VoicePitch. Here, regarding the conditional branch shown in the 22nd to 30th lines in FIG. anim is animation data with the least change in motion, and Anim2. anim, Anim3. The animation data changes rapidly with anim. This means that the degree of movement when the content creator creates the video message can be reflected in the content. Further, in the conditional branch shown in the 37th line to the 42nd line, the effect of dropping a star around the character is determined. eft is anim4. It is set so that the number of stars is larger than that of eft. This means that the degree of voice increase when the video message is created can be reflected.

  When the scenario is determined, the content creation unit 34 issues a request for acquiring content parts such as CG shape data, animation data, and texture data necessary for content creation to the scenario / content server 10 via the communication network 20. When the scenario content server 10 receives the request, it reads out the necessary content parts from the content part holding means 12 and sends them to the content creation means 34 through the distribution means 13, the communication network 20, and the data reception / transmission means 31. Here, the content creating unit 34 receives all the content parts from the scenario / content server 10, but this is not a limitation. For example, parts downloaded at the time of creating content before, parts previously held in the content creation terminal 30 may be acquired from the content holding means 33 and used. Further, a video message input by the content creator may be used as it is as a content part.

  When all the content parts are available, the content is created using them. The content creation unit 34 interprets the scenario and executes the following process generally used in the field of CG according to the scenario to create the content.

(1) Luminance calculation (2) Hidden line / hidden surface elimination (3) Projection conversion, viewport conversion (4) Shading (5) Texture mapping In addition, voice and music are also reproduced at the timing described in the scenario. FIG. 6 shows an example of the content finally created.

  The created content is recorded in the content holding unit 33, but the format is not particularly limited. You may preserve | save uncompressed and you may preserve | save what was encoded in formats, such as MPEG-4. Also, the created content can be sent as an email attachment.

  FIG. 7 is a part of a content scenario related to the “wedding celebration” event. In FIG. 7, <BGColor> is a tag representing a background color, <Voice> is the start / end of a description about audio, <Movie> is the start / end of a description about video, and <Play> is about playback of audio or video. This tag represents the start / end of the description. VoiceAmp represents the size of audio information when the content creator creates a video message. The calculation method of VoiceAmp is not particularly limited. For example, it is conceivable to check the amplitude of the input voice information 37 and set the maximum value to VoiceAmp. In the scenario of FIG. 7, the background color changes according to the value of VoiceAmp. As the value of VoiceAmp increases, blue → green → yellow is set, so in the scenario of FIG. 7, the brighter background color is used as the audio amplitude of the video message increases, and as a result, the content also It will give a bright and flashy impression.

  In the description so far, Momentum, VoiceAmp, and the like are separately used to determine animation data and effect attributes in the scenario, but this is not a limitation. For example, in the scenario shown in FIG. 16, when both Momentum and VoiceAmp are small, the background color is purple, and conversely, when both Momentum and VoiceAmp are large, the background color is yellow. Also, if the momentum is large but the VoiceAmp is small, the color is green. Thus, the scenario may be determined by a combination of a plurality of indices.

  MyPict on line 13 in FIG. This represents mapping the content creator's own face image as a texture to the shape data of mdl. The face image to be used may be a still image stored in advance in the content holding unit 33 or may be used by photographing a still image before creating a video message, but for use as a texture for a CG character. Needs to cut out a face area from the acquired still image. Hereinafter, two methods for extracting the face area will be described.

(1) Method Using Template Matching For template matching, face reference images having various sizes and postures as shown in FIG. 8 are prepared in advance (these images are referred to as templates), and the input still image This is a method of specifying a region by taking a correlation with a partial region of an image. Specifically, the input image is scanned using the prepared template, and the difference square sum S of the pixel value of the input image and the pixel value of the template is sequentially obtained. This process is performed for all templates, and the position and orientation of the template that minimizes S are the position and orientation of the face area in the input image.

(2) Method of using color information together In the method of using color information together, a skin color region is first extracted from an input image. The extracted skin color area is a face area candidate. These candidates are subjected to the same processing as (1) to extract face areas.

  Using the above method, only the face area is extracted from the still image as shown in FIG. The extracted face image is sent to the content creation means 34 and mapped to the CG character. In this way, friendly content can be created by mapping the face image of the content creator to the CG character that appears.

  The MyVoice on the 16th line in FIG. 7 indicates that the audio of the video message created by the content creator is reproduced, and the MyMovie on the 22nd line indicates that the video is reproduced. Accordingly, in the scenario of FIG. 7, a video message created by the content creator, for example, a message celebrating marriage, is played 5.0 seconds after the CG character to which the face image of the content creator is mapped appears. In this manner, the creator's voice and movement information can be reflected in the content, and the video message itself can be embedded in the content.

  In the description so far, the example of changing the animation data, the background color, and the effect attribute for controlling the movement of the CG character according to the information input by the content creator has been described. However, other contents may be changed. Is also possible. For example, the number of CG characters that appear and the music that flows in the background can be changed. When changing the number of characters appearing, it is only necessary to describe the scenario so as to change the number of CG shape data files to be read according to the input information. In addition, when changing the music that flows in the background, tags such as <Music> and <MusicName> are defined, and a scenario may be described so as to change the music data file to be played according to the conditions.

  As described above, according to the content creation device according to Embodiment 1 of the present invention, the face image, voice, and motion information of the content creator are reflected based on the scenario describing the entire content. Can do. Therefore, various contents can be easily created.

(Embodiment 2)
Hereinafter, a content creation apparatus according to Embodiment 2 of the present invention will be described with reference to the drawings.

  FIG. 10 is a diagram showing an example of the configuration of the content creation device according to Embodiment 2 of the present invention. The content creation terminal 30 in FIG. 10 includes a position information acquisition unit 41 in addition to the configuration described in the first embodiment of the present invention. It should be noted that functional configurations corresponding to those of the first embodiment of the present invention are given the same numbers, and detailed descriptions thereof are omitted.

  First, the content creator uses the scenario selection unit 32 to select content to be created. In the second embodiment of the present invention, it is assumed that content related to a “thank you card” event is selected. The selected information is sent to the scenario holding means 11, and the corresponding scenario is sent to the content creation means 34 via the communication network 20.

  FIG. 11 shows a part of the scenario corresponding to the “thank you note” content. In FIG. 11, <Text> is a tag indicating that text is displayed. The Global Position on the fourth line represents the position (location) where the content creation terminal 30 is currently installed. Therefore, in the scenario of FIG. 11, conditional branching is performed according to the location of the terminal, and the text to be displayed is changed. When the content creation means 34 receives the scenario, it first analyzes the contents and confirms that the GlobalPosition is set. , Referred to as position information). When receiving the request, the position information acquisition unit 41 acquires the position information 42. The method for acquiring the position information is not particularly limited, but a GPS (Global Positioning System) mounted on various devices in recent years may be used. The acquired position information 42 is sent to the content creation unit 34.

  The content parts holding means 12 stores text data that expresses “Thank you very much” in various local words. Therefore, in the example of FIG. 11, with reference to the transmitted position information 42, if the position information 42 is greater than or equal to ○ and less than □, the text data “Thank you very much” is selected, and the position information 42 is greater than or equal to □ and less than Δ. If there is, the text data “Honma-Oo-Oki” is selected, and a content part acquisition request is issued. The content part holding unit 12 transmits the selected text data to the content creating unit 34 in the same manner as other content parts necessary for creating the content. The content creation unit 34 creates a content in the same procedure as in the first embodiment of the present invention and stores it in the content holding unit 33. FIG. 12 shows an example of content that is finally created.

  As described above, according to the content creation device according to Embodiment 2 of the present invention, the content content can be changed according to the position (location) where the content creation terminal is currently installed, and the content creation terminal is rich in individuality. Content can be created easily.

(Embodiment 3)
Hereinafter, a content creation apparatus according to Embodiment 3 of the present invention will be described with reference to the drawings.

  FIG. 13 is a diagram illustrating an example of a configuration of a content creation device according to Embodiment 3 of the present invention. The content creation apparatus according to the third embodiment of the present invention is not limited to creating a variety of contents by reflecting information about the content creator in the scenario, but the content creation apparatus according to the first embodiment of the present invention. In the content creation terminal according to the third embodiment of the present invention, content is created on the server side, and only audio information and video information are input on the terminal side. . It should be noted that functional configurations corresponding to those of the first embodiment of the present invention are given the same numbers, and detailed descriptions thereof are omitted.

  The content creation apparatus according to the third embodiment of the present invention includes a content creation server 50, a communication network 20, and an information input terminal 60. In addition to the scenario holding unit 11, the content part holding unit 12, and the distribution unit 13, the content creation server 50 includes a content holding unit 33 that holds the created content, and a content creation unit that creates content using the scenario and the content part. 34, and multiplexed information analyzing means 51 for separating and decoding the audio information 37 and video information 38 sent multiplexed and calculating parameters for determining a scenario from each information. The information input terminal 60 includes an information multiplexing unit 61 that encodes and multiplexes the input audio information 37 and video information 38 in addition to the data transmission / reception unit 31, the scenario selection unit 32, and the input information reception unit 36. ing. Hereinafter, the flow of processing of the content creation device according to Embodiment 3 of the present invention will be described in detail.

  The content creator first selects a desired content from the content table sent from the scenario holding means 11 using the scenario selection means 32. Information regarding the selected content is transmitted to the scenario holding unit 11. The scenario holding unit 11 transmits a scenario corresponding to the selected content to the content creating unit 34. Next, the content creator creates a video message using a camera or a microphone attached to the information input terminal 60. The audio information 37 and the video information 38 constituting the video message are sent to the information multiplexing means 61 via the input information receiving means 36.

  The information multiplexing means 61 receives the sent audio information 37 and video information 38 and converts them into a data format that can be transmitted to the content creation server 50 via the communication network 20. Specifically, as shown in FIG. 14, first, audio information 37 and video information 38 are independently encoded to create a bitstream. The encoding format is not particularly limited, but there is, for example, the MPEG-4 format. Next, the created bit stream is multiplexed. There is no particular limitation on the multiplexing method, but there is an MP4 format, for example. The multiplexed bit stream is sent to the multiplexed information analyzing unit 51 via the communication network 20 and the distributing unit 13.

  The multiplexed information analyzing means 51 separates the transmitted multiplexed bit stream and decodes it to obtain audio information 37 and video information 38. The content creation means 34 interprets what information is necessary to determine the contents in the selected scenario (Momentum, VoicePitch, VoiceAmp, etc. in Embodiment 1 of the present invention), and multiplexes the results. Information is transmitted to the information analysis means 51. The multiplexed information analyzing means 51 calculates necessary parameters such as the amount of motion and the height of speech using the method described above. The calculated parameters are sent to the content creation means 34. Further, as in the second embodiment of the present invention, the information multiplexing means 61 of the information input terminal 60 can be provided with the position information acquisition means 41 (not shown). When the position information acquisition unit 41 is provided, the position information 42 is acquired by using GPS or the like, multiplexed with the audio information 37 and the video information 38 by the information multiplexing unit 61, and transmitted. The multiplexed information analyzing unit 51 acquires the position information 42 by separating the multiplexed bit stream. When GlobalPosition is used in the selected scenario, the scenario is determined with reference to this value.

  Based on the selected scenario and the parameters calculated by the multiplexed information analyzing unit 51, the content creating unit 34 reads out the content parts necessary for content creation from the content part holding unit 12, and creates the content according to the scenario. The created content may be recorded in the content holding unit 33, or may be directly transmitted to the other party as an attachment to an email.

  As described above, according to the content creation device according to Embodiment 3 of the present invention, all content creation is performed by the server, and the terminal only needs to input information. Accordingly, it is possible to easily generate a variety of contents while minimizing the calculation load on the terminal. This is particularly effective when a terminal with low performance is used.

  The content creation device of the present invention can be suitably used by being mounted on, for example, a camera or a mobile phone with a GPS function.

The figure which shows the structure of the content creation apparatus in Embodiment 1 of this invention. The figure which shows an example of the content produced using this invention The figure showing the scenario utilized in Embodiment 1 of this invention The figure explaining the method of calculating a motion amount using a difference image The figure explaining the method of calculating a motion amount using a motion vector Diagram showing an example of content created based on the selected scenario The figure showing the scenario utilized in Embodiment 1 of this invention The figure explaining the template used for extraction of a face area The figure which shows the result of having extracted the face area in an image using a template The figure which shows the structure of the content creation apparatus in Embodiment 2 of this invention. The figure showing the scenario utilized in Embodiment 2 of this invention (A) The figure which shows an example of the content created based on the selected scenario (b) The figure which shows an example of the content created based on the selected scenario The figure which shows the structure of the content creation apparatus in Embodiment 3 of this invention. The figure explaining the procedure which multiplexes audio information and video information Diagram explaining the prior art The figure showing the scenario utilized in Embodiment 1 of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Scenario content server 11 Scenario holding means 12 Content parts holding means 13 Distribution means 20 Communication network 30 Content creation terminal 31 Data transmission / reception means 32 Scenario selection means 33 Content holding means 34 Content creation means 35 Input information analysis means 36 Input information analysis means 36 Means 37 Audio information 38 Video information 41 Position information acquisition means 42 Position information 50 Content creation server 51 Multiplexed information analysis means 60 Information input terminal 61 Information multiplexing means

Claims (12)

Input information receiving means for receiving information input by the content creator, input information analyzing means for analyzing information input by the content creator and determining parameters necessary for content creation, and the determined value of the parameter A content creation apparatus comprising content creation means for creating a scenario of the content reflecting the content and creating the content based on the scenario. The content creation apparatus according to claim 1, wherein the information input by the content creator is a voice of the content creator. The input information accepting unit accepts an input of the content creator's voice, the input information analyzing unit analyzes the volume characteristic and frequency characteristic of the inputted voice, and the content creating unit is configured to analyze the volume characteristic and the analyzed volume characteristic. The content creating apparatus according to claim 2, wherein the content is created by creating a scenario reflecting at least one kind of index among the frequency characteristics. 2. The content creation apparatus according to claim 1, wherein the information input by the content creator is a still image or a moving image taken by the content creator. The input information accepting unit accepts an input of a moving image taken by the content creator, the input information analyzing unit calculates an amount of change between frames of the image constituting the input moving image, and the content creating unit calculates 5. The content creation apparatus according to claim 4, wherein a scenario is created by reflecting a change amount between frames of an image constituting the moving image, and the content is created. The input information accepting unit accepts input of the content creator's voice and moving image, and the input information analyzing unit analyzes a volume characteristic and a frequency characteristic of the inputted voice, and also inputs an image constituting the inputted moving image. The amount of change between frames is calculated, and the content creation means reflects at least one index of the analyzed volume characteristic and frequency characteristic and the calculated amount of change between frames of the image constituting the moving image. The content creation apparatus according to claim 1, wherein a scenario is created to create content. 2. The content creation device according to claim 1, further comprising position information acquisition means for acquiring a current position, wherein the content creation means creates a scenario by reflecting the acquired current position. . 8. The content creation apparatus according to claim 1, wherein the content scenario is a metafile described using a predetermined descriptor. 9. The content creation apparatus according to claim 8, wherein the content creation unit determines a branch destination of the conditional branch described in the metafile based on the parameter value determined by the input information analysis unit. An input information receiving step for receiving information input by the content creator, an input information analyzing step for analyzing information input by the content creator and determining parameters necessary for content creation, and the determined value of the parameter A content creation method comprising creating a content scenario reflecting the content and creating the content based on the scenario. A content creation system configured by connecting a scenario / content server that provides materials for creating content and a content creation terminal via a communication network, the scenario / content server holding a scenario of the content Scenario holding means, distribution means for delivering the scenario, the content creation terminal, input information receiving means for receiving information input by the content creator, and analysis of information input by the content creator to create content Input information analysis means for determining parameters required for the content, and content creation means for creating the scenario reflecting the determined parameter value and creating the content based on the scenario Content creation system. A content creation system configured by connecting an information input terminal and a content creation server via a communication network, wherein the information input terminal encodes information input by a content creator and then multiplexes the information Means, data transmission / reception means for delivering the multiplexed information to the content creation server, the content creation server comprising scenario holding means for holding a scenario of content, and the multiplexing delivered from the information input terminal And separating the decrypted information, decoding the decrypted information, analyzing the decrypted information, and determining a parameter necessary for creating the content, and reflecting the value of the analyzed parameter Content creation means for creating the scenario and creating the content based on the scenario Content production system, characterized in that.

Images