JP2006005895A - Multimedia contents re-constitution apparatus, multimedia contents re-constitution method, program for making computer execute the method, and multimedia contents distribution system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To re-constitute multimedia (MM) contents based on a purpose and a utilization environment and to automatically generate the re-constituted contents. <P>SOLUTION: An automatic commercial (CM) generation apparatus in embodiments comprises a utilization purpose setting section 1, a utilization environment setting section 2, a contents re-constitution section 3, an operation display section 4, and a storage section 5. The utilization purpose setting section 1 accepts and sets utilization purpose information from a user and when the user inputs utilization environment information for viewing CM contents, the utilization environment setting section 2 accepts and sets the inputted information. According to the utilization purpose information set by the utilization purpose setting section 1 and the utilization environment information set by the utilization environment setting section 2, the contents re-constitution section 3 re-constitutes the MM contents and automatically generates the CM contents. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

The present invention relates to a technology for reconfiguring multimedia content, and more particularly to a technology for reconfiguring multimedia content according to the purpose, and more particularly, to generate commercial content by reconfiguring multimedia content. It is related to the technology.

In recent years, an environment in which multimedia contents (hereinafter referred to as MM contents) can be handled by various terminals has been established. In addition, the number of MM contents themselves is increasing. In order for a general user to select MM content to be viewed from a large amount of MM content, each MM
It is convenient to have so-called commercial (CM) content such as content digests and trailers. In that case, so-called CM content reconstructed in a commercial manner, such as a content trailer, is more effective than a digest that simply summarizes the contents of the MM content. However, there is a problem that it is too costly to manually create such a digest or a trailer or other CM content manually, and cannot cope with an increase in MM content.

  In addition, a tool called “MPMeister (R)” manufactured by Ricoh Co., Ltd. has been produced as a tool for recording presentations and automatically generating contents for Web publication.

Thus, for example, a technique has been devised for generating and distributing a digest from multimedia content based on user preferences (Patent Document 1).

JP 2003-333500 A Ricoh Co., Ltd. “MPMeister V1.3 Japanese Environment Release Notes” published by Ricoh Co., Ltd., July 9, 2004

However, although this technique is a technique for generating and distributing a digest based on the personal preference of the distribution destination, the MM content is automatically reconfigured according to the purpose of use including the CM purpose and the user terminal. It wasn't technology.

  The MPMeister (R) generates a one-hour presentation as one-hour content. For this reason, it has not been possible to meet the demands of users who want to watch a presentation easily in a short time, or want to watch the presentation little by little every day. In particular, assuming a mobile terminal as a display device, it is difficult to view for a long time, so it was desirable to provide the content as a short clip in particular. However, the conventional MPMeister (R) cuts out a part of the presentation and partially It was not suitable for viewing on a device such as a mobile terminal because it could not be distributed as a simple content.

The present invention has been made in view of the above, and a multimedia content reconstructing apparatus, a multimedia content reconstructing method, and a program for causing a computer to execute the method for reconstructing MM content from MM content material according to the purpose of use And a multimedia content distribution system. In particular, a multimedia content reconstruction device, a multimedia content reconstruction method, a program for causing a computer to execute the method, and a multimedia content distribution system capable of automatically generating CM content and short clips are provided. For the purpose.

In order to solve the above-described problems and achieve the object, the invention according to claim 1 is a multimedia content reconstructing apparatus that reconfigures multimedia content according to the purpose of use, and uses the object for the purpose of use. Use purpose setting means for accepting setting of purpose information, use environment setting means for accepting setting of use environment information about the environment in which the multimedia content to be reconfigured is set by the use purpose setting means Content reconstructing means for reconstructing the multimedia content material based on the use purpose information and the use environment information set by the use environment setting means.

According to a second aspect of the present invention, in the multimedia content reconstructing device according to the first aspect, the usage purpose setting means is at least one of usage as CM, usage as a short clip, and passive viewing usage. The usage environment setting means accepts a setting input of the usage purpose information including a usage purpose, and the usage environment setting means sets the usage environment information including at least one usage environment of usage on a portable terminal and usage on a television terminal. It is characterized by accepting input.

The invention according to claim 3 is the multimedia content reconstructing device according to claim 1 or 2, further comprising a user information database for storing the use purpose information of the user and the use environment information. The purpose setting means receives the use purpose information stored in the user information database, and the use environment setting means receives the use environment information stored in the user information database.

According to a fourth aspect of the present invention, in the multimedia content reconstructing apparatus according to any one of the first to third aspects, the usage purpose setting means includes a video content trailer, a product as the usage purpose information. Use of commercial (CM) content usage purpose information including at least one of explanation and promotion videos, short clip usage purpose information, usage purpose information for the purpose of presenting at least a part of the presentation, and provision of emergency information The usage purpose information including at least one of intended usage purpose information is received, and the content reconstruction means includes at least one of the CM content, the short clip, at least a part of the presentation, and the emergency information. Multimedia computer Characterized in that it is intended to reconstruct the Ntsu.

According to a fifth aspect of the present invention, in the multimedia content reconstructing apparatus according to the fourth aspect, the content reconstructing means includes a template setting means for accepting setting of a template for reconstructing the multimedia content. Music setting means for receiving music data settings for reconfiguring the multimedia content, material search means for searching for multimedia content material based on the usage purpose information and usage environment information, and the received Multimedia content reconstructing means for reconstructing multimedia content from the template, the music data, and the retrieved multimedia content material based on the usage purpose information and the usage environment information, To do.

The invention according to claim 6 is the multimedia content reconstructing device according to claim 5, wherein a layout of a display screen for displaying the reconstructed multimedia content in the usage environment and a timeline of each material content And a template DB for storing the template including effect information at the time of content switching, and the template setting means selects from the templates stored in the template DB based on the usage purpose information and usage environment information It is displayed to the user and accepts the setting input by the user.

The invention according to claim 7 is the multimedia content reconstructing device according to claim 6, wherein the template setting means receives a template setting input by a user and generates the template by the received setting input. The template DB
And a new template is generated by combining the stored templates and further stored in the template DB.

The invention according to claim 8 is the multimedia content reconstructing device according to claim 6 or 7, further comprising a music information DB for storing music information, wherein the music setting means is configured to set the template. The music information is selected and displayed based on the usage purpose information and the usage environment information, and setting input by the user is accepted.

The invention according to claim 9 is the multimedia content reconstructing device according to any one of claims 5 to 8, wherein the music setting means is BG as music for accepting the setting.
It is characterized by accepting the setting of M (background music).

The invention according to claim 10 is the multimedia content reconstructing device according to any one of claims 5 to 9, further comprising a multimedia content material DB for storing the multimedia content material and its index information. The material search means extracts the multimedia content material from the multimedia content material DB based on the usage purpose information and usage environment information.

The invention according to claim 11 is the multimedia content reconstructing device according to any one of claims 5 to 10, wherein the material search means extracts keyword information in the multimedia content material and is important. Keyword extraction means for setting the degree, image extraction means for extracting the image information and setting the importance, video extraction means for extracting the video information and setting the importance, and extracting the audio information and setting the importance And audio content reconstructing means for reconstructing the multimedia content based on the importance of the extracted information.

The invention according to claim 12 is the multimedia content reconstructing device according to claim 11, wherein the keyword extracting means extracts the keyword information from the multimedia content material DB and sets the importance level. And accepting a change input of the extracted keyword and a setting input of a new keyword by the user.

The invention according to claim 13 is the multimedia content reconstructing device according to claim 11 or 12, wherein the image extraction means determines the importance based on the characteristics of the image, and sets the importance by the keyword extraction means. An image is extracted based on at least one of an input, an input of image importance setting input by the user, and an image cutout by image recognition.

  The invention according to claim 14 is the multimedia content reconstructing device according to claim 13, wherein at least one of the use purpose setting means and the use environment setting means accepts the setting of the size of the content to be reconfigured. In this case, the image extraction means selects the image extraction method based on the accepted set size.

The invention according to claim 15 is the multimedia content reconstructing device according to any one of claims 11 to 14, wherein the video extracting means is a method of determining importance based on video characteristics, and the keyword extracting means. The video is extracted based on at least one of setting input of importance by, receiving input of setting of video importance by the user, and image cutout by video recognition.

  The invention according to claim 16 is the multimedia content reconstructing device according to claim 15, wherein at least one of the use purpose setting means and the use environment setting means sets the size of the content to be reconfigured. The video extraction means selects the video extraction method based on the received set size.

The invention according to claim 17 is the multimedia content reconstructing device according to any one of claims 11 to 16, wherein the voice extraction means is a determination of importance by a voice recognition technique, and the keyword extraction means. The voice is extracted based on at least one of the importance setting input by the user, the determination of the importance by the word spotting technique, the reception of the voice importance setting input by the user, and the cutout by the voice recognition technique. It is characterized by being.

  The invention according to claim 18 is the multimedia content reconstructing device according to claim 17, wherein at least one of the use purpose setting means and the use environment setting means accepts the setting of the size of the content to be reconfigured. In this case, the voice extraction means selects the voice extraction method based on the accepted set size.

The invention according to claim 19 is the multimedia content reconstructing device according to any one of claims 2 to 18, for users including viewers and distributors of the reconfigured multimedia content. And a restriction setting means for accepting a restriction setting input for setting not to display at least a part of the multimedia content material, wherein the content reconstruction means is set not to be displayed by the restriction setting means. The multimedia content is reconstructed by excluding the portion of the multimedia content material.

The invention according to claim 20 is the multimedia content reconstructing device according to any one of claims 11 to 19, wherein the keyword extraction means, the image extraction means, the video extraction means, and the audio extraction Extraction priority setting means for receiving a priority setting input for setting priority levels of importance levels of at least two extraction means among the means; and the content reconfiguration means is set by the extraction priority setting means The multimedia content is reconstructed based on the priority order.

The invention according to claim 21 is a multimedia content reconstructing method for reconfiguring multimedia content according to a usage purpose, a usage purpose setting step of accepting setting of usage purpose information for the usage purpose, Set by the use environment setting step for accepting the setting of use environment information for the environment in which the reconfigured multimedia content is used, the use purpose information set in the use purpose setting step, and the use environment setting step And a content reconstructing step of reconstructing the multimedia content material based on the use environment information.

The invention according to claim 22 is the multimedia content reconstructing method according to claim 21, wherein the use purpose setting step includes at least one use purpose of use as CM and use of passive viewing. The user environment setting input is received, and the use environment setting step includes a user setting input of the use environment information including at least one use environment of use on a mobile terminal and use on a television terminal. It is what is received.

The invention according to claim 23 is the multimedia content reconstructing method according to claim 21 or 22, wherein the use purpose setting step includes a user information database for storing the use purpose information of the user and the use environment information. The usage purpose information stored in the user information database is received, and the usage environment setting step receives the usage environment information stored in the user information database.

According to a twenty-fourth aspect of the present invention, there is provided a multimedia content reconstructing program that causes a computer to execute any one of the multimedia content reconstructing methods according to the twenty-first to twenty-third aspects.

  The invention according to claim 25 is connected to each other via a network, receives a multimedia content generating device that generates multimedia content, and the multimedia content generated by the multimedia content generating device, A multimedia content reconstructing device for reconfiguring the received multimedia content according to the purpose of use; a transmission server for transmitting the multimedia content reconstructed by the multimedia content reconstructing device via the network; A multimedia content distribution system comprising: a plurality of information terminals that receive the reconstructed multimedia content transmitted by the transmission server, wherein the multimedia content reconstruction device A purpose-of-use setting means for accepting setting of purpose-of-use purpose information, a use environment setting means for accepting setting of use environment information for an environment in which the reconfigured multimedia content is used, and the purpose of use setting means Content reconstructing means for reconstructing the generated multimedia content based on the set usage purpose information and the usage environment information set by the usage environment setting means .

  According to a twenty-sixth aspect of the present invention, in the multimedia content distribution system according to the twenty-fifth aspect, the multimedia content generating apparatus is MPMeister (R).

  According to a twenty-seventh aspect of the present invention, in the multimedia content distribution system according to the twenty-fifth or twenty-sixth aspect, the information terminal is a mobile phone, and the usage environment setting means is usage environment information by use of the cellular phone. Is set.

  The invention according to claim 28 is the multimedia content distribution system according to any one of claims 25 to 27, wherein the use purpose setting means is emergency distribution of emergency information, At least one of distribution and presentation content distribution is received as usage purpose information. It is characterized in that at least one of media content and multimedia content which is presentation content is reconstructed.

  The invention according to claim 29 is the multimedia content distribution system according to any one of claims 25 to 28, wherein the transmission server receives the MM content generated by the multimedia content reconstruction device, Distribution is performed based on a preset schedule.

  The invention according to claim 30 is the multimedia content distribution system according to claim 29, wherein the multimedia reconstructing means maintains and reconstructs a timeline of the multimedia content as the presentation content, The transmission server is characterized in that the presentation content reconstructed by maintaining the timeline by the multimedia content reconstructing means is distributed to the information terminal while retaining the timeline.

  The invention according to claim 31 is the multimedia content distribution system according to any one of claims 25 to 30, wherein the transmission server stores the multimedia reconfigured by the multimedia content reconstruction device. A homepage to be displayed is provided on the Web, and downloads from the portable terminal are accepted.

According to the first aspect of the present invention, the usage purpose of the multimedia content to be reconfigured and the usage environment information such as the PC are set, and the multimedia is based on the set usage purpose information and the usage environment information. Since the content material is reconfigured, there is an effect that it is possible to provide a multimedia content reconstructing apparatus capable of automatically reconfiguring multimedia content suitable for the usage purpose and usage environment.

  According to the second aspect of the present invention, the purpose of use can be set and input use purpose information including at least one of use as a CM, use as a short clip, and use of passive viewing. For environment setting, usage environment information including at least one of usage on a mobile terminal and usage on a television terminal can be set and input so that, for example, a short clip can be passively viewed on the mobile terminal by setting input. There is an effect that it is possible to provide a multimedia content reconstruction device capable of automatically reconfiguring multimedia content.

According to the third aspect of the present invention, the usage purpose and usage environment can be set from the user information database that stores the usage purpose information and usage environment information of the user. There is an effect that it is possible to provide a multimedia content reconstruction device that can automatically reconfigure adapted multimedia content.

According to the invention of claim 4, commercial (CM) content including at least one of video content trailers, product descriptions, and promotional videos, short clips, presentations, and the like are automatically obtained from the multimedia content. There is an effect that it is possible to provide a multimedia content reconstruction device that can be reconfigured.

According to the invention of claim 5, a template and music data for reconfiguring multimedia content are set, and multimedia content material is searched and reconstructed based on usage purpose and usage environment information. Therefore, there is an effect that it is possible to provide a multimedia content reconstruction device that can automatically reconfigure multimedia content including music information reconfigured in conformity with the purpose and environment of use.

According to the invention of claim 6, the template DB further stores the template including the layout on the display screen in the usage environment, the timeline of each material content, and the effect information at the time of content switching. Since the user can select a template from the DB, there is an effect that it is possible to provide a multimedia content reconstructing apparatus that can automatically reconfigure content adapted to the user's preference from multimedia content.

According to the invention of claim 7, a new template is accumulated in the template DB by a template setting input by the user, and a new template is generated by combining the accumulated templates and further accumulated in the template DB. Therefore, there is an effect that it is possible to provide a multimedia content reconstructing apparatus that can automatically reconstruct content from multimedia content by using a template with many options that are more adapted to the user's preference.

According to the invention according to claim 8, the music information DB for storing the music information is further provided, and the user can select from the music information selected and displayed from the music information DB. There is an effect that it is possible to provide a multimedia content reconstructing apparatus capable of automatically reconstructing adapted content from multimedia content.

According to the invention of claim 9, since BGM (background music) can be set, a multimedia content reconstructing apparatus capable of automatically reconstructing content adapted to the user's music preference from multimedia content There is an effect that it can be provided.

The invention according to claim 10 further includes a multimedia content material DB for storing multimedia content materials and index information thereof, and based on the usage purpose information and the usage environment information, from the multimedia content material DB. Since the multimedia content material is extracted, there is an effect that it is possible to provide a multimedia content reconstruction apparatus that can automatically and accurately reconstruct the content from various multimedia contents.

According to the invention of claim 11, in the search for multimedia content material, the keyword and the importance of the keyword, the importance of the image information and the image information, the importance of the video information and the video information, and the audio information and the audio The multimedia content can be automatically reconstructed from each important media content by extracting the demand for information and reconstructing the multimedia content based on the respective importance of each extracted information The content reconstructing apparatus can be provided.

According to the invention of claim 12, since keywords are extracted from the multimedia content material DB and importance is set, and the keywords can be changed by the user, keywords for extracting multimedia contents are automatically selected. Even if it is set manually, it can be changed according to the needs of the user, so that it is possible to provide a multimedia content reconstructing apparatus capable of automatically reconstructing contents adapted to the needs of the user from the multimedia contents.

According to the thirteenth aspect of the present invention, since the image extraction is performed based on at least one of the importance level based on the feature of the image, the importance level based on the keyword, and the image importance level set by the user, an important image can be extracted. Can be extracted and the user can change the importance,
There is an effect that it is possible to provide a multimedia content reconstructing apparatus capable of automatically reconstructing content adapted to user needs from image content.

  According to the fourteenth aspect of the present invention, since the size of the content to be reconfigured can be set and the image extraction method can be selected based on the set size, the optimum extraction can be performed based on the set size. This method is advantageous in that it can provide a multimedia content reconstructing apparatus that can take a method, has high generation efficiency, and can automatically reconfigure content that is more suitable for user needs.

According to the fifteenth aspect of the present invention, video extraction is performed based on at least one of importance based on video characteristics, importance based on keywords, setting of video importance by a user, and image cutout based on image recognition. Therefore, since an important video can be extracted and the user can change the level of importance, there is an effect that it is possible to provide a multimedia content reconstructing apparatus capable of automatically reconstructing a content suitable for the user's needs from the video content.

  According to the invention of claim 16, since the size of the content to be reconfigured can be set and the video extraction method can be selected based on the set size, the optimum extraction based on the set size This method is advantageous in that it can provide a multimedia content reconstructing apparatus that can take a method, has high generation efficiency, and can automatically reconfigure content that is more suitable for user needs.

According to the seventeenth aspect of the present invention, at the time of voice extraction, the importance of voice, the importance by keyword, the importance by word spotting technology, the setting of the importance of voice by the user, and the start of cut by voice cuts Since it is based on at least one, important audio can be extracted, and the importance can be changed by the user, so that a multimedia content reconstructing apparatus capable of automatically reconstructing content suitable for the user's needs from audio content There is an effect that it can be provided.

  According to the invention of claim 18, since the size of the content to be reconfigured can be set and the audio extraction method can be selected based on the set size, the optimum extraction can be performed based on the set size. This method is advantageous in that it can provide a multimedia content reconstructing apparatus that can take a method, has high generation efficiency, and can automatically reconfigure content that is more suitable for user needs.

According to the nineteenth aspect of the invention, since it can be set so that at least a part of the multimedia content material is not displayed to the user of the reconstructed multimedia content, the part that is not displayed to the user is displayed. There is an effect that it is possible to provide a multimedia content reconstructing apparatus capable of automatically reconstructing multimedia content that is not performed.

According to the twentieth aspect of the present invention, the priority of the importance of media to be extracted is set from among keyword extraction, image extraction, video extraction, and audio extraction. As a result, it is possible to provide a multimedia content reconstructing device that automatically reconfigures multimedia content with a difference in importance to the media.

According to the invention of claim 21, the usage purpose of multimedia contents to be reconfigured and the usage environment information such as a PC are set, and based on the set usage purpose information and usage environment information, Since the material of the multimedia content is reconfigured, it is possible to provide a multimedia content reconstructing method that can automatically reconfigure multimedia content suitable for the purpose and environment of use.

  According to the invention of claim 22, the usage purpose setting allows the user to set and input usage purpose information including at least one of usage as a CM, usage as a short clip, and passive viewing usage, In addition, since the user can set and input usage environment information including at least one of usage on a mobile terminal and usage on a television terminal, the usage environment can be set and input by the user, for example, passively using a short clip. It is possible to provide a multimedia content reconstructing method capable of automatically reconfiguring multimedia content so that it can be viewed on the Internet.

According to the twenty-third aspect of the present invention, the usage purpose and usage environment can be set from the user information database that stores the usage purpose information and usage environment information of the user. There is an effect that it is possible to provide a multimedia content reconstruction method capable of automatically reconstructing adapted multimedia content.

According to the twenty-fourth aspect of the invention, any one of the multimedia content reconstruction methods according to claims 21 to 23 can be executed on a computer, and a multimedia content reconstruction program can be provided.

  According to the invention of claim 25, a multimedia content generating device that generates multimedia content, a multimedia content reconfiguring device that reconfigures the generated multimedia content according to the purpose of use, and a reconfiguration A multimedia content distribution system comprising: a transmission server for transmitting the multimedia content via a network; and a plurality of information terminals for receiving the reconfigured multimedia content. Reconfigures multimedia content based on the setting of usage purpose information for the purpose of use and the usage environment information for the environment in which it is used. Send in configuration and user An effect that can provide multimedia content distribution system capable of hearing.

  According to the invention of claim 26, since the multimedia content generating apparatus is an MPMeister (R), it is possible to efficiently generate multimedia content to be reconfigured. There is an effect that it is possible to provide a multimedia content distribution system that can automatically reconfigure and transmit multimedia content suitable for the usage environment and allow the user to view it.

  According to the invention of claim 27, since the information terminal is a mobile phone and the multimedia content reconstructing apparatus sets the use environment as a mobile phone and reconfigures it, the information terminal is adapted to the use environment of the mobile phone. It is possible to provide a multimedia content distribution system in which the multimedia content can be automatically reconfigured and transmitted efficiently and viewed by the user.

  Further, according to the invention of claim 28, since multimedia contents are reconfigured in a form suitable for emergency distribution of emergency information, distribution of well-known thorough information, and distribution of presentation contents, a multi-media suitable for each application can be used. It is possible to provide a multimedia content distribution system in which media content is automatically reconfigured and efficiently transmitted, and can be viewed by the user.

  According to the invention of claim 29, since the transmission server distributes the reconfigured content based on a preset schedule, it is possible to provide a multimedia content distribution system that is highly convenient for the user. There is an effect.

  According to the invention of claim 30, the multimedia content timeline is maintained and reconstructed, and the transmission server distributes the reconstructed presentation content to the information terminal while maintaining the timeline. As a result, it is possible to provide a multimedia content distribution system that is highly convenient for the user in which the temporal order is correctly maintained.

  According to the invention of claim 31, since a web page for displaying the reconfigured multimedia is provided on the Web and download from the mobile terminal is accepted, information can be acquired according to the user's request. It is effective in providing a multimedia content distribution system with high efficiency and convenience.

  DETAILED DESCRIPTION Exemplary embodiments of a multimedia content reconstruction device, a multimedia content reconstruction method, a program for causing a computer to execute the method, and a multimedia content distribution system according to the present invention are described in detail below with reference to the accompanying drawings. Explained.

  The multimedia content reconstruction apparatus according to the embodiment of the present invention will be described in the form of being embodied as a multimedia (MM) content reconstruction apparatus for the purpose of generating a short clip such as commercial (CM) content. Here, an embodiment for automatically generating a short clip such as a CM is hereinafter simply referred to as a CM automatic generation apparatus. In the following description, it will be referred to as an automatic CM generation device, but the MM content automatically generated by this automatic CM generation device is not limited to a CM, but a short clip such as a CM, a presentation and a part thereof, a disaster So-called MM content is reconstructed and generated, including urgent information such as the occurrence of accidents, well-known thorough information on thorough well-known matters in business entities, weather forecasts, news programs, or traffic information.

  In the following, for the sake of explanation and simplification, as an example of multimedia content reconfiguration, it will be described mainly that CM content is automatically generated. However, the present invention is limited to automatic generation of CM content. is not. The automatic CM generation apparatus is just one example of implementation of the multimedia content reconstruction apparatus according to the present invention.

(1. Embodiment 1)
FIG. 1 is a functional block diagram of an automatic CM generation device according to Embodiment 1 of the present invention. The automatic CM generation apparatus (hereinafter referred to as “this apparatus”) according to Embodiment 1 includes a usage purpose setting unit 1, a usage environment setting unit 2, a content reconstruction unit 3, an operation display unit 4, and a storage unit 5. Hereinafter, the multimedia content is referred to as MM content.

The usage purpose setting unit 1 sets usage purpose information, the usage environment setting unit 2 sets usage environment information for the user to view the CM content, and the content reconstruction unit 3 uses the usage set by the usage purpose setting unit 1. The CM content is reconstructed from the MM content according to the purpose information and the usage environment information set by the usage environment setting unit 2.

The content reconstruction unit 3 includes a template setting unit 31, a BGM setting unit 32, and a material search unit 3.
3. An MM content reconstruction unit 34 is provided.

The storage unit 5 includes a user profile database (DB) 51 and a CM template DB 5
2. A music material DB 53, an MM material content DB 54, and an MPEG-7 DB 55 are included.

The usage purpose setting unit 1 accepts a setting input for setting what purpose the user uses the MM content. The purpose of the user to use the MM content is to have the user actually use the MM content reconfigured by the apparatus, such as wanting to view it as a CM, passively watch it, or watch it as a teaching material. is there. Here, usage purpose information for the purpose of generating CM content is input to the usage purpose setting unit 1 and accepted.

The user performs setting input for CM content generation purpose as a purpose of use via the operation display unit 4. The operation display unit 4 includes an input device such as a keyboard / mouse for input by the user, and a display device (not shown) for displaying information to the user such as a liquid crystal monitor.

  The storage unit 5 stores a user profile DB 51 that accumulates information about users. The usage purpose setting unit 1 can be configured to access the user profile DB 51 and acquire the usage purpose information of the user. In this way, the usage purpose setting unit 1 can set the usage purpose information of the MM content to be reconfigured by the user. Therefore, when generating the CM content, it can be reconfigured according to the usage purpose information.

The usage environment setting unit 2 sets an environment in which the user views the MM content reconstructed by the apparatus, in this case, the generated CM content. The user viewing environment is, for example,
A viewing environment such as viewing on a mobile terminal, viewing on a TV terminal, or viewing on a personal computer. The use environment setting unit 2 receives the set input when the user inputs the setting of environment information. The environment information setting input by the user is performed via the operation display unit 4 in the same manner as the above-described use information input.

Here, the user profile DB 51 can store usage environment information. In this case, the usage environment setting unit 2 can be configured to access the usage environment information of the user to the user profile DB 51 and acquire the usage environment information.

In addition, the user profile DB 51 accumulates various information about the user, and each processing unit described below accesses the information to read and read information including usage purpose information and usage environment information required by each processing unit. Each function can be executed according to the information. Thus, the usage environment setting unit 2 can set usage environment information such as the user's PC terminal. Therefore, when CM content is generated, it can be reconfigured according to the usage environment information.

The content reconfiguration unit 3 reconfigures the content according to the purpose information set by the use purpose setting unit 1. Therefore, the content reconstruction by the content reconstruction unit 3 of this apparatus is
In other words, it can be understood that the MM content is “re-purposed”.

Here, the MM content material generated using MPMeister (R) already announced by Ricoh Co., Ltd. can be used as a tool for generating the MM content material. MPMeister (R) automatically indexes presentation videos based on files by PowerPoint (R), a presentation tool of Microsoft (R), and works in conjunction with PowerPoint (R).
This is a tool for automatically generating content for eb publication.

In the present embodiment, the content reconstruction unit 3 generates CM content.
For example, CM content such as a trailer for one movie content or CM content for multimedia recording of the entire presentation is generated.

Here, various techniques are known as various processing techniques for the MM content. For example, when a publicly known technique disclosed in Japanese Patent Laid-Open No. 2000-339345 is used, a necessary search can be performed even when an accurate keyword is not known when searching for broadcast content. JP 2001
By using the publicly known technology of No. 24996, it is possible to provide markup language data distributed by digital satellite data broadcasting or the like in an expression format suitable for the needs and preferences of viewers (users). In the present embodiment, MM content is searched for CM content generation and reconstructed as a CM. The above-described known technique can be used for this search.

Hereinafter, each processing unit included in the content reconstruction unit 3 will be described. The template setting unit 31 displays a CM template to be used for CM content reconfiguration on the operation display unit 4. The content reconstruction unit 3 includes a CM template DB 52. CM template is
In the automatic generation of CM contents, information including a screen layout, a timeline of each material content, and an effect at the time of content switching is a preset template. The CM template DB 52 stores CM templates.

The template setting unit 31 automatically selects a template stored in the CM template DB 52 according to the usage purpose set by the usage purpose setting unit 1 and the usage environment information in the usage terminal set by the usage environment setting unit 2. And displayed on the operation display unit 4.

When the user selects and inputs a favorite one from the templates displayed on the operation display unit 4, the template setting unit 31 receives the setting input and sets the template selected by the user.

Alternatively, the user can newly create a CM template via the operation display unit 4. In this case, the template setting unit 31 receives a newly created CM template, and the received template is selected by the user when
A newly created CM template can be set and stored in the template DB 52.

In addition, the template setting unit 31 is configured according to the use purpose information and the use environment information described above.
A new template can be generated by combining existing template portions, and the newly generated template can be displayed on the operation display unit 4 and stored in the template DB 52.

In this way, a template that the user likes, such as the atmosphere and configuration of the CM, can be proposed to the user via the operation display unit 4, and a wider choice of CM content generation can be presented. Alternatively, the template may be automatically determined without waiting for the user's selection to be presented.

The BGM setting unit 32 is a background music (
BGM). The content reconstruction unit 3 is a music material DB 53 that stores music data.
Is provided. The music material DB 53 normally stores music data including copyright-free music data. The BGM setting unit 32 accesses the music material DB 53 and, according to the user preference information acquired from the user profile DB 51, the BG suitable for the CM content atmosphere.
It has both a function of automatically selecting M and a function of accepting a set input when the user himself selects and sets music. Thus, the user can select and input the BGM to be presented via the operation display unit 4, or can automatically select according to the conditions including the purpose of use and the use environment information.

The material search unit 33 includes a keyword extraction unit 331, an image extraction unit 332, a video extraction unit 333,
And a voice extraction unit 334. Briefly describing the function of each extraction unit included in the material search unit 33, the keyword extraction unit 331 extracts keyword information in the MM content material and sets the importance, and the image extraction unit 332 extracts image information. The video extraction unit 333 extracts video information and sets the importance level, and the audio extraction unit 334 extracts audio information and sets the importance level.

The material search unit 33 also includes an MM material content DB 54 that stores various MM material contents necessary for CM content generation. MM stored in the MM material content DB 54
The content is, for example, content generated by the above-described MPMeister (R),
It is possible to store content acquired by receiving digital broadcasting or from a web page.

The material search unit 33 accesses the MM material content DB 54 to search for and extract necessary MM content. Details of each processing unit of the material search unit 33 are as follows.

The keyword extraction unit 331 stores the MPE that stores the index information of the MM content material.
It has G-7DB55. The keyword extraction unit 331 is a function that automatically extracts important keywords from the MM material content DB 54 and the MPEG-7 DB 55 using existing keyword extraction technology. A function of accepting a keyword, or a function of accepting a change by a user with respect to an automatically extracted keyword and its importance. Here, about keyword extraction technology,
The search for content material can be realized using various known techniques including the technique disclosed in the above-mentioned known documents. In this way, the keyword extraction unit 331 determines M as an important keyword
M content material can be searched and extracted. Alternatively, there is a technique that can extract a certain degree of related MM content material even when an accurate keyword is not known (described above).

The image extraction unit 332 includes a known image feature determination technique and a keyword extraction unit 33.
1 has the function of calculating the importance of an image using the keyword extracted in 1 and automatically extracting an important image according to the calculated importance. Further, the image extraction unit 332 has a function of accepting a selection setting for the user himself to select an image, or a change setting for changing the automatically extracted image and its importance.

The video extraction unit 333 includes a known video feature determination technique and a keyword extraction unit 33.
1 has the function of calculating the importance of the video scene using the keywords extracted in 1 and automatically extracting the important video scene according to the calculated importance. The video extraction unit 3
33 has a function of accepting a selection setting for the user himself to select a video, or a change setting for changing the automatically extracted video and its importance.

The voice extraction unit 334 has a function of calculating the importance level of a voice by using a known voice recognition technique and a word spotting technique, and automatically extracting important voice according to the calculated importance level. In addition, the voice extraction unit 334 has a function of accepting an importance level setting in which the user himself sets the importance level of the voice, or an automatically extracted voice and a change setting for changing the importance level.

The MM content restructuring unit 34 is a template set by the template setting unit 31;
The BGM set by the BGM setting unit 32 and the material searched and extracted by the material search unit 33 are reconfigured according to the acquired usage purpose information and usage environment information, and CM content is generated. Here, as a technique for summarizing contents, for example, a technique disclosed in Japanese Patent Laid-Open No. 2002-259720 can be used. Also, the technique disclosed in Patent Document 1 can be used.

FIG. 2 is a diagram for explaining the analysis of the importance of images, video, and audio in the MM content material. In FIG. 2, the image 202, the video 203, and the audio 2 with respect to the time axis 201.
It is shown that each information of 04 is provided. Here, as events 205, 206 and 207, in the display of PowerPoint (R) which is presentation software,
Event information by events such as turning pages is provided as metadata as appropriate. For video, audio, and image information, for example, importance is calculated using keyword extraction using metadata, image recognition, and audio recognition technology.

The importance analysis of the image in the image extraction unit 332 calculates the importance of the image based on the keyword extracted by the keyword extraction unit 331 using, for example, the technique described in Patent Document 1 described above. . Alternatively, the importance of an image can be calculated based on whether or not the metadata corresponding to the image matches a keyword. In this way, the MM content material including the important image portion can be extracted by the image extraction unit 332.

In the video importance analysis in the video extraction unit 333, camera movement such as scene change and zoom-in is analyzed to calculate the importance. In this way, the MM content material including the important video portion can be extracted by the video extraction unit 333.

In the voice importance analysis in the voice extraction unit 334, a word spotting technique is applied based on the keyword extracted by the keyword extraction unit 331 to increase the voice importance including the keyword, or sound other than the voice of the keyword is generated. Apply rules such as lowering the importance of the part that contains or increasing the importance of the part that contains the voices of multiple people. In this way, the MM content material including the important audio part can be extracted by the audio extraction unit 334.

Compared to summarizing content, the purpose of generating CM content is often the case where the relationship between the materials may be low, so analyze the importance for each material and identify the high importance portions of each material. It may be selected as a CM component material. Of course, it is also possible to calculate the degree of association between the materials and determine the importance of the extracted material in combination.

As shown in FIG. 2, portions 208a to 208f having high image (image) importance, video (video) importance, and audio importance are extracted, reconstructed by the MM content reconstructing unit 34, and CM content is extracted. Is automatically generated.

FIG. 3 is a flowchart showing a procedure for automatically generating a CM by the automatic CM generating apparatus according to the first embodiment. The user inputs usage purpose information of the MM content via the operation display unit 4. The usage purpose setting unit 1 determines whether or not a usage purpose setting input for the MM content has been accepted (step S101), and if it has been accepted (Yes in step S101)
), The usage purpose setting unit 1 determines whether the usage purpose information is CM (step S102).

When the usage purpose setting unit 1 determines that the usage purpose information is the generation of CM content (Yes in step S102), the usage environment setting unit 2 determines whether or not the usage environment information setting input has been received ( In step S103), when it is determined that it has been accepted (Yes in step S103), the template setting unit 31 of the content reconfiguration unit 3 selects a corresponding template based on the received usage purpose information and usage environment information, and an operation display unit 4 (step S104).

The user can select whether or not to adopt the template displayed on the operation display unit 4. The operation display unit 4 determines whether or not a setting input indicating selection by the user has been received (
If it is determined that the content has been received (step S105: Yes in step S105), the material search unit 33 searches for the content material according to the template (step S106). On the other hand, if it is determined that it has not been accepted for a certain period of time (No in step S105), a template generation input by the user is accepted (step S107), and whether or not a registration setting input for a template newly generated by the user is accepted. Determination (step S108)
), If it is determined that it has not been accepted (No in step S108), if it is determined that it has been accepted (Yes in step S108), the accepted new template is registered (step S109). The material search unit 33 searches for the content material according to the template set by (Step S106).

The material search unit 33 determines whether or not the material can be searched (step S110). If the material search cannot be performed within a predetermined time (No in step S110), the process is terminated and the search can be performed (Yes in step S110). The keyword extraction unit 331 determines whether or not a keyword setting input has been accepted (step S111), and if accepted (Yes in step S111).
s) The image extraction unit 332 uses the keyword to calculate the importance of the image and automatically extracts the image (step S112). Here, the keyword may be set by being input and received by the user, or may be set by automatically accessing the user profile DB 51 from the usage purpose information and the usage environment information.

The BGM setting unit 32 automatically extracts music information to be BGM using a keyword (
Step S113). The video extraction unit 333 calculates the importance of the video scene using the keyword, and automatically extracts an important video scene according to the calculated importance (step S11).
4). The voice extraction unit 334 calculates the importance level of the voice by using the keyword and the word spotting technique, and automatically extracts the important voice according to the calculated importance level (step S115).

The MM content reconstruction unit 34 includes the BGM set by the BGM setting unit 32 on the template set by the template setting unit 31 and the image, video, and audio information searched and extracted by the material search unit 33. The material is reconfigured according to the acquired usage purpose information and usage environment information, and the CM content is reconstructed and generated (step S116).

FIG. 4 is a schematic diagram showing an example of the header portion of the CM content generation template. A part 400 of the CM template shown in FIG. 4 includes a header part 410 and a layout setting part 42.
0, and an effect setting unit 430.

The header part 410 includes copyright information. The layout setting unit 420 includes layout information (area identifier, location, size, display order on the screen, etc.) of the screen area (referred to as “Region”) constituting the CM. The effect setting unit 430 displays effect information (
Set fade-in / out, zoom-in / out, etc.).

FIG. 5 is a schematic diagram illustrating an example of a body part of a CM content generation template. C
The M body portion 500 defines the material constituting the CM and the configuration of the scene, sets the length and BGM of the entire CM, and describes information on the scene displayed on the screen. The scene definition unit 502 defines Duration (time interval) and refers to the layout information in the header. Each scene definition 510, 520, 530, 540, and 5 of the scene definition unit 502
50 generates corresponding scenes 1, 2, 3, 4, and 5. Each scene 1-5
The display time is shown in detail with a value where the CM start time is 0, but may be described as a relative value where the scene start time is 0 for each scene.

In the CM template, the header part and the CM body part can be described as the same file, but can also be described as separate files.

FIG. 6 is a schematic diagram showing CM content generated by reconstructing multimedia content material using the templates shown in FIGS. Here, the multimedia content material used by the apparatus is a content material generated by MPMeister (R), and the apparatus reconstructs the CM content 600. A layout scene is generated in accordance with the description of the CM body portion of the template, and BGM 610 is generated.
And a scene 620 including a video.

In this way, the CM automatic generation device according to Embodiment 1 allows the user to input the usage purpose and the usage environment information of the terminal or the like, or the usage purpose information of the user and the usage environment information such as the terminal that have already been stored. When the apparatus automatically reads, the CM content can be automatically generated by reconfiguring the MM content material according to the usage purpose and usage environment of the user.

(2. Embodiment 2)
The difference between the second embodiment and the first embodiment is that it includes a usage restriction unit that imposes usage restrictions on multimedia content materials, and the content reconfiguration unit is a multimedia content whose use is restricted by the usage restriction unit. The material is not used. With this configuration, it is possible to automatically generate CM content by accepting a usage restriction input by a user or excluding MM content set not to be included in CM content according to information in the user profile DB 51.

FIG. 7 is a functional block diagram of the automatic CM generation device according to the second embodiment. The content reconstruction unit 30 includes a usage restriction unit 35.

When various types of information that the user does not want to include in the CM content are input by the user, the usage restriction unit 35 receives the input information. For example, the usage restriction unit 35 receives information that the user does not want to include as a keyword. Alternatively, keywords for which usage restrictions are imposed on the user profile DB 51 are accumulated in advance, and the accumulated usage restriction keyword information is acquired. The content reconstruction unit 30 according to the present embodiment accesses the usage restriction unit 35, acquires information on which usage restrictions are imposed, for example, in the form of keywords, and excludes the information from the target of reconstruction.

Although illustration of the procedure is omitted, the use restriction information input by the use restriction unit 35 is accepted immediately before step S106 shown in FIG. By inserting the step of accepting the input of the usage restriction information, the automatic generation procedure by the CM automatic generation device according to the second embodiment can be executed.

In this way, the CM automatic generation device according to the second embodiment automatically reconfigures CM content by excluding MM content material that is not desired to be included in the generated CM based on a user input or a user-related database. Since it can be generated, unpleasant or socially unhealthy content can be excluded, and personally and socially sound CM content that falls within a certain range of values can be automatically generated. it can.

(3. Embodiment 3)
The difference between the third embodiment and the first embodiment is that, when the material detection unit of the content reconstruction unit extracts the MM content material, a difference is provided in the importance calculated by each extraction unit. For this reason, the automatic CM generation apparatus according to the third embodiment includes an extraction priority setting unit 36 that sets the importance level extracted by each extraction unit. With this configuration, the CM content automatic generation device according to Embodiment 3 can preferentially adopt the one that the user attaches importance to from the image, video, and audio information when extracting the MM content. Even if it ’s content, we ’ll focus on specific types of information,
For example, CM content with many images can be automatically generated.

FIG. 8 is a functional block diagram of the automatic CM generation device according to the third embodiment. The content reconstruction unit 30a according to the third embodiment includes an extraction priority setting unit 36. The extraction priority setting unit 36 receives the priority information when the user inputs the priority information of the type of content that is given priority as the CM content. Then, the MM content reconstruction unit 34 reconstructs each extracted MM content according to the priority set by the extraction priority setting unit 36. As a result, for example, when the priority of the video media is set high, the extraction priority setting unit 36 generates CM content with a lot of video media. Or
When priority information is stored as personal information in the user profile DB 51 in advance,
It may be configured to receive the accumulated priority information.

Although illustration of the CM automatic generation procedure according to the third embodiment is omitted, for example, priority information by the extraction priority setting unit 36 is accepted immediately before step S116 shown in FIG.
By inserting a step for receiving this extraction priority information, an automatic generation procedure by the automatic CM generation apparatus according to the third embodiment can be executed.

In this way, the CM automatic generation apparatus according to the third embodiment can automatically generate a CM by changing the amount of content to be included in the generated CM based on a user setting input or a user-related database. Therefore, for example, when the priority order of the video is high, a CM that can reflect a user's preference including a lot of video media can be automatically generated.

(4. Embodiment 4)
The automatic CM generation apparatus according to the fourth embodiment is different from the first embodiment in that the material detection unit of the content reconstruction unit detects a break in information to be extracted when extracting the MM content material. It is divided and extracted by. Thereby, the MM content can be divided and extracted efficiently and accurately by a simple method of information breaks.

  Another difference is that, for example, when the size of the MM content reconstructed from the operation display unit or the like is designated and input, the usage purpose setting unit or the usage environment setting unit accepts the designation input, Each extraction unit is made to select an extraction method including division based on a designated size and extract each MM information. Thus, by performing extraction and reconfiguration based on a size suitable for the usage environment, for example, a usage environment such as a mobile phone, it is possible to generate highly practical content suitable for distribution.

  FIG. 9 is a functional block diagram of the automatic CM generation device according to the fourth embodiment. FIG. 10 is a diagram for explaining that the MM content is divided and extracted in the automatic CM generation device according to the fourth embodiment.

  In the material search unit 33b of the content reconstruction unit 30b according to the fourth embodiment, the image extraction unit 332b, the video extraction unit 333b, and the audio extraction unit 334b detect and extract a break between pieces of information to be extracted. FIG. 10 shows an embodiment in which a part of presentation content is cut out. In the case of cutting out a presentation, various recognition techniques are used not for extracting an important part but for searching for a break timing. For example, when there is a clear break in the voice, the voice break is set as the extraction timing. Alternatively, the slide (image) switching timing is set as the extraction timing. Or the place where the feature-value of a moving image changed a lot is made into extraction timing. Here, when the size of the partial content is set at the time of cutting out, it is cut out according to the set size or adjusted so as not to exceed the maximum size.

  The image extraction unit 332b detects, breaks, and extracts image information 1002a in the MM content by detecting image breaks that occur on both sides of the time axis 1001. In addition, the video extraction unit 333b detects, cuts, and extracts image breaks occurring on both sides of the video information 1003a in the MM content as viewed on the time axis 1001. In addition, the audio extraction unit 334b detects, divides, and extracts audio information 1004a in the MM content by detecting image breaks that occur on both sides of the time axis 1001.

  Here, it is desirable that each extraction unit selects an extraction method of information extracted by each extraction unit according to a predetermined size. From the method described in the first to third embodiments and the method of dividing by the information break described in 4, the method most suitable for a predetermined size is adopted and extracted. It is desirable to select the most suitable extraction method according to the information set by the usage environment setting unit and the usage purpose setting unit.

  Here, each said extraction part selects so that it may not exceed the maximum size calculated according to the set size. The MM content reconstruction unit 34 desirably reconstructs the MM content extracted by each extraction unit so as not to exceed a predetermined size. Here, the MM content reconstructing unit 34b can reconstruct by limiting the size of the reconstructed content to be distributed using the threshold value calculated according to the size of the reconstructed MM content itself.

  Although illustration of the CM automatic generation procedure according to the fourth embodiment is omitted, for example, in step S111 shown in FIG. 3, whether or not a keyword and a setting input of the maximum size of the reconstructed MM content are accepted. In step S112 to S115, each information is extracted according to the size. In S116, each extracted MM content is selected according to the designated maximum size and reconfigured.

  According to the automatic CM generation apparatus according to the fourth embodiment, since the MM content can be divided and extracted by detecting the breaks in information, the MM content can be reconstructed simply, efficiently and accurately. In addition, the extraction method is selected by specifying the size of the reconstructed MM content, and the reconfiguration is performed according to the size suitable for the usage environment. Therefore, highly practical content suitable for actual distribution is automatically selected. It becomes a CM automatic generation device that can be reconfigured.

(5. Embodiment 5)
FIG. 11 is a functional block diagram of the MM content distribution system according to the fifth embodiment. The MM content distribution system according to the fifth embodiment includes an MM content generation device 1101, an MM content reconfiguration device 1102, a content distribution server 1103, and mobile phones 1104 to 1106 connected via a network 1107.

  A network 1107 includes the Internet, a LAN, and a mobile phone network. The MM content generation device 1101 generates MM content, and here, MPMeister (R) is applied. Here, the MM content reconstruction apparatus 1102 applies the CM automatic generation apparatus according to the first embodiment. The content distribution server 1103 receives the MM content reconfigured by the MM content reconfiguration apparatus 1102 and distributes it to the mobile phones 1104 to 1106 via the network 1107. The mobile phones 1104 to 1106 receive the distributed reconstructed MM content and can be viewed by the user. Here, the number of mobile phones is not particularly limited, and is usually a plurality. In general, the present invention can be applied not only to a mobile phone but also to a terminal or a mobile terminal.

  With this configuration, the MM content reconstruction device 1102 reconstructs the MM content based on the MM content generated by the MM content generation device 1101, and the content distribution server 1103 distributes the content via the network 1107 for viewing. A person can watch a short clip such as a CM or a CM that has been reconfigured and usually shortened in time through the mobile phones 1104 to 1106.

  12-14 is a figure explaining the Example of the MM content delivery system by Embodiment 5. FIG. The example shown in FIG. 12 is an example in the case of distributing emergency information such as a disaster. When troubles such as accidents and disasters occur, text is added to images and video shot on the spot or broadcasted on the spot, for example, creating material with several lines of text added . The MPMeister (R) 1101a is used to create and transmit a basic original material, and the received MM content reconstruction apparatus 1102a automatically generates a short clip that is emergency information to be distributed to the mobile terminal. The content distribution server 1103a distributes the automatically generated short clip to the mobile phones 1104 and 1105 via the mobile phone network 1107.

  Here, it is desirable that emergency information with high urgency is set to be distributed preferentially by the content distribution server 1103a. Alternatively, it can be registered and distributed in the content distribution server 1103a during the night, and the user can acquire it in the morning of the next day.

  Further, the example shown in FIG. 13 is an example in the case of generating and distributing information that is desired to be thoroughly known, such as high security information and compliance. Reconstructed MM generated by using MPMeister (R) 1101b to create MM content from materials prepared in advance for delivery and sending it to the MM content reconstructing device 1102b, and setting it for the purpose of well-known thorough information The content is distributed to the mobile phones 1104 and 1105 via the content distribution server 1103b.

  Here, by specifying a distribution date and a distribution time and registering in the content distribution server 1103b, distribution may be performed according to a schedule. In addition, a delivery method for inducing access to actual content by notifying the user's terminal of the existence of the content and its URL (Uniform Resource Locator) by e-mail or the like can also be applied.

  Further, the example shown in FIG. 14 is an example in which partial content of presentation content is divided and distributed. When the presentation content produced using the MPMeister (R) 1101c is reconstructed by the content reconstruction device 1102c, partial MM content is generated and reconstructed by the division processing shown in FIG. The reconstructed MM content is transmitted to the content distribution server 1103c and registered. The content distribution server 1103c distributes partial content of one presentation to the user's mobile phones 1104 and 1105 every day (for example, five days a week) while maintaining the presentation timeline.

  Based on the MM content generated by MPMeister (R) or the like by the MM content distribution system according to the fifth embodiment, the MM content reconfiguration device reconfigures the MM content, and the content distribution server is the viewer's mobile phone, etc. Therefore, it is possible to view a short clip that has been reconstructed and shortened immediately or periodically.

(6. Hardware configuration of CM automatic generation device according to embodiment)
FIG. 15 is a hardware configuration diagram of the automatic CM generation device according to the embodiment. The CM content automatic generation apparatus according to the present embodiment includes a control device such as a CPU 1501, a storage device such as a ROM (Read Only Memory) 1502 and a RAM 1503, an external storage device such as an HDD 1504 and a CD drive device, a display device, and the like. Display devices 1505 and 1511, input devices such as a keyboard 1512, a mouse 1513, and an input interface 1506 are provided, and a hardware configuration using a normal computer is employed.

The CM content automatic generation program executed by the CM content automatic generation device of the present embodiment is a file in an installable format or an executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile). D
is) recorded on a computer-readable recording medium.

In addition, the CM content automatic generation program executed by the CM content automatic generation device of the present embodiment is stored on a computer connected to a network such as the Internet, and
You may comprise so that it may provide by downloading via a network. Further, the CM content automatic generation program executed by the CM content automatic generation device of the present embodiment may be configured to be provided or distributed via a network such as the Internet.

Further, the CM content automatic generation program according to the present embodiment may be provided by being incorporated in advance in a ROM or the like.

The CM content automatic generation program executed by the CM content automatic generation apparatus according to the present embodiment has a module configuration including the above-described units. As actual hardware, a CPU (processor) 1501 executes CM from the above storage medium. By reading and executing the content automatic generation program, the above-described units are loaded onto the main storage device, and the respective units are generated on the main storage device.

As described above, the multimedia content reconstruction device, the multimedia content reconstruction method, the program for causing the computer to execute the method, and the multimedia content distribution system according to the present invention are useful for the multimedia content generation technology. In particular, it is suitable for a technique for generating multimedia content automatically reconstructed from multimedia material.

It is a functional block diagram of the CM automatic generation apparatus by Embodiment 1 of this invention. It is a figure explaining the analysis of the importance of the image in an MM content material, an image | video, and an audio | voice. 6 is a flowchart showing a procedure for automatically generating a CM by the automatic CM generating apparatus according to the first embodiment. It is a schematic diagram which shows an example of the header part of CM content generation template. It is a schematic diagram which shows an example of the body part of CM content generation template. FIG. 6 is a schematic diagram showing CM content generated by reconstructing multimedia content materials using the templates shown in FIGS. 4 and 5. 6 is a functional block diagram of an automatic CM generation device according to Embodiment 2. FIG. FIG. 10 is a functional block diagram of a CM automatic generation device according to a third embodiment. FIG. 10 is a functional block diagram of a CM automatic generation device according to a fourth embodiment. FIG. 10 is a diagram for explaining that the MM content is divided and extracted in the automatic CM generation device according to the fourth embodiment. FIG. 10 is a functional block diagram of an MM content distribution system according to a fifth embodiment. It is a figure explaining the Example of the MM content delivery system by Embodiment 5. FIG. It is a figure explaining the Example of the MM content delivery system by Embodiment 5. FIG. It is a figure explaining the Example of the MM content delivery system by Embodiment 5. FIG. It is a hardware block diagram of the CM automatic generation apparatus by embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Usage purpose setting part 2 Usage environment setting part 3 Content reconstruction part 4 Operation display part 5 Memory | storage part 31 Template setting part 32 BGM setting part 33 Material search part 34 MM content reconstruction part 35 Usage restriction part 36 Extraction priority setting part 51 User Profile DB
52 CM template DB
53 Music Material DB
54 MM Material Content DB
55 MPEG-7DB
331 Keyword extraction unit 332 Image extraction unit 333 Video extraction unit 334 Audio extraction unit 1101 MM content generation device 1102 MM content reconstruction device 1103 Content distribution server 1104, 1105, 1106 Mobile phone 1107 Network

Claims (31)

A multimedia content reconstruction device for reconfiguring multimedia content according to a purpose of use,
Utilization purpose setting means for accepting setting of utilization purpose information regarding the utilization purpose;
Usage environment setting means for accepting setting of usage environment information for an environment in which the reconfigured multimedia content is used;
Content reconstructing means for reconstructing the material of the multimedia content based on the use purpose information set by the use purpose setting means and the use environment information set by the use environment setting means;
A multimedia content reconstructing apparatus comprising: The usage purpose setting means receives a setting input of the usage purpose information including at least one usage purpose of CM usage, short clip usage, and passive viewing usage,
2. The usage environment setting unit is configured to receive a setting input of the usage environment information including at least one usage environment of use on a portable terminal and use on a television terminal. Multimedia content reconstruction device. A user information database for accumulating the usage purpose information of the user and the usage environment information;
The usage purpose setting means receives the usage purpose information stored in the user information database,
3. The multimedia content reconstruction apparatus according to claim 1, wherein the usage environment setting unit receives the usage environment information stored in the user information database. The usage purpose setting means includes, as the usage purpose information, commercial purpose (CM) content usage purpose information including at least one of video content trailers, product descriptions, and promotional videos, short clip usage purpose information, and at least presentation presentation information. Receiving the use purpose information including at least one of the use purpose information for the purpose of presentation of a part and the purpose of use information for the purpose of providing emergency information;
The content reconstructing means reconstructs multimedia content including at least one of the CM content, the short clip, at least a part of the presentation, and the emergency information. 4. The multimedia content reconstruction apparatus according to any one of 3. The content reconstruction means includes:
Template setting means for receiving a template setting for reconfiguring the multimedia content;
Music setting means for receiving settings of music data for reconfiguring the multimedia content;
Material search means for searching for multimedia content material based on the use purpose information and use environment information;
Multimedia content reconstructing means for reconstructing multimedia content from the received template, the music data, and the retrieved multimedia content material based on the usage purpose information and usage environment information;
The multimedia content reconstructing apparatus according to claim 4, further comprising: A template DB for storing the template including a layout of a display screen for displaying the reconfigured multimedia content in the usage environment, a timeline of each material content, and effect information at the time of content switching;
The template setting means selects from the templates stored in the template DB based on the usage purpose information and usage environment information, displays the template, and accepts a setting input by the user. The multimedia content reconstructing apparatus according to claim 5, wherein: The template setting means receives a template setting input by a user, generates the template by the received setting input, stores the template in the template DB,
And,
7. The multimedia content reconstruction apparatus according to claim 6, wherein a template is newly generated by combining the stored templates and further stored in the template DB. A music information DB for storing music information is further provided,
The music setting means is configured to select and display music information based on the set template, use purpose information, and use environment information, and accept setting input by the user. Item 8. The multimedia content reconstruction apparatus according to Item 6 or 7. The multimedia content reconstruction apparatus according to any one of claims 5 to 8, wherein the music setting means receives a setting of BGM (background music) as music for receiving the setting. A multimedia content material DB for storing multimedia content materials and index information thereof;
The said material search means extracts the said multimedia content material from the said multimedia content material DB based on the said utilization purpose information and utilization environment information, The any one of Claims 5-9 characterized by the above-mentioned. The multimedia content reconstruction apparatus as described in one. The material search means extracts keyword information in the multimedia content material and sets importance, and keyword extraction means;
Image extraction means for extracting image information and setting importance;
Video extraction means for extracting video information and setting importance;
Voice extraction means for extracting voice information and setting the importance;
11. A multimedia content reconstructing unit that reconstructs multimedia content based on the importance of the extracted information.
The multimedia content reconstruction apparatus according to any one of the above. The keyword extraction means is for extracting the keyword information from the multimedia content material DB and setting the importance, and
12. The multimedia content reconstruction apparatus according to claim 11, wherein the input of change of the extracted keyword and setting input of a new keyword by the user are accepted.   The image extraction means is based on at least one of determination of importance based on image characteristics, importance setting input by the keyword extraction means, acceptance of image importance setting input by the user, and image cutout by image recognition. The multimedia content reconstruction device according to claim 11 or 12, wherein the image is extracted.   When at least one of the usage purpose setting unit and the usage environment setting unit receives the setting of the size of the content to be reconfigured, the image extraction unit selects the image extraction method based on the received setting size The multimedia content reconstructing device according to claim 13, wherein The video extraction means is based on at least one of determination of importance based on video characteristics, importance setting input by the keyword extraction means, acceptance of video importance setting input by the user, and video segmentation by video recognition. 15. The multimedia content reconstruction device according to claim 11, wherein the video content is extracted.   When at least one of the usage purpose setting unit and the usage environment setting unit receives the setting of the size of the content to be reconfigured, the video extraction unit selects the video extraction method based on the received setting size 16. The multimedia content reconstruction apparatus according to claim 15, wherein   The voice extraction means includes determination of importance by voice recognition technology, importance setting input by the keyword extraction means, importance determination by word spotting technology, acceptance of voice importance setting input by the user, and The multimedia content reconstructing device according to any one of claims 11 to 16, wherein the speech is extracted based on at least one of cutouts based on speech breaks by speech recognition technology.   When at least one of the usage purpose setting unit and the usage environment setting unit receives the setting of the size of the content to be reconfigured, the audio extraction unit selects the audio extraction method based on the received setting size The multimedia content reconstructing device according to claim 17, wherein Limit setting means for receiving a limit setting input for setting a setting so as not to display at least a part of the multimedia content material for users including viewers and distributors of the reconfigured multimedia content,
3. The content reconstructing unit is configured to reconstruct the multimedia content by excluding a portion of the multimedia content material set not to be displayed by the restriction setting unit. The multimedia content reconstruction device according to any one of -18. An extraction priority setting means for receiving a priority setting input for setting priority orders of importance levels of at least two extraction means among the keyword extraction means, the image extraction means, the video extraction means, and the audio extraction means; Prepared,
The content reconstructing means reconstructs the multimedia content further based on the priority set by the extraction priority setting means. The multimedia content reconstruction apparatus as described in 1. A multimedia content reconstruction method for reconfiguring multimedia content according to a purpose of use,
A use purpose setting step for accepting setting of use purpose information for the use purpose;
A use environment setting step for accepting setting of use environment information about an environment in which the reconfigured multimedia content is used;
A content restructuring step of reconstructing the material of the multimedia content based on the usage purpose information set in the usage purpose setting step and the usage environment information set in the usage environment setting step;
A multimedia content reconstructing method comprising: The usage purpose setting step receives a setting input of the usage purpose information including at least one usage purpose of usage as a CM, usage as a short clip, and passive viewing usage,
The use environment setting step receives a setting input of the use environment information including at least one use environment of use on a mobile terminal and use on a television terminal. Multimedia content reconstruction method. The usage purpose setting step accepts the usage purpose information stored in a user information database that stores the usage purpose information of the user and the usage environment information,
The multimedia content reconstructing method according to claim 21 or 22, wherein the usage environment setting step receives the usage environment information stored in the user information database. 24. A multimedia content reconstruction program that causes a computer to execute any one of the multimedia content reconstruction methods according to claim 21. A multimedia content generation device configured to generate multimedia content, each connected via a network;
A multimedia content reconstructing device that receives the multimedia content generated by the multimedia content generating device and reconfigures the received multimedia content according to the purpose of use;
A transmission server for transmitting the multimedia content reconstructed by the multimedia content reconstruction device via the network;
A multimedia content distribution system comprising a plurality of information terminals for receiving reconstructed multimedia content transmitted by the transmission server,
The multimedia content reconstruction device includes:
Utilization purpose setting means for accepting setting of utilization purpose information regarding the utilization purpose;
Usage environment setting means for accepting setting of usage environment information for an environment in which the reconfigured multimedia content is used;
Content reconfiguring means for reconfiguring the generated multimedia content based on the usage purpose information set by the usage purpose setting means and the usage environment information set by the usage environment setting means;
A multimedia content distribution system comprising:   The multimedia content distribution system according to claim 25, wherein the multimedia content generation device is MPMeister (R). The information terminal is a mobile phone;
27. The multimedia contents distribution system according to claim 25 or 26, wherein the use environment setting means sets use environment information by use of the mobile phone. The usage purpose setting means accepts at least one of emergency delivery of emergency information, delivery of well-known thorough information, and delivery of presentation content as usage purpose information,
The multimedia content reconstructing means reconstructs at least one of multimedia content related to emergency information resulting from an emergency, multimedia content related to well-known information, and multimedia content that is presentation content. The multimedia content distribution system according to any one of claims 25 to 27.   The multimedia according to any one of claims 25 to 28, wherein the transmission server distributes the MM content generated by the multimedia content reconstruction device based on a preset schedule. Content distribution system. The multimedia reconstruction means maintains the timeline of the multimedia content that is the presentation content, and reconfigures,
30. The transmission server according to claim 29, wherein the transmission content is delivered to the information terminal while holding the timeline and reconstructed the presentation content held by the multimedia content reconstruction unit. The multimedia content distribution system described.   The transmission server includes a home page on the Web for displaying multimedia reconstructed by the multimedia content reconstruction device, and accepts download from the mobile terminal. The multimedia content distribution system according to any one of the above.

Images