JP2007011584A - Multimedia data processor, multimedia data processing method, and multimedia data processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multimedia data processor capable of easily preparing multimedia data, a multimedia data processing method, and a multimedia data processing program therefor. <P>SOLUTION: When a distribution request of the multimedia data is transmitted by a client terminal 12, a URL analysis part 26 analyzes a URL for making the distribution request. The multimedia data for distribution are prepared with a multimedia data preparation part 28 on the basis of the URL by replacing a replacement target image in multimedia template data with a distribution image. The multimedia data for distribution are distributed to the client terminal 12 via a distribution part 34 after being converted corresponding to a model of the client terminal 12. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a multimedia data processing apparatus, a multimedia data processing method, and a multimedia data processing program, and more particularly to a technique for creating multimedia data using desired media data.

Conventionally, techniques for creating multimedia data provided via the Internet or the like have been developed. For example, Patent Document 1 discloses a template file creation apparatus that creates a multimedia template file in which a post-editable range is defined in advance.
JP 2003-281461 A

  However, the template file creation device disclosed in Patent Document 1 described above uses a dedicated authoring application to individually select the timing at which media data is played back and output and the media data to be played back at a specified timing. I had to edit it. An authoring application for creating multimedia data is very difficult to operate. For example, even simple editing work of replacing specific media data is difficult unless the user is proficient.

  The present invention has been made in view of such circumstances, and an object thereof is to provide a multimedia data processing device, a multimedia data processing method, and a multimedia data processing program capable of easily creating multimedia data. To do.

  In order to achieve the above object, a multimedia data processing apparatus according to claim 1 includes data input means for inputting distribution media data, and reproduction order specifying means for specifying the reproduction order of the input distribution media data. , Template storage means for storing multimedia template data including a plurality of media data to be replaced in which playback order information at the time of playback is written, and creating multimedia data for distribution from the stored multimedia template data A template designating unit for designating multimedia template data to be used when performing the playback, a playback sequence information acquiring unit for acquiring playback sequence information included in the replacement target media data in the specified multimedia template data, and the playback sequence For delivery with matching Interchanging the media data and the replacement target media data, characterized by comprising a multimedia data generation means for generating delivery for multimedia data.

  According to the multimedia data processing apparatus according to claim 1, since the multimedia template data including the replacement target image in which the reproduction order is written in advance is prepared, the distribution media data (distribution image) and the reproduction order thereof are prepared. And specifying the multimedia template data, it is possible to automatically create multimedia data in which distribution media data is effectively displayed in a desired reproduction order.

  A multimedia data processing apparatus according to a second aspect of the present invention is the multimedia data processing apparatus according to the first aspect, wherein the replacement target media data and the distribution media data are image data. Claim 2 limits the type of media data of claim 1 to image data.

  The multimedia data processing apparatus according to claim 3 is the multimedia data processing apparatus according to claim 2, wherein the reproduction order information is written in the image data, and includes a digital watermark, a character, a one-dimensional code, or a two-dimensional code for displaying the reproduction order. It is characterized by being at least one. The third aspect limits the means for writing the reproduction order information to the image data of the second aspect.

  The multimedia data processing device according to claim 4 is the multimedia data processing device according to claim 2, wherein the reproduction order information is a mark written in the image data, and the reproduction order information acquisition unit analyzes the image data, Mark extraction means for extracting the mark, a table storing a correspondence relationship between at least one of the color of the mark, a combination of colors, the number or position of the mark, and the reproduction order of the media data; and the table And means for acquiring the reproduction order of the media data. The fourth aspect limits the means for writing the reproduction order information into the image data of the second aspect.

  The multimedia data processing device according to claim 5 is the access information for accessing the delivery multimedia data according to claims 1 to 4, wherein the multimedia data is replaced with the delivery media data, and the delivery Distribution request receiving means for receiving a distribution multimedia data distribution request including access information including a corresponding relationship with the media data for distribution from a client terminal; and distribution means for distributing the distribution multimedia data to the client terminal; The multimedia data creating means creates the multimedia data based on the access information when the distribution request is accepted.

  According to the multimedia data processing apparatus of the fifth aspect, the multimedia data can be easily created based on the distribution request including the access information.

  The multimedia data processing method according to claim 6 is a data input step for inputting distribution media data, a reproduction order specifying step for specifying a reproduction order of the input distribution media data, and reproduction order information at the time of reproduction. A template storage step for storing multimedia template data including a plurality of replacement target media data in which is written, and multimedia used for creating multimedia data for distribution from the stored multimedia template data A template designating step for designating template data, a playback sequence information acquiring step for acquiring playback sequence information included in the media data to be replaced in the specified multimedia template data, and delivery media data having the same playback sequence And replace Interchanging the elephants media data, characterized by comprising a multimedia data generation step of generating a multimedia data for distribution.

  A multimedia data processing program according to claim 7 is a data input function for inputting distribution media data, a reproduction order specifying function for specifying a reproduction order of the input distribution media data, and reproduction order information at the time of reproduction A template storage function for storing multimedia template data including a plurality of replacement target media data in which is written, and multimedia used for creating multimedia data for distribution from the stored multimedia template data A template designating function for designating template data, a playback order information acquiring function for acquiring playback order information included in the media data to be replaced in the specified multimedia template data, and distribution media data having the same playback order And enter Interchanging the target media data instead, it is characterized in that to realize the multi-media data creation function to the computer on which you want to create a multi-media data for distribution.

  The multimedia data processing program and the multimedia data processing method of the present invention can be realized by applying the multimedia data processing program according to claim 7 to a server or the like for distributing content via a network. .

  According to the present invention, by preparing multimedia template data including a replacement target image in which a reproduction order is written in advance, the distribution image and the reproduction order are input, and the multimedia template data is simply designated. Thus, multimedia data in which distribution images are effectively displayed in a desired reproduction order can be automatically created.

  Preferred embodiments of a multimedia data processing apparatus, multimedia data processing method, and multimedia data processing program according to the present invention will be described below with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing a main configuration of a multimedia data processing apparatus according to an embodiment of the present invention. The multimedia data processing apparatus 10 shown in the figure is an apparatus for creating multimedia data 10A and distributing it to the client terminal 12, and includes a distribution image input unit 14, a storage unit 16, a template storage unit 18, and a display unit. 20, an operation unit 22, a distribution request reception unit 24, a URL analysis unit 26, a multimedia data creation unit 28, a client terminal identification unit 30, a multimedia data conversion unit 32, and a distribution unit 34. Each of the above blocks is connected via a bus 36 so that data can be transmitted and received.

  The distribution image input unit 14 is a device for inputting a distribution image 14A for distribution to the client terminal 12, and includes a media reader that reads the distribution image from a recording medium such as a CD-ROM. The distribution media data may be input via a network or a cable, for example. The storage unit 16 stores the input distribution image 14A. The template storage unit 18 stores multimedia template data for creating multimedia data using the distribution image 14A.

  The display unit 20 is, for example, a CRT (Cathode Ray Tube) monitor or a liquid crystal monitor, and displays a delivery image, multimedia template data described later, various operation menus, and the like. The operation unit 22 is a block that receives an operation input by a user, and includes an input device such as a keyboard, a mouse, and a touch panel. The user can input and specify the reproduction order of the distribution image 14 </ b> A using the operation unit 22. This reproduction order is stored in the storage unit 16 together with the distribution image 14A.

  In addition, the user causes the display unit 20 to display a list of multimedia template data stored in the template storage unit 18 and designates the multimedia template data used to create distribution multimedia data using the operation unit 22. Can do.

  The distribution request receiving unit 24 receives a multimedia data distribution request transmitted from the client terminal 12. The distribution request is made, for example, by clicking or selecting a link (URL) included in the web content displayed on the client terminal 12. This URL (Uniform Resource Locator) includes the multimedia template data specified above, an image for distribution, and an argument for specifying information on the reproduction order of each image for distribution. An example of output of this URL will be described later. The URL analysis unit 26 analyzes the URL included in this distribution request.

  When the multimedia data delivery request is received, the multimedia data creation unit 28 creates delivery multimedia data based on the URL. The client terminal identification unit 30 transmits the multimedia data distribution request to the multimedia data processing apparatus 10 (for example, a model of a mobile phone, a personal computer (PC), a personal digital assistant (PDA)). )) Is identified. Based on the model of the client terminal 12, the multimedia data conversion unit 32 converts the multimedia data into a file format and file size that are reproducible or suitable for reproduction on the client terminal 12. The multimedia data thus converted is distributed to the client terminal 12 via the distribution unit 34.

  FIG. 2 is a block diagram showing the main configuration of the multimedia data creation unit 28. As shown in the figure, the multimedia data creation unit 28 includes an image extraction unit 38, a reproduction order information acquisition unit 40, an image replacement unit 42, and a file size adjustment unit 44.

  The multimedia template data described above includes media data such as images, sounds, and characters, and scenario data that defines the output mode of the media data. The image extraction unit 38 extracts image data included in the multimedia template data designated as described above. In the extracted image data, reproduction order information defined by the scenario data is written, for example, with a digital watermark. Hereinafter, the extracted image data is referred to as a replacement target image. The playback order information acquisition unit 40 reads this digital watermark and acquires playback order information of all replacement target image data included in the multimedia template data.

  The image exchanging unit 42 collates the distribution image specified by the argument of the URL and the reproduction order information thereof with the reproduction order information of the exchange target image data, and exchanges images having the same reproduction order. When the replacement target image is replaced with the distribution image, the file size adjustment unit 44 performs processing such as compression, reduction, color reduction, trimming, and bit rate adjustment on the distribution image 14A to adjust the file size of the distribution image. adjust. The file size adjustment unit 44 performs processing so that the file size of the distribution image is equal to or less than the file size of the replacement target image, for example.

  FIG. 3 is a diagram schematically showing the configuration of multimedia template data. As shown in the figure, the multimedia template data 50 includes a header 52 and tags 54 (1, 2,..., N).

  Information such as the file size of the multimedia template data 50 is stored in the header 52. Each tag 54 includes a tag code 56, a character ID 58, and an object 60 (1, 2,..., N). The character ID 58 is a code uniquely assigned to the object 60 included in the multimedia template data 50. The object 60 is media data or scenario data, and its type is specified by a tag code. The media data is, for example, data such as characters, images (still images, moving images), and voices. The scenario data is data defining the timing for displaying and reproducing the media data, the display position, the display effect (for example, movement and blinking), and the like.

  In the example shown in FIG. 3, three images are included in the object 60, and these images (replacement target images A, B, and C) are replaced with the distribution image 14 </ b> A by the multimedia data creation unit 28. Multimedia data for distribution is created.

  Hereinafter, a multimedia data processing method according to the present invention will be described. First, web content on which URLs including multimedia template data, delivery images, and arguments that specify information on the playback order of each delivery image are posted in advance from a web server (not shown). The client terminal 12 transmits a multimedia data distribution request to the multimedia data processing apparatus 10 of the present embodiment using the URL in the web content.

  When a multimedia data distribution request is transmitted by the client terminal 12, the URL for making the distribution request is analyzed by the URL analysis unit. Based on this URL, the multimedia data creation unit 28 replaces the replacement target image in the multimedia template data with the distribution image, thereby generating distribution multimedia data. The distribution multimedia data is converted according to the model of the client terminal 12 and distributed to the client terminal 12 via the distribution unit 34.

An example URL is shown below. It is assumed that the multimedia template data is a file “sample.swf” and the distribution image 14A is three files “000.jpg”, “001.jpg”, and “002.jpg”. Further, the character strings “?” And “&” are characters indicating a separator between the file name and the argument and between the arguments, respectively.
[Example of URL]
http://example.xxx.co.jp/aaa/000.jpg?FFunc=RF&FFtmpl=sample.swf&FFimg1=001.jpg&FFimg2=002.jpg
In the above URL, the argument “FFunc = RF” means that the image in the multimedia template data “sample.swf” specified by the argument “FFtmpl = sample.swf” is replaced with the image for distribution. In the above URL, the reproduction order of each distribution image is the first distribution image “000.jpg” before the character string “?” And the arguments “FFimg1 = 001.jpg” and “FFimg2 = 002.jpg”. The distribution images “001.jpg” and “002.jpg” designated by “” are the second and third, respectively. Therefore, for example, in FIG. 3, when the reproduction order of the replacement target image is C → A → B, the replacement target image C is the distribution image “000.jpg”, and the replacement target image A is the distribution image. “001.jpg” and the replacement target image B are replaced with the distribution image “002.jpg”.

  When there are three or more images for distribution, arguments “FFimg3 =.. .Jpg”, “FFimg4 =. .Jpg”,... Are sequentially described at the end of the URL for the number of images for distribution.

  Next, a method for creating multimedia data will be described with reference to FIG. FIG. 4 is a flowchart showing a multimedia data creation method according to the first embodiment of the present invention.

  First, upon receiving a multimedia data distribution request from the client terminal 12, the file name of the multimedia template data included in the URL of the distribution request is read, and the multimedia template data “sample.swf” is acquired ( Step S10).

  Next, the image extraction unit 38 extracts one replacement target image from the multimedia template data (for example, in order from the top of the multimedia template data 50 in FIG. 3) (step S14). Then, the playback order information acquisition unit 40 reads the digital watermark from the replacement target image, and acquires the playback order information of the replacement target image (step S16).

  Next, the reproduction order of the distribution image designated by the URL of the distribution request is referred to, and the distribution image that matches the replacement target image and the reproduction order is acquired from the storage unit 16 (step S18). The file size of the distribution image is adjusted by the file size adjustment unit 44 so as to be equal to or smaller than the file size of the replacement target image (step S20). Then, the distribution image whose file size has been adjusted is replaced with the replacement target image by the image replacement unit 42 (step S22).

  Then, steps S14 to S22 are repeated for the number of images in the multimedia template data to create multimedia data (steps S12 and S24).

  According to the present embodiment, multimedia template data including a replacement target image in which a reproduction order is written in advance with a digital watermark is prepared, whereby a distribution image and its reproduction order are input, and multimedia template data is input. By simply designating, it is possible to automatically create multimedia data in which distribution images are effectively displayed in a desired reproduction order.

  Next, a second embodiment of the present invention will be described with reference to FIGS. In this embodiment, the reproduction order information of the replacement target image is written as a color mark.

  FIG. 5 is a block diagram illustrating a main configuration of the reproduction order information acquisition unit 40 according to the present embodiment. As shown in the figure, the reproduction order information acquisition unit 40 of this embodiment includes a color mark detection unit 40A, a color-reproduction order table 40B, and a reproduction order determination unit 40C. The color mark detection unit 40A stores the position coordinates of the color mark in the replacement target image in the multimedia template data 50, and detects the color mark based on this coordinate. As shown in FIG. 6, the color-reproduction order table 40B is a table in which the correspondence between the color of the color mark and the reproduction order is stored. The reproduction order determination unit 40C refers to the color-reproduction order table 40B and determines the reproduction order of the replacement target images.

  Next, a method for creating multimedia data according to the present embodiment will be described with reference to FIG. FIG. 7 is a flowchart showing a multimedia data creation method according to the second embodiment of the present invention.

  First, as in the first embodiment, upon receiving a multimedia data distribution request from the client terminal 12, the file name of the multimedia template data included in the URL of the distribution request is read, and the multimedia template data is read. “Sample.swf” is acquired (step S30). Further, the color-reproduction order table 40B and the color mark coordinates are acquired (steps S32 and S34).

  Next, the image extraction unit 38 extracts one replacement target image from the multimedia template data (for example, in order from the top of the multimedia template data 50 in FIG. 3) (step S38). Then, the reproduction order information acquisition unit 40 detects a color mark from the replacement target image, and acquires the reproduction order information of the replacement target image based on the color of the color mark (step S40).

  Next, the reproduction order of the distribution image designated by the URL of the distribution request is referred to, and the distribution image that matches the replacement target image and the reproduction order is acquired from the storage unit 16 (step S42). The file size of the distribution image is adjusted by the file size adjustment unit 44 to be equal to or smaller than the file size of the replacement target image (step S44). Then, the distribution image whose file size has been adjusted is replaced with the replacement target image by the image replacement unit 42 (step S46).

  Then, steps S38 to S46 are repeated for the number of images in the multimedia template data to create multimedia data (steps S36 and S48).

  According to the present embodiment, by preparing multimedia template data including a replacement target image in which the reproduction order is written in advance using color marks, the distribution image can be obtained in the desired order as in the above-described embodiment. Automatically displayed multimedia data.

  In the above embodiment, the multimedia data is created after the delivery request using the URL is sent from the client terminal 12. However, the file format or file corresponding to various models of the client terminal 12 in advance is used. You may create multimedia data of size. In this case, multimedia data created in advance in various file formats or file sizes is stored in the storage unit 16 together with information corresponding to each model of the client terminal 12. Then, according to the model of the client terminal 12 identified by the client terminal identification unit 30, multimedia data suitable for reproduction is selected by the distribution unit 34 and distributed.

  In the above embodiment, the multimedia template data is an SWF file created by Macromedia Flash (registered trademark), but uses other formats such as SVG (Scalable Vector Graphics). May be. In addition to the JPEG (Joint Photographic Experts Group) format shown in FIG. 3, the distribution image 14A may be in GIF (Graphic Interchange Format), PNG (Portable Network Graphics), or the like.

  In the above embodiment, the reproduction order information may be written in the replacement target image as a character, a one-dimensional code, or a two-dimensional code. In addition to the color of the mark, the reproduction order information may be represented by the position and number of the mark, or a combination thereof.

  In the above embodiment, the distribution image 14A is replaced with the replacement target image in the multimedia template data 50 to create multimedia data. For example, an image including character data, voice data, and voice data is used. Data and the like can be replaced with the same kind of data in the multimedia template data 50 by the same procedure.

1 is a block diagram showing the main configuration of a multimedia data processing apparatus according to an embodiment of the present invention. The block diagram which shows the main structures of the multimedia data preparation part 28 Diagram showing the structure of multimedia template data The flowchart which shows the multimedia data creation method which concerns on the 1st Embodiment of this invention The block diagram which shows the main structures of the reproduction | regeneration order information acquisition part 40 which concerns on this embodiment. The figure which shows the color-reproduction order table 40B The flowchart which shows the multimedia data creation method concerning the 2nd Embodiment of this invention

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Multimedia data processing apparatus, 10A ... Multimedia data, 12 ... Client terminal, 14 ... Delivery image input unit, 14A ... Delivery image, 16 ... Storage unit, 18 ... Template storage unit, 20 ... Display unit, 22 DESCRIPTION OF SYMBOLS Operation part 24 ... Delivery request reception part 26 ... URL analysis part 28 ... Multimedia data creation part 30 ... Client terminal identification part 32 ... Multimedia data conversion part 34 ... Delivery part 36 ... Bus 38 ... Image extraction unit, 40 ... Playback order information acquisition unit, 40A ... Color mark detection unit, 40B ... Color-playback order table, 40C ... Playback order determination unit, 42 ... Image replacement unit, 44 ... File size adjustment unit, 50 ... Multimedia template data, 52... Header (header), 54... Tag (1, 2,..., N), 56. 58 ... character ID (Character ID), 60 ... Object (1,2, ..., N)

Claims (7)

Data input means for inputting media data for distribution;
Playback order designating means for designating the playback order of the input distribution media data;
Template storage means for storing multimedia template data including a plurality of replacement target media data in which reproduction order information at the time of reproduction is written;
A template designating unit for designating multimedia template data to be used when creating multimedia data for distribution from the stored multimedia template data;
Playback order information acquisition means for acquiring playback order information included in the replacement target media data in the designated multimedia template data;
Multimedia data creating means for creating distribution multimedia data by replacing the distribution media data and the replacement target media data with the same reproduction order;
A multimedia data processing apparatus comprising:   2. The multimedia data processing apparatus according to claim 1, wherein the replacement target media data and the distribution media data are image data.   The multimedia according to claim 2, wherein the reproduction order information is at least one of a digital watermark, a character, a one-dimensional code, and a two-dimensional code that is written in the image data and displays the reproduction order. Data processing device. The reproduction order information is a mark written in the image data,
The reproduction order information acquisition means includes
Mark extraction means for analyzing the image data and extracting the mark;
A table storing a correspondence relationship between at least one of the color of the mark, a combination of colors, the number or position of the mark, and the reproduction order of the media data;
Means for referring to the table to obtain the playback order of the media data;
The multimedia data processing apparatus according to claim 2, further comprising: Multimedia information for distribution including access information for accessing the multimedia data for distribution, including access information including correspondence between the media data replaced with the media data for distribution and the media data for distribution A distribution request receiving means for receiving a distribution request from a client terminal;
Distribution means for distributing the distribution multimedia data to the client terminal;
5. The multi-media data according to claim 1, wherein the multi-media data creating unit creates the multi-media data based on the access information when the distribution request is accepted. 6. Media data processing device. A data input process for inputting media data for distribution;
A playback order designating step for designating the playback order of the input distribution media data;
A template storage step for storing multimedia template data including a plurality of replacement target media data in which reproduction order information at the time of reproduction is written;
A template designating step for designating multimedia template data to be used when creating multimedia data for distribution from the stored multimedia template data;
A reproduction order information acquisition step of acquiring reproduction order information included in the replacement target media data in the designated multimedia template data;
A multimedia data creation step of creating distribution multimedia data by replacing the distribution media data and the replacement target media data with the same reproduction order;
A multimedia data processing method comprising: Data input function to input media data for distribution,
A playback order specifying function for specifying the playback order of the input distribution media data;
A template storage function for storing multimedia template data including a plurality of replacement target media data in which reproduction order information at the time of reproduction is written;
A template designating function for designating multimedia template data to be used when creating multimedia data for distribution from the stored multimedia template data;
A playback order information acquisition function for acquiring playback order information included in the media data to be replaced in the designated multimedia template data;
A multimedia data creation function for creating delivery multimedia data by replacing delivery media data and replacement target media data having the same reproduction order;
A multimedia data processing program characterized in that a computer is realized.

Images