JP2007041861A - Content editing device, computer-readable program, and recording medium with the same recorded - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable the creation and display of new multimedia content by easily changing materials of multimedia content on the Web. <P>SOLUTION: If an editable area is set in an object specified by a user, a reproduction control part 601 first suspends reproduction, and an input area display part 611 then displays an input area in the position of the specified object to wait for the user's input. The input area is displayed over the content object. The user then enters input, completing the process. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to technology for acquiring, processing, and displaying data from the Internet and the like, and in particular, a content editing apparatus that processes and edits data to generate new multimedia content data, a computer-readable program, and a program recorded therein The present invention relates to a recording medium.

  In recent years, with the increase in capacity of computer network systems, opportunities for using services using multimedia contents for various network terminals are increasing in general households. Multimedia content here refers to moving content that is a composite of images, moving images, text, sound, animation, etc. that changes over time, and is currently used mainly for displaying websites on the Internet. This is different from static document-based content such as pages written only in (Hyper Text Markup Language). As seen in the example of TV, conventional multimedia contents are profitable by a model in which some professional production companies produce and distribute large amounts of money for a large number of viewers. Yes.

  A large number of production application software and dedicated devices for PCs (personal computers) etc. have already been provided to create and provide multimedia content, and content creators can make full use of the above tools. To provide multimedia content.

  In the future, when distributing multimedia content to each individual via the network, in order to differentiate it from existing broadcast content, etc., we will provide various contents corresponding to individual preferences and profiles. It is necessary to go. Further, not only some specialized production companies but also general information providers can distribute contents, so that more diverse contents can be provided to more diverse individuals. What is needed here is a tool that can produce a variety of individual content at a low cost, and a tool that can be easily used to rewrite the contents of paper without having to master specialized knowledge. is there.

  Many of the existing multimedia content creation tools are intended for use by so-called professional content creators and designer specialists. To use these tools, learn basic concepts and use them. Requires skill and takes time to produce.

Therefore, in Patent Document 1 described later, there is a method for changing information on a template multimedia content by using an HTML page on the Web, performing text, image insertion, etc. on a predetermined original form editing screen. It is disclosed. As shown in FIG. 32, contents can be edited by inputting characters and images in a portion that can be edited on a preset form editing screen. This makes it easier for users familiar with the Web to understand the operation method than to use a specialized tool.
JP 2003-101492 A

  However, in the technique of Patent Document 1, since the text, image insertion, and the like are performed on a predetermined original form editing screen, the editing screen is far from the layout that is actually posted, and the editor feels the layout atmosphere. In order to grasp this, it is necessary to repeat the act of calling the preview screen generated each time, returning to the editing screen again after confirmation. Therefore, there is a problem that the editing work is extremely complicated and unusable for the content editor.

  The present invention has been made to solve the above-described problem, and is a content editing apparatus that can easily change the material of multimedia content on the Web to produce and display new multimedia content. It is another object of the present invention to provide a computer-readable program and a recording medium on which the program is recorded.

  The present invention provides a playback control means for stopping playback at an arbitrary time during playback of multimedia content arranged on a time axis, and displaying a content image at the time of stop, and displaying an object provided in the content The content editing apparatus includes an editing control unit that allows the selected object to be edited and edits the selected object, and reproduces the edited multimedia content when the object is edited.

  And a monitoring unit that monitors whether the position of the selected object is an editable region, wherein the editing control unit is detected that the editable region exists at the position of the object selected by the monitoring unit. In this case, the selected object can be edited.

  Further, the editing control means moves according to the movement of the object on the time axis.

  Further, the edit control means makes the editable area transparent, and visualizes it as an input area when the editable area becomes editable by the edit control means.

  The editable area includes a plurality of editable areas, and each of the editable areas exists independently on the time axis.

  The editing control means may display an editing list including a plurality of editing object candidates in the editable area, and select an arbitrary object from the list.

  Further, the edit control means displays edit object candidates in order in the editable area, and selects an arbitrary object from them.

  Further, the editing control means replaces the editable area as an editing area and replaces it with an arbitrary object.

  The editing control means also edits an object related to the object when an arbitrary object is edited.

  The editing control means adds or deletes a scene related to the scene of the object when an arbitrary object is edited.

  The reproduction control means can display a screen similar to the editing screen on another editing apparatus via a network when an arbitrary object is edited.

  Further, the present invention may be a program for causing a computer to function the above means, or a recording medium on which this program is recorded.

  According to the present invention, since the editing screen and the preview screen are handled in the same manner, the image and text in the content can be changed as desired without changing the layout screen on which the multimedia content is posted, and the work efficiency is improved. With simple operability, new information can always be transmitted by editing more information in real time. By fusing editing and players, it is no longer necessary for ordinary users to use authoring tools that are not good at using them.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an overall configuration of a content editing / generation system according to an embodiment of the present invention. In this system, a content editing terminal 101 such as a notebook computer or a mobile phone, a content generation server 102, and a content receiving terminal 103 such as a personal computer or a television are connected via a network 104 which is a communication line such as the Internet. Yes. Note that the content editing terminal 101, the content generation server 102, and the content receiving terminal 103 may be connected to the network 104 in a plurality having the same configuration. Also, these terminals / servers may be physically located in the same terminal.

  The content here refers to data in which various types of media such as moving images, still images, musical sounds, character strings, animations, etc. are mixed, and each media has a predetermined schedule as time progresses, and The one that can be displayed on the screen at the specified position. Here, the content includes content that can be displayed on the screen by dynamically changing the position and shape with the progress of time.

  FIG. 2 is a block diagram illustrating an embodiment of the content generation server 102. The content generation server 102 is implemented in the form of a software module, and includes a template registration unit 201, a material / change data input unit 202, a content generation unit 203, a content material template storage unit 204, and an editing information transmission unit 205. It is. Here, the content / material / template storage unit 204 stores content, material, template, content display editing module, and the like.

  First, a template creator creates a template 206 and registers it in the content / material / template storage unit 204 through the template registration unit 201 in advance. Here, the template is a template showing the progress of the content scenario and the screen design.

  A content creator who edits or generates content accesses the content generation server 102 from the content editing terminal 101 and is registered in the content / material / template storage unit 204 through the material / change data input unit 202. Select the template you want to use. At this time, the selected template data 206 is output to the content editing terminal 101 through the editing information transmission unit 205. The content creator displays a template on the content editing terminal 101 and inputs a material (image, sound, video, text) according to the template. This material data is registered in the content / material / template storage unit 204 through the material / change data input unit 202, output to the content editing terminal 101 through the editing information transmission unit 205, displayed on the content editing terminal 101, and content. The creator can confirm.

  When the content creator has instructed content generation from the content editing terminal 101 when the content editing is completed, the material / change data input unit 202 finally registers the content / material / template storage unit 204 in the template The data 206 and the material data are output to the content generation unit 203. The content generation unit 203 generates content 207 by embedding material data in the template data 206, and this content is distributed to each receiving terminal 103.

(Data structure)
Next, the data structure of content generated by the content generation server 102 will be described.
As described above, when the template creator creates the template 206 to be registered in the content generation server 102, the template file 302 is created based on the content file 301 described in a certain language as shown in FIG. .
Here, the content file 301 is described in a language such as SMIL (Synchronized Multimedia Integrated Language). When written in this language, the media are displayed in a predetermined layout on the screen in synchronization with the determined timing.

  FIGS. 4 to 6 show examples of description of multimedia contents described by SMIL. As shown in FIGS. 4 to 6, the document indicates the start and end with <smil> and </ smil>. There are two elements in the document: <head> and <body>. <Head> to </ head> are described as options, and detailed information about the entire SMIL document, such as layout and title definitions, is described therein.

  The layout is set using the <layout> tag in the <head> tag. The size of the entire display area is set with the <root-layout> tag, and the size of each part is specified with the <region> tag. Each region can be given an identifier and can be referenced later.

  In order to specify the width and height of the entire display area in <root-layout>, the width and height attributes are used, and the backgroundColor attribute is used for setting the background color. Similarly, in the <region> tag, the size of each part is specified by the width and height attributes, and the part to be positioned with respect to the entire display area is determined by the top attribute, the position from the upper end of the entire screen, and the left Specify the position from the left edge of the entire screen in the attribute. In order to set the background color, the backgroundColor attribute is used, and the overlapping order of the media in each part is represented by the z-index attribute (the higher the value, the uppermost surface).

An identifier can be attached to the display area with the id attribute.
The fit attribute can be used to specify how to display within the playback area when the “playback area specified by the <region /> tag” differs from the “display size of the associated media”. If the value of the fit attribute is hidden, it is placed at the upper left corner of the area with the original size of the medium, and if the medium is smaller than the area, the rest will be the background color of the area, conversely, the medium will be the area If it is larger than that, the area that cannot be fully inserted is cut off. Other values that can be taken by the fit attribute include fill, meet, and slice.

In the <head> tag, in addition to specifying each area with the <layout> tag,
A transition can be specified by a <transition> tag. A transition is a transition effect on the screen when the media is played, finished, or switched to the next media. The next media is covered so that a square appears from the four directions of the area. There are fourBox Wipe that comes out, crossfades that the media becomes thinner and disappears, and the next media becomes darker and the display is switched.

Again, an identifier can be attached to the specified transition with the id attribute.
<Body> to </ body> are indispensable, and in this, specification of media data to be reproduced and specification of operation along with the progress of time are described.
As tags for specifying and playing back a single media, <img>, <audio>, <video>, <animation>, by type of media such as still image, audio, video, animation, text stream, text, etc. Although tag names such as <textstream> and <text> are prepared, the type of media that can be played back and the supported tag names vary depending on the playback environment.

  Tags for grouping and reproducing a plurality of media collectively include a <par> tag and a <seq> tag. These two groups are used in combination as necessary. A plurality of media designated by <par> are reproduced in parallel, and a plurality of media designated by <seq> are reproduced in order. For each medium or a plurality of grouped media, the start time, duration time, and end time can be specified by the begin, dur, and end attributes, respectively.

Each medium can represent an area for displaying the media by designating the identifier designated in the id attribute in the above <region> tag in the region attribute of the media.
Each media can represent the transition effect when displaying the media by designating the identifier designated in the id attribute in the <transition> tag described above in the transIn attribute of the media.

Further, the data entity of the media can be specified using a URL (Unified Resource Locator) using the src attribute.
For example, the reference of the image data existing in the external network is specified as <img src = “http://xxx.yyy.zzz.com/graphefrits.jpg” //. Normally, media data entities such as still images, audio, video, animation, and text are specified in the URL by specifying file names such as * .jpg, * .mpg, * .svg, * .txt. Other designation methods are also possible. For example, text display may be specified in the form of src = hogehoge.txt, or the text content can be specified directly in the form of src = data; (actual text) .... . The text display of the present embodiment uses the latter.

  7 and 8 are diagrams showing examples of specifications describing the SMIL template. The SMIL template is performed by extending the description of the existing SMIL content. A description is added to a place that can be replaced with another material in the content described in SMIL. In the examples of FIGS. 7 and 8, <SmilElement> is used as the tag name for extension, but the extension name and the grammar for extension are arbitrary.

For example, as shown in FIG. 7A, in the description <img region = “pic” src = “graphfruits.jpg” dur = “3 s” transIn = “cross 3” fill = “hold” /> If this image can be replaced with another image, a description is added here, and <SmilElement type = “image” name = “syohin1” comment = “product image (400 × 300)” inputtype = “userinput” region = “pic” “Src =“ graffitits.jpg ”dur =“ 3 s ”transIn =“ cross3 ”fill =“ hold ”/>, this image can be replaced. In the part indicated by the comment attribute in this description, a message to be transmitted to the content creator is entered (such as the type of image to be replaced).
Using this notation, when this image is selected, if there is a file selection box in the OS outside the editing browser, it will appear and it will be displayed, and the file name of the image to be replaced An operation for changing an image can be performed by inputting or selecting. When there is no file selection box, only a text box appears at the same location, and an operation for changing an image can be performed by inputting an image file name to be replaced.

In addition, as shown in FIG. 7B, in the description <text region = “specialprices” src = “data; 248 yen”, dur = “2s” fill = “hold” /> If you want to replace it with the text below, add a description here, <SmilElement type = “text” name = “specialprice1” comment = “Price after price cut, within 10 characters (eg 97 yen)” inputtype = “userinput” If region = “special price” src = “data; 248 yen” dur = “2 s” fill = “hold” />, this text can be replaced. In the part indicated by the comment attribute in this description, a message to be transmitted to the content creator is entered (such as the type of text to be replaced).
When this notation is used, when this text is selected, a text box appears at the same place, and the operation of changing the text can be performed by inputting the replacement text.

  Further, as shown in FIG. 8A, in the description <img region = “pic” src = “graffruits.jpg” dur = “3 s” transIn = “cross 3” fill = “hold” /> for arranging the images, When designating a method of replacing this image with another image by mouse operation, an element of inputtype = “dragondrop” is further added in the case of FIG. 7A, and <SmilElement type = “image” name = “ syohin1 ”comment =“ product image (400 × 300) ”inputtype =“ dragondrop ”region =“ pic ”src =“ graffruits.jpg ”dur =“ 3s ”transIn =“ cross3 ”fill = “Hold” />, the location of this image can be replaced by dragging and dropping the mouse, and the image can be changed by dragging and dropping the image icon from outside the editing browser. Can do.

  Further, as shown in FIG. 8B, in the description <img region = “pic” src = “graphfruits.jpg” dur = “3 s” transIn = “cross 3” fill = “hold” /> for arranging the images, In the case of designating a method for selecting one of a plurality of candidates and replacing it with another image, inputtype = “listbox” option = “graffitruits.jpg”, kabocha.jpg, <smilElement type = “image” name = “syohin1” comment = “product image (400 × 300)” inputtype = “listbox” option = “graffruits.jpg” abocha.jpg, rice.jpg "region =“ pic ”src =“ graffruits.jpg ”dur =“ 3s ”transIn =“ cross3 ”fill =“ hold ”/> A list box in which candidates are enumerated is displayed, and an operation for selecting one of them and replacing it with another image can be performed.

  In addition, as shown in FIG. 8C, in the description <img region = “pic” src = “graphfruits.jpg” dur = “3 s” transIn = “cross 3” fill = “hold” /> for arranging the images, When this image is selected from a plurality of candidates and replaced with another image (on-click switching), the inputtype = “onclickchange” option = “grafpefrits.jpg” is further added in the case of FIG. , Kabocha.jpg, rice.jpg ", and <SmilElement type =“ image ”name =“ syohin1 ”comment =“ product image (400 × 300) ”inputtype =“ onclickchange ”opti n = “grapefrits.jpg, kabocha.jpg, rice.jpg” region = “pic” src = “graphfruits.jpg” dur = “3 s” transIn = “cross3” fill = “hold” / mouse = “hold” When this image is selected and the mouse is clicked at the same location, multiple candidates are replaced one after another, and the subsequent decision operations (such as after a certain period of time, double-clicking, or pressing another key) You can select one of them and specify how to replace it with another image.

  Note that the description of the inputtype attribute can be omitted, and the behavior at that time is the same as when inputtype = “userinput” is specified, but when omitted, the behavior such as when draganddrop is specified may be performed. Good.

  FIGS. 9 to 12 show templates obtained by replacing the SMIL contents shown in FIGS. 4 to 6 with this rule. In this way, it is possible to create a template by adding a description to existing content.

  Also, this time, in order to handle not only material replacement but also the concept of scenes, a certain range in the content is expressed as <SmilElement type = “scene_info” name = “scene3” tag_type = “par”> </ SmilElement> It can be bundled. In this way, the bundled portion is collectively treated as a scene, and can be deleted as a scene or inserted into another location.

It is also possible to introduce a unit called a group for replacing a plurality of objects together. In this case, as shown in FIG. 13, <SmilElement type = “group_info” id = “1”> is described in the content to set the group. In this group, a group of objects constituting a group is specified by a group_element element. In the example of FIG. 13, two image objects and two text objects are designated as groups with id numbers img1, txt1b, and txt1c.
In the next group_set element, values that these objects can take are specified.
There may be a plurality of group_set elements.
The element treated as a group in the group_element element is the group_set element when other parts registered in the same group in the group_element element when one place of these elements in the display screen is changed by the user. Will be changed automatically. For example, when the value of the txt1b object is changed to “grapefruit” by the user, the value of the txt1c object is “128 yen”.

  FIG. 14 is a block diagram showing a hardware configuration of the content editing terminal 101. The content editing terminal 101 is a personal computer, for example, a UI (User Interface) output device 401 for displaying images, a storage (storage storage device) 402 such as a hard disk, a network I / F 403 for connecting to the network 104, a mouse And a UI input device 404 such as a keyboard and a remote controller, a processor 405, and a memory (ROM / RAM) 406.

  FIG. 15 is a functional block diagram of the processor 405 operating on the content editing terminal 101. The processor 405 operates as the following functional blocks by software. That is, as an OS (Operating System) 501 such as Windows (registered trademark), Linux, ortron, an input / output management unit 502, a storage management unit 503, a communication management unit 504, a network content browsing unit 505, and a multimedia content display editing unit 506 Function.

  The multimedia content display / editing unit 506 is for displaying and editing content on the UI output device (display) 401. If the content is not in the content editing terminal 101 in the initial state, it is downloaded from an external server or the like. Is done. The network content browsing unit 505 is an HTML browser generally executed on a PC or the like, and the multimedia content display editing unit 506 may be executed as a format (plug-in) of an external module executable by the HTML browser. However, if there is no HTML browser, it may be executed independently.

  FIG. 16 is a block diagram illustrating a configuration of the multimedia content display editing unit 506. The multimedia content display editing unit 506 includes a playback control unit 601, an editing control unit 602, a layout / schedule analysis unit 603, a structure analysis unit 604, a media storage unit 605, a timer 606, a file acquisition unit / transmission unit 607, and media playback. Unit 608, audio reproduction unit (superimposition control) 609, drawing unit (superimposition control) 610, input region display unit 611, editable region monitoring unit 612, input unit 613, content generation / editing unit 614, update information transmission / reception unit 615.

  The content 206 described in SMIL is input from the file acquisition / transmission unit 607, analyzed by the structure analysis unit 604, and a DOM tree / SAX event 616 is output. Here, the DOM tree / SAX event 616 refers to an internal representation (DOM: Document Object Model, SAX: Simple API for XML) defined by W3C (World Wide Web Consortium). Depending on the embodiment, this format may be used instead of this format. In addition, the generation of this data itself may be omitted.

  FIG. 17 shows an example of a DOM tree. In the case of a DOM tree, the structure of each element is expanded on the tree and can be used from the layout / schedule analysis unit 603. FIG. 18 shows an example of the SAX event. In the case of a SAX event, the analyzed contents are arranged as an event in time series in the order of processing, and transmitted to the layout / schedule analysis unit 603.

  In this way, the layout / schedule analysis unit 603 analyzes the DOM tree / SAX event 616 and outputs the layout table 617 and the schedule table 618. FIG. 19 shows an example of the layout table 617. The layout table 617 stores the position and area where each media object is to be displayed. The schedule table 618 stores the timing at which each media object is to be displayed. As shown in FIG. 20, in addition to the reproduction start time and reproduction end time for each media object, reproduction time, repetition attribute, and effect attribute are stored. Here, since the description of SMIL itself is a nested expression composed of <par> and <seq> nodes, the start time and end time are affected by the playback time of the parent node and child node. Therefore, the start time, end time, and playback time in the table mean the sum of those playback times.

  FIG. 20 shows an example of the editable area table 619. This is similarly generated by the layout / schedule analysis unit 603, and includes an object id, a changeable / unchangeable flag, a change reception position, a change reception area size, and an edit area form (text box, list box) , Drag-and-drop, on-click switching, etc), selection candidate information when selecting object replacement from several candidates, and initial values of variables are stored. This table may be included in the layout table 617 and the schedule table 618.

  FIG. 22 shows an example of a table 620 that defines groups for use in batch conversion or the like. The group_id, group element, and batch replacement candidate setting are stored. This is set so that when any one of the object ids included in the group element is changed, the remaining objects of this group are also changed. For example, when the image with the object id “img1” changes to “graphfruits.jpg”, the text with the object id “txt1b” changes to “grapefruit”, and the text with the object id “txt1c” becomes “95 yen”. When the text with the object id txt1b changes to “pumpkin”, the image with the object id img1 changes to “kabocha.jpg”, and the text with the object id txt1c becomes “120 yen”.

  FIG. 23 is a diagram illustrating an example of the scene table 621. In the scene table 621, whether or not each scene defined in advance can be deleted or added (a new scene is added after this scene) is set.

  FIG. 24 is a flowchart showing editable content reproduction processing executed by the content editing terminal 101. First, the content creator uses the content editing terminal 101 to access the content generation server 102 via the network 104 to select a template for editing (S11). As a method at this time, it is conceivable to use an HTML browser or the like. When selecting a template, the information on the template in the content / material / template storage unit 204 in the content generation server 102 is browsed, selected from templates classified by genre, previewed, etc. for convenience. Make it selectable. After the content creator determines the template, the template data 206 selected from the content generation server 102 is sent to the content editing terminal 101, and content editing is started based on the template data 206. The start method may be to press a start button or a link in HTML.

  When content editing starts, the content editing terminal 101 acquires a template (and material data used as a template) necessary for editing from the content generation server 102 through the file acquisition unit 607 and temporarily stores it in the media storage unit 605. (S12). Thereafter, the template is read to start editing. At this time, if the multimedia content display editing unit 506 is not present in the terminal 101, the editing unit 506 is downloaded from an external server (S13).

  The multimedia content display editing unit 506 parses the downloaded SMIL template 206 and converts it into an internal representation (DOM tree, SAX event, etc.) 616 (S14). This step may be omitted depending on the implementation form and the template form.

  Thereafter, the internal representation 616 creates a layout table 617 and a schedule table 618 necessary for drawing from the internal representation 616 in the layout / schedule analysis unit 603 (S15). Subsequently, the layout / schedule analysis unit 603 further extracts editable areas, changeable contents, variable initial settings, group settings, and selection candidate settings from the internal representation 616 to create an editable area table 619. (S16). This step is performed in common with S15 when the editable area table 619 is included in the layout table 617 and the schedule table 618. Thereafter, based on the contents of the layout table 617 and schedule table 618, the playback control unit 601 activates each media playback unit 608 required for playback and plays back (S17). Note that the reproduction process may be started when the reproducible information is prepared without waiting for the end of the process in the previous steps (S14 to S16).

Next, based on the contents of the editable area table 619, the edit control unit 602 activates the editable area monitoring unit 612 (S18). This process may be performed simultaneously with the process of S17 or in parallel. Then, it is checked whether or not the content creator has designated an object to be edited (S19). If an object is designated, content editing processing is performed (S20). Specifically, as a method of specifying an object, a method of clicking with a mouse on a position where an object to be edited is displayed on a screen on which content is displayed is generally used. If you want to use the remote control, press the up / down / left / right keys on the remote control to focus the object displayed on the screen (displays a rectangle around the object, etc.) is there.
If no object is specified, the reproduction process is completed from the contents of the schedule table 618 (S21), and the reproduction process is terminated. If the reproduction process is not completed, the process returns to S17.

  FIG. 25 is a flowchart showing editable content editing processing executed by the content editing terminal 101 in S20. In S19, when the content creator (user) designates an object to be edited, the editable area monitoring unit 612 determines whether an editable area is set at the position designated by the content creator (S31). If the editable area is not set, the playback control unit 601 continues playback as it is. When the editable area is set, the playback control unit 601 first pauses playback (S32), and the input area display unit 611 displays the input area at the position where the specified object is located, and the content creator (S33). The input area at this time is displayed on top of the object in the content, and the format of the input area is the type of media (image, text, sound, etc.) of the object and the type of editable content (pre-set It depends on whether there is a choice of candidates, whether new input is required, whether mouse drag and drop is required ...).

  Thereafter, the user performs input processing and completes processing (S34). As an input operation at this time, in the case of image replacement, there are methods of selecting candidate images one after another by selecting from a list box, dragging and dropping from the outside, or clicking a mouse. In the case of text input, in addition to typing text one character at a time, clicking on the text area can change the text sequentially. For example, (July-> August-> September ...). In addition, a slider bar can be provided below to indicate an ongoing or paused state, and to return slightly. In addition, when performing these replacement operations, if group settings are made for the object to be replaced, the editing control unit 602 displays not only the content of the object but also the content of another object related to the object. , And can be replaced with preset selection candidates.

  The edit control unit 602 can change the position of the object by dragging and dropping it to the input area at the time of editing through the input area display unit 611. In addition, the size of the area can be variably set so as to be automatically adjusted according to the text length. When the input is completed, the completion operation is completed with a prescribed operation such as pressing a line feed in the case of text input.

  The edit control unit 602 replaces the information of the object that matches the specified editable area with the value input through the input unit 613 (updates the table or the like) (S35), and displays the input area at the specified position. The input area is erased (transparent) through the part (S36), and the old object is erased (S37). Thereafter, the playback control unit 601 registers an object with new contents (acquires new media data as necessary) and displays it (S38). At this time, the content display screen has been changed, but the original content (SMIL content) has not been changed yet, so this change is necessary. As a method for this, a method in which updated new information (adding media data as necessary) is transmitted to the server, and the update information is passed to the local content generation / editing unit 614 to generate SMIL content. There is a method (S39). Since this step is functionally independent, it may be performed immediately after S37.

Thereafter, the edit control unit 602 determines whether or not the designated editable area is set as a group (S40), and when the editable area is set as a group, the locations of all objects corresponding to the group are changed. (S41). Until the positions of all the objects corresponding to the group are changed, the processes of S35 to S39 are repeated and replaced with values set in advance. When the rewriting process is completed, the process returns to S17 to perform the reproduction process.
If the editable area is not set as a group in S40, the process returns to S17 and the playback control unit 601 performs playback processing.

  FIG. 26 is an explanatory diagram showing an example of a screen display during content editing. An image object 701 and a character object 702 are displayed on the screen, and the editable area 703 is positioned so as to overlap the changeable object. It looks transparent to the user. When the user places the mouse cursor 704 on the editable area and clicks on it, an input area 705 appears. In the example shown, a text box appears. The user edits this using the keyboard. There is an edit bar 706 at the bottom row, but this may be displayed only in the pause state. The edit bar 706 includes a BGM setting button 707, a slider 708, a scene addition button 709, and a scene deletion button 710.

  When the BGM setting button 707 is pressed, an input area set in advance appears and the BGM can be changed. The BGM may be changed one after another by continuously pressing this button. The slider 708 indicates the progress of the content, and when the middle pointer is moved to the left or right, the screen being played back can be displayed backward or forwarded. When a scene addition button 709 is pressed, a scene is added if a scene can be added after this scene. When a scene deletion button 710 is pressed, if the currently displayed scene can be deleted, the scene is deleted.

  FIG. 27 shows an example of a screen shot during editing as viewed from the user operation side. As shown in FIG. 27A, when the editing of the content is started, the reproduction of the content starts, and the content dynamically changes with the passage of time. At this time, if a location that you want to edit appears, click that location. Then, as shown in FIG. 27B, the content is paused at that time, and an input form appears at a position where editing is desired. In the example of the figure, since the price is clicked, the text box for changing the price is the input form 705.

  As shown in FIG. 27 (c), the contents to be updated are input here and a completion instruction is given (enter key or mouse click). Then, as shown in FIG. 27 (d), the contents are changed and the reproduction is resumed.

An example when an electronic leaflet creation system is configured using this system will be described.
The electronic leaflet here refers to a format in which information such as an ordinary leaflet inserted in a newspaper is displayed on a medium such as a television or a PC. It is provided in the form of multimedia content in which various types of media such as images, musical sounds, and character strings are mixed. Therefore, it is possible to incorporate an expression that dynamically changes with the passage of time, rather than a stationary information display like a paper medium. It mainly contains advertisements for products to be sold and contents to be notified to buyers.

  FIG. 28 is a schematic explanatory view showing an example of an electronic leaflet. In the case of a product flyer, information includes a product name 721, a product description 722, and a price 723, and includes a product image 724, a sales unit 725, a store name, a store logo, a sale period, and the like. In the embodiment of the present invention, these are defined as character objects and image objects, respectively.

  In the example of FIG. 28, the object moves on the screen as time passes, so that it is possible to increase the impression to the user including detailed emotional expressions. In the example of FIG. 28, the product information is updated and the next product is introduced as time elapses, and the concept of scene = introduction of one product is defined. In this case, when it is desired to add a product to be introduced, a scene should be added.

  FIG. 29 shows an example of a screen shot during editing as viewed from the user operation. As shown in FIG. 29 (a), when the electronic leaflet editing is started, the reproduction of the content starts, and the content dynamically changes with the passage of time. At this time, if a location that you want to edit appears, click that location. Then, as shown in FIG. 29B, the content is paused at that time, and an input form appears at a position where editing is desired. In the example in the figure, since the price was clicked, the text box for changing the price is the input form.

  As shown in FIG. 29 (c), the contents to be updated are input here and a completion instruction is given (enter key or mouse click). Then, as shown in FIG. 29 (d), the contents are changed and the reproduction is resumed.

  Here, as a method of changing the contents, there is also a method of changing for each object as described above, but for a product with a corresponding relationship such as a product name, product image, product description, etc. There is also a way to change one automatically so that the others are automatically changed. In the latter case, items that can be set for each product, such as a product name, a description of the product, and an image of the product, are registered in advance as a group setting table as a group. Group settings can be described in the content.

With this group setting, for example, when an object of an image of a product is changed in the content, other objects such as a product name and product description related thereto are automatically changed accordingly.
Further, a time interval for displaying one product or a group of product groups can be defined as one scene. The definition of the scene is performed by putting a scene break in the template description file. If scenes are divided in units of products, when the number of products (or product groups) to be advertised in the content is increased or decreased, it is possible to easily cope with an operation of adding or deleting scenes.

  Next, an example when an electronic album generation / editing system is configured using this system will be described. Here, the electronic album is a format in which images taken with a personal digital camera or the like are arranged and edited, and arranged in time series or on a screen are displayed on a medium such as a television or a PC. Point to. Like an electronic flyer, it is provided in the form of multimedia content in which various types of media such as images, musical sounds, and character strings are mixed. Therefore, it is possible to incorporate an expression that dynamically changes with the passage of time, rather than a stationary information display like a paper medium. Expression methods can be tailored to individual preferences or customized.

  FIG. 30 is a screen display diagram showing an embodiment of an electronic album. In the case of an electronic album, information may include a photographed (or moving image) 801, a photograph description 802, a photographing date 803, a photographing location, and the like. In the embodiment of the present invention, these are defined as character objects and image objects, respectively. There are various ways to arrange and view the images. As shown in Example 1 of FIG. 30A, the images are displayed in 2 × 3, and the display screen scrolls to the left, and different pictures appear one after another. If there is a way to show, as shown in Example 2 in FIG. 30B, a photo can be arranged like a paper album, and the next page appears by turning over like a spread page, FIG. 30C As in Example 3), the background may be similar to that of a bulletin board, and it may be viewed as if the photos are falling from the front of the screen toward the back of the screen while accumulating and rotating.

  As in these examples, when the object moves on the screen as time passes, it is possible to increase the impression to the user including detailed emotional expressions. In the case of Example 2 in FIG. 30B, if one spread page is defined as a scene, scene addition = page addition.

  This album editing is the same as the electronic flyer editing method described above when performed by a single user, but two or more families who are separated from each other communicate with each other's devices and talk together. It can also be used for making albums.

  FIG. 31 shows an example of a screen shot at the time of editing from the viewpoint of user operation. When the editing of the electronic album is started, the playback of the content starts on both sides, and the content changes dynamically with the passage of time. As shown in FIG. 31A, the content displays at this time are synchronized with each other. At this time, if a location that you want to edit appears, click that location. As shown in FIG. 31 (e), on the clicked side, the content is paused at that point, and an input form appears at a position where editing is desired.

In the example of FIG. 31B, since the place where the image is clicked, it is a drag and drop icon for changing the image. As shown in FIG. 31 (f), the content is also paused at the same position on the other party, and the part selected on the other party changes its color and blinks.

  Next, the image to be updated is designated on the editing side. As shown in FIG. 31C, here is an example in which an image is designated by dragging and dropping an image icon from outside the browser being edited. As shown in FIG. 31 (g), during this work, the other side is kept in a state where the selected location is blinking.

  As shown in FIG. 31D, when the drag-and-drop editing is completed on the editing side, the contents are changed and the reproduction is resumed. As shown in FIG. 31 (h), the other party's display is also changed at this time, and reproduction is resumed in a synchronized manner.

  As described above, in the system according to the present embodiment, the content editing apparatus handles the editing screen and the preview screen in the same way, so that the layout screen on which the multimedia content is posted remains as desired. You can change the image and text, and work efficiency will increase. With simple operability, new information can always be transmitted by editing more information in real time. By fusing editing and players, it is no longer necessary for ordinary users to use authoring tools that are not good at using them.

  In the above-described embodiment, an example using the SMIL language, which is a kind of XML language, has been described. However, the same function can be realized in other content forms capable of performing multimedia expression. As formats of multimedia contents that are widely used on the Internet as of 2004, there are Flash (swf) and Shockwave of Macromedia, SVG (Scalable Vector Graphics) of the W3C standard, EVA animator, and the like. It is also conceivable to create content from scratch using an object-oriented language such as Java (registered trademark).

  Here, an example using Flash of Macromedia is described. In this format, an animation is represented as a set of vectors in coordinate units, and a description that changes in time series is possible. It can also handle images, audio, moving images, input / output, etc., other than animation drawing. Furthermore, with a program language called ActionScript that conforms to the ECMA script standardized by W3C, animations and images on the screen, Programming that controls voice, input / output control, communication control, etc. is possible. These can be combined to create buttons, forms, etc., and are also available in authoring tools as standard components. Since the structure is different from the SMIL language, there is no DOM tree, SAX event, schedule table, layout table, etc. in the content display / generation unit in FIG. 16, but the part that interprets the content format and interprets the layout and schedule, The part that controls playback exists in another implementation. In this embodiment, input area display, non-display, editable area monitoring, change information input, input area control, and transmission / reception of update information can be realized by programming and executing this action script in the flash content. is there. For each object to be changed, an editable area (area for detecting mouse clicks) is set, and when it is pressed, the content playback time is stopped and a form for input is dynamically generated and input to the user. Let User input completion instructions (enter key and mouse click) are defined, and when user input completion is detected, the form is deleted, the specified object is deleted, a new object to be changed is generated, and the same place is created. paste. The update information at this time can be transmitted to a server or another terminal via a communication line. When the change process is finished, playback is resumed at the end.

  The present invention is based on the premise that the processor operates on software, that is, a program, and further, this program can be recorded on a recording medium such as a CD or a memory, read out and executed. .

  As described above, the embodiments and examples of the present invention have been described. However, the embodiments and examples disclosed this time should be considered as illustrative in all points and not restrictive. is there. The scope of the present invention is defined by the terms of the claims, and includes meanings equivalent to the terms of the claims and all modifications within the scope.

It is a block diagram which shows the whole structure of the content edit / generation system which concerns on embodiment of this invention. 3 is a block diagram illustrating an example of a content generation server 102. FIG. It is a figure which shows the language specification for a SMIL template. It is a figure which shows the example of description of the multimedia content described by SMIL. It is a figure which shows the example of description of the multimedia content described by SMIL following FIG. It is a figure which shows the example of description of the multimedia content described by SMIL following FIG. It is a figure which shows the example of the specification which describes a SMIL template. It is a figure which shows the other example of the specification which describes a SMIL template. It is a figure which shows the example of a description of the template of the multimedia content described by SMIL. It is a figure which shows the example of a description of the template of the multimedia content described by SMIL following FIG. FIG. 10 is a diagram illustrating a description example of a multimedia content template described by SMIL following FIG. 9. It is a figure which shows the example of a description of the template of the multimedia content described by SMIL following FIG. It is a figure which shows the table which defines the group for using for batch conversion etc. It is a block diagram which shows the hardware constitutions of a content editing terminal. It is a functional block diagram of the processor which operate | moves with a content editing terminal. It is a block diagram which shows the structure of a multimedia content display edit part. It is a figure which shows the example of a DOM tree. It is a figure which shows the example of a SAX event. It is a figure which shows the example of a layout table. It is a figure which shows the example of a schedule table. It is a figure which shows the example of an editable area | region table. It is a figure which shows the example of the table which defines the group for using for batch conversion etc. It is a figure which shows the example of a scene table. It is a flowchart which shows the reproduction | regeneration processing of the editable content performed with a content editing terminal. It is a flowchart which shows the edit process of the editable content performed with the content edit terminal in S20. It is explanatory drawing which shows an example of the screen display at the time of content editing. It is a figure which shows the example of a screenshot at the time of the content edit seen from the surface of user operation. It is explanatory drawing which shows an example of the screen display at the time of editing of an electronic leaflet. It is a figure which shows the example of a screenshot at the time of electronic leaflet editing seen from the surface of user operation. It is a screen display figure which shows one Example of an electronic album. It is a figure which shows the example of a screenshot at the time of electronic album editing seen from the surface of user operation. It is explanatory drawing which shows an example of the conventional content edit screen.

Explanation of symbols

101 content editing terminal 102 content generation server 103 content reception terminal 104 network 201 template registration unit 202 changed data input unit 203 content generation unit 204 content material template storage unit 205 editing information transmission unit 206 content template 207 content 301 content file 302 template file 401 Output device 404 Input device 405 Processor 502 Input / output management unit 503 Storage management unit 504 Communication management unit 505 Network content browsing unit 506 Multimedia content display editing unit 601 Playback control unit 602 Edit control unit 603 Schedule analysis unit 604 Structure analysis unit 605 Media Storage unit 606 Timer 607 File acquisition unit / transmission unit 608 Media playback unit 611 Force region display unit 612 Editable region monitoring unit 613 Input unit 614 Editing unit 615 Update information transmission / reception unit 616 Internal representation 617 Layout table 618 Schedule table 619 Editable region table 620 Group setting table 621 Scene table 701 Image object 702 Object 703 Editable Area 704 Mouse cursor 705 Input area 706 Edit bar 707 Setting button 708 Slider 709 Add scene button 710 Delete scene button 721 Product name 722 Product description 723 Price 724 Image 725 Sales unit 802 Description 803 Shooting date

Claims (13)

Playback control means for stopping playback at an arbitrary time during playback of multimedia content arranged on the time axis, and displaying a content image at the time of stop;
Editing control means for allowing an object provided in the content to be selected on an image display and editing the selected object;
A content editing apparatus, wherein, when the object is edited, reproduction is performed using the edited multimedia content. Comprising monitoring means for monitoring whether the position of the selected object is an editable area;
2. The edit control unit according to claim 1, wherein the edit control unit enables editing of the selected object when it is detected that the editable region exists at the position of the object selected by the monitoring unit. Content editing device.   The content editing apparatus according to claim 1, wherein the editing control unit moves in accordance with the movement of the object on the time axis.   4. The content editing apparatus according to claim 1, wherein the editing control unit makes the editable area transparent, and visualizes the editable area as an input area when the editable area becomes editable.   5. The content editing apparatus according to claim 1, wherein there are a plurality of editable areas on the screen, and each of them is independently present on a time axis.   6. The edit control unit according to claim 1, wherein an edit list including a plurality of edit object candidates is displayed in the editable area, and an arbitrary object is selected from the edit list. Content editing device.   6. The content editing apparatus according to claim 1, wherein the editing control means displays editing object candidates in order in the editable area, and selects an arbitrary object from them.   The content editing apparatus according to claim 1, wherein the editing control unit replaces the editable region with a region for editing and replaces the region with an arbitrary object.   6. The content editing apparatus according to claim 1, wherein when an arbitrary object is edited, the editing control unit also edits an object related to the object.   6. The content editing apparatus according to claim 1, wherein when an arbitrary object is edited, the editing control unit adds / deletes a scene related to the scene of the object.   6. The content editing according to claim 1, wherein, when an arbitrary object is edited, the playback control means can display a screen similar to the editing screen on another editing device via a network. apparatus.   The program for making a computer function the means in any one of Claims 1-11. A recording medium on which the program according to claim 12 is recorded.

Images