JP2006323528A - Content editing system, content editing program, and content editing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a content editing system, content editing program, and content editing method capable of saving labor for writing a zooming description language from the beginning. <P>SOLUTION: A content converting means 21 generates and outputs zooming description related to the zooming operation/behavior describing at least one of the correspondence between zooming ratio and display state every object that constitutes a content and is to be zoomed and zoom propagation between associated objects, based on the content description described and structured in XML or HTML, thereby saving labor for writing the zooming description language from the beginning. A zoom behavior setting means 22 can easily edit the zooming operation/behavior of the content in the automatically generated zooming description language into that reflecting intention of a content generating person. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a content editing apparatus, a content editing program, and a content editing method.

  In recent years, office documents (reports, minutes, memos, etc.) are composed of a collection of objects consisting of various media (text, still images, videos, etc.) due to the popularization of mobile phones with cameras and digital video cameras. The development of multimedia content is progressing.

  By the way, when browsing and editing such multimedia contents with the current browser, there are the following problems.

  First, the screen configuration is fixed. More specifically, when all information is displayed on one page, the listability becomes poor and the screen configuration is fixed, so the level of detail of the media and the display balance between different types of media (for example, text and related images) can be viewed. It cannot be flexibly controlled according to the user's preferences and browsing devices.

  Second, related information is displayed on different pages. More specifically, when the association is performed using a hyperlink, the related information is displayed on different pages, so that the position of the target portion in the whole and the context of browsing become difficult to understand.

  Thirdly, it takes time to edit and create. In more detail, it is necessary to create the details of the layout and display size in the page in creating content, which is troublesome. Also, when creating content, it is necessary to create all pages of the link source and link destination.

  Therefore, in Patent Document 1, an attempt is made to solve a part of the above problems by using a zooming metaphor.

  In Patent Literature 1, a zoom state is determined by a zoom state determination unit in accordance with an input from an input device, a content layout is generated by a content layout generation unit according to the determined zoom state, and the determined zoom state and the generated state are generated. A browser system is described in which a meta information layout is dynamically generated by a meta information layout generation unit according to the content layout, and finally a content layout, a meta information layout, and a pointer are superimposed and displayed on a display device. According to such a browser system of Patent Document 1, it is possible to ensure consistency between the content layout and the meta information layout even when the content layout changes dynamically.

JP 2003-330856 A

  However, according to the browser system of Patent Document 1, two types of layouts, a content layout and a meta information layout, are defined and a zooming metaphor is applied thereto. However, it is necessary to classify content and meta information in advance. There is a problem that it takes time to prepare and organize data.

  Further, since the relationship between the parameter indicating the degree of zooming (zoom rate) and the content display state is automatically set by the browser, the intention of the content creator cannot be reflected.

  The present invention has been made in view of the above, and an object of the present invention is to provide a content editing apparatus, a content editing program, and a content editing method that can save the trouble of writing down a zoom description language from the beginning.

  The present invention has been made in view of the above, and a content editing apparatus and content editing device that can easily edit a zooming operation / behavior of content in a zooming description language to reflect the intention of the content creator It is an object to provide a program and a content editing method.

  In order to solve the above-described problems and achieve the object, a content editing apparatus according to a first aspect of the present invention is based on a structured content description, and a zoom rate and a display for each zoom target object constituting the content. Content conversion means for generating and outputting a zooming description related to a zooming operation / behavior that describes at least one of state correspondence and zoom propagation between associated objects is provided.

  According to a second aspect of the present invention, the content editing apparatus includes zoom behavior setting means for editing a zooming description regarding a zooming operation / behavior for each object to be zoomed constituting the content and outputting the zooming description after the editing. .

  According to a third aspect of the present invention, in the content editing apparatus according to the first aspect, the zoom behavior setting for editing the zooming description relating to the zooming operation / behavior generated by the content conversion means and outputting the zooming description after editing. Means are further provided.

  According to a fourth aspect of the present invention, in the content editing apparatus according to any one of the first to third aspects, the content is displayed according to the set zooming description, and the zooming operation / behavior according to the description is realized. Content display means is further provided.

  According to a fifth aspect of the present invention, in the content editing apparatus according to the first aspect, the content conversion unit classifies the terminal node of the content having a tree structure according to the type of the corresponding object, and the zoom rate and the level according to the classification. The means for setting the correspondence of the display state and the non-terminal node are configured from objects corresponding to the terminal nodes below the non-terminal node, and the non-terminal node below the non-terminal node is positioned as a lower zoom target. And a means for setting zoom propagation from a higher zoom target to a lower zoom target.

  According to a sixth aspect of the present invention, in the content editing apparatus according to the second or third aspect, the zoom behavior setting unit includes a zoom target setting unit that edits a configuration of an object that is a zoom target to be a zoom operation target, For each object constituting the zoom target, zoom ratio setting means for setting the correspondence between the zoom ratio and the display state, and in the case of a zoom target composed of a plurality of objects, whether the object layout is arranged vertically or horizontally At least one of layout setting means for setting the zoom propagation and zoom propagation setting means for setting the zoom propagation relationship between the associated zoom targets.

  According to a seventh aspect of the present invention, in the content editing apparatus according to the sixth aspect, the zoom ratio setting means sets only a zoom ratio at which a change tendency of a zoom target changes or a zoom ratio at which display / non-display is switched. However, interpolation is performed for other zoom ratios.

  According to an eighth aspect of the present invention, in the content editing device according to the sixth aspect, the zoom ratio setting means changes the image size by directly enlarging / reducing and changing the image size, and specifying the zoom ratio. Define and set the correspondence with the display size.

  According to a ninth aspect of the present invention, in the content editing apparatus according to the sixth aspect, the zoom propagation setting unit is configured to make the zoom ratio of the propagation source zoom object or the relative change of the zoom ratio when the propagation destination zoom object appears. The relationship is set in association with the line segment position and length ratio.

  According to a tenth aspect of the present invention, there is provided a content editing program based on a structured content description, corresponding to a zoom ratio and a display state of each object to be zoomed constituting the content, and zooming between associated objects. A computer executes a content conversion function for generating and outputting a zooming description related to a zooming operation / behavior that describes at least one of propagation.

  A content editing program according to an eleventh aspect of the invention has a zoom behavior setting function for editing a zooming description regarding a zooming operation / behavior for each object to be zoomed constituting the content, and outputting the zooming description after editing. To run.

  According to a twelfth aspect of the present invention, in the content editing program according to the tenth aspect, zoom behavior setting for editing a zooming description related to a zooming operation / behavior generated by the content conversion function and outputting the zooming description after editing. Causes the computer to perform further functions.

  According to a thirteenth aspect of the present invention, in the content editing program according to any one of the tenth to twelfth aspects, the content is displayed according to the set zooming description, and the zooming operation / behavior according to the description is realized. The computer further executes a content display function.

  According to a fourteenth aspect of the present invention, in the content editing program according to the tenth aspect, the content conversion function classifies the terminal node of the content having a tree structure according to the type of the corresponding object, and the zoom rate and the level according to the classification. The function for setting the display state correspondence and the non-terminal node are configured from objects corresponding to the terminal nodes below the non-terminal node, and the non-terminal node below the non-terminal node is positioned as a lower zoom target. And a function to set zoom propagation from a higher zoom target to a lower zoom target and to cause the computer to execute at least one of the functions.

  According to a fifteenth aspect of the present invention, in the content editing program according to the eleventh or twelfth aspect, the zoom behavior setting function includes a zoom target setting function for editing a configuration of an object that is a zoom target to be a zoom operation, The zoom ratio setting function that sets the correspondence between the zoom ratio and display state for each object that constitutes the zoom target, and whether the object layout is vertical or horizontal in the case of a zoom target that consists of multiple objects The computer executes at least one of a layout setting function for setting the zoom propagation and a zoom propagation setting function for setting a zoom propagation relationship between the associated zoom targets.

  Further, the invention according to claim 16 is the content editing program according to claim 15, wherein the zoom ratio setting function sets only a zoom ratio at which a change tendency of a zoom target changes or a zoom ratio at which display / non-display is switched. However, interpolation is performed for other zoom ratios.

  According to a seventeenth aspect of the present invention, in the content editing program according to the fifteenth aspect, the zoom ratio setting function changes the image size by directly enlarging / reducing and changing the zoom ratio and specifying the zoom ratio. Define and set the correspondence with the display size.

  According to an eighteenth aspect of the present invention, in the content editing program according to the fifteenth aspect, the zoom propagation setting function is configured such that when the propagation destination zoom object appears, the zoom ratio of the propagation source zoom object or the relative change of the zoom ratio. The relationship is set in association with the line segment position and length ratio.

  The content editing method according to the nineteenth aspect of the present invention is based on a structured content description, the correspondence between the zoom rate and the display state of each zoom target object constituting the content, and the zoom between the associated objects. A content conversion step of generating and outputting a zooming description related to a zooming operation / behavior that describes at least one of propagation is included.

  The content editing method according to the twentieth aspect includes a zoom behavior setting step of editing a zooming description relating to a zooming operation / behavior for each object to be zoomed constituting the content and outputting the zooming description after editing. .

  According to a twenty-first aspect of the present invention, in the content editing method according to the nineteenth aspect, the zoom behavior setting for editing the zooming description regarding the zooming operation / behavior generated by the content conversion step and outputting the zooming description after editing. The method further includes a step.

  The invention according to claim 22 is the content editing method according to any one of claims 19 to 21, wherein the content is displayed according to the set zooming description, and the zooming operation / behavior according to the description is realized. A content display step is further included.

  Further, the invention according to claim 23 is the content editing method according to claim 19, wherein the content conversion step classifies the terminal node of the content forming the tree structure according to the type of the corresponding object, and the zoom rate and the level according to the classification. The step of setting the correspondence of the display state and the non-terminal node are configured from objects corresponding to the terminal nodes below the non-terminal node, and the non-terminal node below the non-terminal node is positioned as a lower zoom target. And setting a zoom propagation from an upper zoom object to a lower zoom object.

  The invention according to claim 24 is the content editing method according to claim 20 or 21, wherein the zoom behavior setting step includes a zoom target setting step of editing a configuration of an object that is a zoom target to be zoomed, The zoom ratio setting process for setting the correspondence between the zoom ratio and the display state for each object constituting the zoom target, and whether the object layout is arranged vertically or horizontally in the case of a zoom target composed of a plurality of objects At least one of a layout setting step for setting the zoom propagation and a zoom propagation setting step for setting a zoom propagation relationship between the associated zoom targets.

  According to a twenty-fifth aspect of the present invention, in the content editing method according to the twenty-fourth aspect, in the zoom ratio setting step, only a zoom ratio at which a change tendency of a zoom target changes or a zoom ratio at which display / non-display is switched is set. However, interpolation is performed for other zoom ratios.

  According to a twenty-sixth aspect of the present invention, in the content editing method according to the twenty-fourth aspect, in the zoom ratio setting step, the zoom ratio is set by changing the image size by directly enlarging / reducing and specifying the zoom ratio. Define and set the correspondence with the display size.

  According to a twenty-seventh aspect of the present invention, in the content editing method according to the twenty-fourth aspect, in the zoom propagation setting step, when the propagation destination zoom target appears, the zoom ratio or zoom ratio change of the propagation source zoom target The relationship is set in association with the line segment position and length ratio.

  According to the first aspect of the present invention, based on the structured content description, at least the correspondence between the zoom rate and the display state of each zoom target object constituting the content and the zoom propagation between the associated objects By generating and outputting a zooming description relating to a zooming operation / behavior describing any one of them, it is possible to save the trouble of writing down the zooming description language from the beginning.

  Further, according to the invention of claim 2, there is an effect that the zooming operation / behavior of the content can be easily edited to reflect the intention of the content creator.

  Further, according to the invention of claim 3, there is an effect that the zooming operation / behavior of the content in the automatically created zooming description language can be easily edited to reflect the intention of the content creator.

  According to the invention of claim 4, the content editing result is displayed according to the set zooming description, and the content editing result can be immediately visually confirmed by realizing the zooming operation / behavior according to the description. There is an effect.

  Further, according to the invention of claim 5, there is an effect of saving the trouble of writing down the zoom description language from the beginning.

  Further, according to the invention of claim 6, there is an effect that the zooming operation / behavior of the content can be easily edited to reflect the intention of the content creator.

  Moreover, according to the invention concerning Claim 7, there exists an effect that the effort of editing can be reduced and an editor can make it easy to grasp | ascertain a display state.

  Further, according to the eighth aspect of the invention, the correspondence between the zoom ratio and the image size can be visually and continuously captured, so that the editor can easily understand.

  According to the invention of claim 9, there is an effect that it is easy to intuitively edit / understand the relative relationship between the propagation source and the propagation destination in zoom propagation.

  According to the invention of claim 10, based on the structured content description, the correspondence between the zoom rate and the display state of each zoom target object constituting the content, and the zoom propagation between the associated objects, By generating and outputting a zooming description relating to a zooming operation / behavior that describes at least one of the above, it is possible to save the trouble of writing the zooming description language from the beginning.

  According to the invention of claim 11, the zooming operation / behavior of the content can be easily edited to reflect the intention of the content creator.

  Further, according to the invention of claim 12, there is an effect that the zooming operation / behavior of the content in the automatically created zooming description language can be easily edited to reflect the intention of the content creator.

  According to the invention of claim 13, the content editing result is displayed according to the set zooming description and the zooming operation / behavior according to the description is realized, so that the content editing result can be immediately visually confirmed. There is an effect.

  Further, according to the fourteenth aspect of the present invention, there is an effect of saving the trouble of writing down the zoom description language from the beginning.

  According to the fifteenth aspect of the present invention, the zooming operation / behavior of content can be easily edited to reflect the intention of the content creator.

  According to the sixteenth aspect of the invention, it is possible to reduce the labor of editing and to make it easier for the editor to grasp the display state.

  According to the seventeenth aspect of the present invention, the correspondence between the zoom ratio and the image size can be grasped visually and continuously, so that the editor can easily understand.

  Further, according to the eighteenth aspect, there is an effect that it is easy to intuitively edit / understand the relative relationship between the propagation source and the propagation destination in zoom propagation.

  According to the nineteenth aspect of the invention, based on the structured content description, the correspondence between the zoom rate and the display state of each zoom target object constituting the content, and the zoom propagation between the associated objects, By generating and outputting a zooming description relating to a zooming operation / behavior that describes at least one of the above, it is possible to save the trouble of writing the zooming description language from the beginning.

  Further, according to the twentieth aspect, there is an effect that the zooming operation / behavior of the content can be easily edited to reflect the intention of the content creator.

  Further, according to the invention of claim 21, there is an effect that the zooming operation / behavior of the content in the automatically created zooming description language can be easily edited to reflect the intention of the content creator.

  According to the invention of claim 22, by displaying the content according to the set zooming description and realizing the zooming operation / behavior according to the description, the content editing result can be immediately visually confirmed. There is an effect.

  According to the twenty-third aspect of the present invention, there is an effect of saving the trouble of writing down the zooming description language from the beginning.

  According to the invention of claim 24, the zooming operation / behavior of the content can be easily edited to reflect the intention of the content creator.

  Further, according to the invention of claim 25, there is an effect that it is possible to reduce the labor of editing and make it easy for the editor to grasp the display state.

  According to the invention of claim 26, the correspondence between the zoom ratio and the image size can be grasped visually and continuously, so that the editor can easily understand.

  In addition, according to the twenty-seventh aspect, there is an effect that it is easy to intuitively edit / understand the relative relationship between the propagation source and the propagation destination in zoom propagation.

  Exemplary embodiments of a content editing apparatus, a content editing program, and a content editing method according to the present invention are explained in detail below with reference to the accompanying drawings.

  An embodiment of the present invention will be described with reference to FIGS.

[1. Overview of screen transitions when viewing multimedia content]
First, an outline of screen transition in browsing multimedia contents, which is a premise of the present invention, will be described.

  First, an example of zoom propagation when the zoom ratio relationship is a positive value will be described. FIG. 1 to FIG. 3 are explanatory diagrams showing examples of screen transition in browsing multimedia contents. FIG. 1 is a front view showing an example of multimedia content displayed on a display. The example shown in FIG. 1 is an example in which “business trip report” is applied as multimedia content. The multimedia content shown in FIG. 1 is mainly composed of text as an object.

  FIG. 2 shows the result of zooming in on the multimedia content object A shown in FIG. As shown in FIG. 2, when the zoom-in operation is performed on the object A of the multimedia content, the object B subordinate to the object A is newly displayed, and the new object C is displayed below the object B. Is done. Here, the new object C is a still image of a moving image in which the discussion scene at the time when the discussion related to the object A was made.

  Further, FIG. 3 shows the result of zooming in on the multimedia content object A shown in FIG. As shown in FIG. 3, when the zoom-in operation is performed on the multimedia content object A, the font sizes of the objects A and B are enlarged. In addition, as shown in FIG. 3, when the zoom-in operation is performed on the multimedia content object A, the degree of detail of the still image that is the object C increases (the image size increases). Furthermore, when the object C is enlarged to a certain size, reproduction of a moving image (and sound) is started.

  The screen transition in browsing multimedia contents is described in the following display description (structure description and zooming description). The structure description and zooming description are described in an XML (Extensible Markup Language) -based language.

  Here, the zooming description will be described below with a simple example.

1. Designation of media object Each of text, still image, moving image, and sound is represented by tags of <text />, <img />, <video />, and <audio />. This tag specifies the specific text content or source file.
(Example 1)
<text id = text1> This is text. </ text>
<img id = img1 src = "img1.jpg"/>
<video id = video1 src = "video1.mpg"/>
<audio id = audio1 src = "audio1.wav"/>

2. Zoom rate range
In zoomFactor attribute in the <div /> tag, specify the maximum and minimum values of the zoom factor and represent the range of the zoom factor as a continuous parameter.
(Example 2)
<div zoomFactor = "0.0 0.5"/>

3. Display of media object Each text, still image, moving image, and audio is represented by <dispText>, <dispImg>, <dispVideo>, and <dispAudio> tags. It is always included in the <div /> tag, and represents the display state of each media object at the zoom ratio in the range specified by the <div /> tag.
(Example 3-1)
<div zoomFactor = "0.0 0.5">
<dispText id = "disptext1" textId = "text1" fontSize = "10pt 14pt"/>
</ div>
The above means that the text specified by text1 in the <text /> tag is displayed as 10pt when the zoom factor is 0.0, and 14pt when the zoom factor is 0.5, and the font size is as smooth as possible during that time Is to change.
(Example 3-2)
<div zoomFactor = "0.0 0.5">
<dispImg id = "dispimg1" imgId = "img1" imgSize = "10% 50%"/>
</ div>
The above means that the still image specified by img1 in the <img /> tag is displayed at 10% of the maximum size when the zoom factor is 0.0, and 50% when the zoom factor is 0.5. Is to change the size as smoothly as possible.
(Example 3-3)
<div zoomFactor = "0.0 0.5">
<dispVideo id = "dispvideo1" videoId = "video1" start = "0" end = "300" videoSize = "10% 50%"/>
</ div>
The above means that the 0th to 300th frame of the video specified by video1 in the <video /> tag is 10% of the maximum size when the zoom ratio is 0.0, and when the zoom ratio is 0.5 Each is displayed at 50%, and the size is changed as smoothly as possible.
(Example 3-4)
<div zoomFactor = "0.0 0.5">
<dispAudio id = "dispaudio1" audioId = "audio1" start = "0s" end = "30s"/>
</ div>
The above meaning is that the first 30 seconds of the audio specified by audio1 in the <audio /> tag is played back during the zoom ratio of 0.0 to 0.5.

4). Zoom target Describe the zoom target with the <zoomObject /> tag. The initial zoom rate, the zoom target of the zoom propagation destination, and the zoom rate relationship are also described with attributes in the tag. Be sure to include either <div /> or other <zoomObject />.

  The structure description and zooming description for the screen transition examples shown in FIGS. 1 to 3 are shown below. In the following description, the structure description of the content and the zooming description regarding the zooming operation / behavior are described separately (onlyHierarchy = "on" indicates that the description is only for the structure).

(Content structure description)
<zoomObject id = "zoom1" onlyHierarchy = "on">
<text id = "text1"> 1. Improvements of new teaching materials </ text>
<text id = "text2"> Ask participants to give feedback on the content of the material. </ text>
<zoomObject id = "zoom2" onlyHierarchy = "on">
<text id = "text3"> How can I get new things out one after another,
How can I get it used over and over again (problem) </ text>
<zoomObject id = "zoom3" onlyHierarchy = "on">
<text id = "text4"> Development needs to be made in a slightly shorter span. </ text>
<text id = "text5"> I will update every 3 months. </ text>
.......
</ zoomObject>
<zoomObject id = "zoom4" onlyHierarchy = "on">
<video id = "video1" src = "meeting 11.mpg"/>
</ zoomObject>
</ zoomObject>
<zoomObject id = "zoom5" onlyHierarchy = "on">
<text id = "text10"> First time with interpreter memo in step 6 .... </ text>
.......
</ zoomObject>
.......
</ zoomObject>

(Zooming description for zooming operation / behavior)
<zoomObject id = "zoom1" initZoomFactor = "0.0" relatedTo = "children: 0.8">
<div zoomFactor = "0.0 1.0">
<dispText id = "disptext1" textId = "text1" textSize = "12pt 14pt"/>
<dispText id = "disptext2" textId = "text2" textSize = "12pt 14pt"/>
</ div>
</ zoomObject>

<zoomObject id = "zoom2" initZoomFactor = "0.0" relatedTo = "children: 0.8">
<div zoomFactor = "0.0 1.0">
<dispText id = "disptext5" textId = "text3" textSize = "11pt"/>
</ div>
</ zoomObject>

<zoomObject id = "zoom3" initZoomFactor = "0.0" relatedTo = "brother: -0.5">
<div zoomFactor = "0.1 1.0">
<dispText id = "disptext6" textId = "text4" textSize = "8pt 10pt"/>
<dispText id = "disptext7" textId = "text5" textSize = "8pt 10pt"/>
.......
</ div>
</ zoomObject>

<zoomObject id = "zoom4" initZoomFactor = "0.0" relatedTo = "brother: -0.5">
<div zoomFactor = "0.1 0.4">
<dispVideo id = "dispvideo1" videoId = "video1" start = "0" end = "0" videoSize = "20% 50%"/>
</ div>
<div zoomFactor = "0.4 1.0">
<dispVideo id = "dispvideo2" videoId = "video1" start = "0" end = "900" videoSize = "50% 100%"/>
</ div>
</ zoomObject>

  According to the structure description of this content, zoom1 is at the top, zoom2, zoom5, etc. are below it, and zoom3, zoom4 are further below zoom2. Zoom3 is composed of a plurality of texts (text4, text5, etc.), and zoom4 is composed of one moving image (video1).

  Also, according to the zooming description regarding zooming operation / behavior, zoom1, zoom2, zoom3, and zoom4 all have an initial zoom ratio of 0.0, but the first two display text (text1, text2, text3) from the beginning. On the other hand, nothing is displayed for the latter two (this corresponds to the initial state of FIG. 1).

  Here, when zoom2 is zoomed in, it propagates to the zoom target of the child hierarchy (relatedTo = "children: 0.8" indicates that the zoom propagates to all the child hierarchies with a zoom ratio of 0.8). When zoom2 zoom ratio increases, zoom3 and zoom4 zoom ratios increase by 0.8 (when zoom2 zoom ratio changes +0.5, zoom3 and zoom4 change +0.4, respectively) and reach 0.1 Then, text4, text5, etc. and video1 are displayed (see FIG. 2). This is an example of media expansion because moving image information is added to text information. However, for video1, only frame 0 is still displayed here.

  If zoom2 is zoomed in further from this state, the zoom rate of zoom3 and zoom4 will also increase, and the font size of text4, text5 and other will increase. At the same time, the display size of video1 is enlarged, and when zoom4 of zoom4 reaches 0.4, frames 0 to 900 of video1 are reproduced (FIG. 3, example of change in detail).

  If zoom2 is zoomed out in the state shown in FIG. 3, zoom3 and zoom4 are zoomed out together to the state shown in FIG. 2 contrary to the case of zooming in. When each zoom ratio becomes 0.1 or less, text4, text5, etc. And video1 disappear from the screen and return to the state of FIG. Alternatively, if the operation is forcibly returned to the initial state, the state shown in FIG. 1 is restored from any display state.

  Next, an example of zoom propagation when the zoom ratio relationship is a negative value will be described.

  FIG. 4 is an explanatory diagram illustrating an example of screen transition in browsing multimedia contents. FIG. 4 shows the result of zooming in on the multimedia content object B shown in FIG. As shown in FIG. 4, when the zoom-in operation is performed on the object B of the multimedia content, the font size of the object B is enlarged, but the display size of the object C is reduced.

In the above zooming description on zooming operation / behavior, both zoom3 and zoom4
relatedTo = "brother: -0.5"
There is a description. This indicates that zoom propagation occurs between zoom targets having a common parent. A negative zoom ratio relationship indicates that zooming in on one zooms out the other. Therefore, if only zoom3 is selected from the state of FIG. 3 and zoomed in, zoom4 is zoomed out (text4, text5, etc. are further enlarged, and video1 is conversely reduced (see FIG. 4)).

  The above is the outline of screen transition in browsing multimedia contents.

[2. Description of content editing device]
According to the zooming description as described above, when one media object (text, still image, moving image, audio, etc.) is zoomed, other media objects (text, still image, moving image, audio, etc.) are linked with it. Since it is possible to describe zoom propagation between zooming objects to be zoomed, natural zooming from one zoom object to another zoom object can be performed. However, when describing a structure description and a zooming description in an XML-based language as described above, it is generally quite troublesome and difficult to manually describe an XML script.

  In view of this, the content editing apparatus according to the present embodiment edits a zooming operation / behavior for multimedia content, and outputs the result in a zooming description language format.

[2-1. Hardware configuration of content editing device]
FIG. 5 is a block diagram showing a configuration of the content editing apparatus 1 according to the embodiment of the present invention. A content editing apparatus 1 according to the present embodiment is mainly composed of a personal computer, and includes a CPU (Central Processing Unit) 2 that performs information processing, a ROM (Read Only Memory) that stores a BIOS (Basic Input Output System), and the like. ) 3, RAM (Random Access Memory) 4 that temporarily stores information during processing, HDD (Hard Disk Drive) 5 that is a storage unit that stores application programs and processing results, and information is stored outside Alternatively, a network interface 8 for connecting to a drive 6a of a removable medium 6 which is a storage medium for distributing or obtaining information (application program etc.) from the outside and a network N for communicating with other external electronic devices. And a display 9 which is a display unit for displaying the process progress and process result to the user, and an operator Is composed of a input unit such as a keyboard 10 and a mouse 11 for Ntsu enter commands and information to the editing device 1, the data communication between the bus controller 12 is operating in the arbitration.

  The removable medium 6 includes a magnetic storage medium such as a flexible disk, a hard disk, and a magnetic tape, a magneto-optical storage medium such as an MO, a CD, a CD-ROM, a CD-R, a CD-RW, Various storage media such as optical storage media such as DVD-ROM, DVD-R, DVD-RAM, DVD-RW, DVD + RW, and semiconductor memory can be applied.

  In the data transmission, the network interface 8 outputs a signal to the network N by sending data to the network interface 8 of the content editing apparatus 1. Further, regarding the signal received by the network interface 8, it is determined whether or not it is necessary in the network interface 8, and processing such as fetching if necessary data and discarding if unnecessary is performed. That is, all data transmission / reception is performed via the network interface 8.

  In general, when the user turns on the power of the content editing apparatus 1, the CPU 2 activates a program called a loader included in the BIOS in the ROM 3, and the hardware of the content editing apparatus 1 called the operating system (OS) from the HDD 5. A program for managing software is read into the RAM 4. When the OS is activated, it supports activation of application programs, reading of information, storage, and the like in accordance with user operations. As typical OS, Windows (registered trademark of Microsoft Corporation), UNIX (registered trademark of X / Open, Inc.) and the like are known. Programs that run on these OSs are called application programs. The application program is not limited to one that runs on a predetermined OS, and may be one that causes the OS to execute some of the various processes described below, or constitutes predetermined application software, an OS, or the like. It may be included as part of a group of program files.

  In general, an application program installed in the HDD 5 of the content editing apparatus 1 is recorded in the removable medium 6, and the application program recorded in the removable medium 6 is installed in the HDD 5. For this reason, the removable medium 6 can also be a storage medium for storing application programs. Furthermore, the application program may be taken in from the outside via, for example, the network interface 8 and installed in the HDD 5.

  In the content editing apparatus 1, when an application program running on the OS is activated, the CPU 2 executes various arithmetic processes according to the application program, and controls each unit intensively.

[2-2. Content editing process in content editing device]
Next, content editing processing that is characteristic processing of the present embodiment among various arithmetic processing executed by the CPU 2 of the content editing device 1 will be described below. Schematically, the characteristic content editing process of the present embodiment is such that a zooming operation / behavior for multimedia content is edited, and the result can be output in the form of a zooming description language. .

  The content editing apparatus 1 stores a content editing program in the HDD 5 as an application program. That is, in the content editing apparatus 1, when a content editing program operating on the OS is started, the CPU 2 controls each unit and executes content editing processing according to the content editing program.

  FIG. 6 is a block diagram illustrating a functional configuration related to the content editing process of the content editing apparatus 1. As shown in FIG. 6, the content editing apparatus 1 implements a content conversion unit 21, a zoom behavior setting unit 22, and a content display unit 23 when the CPU 2 follows a content editing program that runs on the OS. Hereinafter, each part is explained in full detail.

[2-2-1. Content conversion means]
The content conversion unit 21 sets the zoom target structure in the content and zoom ratio so that zooming can be applied to content structured in XML (Extensible Markup Language) and HTML (Hyper Text Markup Language). The setting of the correspondence between the display state of the zoom target and the zoom target, the setting of the layout of the media object inside the zoom target, and the setting of zoom propagation between the zoom targets are automatically performed. Note that such a structured content description is input via the network N or the removable medium 6. More specifically, the terminal node of the content having a tree structure is classified according to the type of the corresponding media object, and the correspondence between the zoom ratio and the display state is automatically set according to the classification. On the other hand, with respect to a non-terminal node, a zoom target is automatically set that is composed of media objects corresponding to each terminal node lower than the non-terminal node and positions the non-terminal node lower than the non-terminal node as a lower zoom target. . Further, zoom propagation from the upper zoom target to the lower zoom target is automatically set.

  A processing operation in the content conversion unit 21 will be described based on a description example of structured content described in XML.

(Structured content description)
<Session session_no = "1">
<DATESTAMP> 04-10-01 </ DATESTAMP>
<BASIC_INFO> Customer: __; Device: ipsio4500; CE: __; </ BASIC_INFO>
<DESCRIPTION> Problem: noise in the output image </ DESCRIPTION>
<DATAITEMS>
<DATAITEM session_no = "1">
<VIDEO> videofile1-1-1-1.wmv </ VIDEO>
<TEXT> service condition video </ TEXT>
</ DATAITEM>
<DATAITEM session_no = "1">
<IMAGE> imgfile1-1-1-2.jpg </ IMAGE>
<TEXT> printout sample </ TEXT>
</ DATAITEM>
</ DATAITEMS>
</ Session>

Among these, the following description corresponds to the terminal node.
<DATESTAMP> 04-10-01 </ DATESTAMP>
<BASIC_INFO> Customer: __; Device: ipsio4500; CE: __; </ BASIC_INFO>
<DESCRIPTION> Problem: noise in the output image </ DESCRIPTION>
<VIDEO> videofile1-1-1-1.wmv </ VIDEO>
<TEXT> service condition video </ TEXT>
<IMAGE> imgfile1-1-1-2.jpg </ IMAGE>
<TEXT> printout sample </ TEXT>

  For these, a file without an extension is regarded as text, and a file with an extension is regarded as a corresponding media object. For example, “.jpg”, “.gif”, “.tiff”, etc. are still images, “.mpg”, “.wmv”, “.avi”, etc. are moving images, “.mp3”, “.wav”, etc. are audio, etc. Is considered text. For each media object, a font size for text, a still image size for still images, a moving image size and playback section for moving images, and a playback section for audio are automatically set.

  On the other hand, in the above description, the non-terminal node is associated with the zoom target. At that time, corresponding to the original tree structure, media objects constituting each zoom target and zoom targets positioned below the media object are automatically set. Furthermore, zoom propagation from the upper zoom target to the lower zoom target is also automatically set.

  As a result, the above-described structured content description is converted into, for example, the following zoom description language.

(Zooming description language)
<zoomObject id = ”zoom-1-1” initZoomFactor = ”0.0” relatedTo = ”children: 0.5” relativeLayout = ”vertical”>
<div zoomFactor = ”0.0 1.0”>
<dispText id = ”txt-1-1-1” fontSize = ”8pt 14pt”> 04-10-01 </ dispText>
<dispText id = ”txt-1-1-2” fontSize = ”8pt 14pt”> Customer: __; Device: ipsio4500; CE: __; </ dispText>
<dispText id = ”txt-1-1-3” fontSize = ”8pt 14pt”> Problem: noise in the output image </ dispText>
</ div>
<zoomObject id = ”zoom-1-1-4” initZoomFactor = ”0.0” relatedTo = ”children: 0.5” relativeLayout = ”vertical”>
<zoomObject id = ”zoom-1-1-4-1” initZoomFactor = ”0.0” relatedTo = ”children: 0.5” relativeLayout = ”vertical”>
<div zoomFactor = ”0.0 1.0”>
<dispVideo id = ”vid-1-1-4-1-1” src = ”videofile1-1-1-1.wmv” star t = ”0” en d = ”200” videoSize = ”50% 100%” />
<dispText id = ”txt-1-1-4-1-2” fontSize = ”8pt 14pt”> service condition video </ dispText>
</ div>
</ zoomObject>
<zoomObject id = ”zoom-1-1-4-2” initZoomFactor = ”0.0” relatedTo = ”children: 0.5” relativeLayout = ”vertical”>
<div zoomFactor = ”0.0 1.0”>
<dispImg id = ”img-1-1-4-2-1” src = ”imgfile1-1-1-2.jpg” imgSize = ”10% 100%” />
<dispText id = ”txt-1-1-4-2-2” fontSize = ”8pt 14pt”> printout sample </ dispText>
</ div>
</ zoomObject>
</ zoomObject>
</ zoomObject>

  Here, the original description <Session session_no = ”1”> is converted into a zoom target <zoonObject id = ”zoom-1-1” />, which is <dispText id = ”txt-1-1-1 “/>, <DispText id =” txt-1-1-2 ”/>, <dispText id =” txt-1-1-3 ”/>. Each text is set by default so that the font size is enlarged from 8 pt to 14 pt while the zoom rate is changed from 0.0 to 1.0.

  <zoonObject id = ”zoom-1-1” /> has <zoonObject id = ”zoom-1-1-4” /> in the lower level (corresponding to <DATAITEMS> in the original description), and in the lower level, <zoonObject id = ”zoom-1-1-4-1” /> and <zoonObject id = ”zoom-1-1-4-2” /> (both in the original <DATAITEM session_no = ”1”> Correspondence). However, there is no media object directly included in <zoonObject id = ”zoom-1-1-4” />.

  <zoonObject id = ”zoom-1-1-4-1” /> is a moving image media object <dispVideo id = ”vid-1-1-4-1-1” /> and <dispText id = ”txt -1-1-4-1-2 "/> is composed of text media objects. The former always plays back the first 200 frames while the zoom ratio changes from 0.0 to 1.0, and the original image size It defaults to scale from 50% to 100% of the size. For text, the behavior is the same as <dispText id = ”txt-1-1-1” /> above.

  <ZoonObject id = ”zoom-1-1-4-2” /> is a <dispImg id = ”vid-1-1-4-2-1” /> static image media object and <dispText id = It consists of text media object “txt-1-1-4-2-2” />. The former increases the image size from 10% to 100% of the original size while the zoom ratio changes from 0.0 to 1.0. Is set as default. For text, the behavior is the same as <dispText id = ”txt-1-1-1” /> above.

  The zoom propagation is set by default so that zoom propagation is performed from the upper zoom target to the lower zoom target with a zoom ratio of 0.5.

  Note that the settings of the zoom rate and the display state of each media object (font size, still image size, moving image size, moving image playback section) are not limited to the values shown in the above example. The zoom ratio relationship in zoom propagation is not limited to this value.

  By using the conversion function realized by the content conversion means 21, an effect of saving the trouble of writing down the zooming description language from the beginning occurs.

[2-2-2. Zoom behavior setting means]
The zoom behavior setting means 22 controls the configuration of the zoom target of the content, the setting of the zoom ratio and display state, the setting of zoom propagation, and the like, and is used when the behavior automatically set by the content conversion means 21 is changed. Is. As shown in FIG. 6, the zoom behavior setting unit 22 includes a zoom target setting unit 221, a zoom rate setting unit 222, a layout setting unit 223, and a zoom propagation setting unit 224. It can be selectively executed. The selection of each means is executed by displaying a button related to each means on the display 9 and clicking the button with the mouse 11 although not shown.

(1) Zoom Target Setting Unit The zoom target setting unit 221 can edit the configuration of an object to be zoomed. Specifically, two zoom targets can be combined and set as one zoom target. The “zoom target” is a unit that is a target of the zoom operation, and is composed of “media objects” of text, still images, moving images, and audio that constitute the content.

  When execution of the zoom target setting unit 221 is selected, a window W1 shown in FIG. A sub-window SW1 (lower part of the title “Structure Edit”) of the window W1 shown in FIG. 7 is a structure edit screen. On this structure editing screen, the id of each zoom target constituting the content and the hierarchical structure between the zoom targets are displayed.

  In “Structure Edit” of the sub-window SW1 of the window W1 shown in FIG. 7, when a certain zoom target is selected and dragged and dropped with the mouse 11 to another zoom target, the former is combined with the latter to become one zoom target. . For example, as shown in FIG. 7, by selecting id = “1-1-1-2” and dragging and dropping it to id = “1-1-1-1”, id = “1-1” Id = ”1-1-1-2” can be combined with -1-1 ”.

  Here, an example in which the part below the id = “1-1-1” is described in the zooming description language is shown below.

(Zooming description language description example)
<zoomObject id = ”1-1-1”>
<zoomObject id = ”1-1-1-1”>
<div zoomFactor = ”0.0 0.5”>
<dispVideo id = ”video1-1-1-1-1” src = ”Animals1.wmv” start = ”0” end = ”100” videoSize = ”5.0% 52.5%”>
</ dispVideo>
</ div>
<div zoomFactor = ”0.5 1.0”>
<dispVideo id = "video1-1-1-1-2" src = ”Animals1.wmv” start = ”0” end = ”100” videoSize = ”52.5% 100.0%”>
</ dispVideo>
<dispText id = ”text1-1-1-1-1” src = ”” fontSize = ”8pt 14pt”>
Animal 1
</ dispText>
</ div>
</ zoomObject>
<zoomObject id = ”1-1-1-2”>
<div zoomFactor = "0.0 0.5">
<dispVideo id = ”video1-1-1-2-1” src = ”Animals2.wmv” start = ”0” end = ”100” videoSize = ”5.0% 52.5%”>
</ dispVideo>
</ div>
<div zoomFactor = ”0.5 1.0”>
<dispVideo id = ”video1-1-1-2-2” src = ”Animals2.wmv” start = ”0” end = ”100” videoSize = ”52.5% 100.0%”>
</ dispVideo>
<dispText id = ”text1-1-1-2-1” src = ”” fontSize = ”8pt 14pt”>
Animal 2
</ dispText>
</ div>
</ zoomObject>
<zoomObject id = ”1-1-1-3”>
<div zoomFactor = ”0.0 0.5”>
<dispVideo id = ”video1-1-1-3-1” src = ”Animals3.wmv” start = ”0” end = ”100” videoSize = ”5.0% 52.5%”>
</ dispVideo>
</ div>
<div zoomFactor = ”0.5 1.0”>
<dispVideo id = ”video1-1-1-3-2” src = ”Animals3.wmv” start = ”0” end = ”100” videoSize = ”52.5% 100.0%”>
</ dispVideo>
<dispText id = ”text1-1-1-3-1” src = ”” fontSize = ”8pt 14pt”>
Animal 3
</ dispText>
</ div>
</ zoomObject>
</ zoomObject>

  id = ”1-1-1” includes id = ”1-1-1-1”, id = ”1-1-1-2” and id = ”1-1-1-3” Also consists of video and text. Here, in “Structure Edit” of the sub-window SW1 of the window W1 shown in FIG. 7, “id =“ 1-1-1-2 ”is selected, and this is dragged to id =“ 1-1-1-1 ”. When dropped, only id = “1-1-1-1” is obtained as shown in FIG. By this combination, the description example of the zooming description language is converted as follows.

(Example of zooming description language after editing)
<zoomObject id = ”1-1-1”>
<zoomObject id = ”1-1-1-1”>
<div zoomFactor = ”0.0 0.5”>
<dispVideo id = ”video1-1-1-1-1” src = ”Animals1.wmv” start = ”0” end = ”100” videoSize = ”5.0% 52.5%”>
</ dispVideo>
<dispVideo id = ”video1-1-1-1-2” src = ”Animals2.wmv” start = ”0” end = ”100” videoSize = ”5.0% 52.5%”>
</ dispVideo>
</ div>
<div zoomFactor = ”0.5 1.0”>
<dispVideo id = ”video1-1-1-1-3” src = ”Animals1.wmv” start = ”0” end = ”100” videoSize = ”52.5% 100.0%”>
</ dispVideo>
<dispText id = ”text1-1-1-1-1” src = ”” fontSize = ”8pt 14pt”>
Animal 1
</ dispText>
<dispVideo id = ”video1-1-1-1-4” src = ”Animals2.wmv” start = ”0” end = ”100” videoSize = ”52.5% 100.0%”>
</ dispVideo>
<dispText id = ”text1-1-1-1-2” src = ”” fontSize = ”8pt 14pt”>
Animal 2
</ dispText>
</ div>
</ zoomObject>
<zoomObject id = ”1-1-1-3”>
<div zoomFactor = ”0.0 0.5”>
<dispVideo id = ”video1-1-1-3-1” src = ”Animals3.wmv” start = ”0” end = ”100” videoSize = ”5.0% 52.5%”>
</ dispVideo>
</ div>
<div zoomFactor = ”0.5 1.0”>
<dispVideo id = ”video1-1-1-3-2” src = ”Animals3.wmv” start = ”0” end = ”100” videoSize = ”52.5% 100.0%”>
</ dispVideo>
<dispText id = ”text1-1-1-3-1” src = ”” fontSize = ”8pt 14pt”>
Animal 3
</ dispText>
</ div>
</ zoomObject>
</ zoomObject>

  That is, id = “1-1-1-1” before the combination is from the video “Animals1.wmv” and the text “Animal 1”, and id = “1-1-1-2” is the video “Animals2.wmv” ”And the text“ Animal 2 ”, but after the combination, id =“ 1-1-1-1 ”becomes the video“ Animals1.wmv ”and“ Animals1.wmv ”and the text“ Animal 1 ”. ”And“ Animal 2 ”.

(2) Zoom rate setting unit The zoom rate setting unit 222 can set the correspondence between the zoom rate and the display state for each media object constituting the zoom target (display / non-display, font size and image). Size setting, moving image playback section, etc.). At that time, for the font size, still image / moving image size, and playback section, it is sufficient to set only the zoom rate at which the tendency of the change or the zoom rate at which display / non-display is switched. The display state is automatically interpolated. The zoom rate is a value representing the degree of zoom of each zoom target, and takes a value from 0.0 to 1.0 continuously.

a. Text Zoom Rate Setting Example FIG. 9 is a front view showing an example of a window W2 for setting the correspondence between the text zoom rate and the display state. As shown in the window W2 which is an editing screen for setting the correspondence between the zoom ratio of the text and the display state, the zoom ratio is obtained by pressing and pressing the button B1 of the “zoom ratio” at the top row. Can be set to display the target text (in FIG. 9, it is set to display at a zoom ratio of 0.5 to 1.0). Also, by setting the middle “div setting” check box CB1 to ON, the font size at the zoom ratio can be set. This corresponds to the description of the <div /> tag in the zoom description language (in FIG. 9, the setting is to describe the <div /> tag when the zoom ratio is 0.5 and 1.0). Furthermore, the font size is set in “Size” in the lower row at the zoom ratio with the div setting set to on.

With this setting, the following description is generated.
<div zoomFactor = ”0.5 1.0”>
<dispText id = ”text1-1-1-4-1” src = ”” fontSize = ”8pt 24pt”>
Animals 4
</ dispText>
</ div>

  In FIG. 9, by pressing the “automatic calculation” button B2, the font size at the zoom rate at which the div setting is off is automatically calculated. This automatic calculation is performed so that the font size set at the zoom rate with the div setting on is used as end point information, and the size change therebetween is smoothly interpolated. The calculation result is reflected in the “size” column and the lower graph G1.

  As described above, the zoom rate setting means 222 reduces the trouble of editing by setting only the zoom rate at which the tendency of the font size changes or the zoom rate at which display / non-display is switched. By automatically interpolating the font size at the zoom rate, the editor can easily grasp the display state.

  The font size can also be changed by pointing and moving the graph G1 displayed in the window W2 with the mouse 11.

b. Still Image Zoom Rate Setting Example FIG. 10 is a front view showing an example of a window W3 for setting the correspondence between the still image zoom rate and the display state. As shown in window W3, which is an editing screen for setting the correspondence between the zoom ratio of still images and the display state, for "zoom ratio" and "div setting", the correspondence between the zoom ratio of text and the display state described above is set. As in the case of the window W2, the ratio of the still image to the original size is set for “size”.

  In the example of FIG. 10, still images are displayed at all zoom ratios, and the zoom ratio from 0.0 to 0.4 is set to 5.0% of the original size, and from 0.4 to 1.0 is set to smoothly expand to reach 100.0%. ing. Again, just as with text, you only need to set a zoom factor that changes the trend of size change or a zoom factor that switches between display and non-display (set only zoom factor 0.0, 0.4, 1.0), and between them Are interpolated and displayed by the “automatic calculation” button B2.

  It is also possible to change the “size” that is the ratio of the still image to the original size by pointing and moving the graph G2 displayed in the window W3 with the mouse 11.

The description generated by this is shown below.
<div zoomFactor = ”0.0 0.4”>
<dispImg id = ”img1-1-1-5-1” src = ”Machine.jpg” imgSize = ”5.0% 5.0%”>
</ dispImg>
</ div>
<div zoomFactor = ”0.4 1.0”>
<dispImg id = ”img1-1-1-5-2” src = ”Machine.jpg” imgSize = ”5.0% 100.0%”>
</ dispImg>
</ div>

  By the way, the definition setting of the zoom ratio of the still image can be performed on a window W4 which is an editing screen as shown in FIG. In the window W4 shown in FIG. 11, the zoom rate is designated by the position of the slide bar SB1, the lower image size is pointed with the mouse 11, and directly enlarged and reduced by drag and drop to change the zoom rate and display. The correspondence with the size can be defined. As a result, the correspondence between the zoom ratio and the still image size can be visually and continuously captured, which is easy for the editor to understand.

  The “size” setting is not limited to the ratio with respect to the original, and may be anything that can uniquely set the image size, such as the number of vertical and horizontal pixels of the still image.

c. Example of Moving Image Zoom Ratio Setting FIG. 12 is a front view showing an example of a window W5 for setting the correspondence between the moving image zoom ratio and the display state. As shown in the window W5 which is an editing screen for setting the correspondence between the zoom ratio of the moving image and the display state, the “zoom ratio”, “div setting”, and “size” are the zoom ratio and display of the still image described above. This is similar to the case of the window W3 for setting the state correspondence. In addition, the window W5 is provided with a “start frame” column and an “end frame” column for setting a playback section of a moving image. In the “start frame” field and the “end frame” field, only the zoom rate at which the div setting is on is set. In the “start frame” column, a moving image reproduction start frame at the zoom rate is set, and in the “end frame” column, a moving image reproduction end frame at the zoom rate is set.

  In the example of FIG. 12, moving images are displayed at all zoom rates, and only the first frame (0th frame) is displayed in a stationary state at a zoom rate of 0.0 to 0.3 with an original size of 5.0%. After that, when the zoom ratio was from 0.3 to 0.6, the size gradually increased while playing from 0 frame to 50 frames, reaching 60.0%, and after that, the original zoom ratio of 1.0 was played while playing from 0 frame to 100 frames. Reach 100.0%.

  Again, just as with text and still images, you only need to set the zoom rate at which the size or playback section changes, or the zoom rate at which display / non-display is switched (zoom rate 0.0, 0.3, 1.0). Between them, the “automatic calculation” button B2 interpolates and displays them. However, for the playback section, the set value at the maximum zoom ratio that does not exceed the zoom ratio of interest within the set zoom ratio is copied as it is (in the example of FIG. 12, the zoom ratio of 0.3 to 0.5 has a zoom ratio of 0.3). Copy the playback section).

  It is also possible to change the “size” that is the ratio of the moving image to the original size by pointing and moving the graph G3 displayed in the window W5 with the mouse 11.

The description generated by this is shown below.
<div zoomFactor = ”0.0 0.3”>
<dispVideo id = ”video1-1-1-6-1” src = ”Animals.wmv” start = ”0” end = ”0” videoSize = ”5.0% 5.0%”>
</ dispVideo>
</ div>
<div zoomFactor = ”0.3 0.6”>
<dispVideo id = ”video1-1-1-6-2” src = ”Animals.wmv” start = ”0” end = ”50” videoSize = ”5.0% 60.0%”>
</ dispVideo>
</ div>
<div zoomFactor = ”0.6 1.0”>
<dispVideo id = ”video1-1-1-6-3” src = ”Animals.wmv” start = ”0” end = ”100” videoSize = ”60.0% 100.0%”>
</ dispVideo>
</ div>

  By the way, the definition setting of the zoom ratio of the moving image can be performed in the window W6 which is an editing screen as shown in FIG. In the window W6 shown in FIG. 13, the zoom rate is designated by the position of the slide bar SB2, and the lower image size is pointed with the mouse 11 and directly enlarged / reduced and changed by drag and drop to display the zoom rate and display. The correspondence with the size can be defined. As a result, the correspondence between the zoom ratio and the moving image size can be grasped visually and continuously, so that the editor can easily understand.

  The “size” setting is not limited to the ratio with respect to the original, and may be anything that can uniquely set the image size, such as the number of vertical and horizontal pixels of the moving image. Also, the playback section is not limited to the “start frame” and “end frame”, but may be any as long as the playback range can be set uniquely, such as “start time” and “end time”.

(3) Layout setting means In the case of a zoom target composed of a plurality of media objects, the layout setting means 223 can set whether the layout of the media objects is arranged vertically or horizontally. For example, when the layout to be zoomed consisting of video and text is set in a vertical arrangement, as shown in FIG. 14, the “vertical arrangement” radio button RB1 of “layout” is pointed and selected with the mouse 11, and the horizontal arrangement is performed. In this case, as shown in FIG. 15, the “horizontal” radio button RB2 is pointed with the mouse 11 and selected.

In the case of FIG. 14, the following description is output.
<zoomObject id = ”1-1-1-1” relativeLayout = ”vertical”>
<div zoomFactor = ”0.0 1.0”>
<dispVideo id = ”video1-1-1-1-1” src = ”Animals.wmv” start = ”0” end = ”200” videoSize = ”5.0% 100.0%”>
</ dispVideo>
<dispText id = ”text1-1-1-1-1” src = ”” fontSize = ”8pt 24pt”>
Animal 1
</ dispText>
</ div>
</ zoomObject>

In the case of FIG. 15, the following description is output.
<zoomObject id = ”1-1-1-1” relativeLayout = ”horizontal”>
<div zoomFactor = ”0.0 1.0”>
<dispVideo id = ”video1-1-1-1-1” src = ”Animals.wmv” start = ”0” end = ”200” videoSize = ”5.0% 100.0%”>
</ dispVideo>
<dispText id = ”text1-1-1-1-1” src = ”” fontSize = ”8pt 24pt”>
Animal 1
</ dispText>
</ div>
</ zoomObject>

(4) Zoom propagation setting means “Zoom propagation” means that when a zoom target is zoomed, the other zoom targets are also zoomed together (for example, when a zoom target at a higher level is zoomed, the lower level is also zoomed simultaneously). In zoom propagation, the propagation destination zoom rate is calculated from the zoom rate of the propagation source zoom target based on a predetermined “zoom rate relationship” to control the display state of the propagation destination zoom target. Here, the zoom rate relationship is a value that represents the ratio of the change rate of the zoom rate between the propagation source and the propagation destination (if the zoom rate relationship is 0.8, the propagation destination is changed by 0.4 when the propagation source zoom rate changes by 0.5. ). The zoom propagation setting means 224 can set these.

  When execution of the zoom propagation setting unit 224 is selected, a window W1 shown in FIG. 16 similar to FIG. A sub-window SW2 (lower part of the title “propagation edit”) of the window W1 shown in FIG. 16 is a propagation edit screen. With this subwindow SW2, the zoom ratio relationship can be set. A sub-window SW2 of the window W1 shown in FIG. 16 is an editing screen for setting zoom propagation with a zoom target id = “1-1” as a propagation source. In the sub window SW2, the zoom ratio of the propagation source zoom object when the propagation destination zoom object appears or the relative relationship of the zoom ratio change is set in association with the position of the line segment and the ratio of the length. In FIG. 16, the display is performed from the state in which all the zoom targets simultaneously have a zoom ratio of 0.

Here, it is assumed that the line segment corresponding to id = “1-1-1” is moved and changed as shown in FIG. In this way, when id = ”1-1” zoom ratio is 0.0, id = “1-1-1” is not displayed, and when id = “1-1” becomes 0.3, id The zoom factor of “1-1-1” is set to 0.0 for the first time and display starts. A description generated for id = “1-1” by the change shown in FIG. 17 is shown below.
<zoomObject id = ”1-1” relatedTo = ”children: 0.80” />

Further, when the cursor is moved as shown in FIG. 18, when the zoom rate of id = “1-1” becomes 1.0, the zoom rate of id = “1-1-1” is 0.7. It can be seen that the ratio of the zoom rate change rate (the zoom rate relationship from id = “1-1” to id = “1-1-1”) is set to 1.0. This description is output as follows:
<zoomObject id = ”1-1” relatedTo = ”children: 1.00” />

Here, it is assumed that the line segment corresponding to id = “1-1-1” is extended to the right as shown in FIG. Then, when id = “1-1” zoom ratio is 1.0, id = “1-1-1” zoom ratio is still 0.5, so the ratio of change rate of both zoom ratio is about 0, It can be seen that 71 is set. This description is output as follows:
<zoomObject id = ”1-1” relatedTo = ”children: 0.71” />

  As described above, since the zoom ratio of the propagation source zoom object when the propagation destination zoom object appears, or the relative relationship of the zoom ratio change can be set in association with the position of the line segment and the ratio of the length, It becomes easy to intuitively edit / understand the relative relationship between the propagation source and the propagation destination in zoom propagation.

  FIG. 20 is a window that is an editing screen for setting the association definition of zoom propagation with the zoom target id = “1-1” as the propagation source in the content having the hierarchy as shown in the structure editing sub-window SW2. W7 is shown.

  An upper area A1 in FIG. 20 is a part for setting propagation to a zoom target having a sibling relationship with id = “1-1”. “1-2” in “Associateable Items” is because id = “1-2” is a sibling with id = “1-1”, so zoom propagation from id = “1-1” Indicates that this is a previous candidate (but propagation has not been set up yet). Here, when the “>>” button B3 is pointed and pressed with the mouse 11, “1-2” is moved to “associated item” and is set as a propagation destination.

  A lower area A2 in FIG. 20 is a part for setting propagation to a zoom target that is a child of id = “1-1”. “1-1-1” in “Associated Items” means that id = ”1-1-1” is a child with id = “1-1” and has already been set as the propagation destination. Show.

  “Zoom factor” has the same meaning as “Zoom rate relationship” described above. Here, zoom propagation is set from id = “1-1” to id = “1-1-1” with a zoom rate relationship of 0.8. Yes. If the “<<” button B4 is pointed and pressed with the mouse 11, “1-1-1” moves to “items that can be associated” and the propagation relationship is canceled.

[2-2-3. Content display means]
The content display means 23 can interpret the zoom description language in order to confirm the description result of the zoom behavior set by the content conversion means 21 and the zoom behavior setting means 22, display the content according to the description, and A zoom operation / behavior according to the description can be realized. As a result, the content editing result can be immediately visually confirmed.

  As described above, according to the present embodiment, in the content conversion unit 21, the zoom rate and display state of each object to be zoomed constituting the content are determined based on the structured content description described in XML or HTML. The effect of saving the trouble of writing down the zoom description language from the beginning by generating and outputting the zoom description related to the zoom operation / behavior that describes at least one of the correspondence and the zoom propagation between the associated objects. Play.

  Further, the zoom behavior setting means 22 can easily edit the zooming operation / behavior of the content in the automatically created zooming description language to reflect the intention of the content creator.

It is a front view which shows an example of the multimedia content displayed on the display for demonstrating the outline | summary of the screen transition in the multimedia content browsing used as the premise of this invention. It is a front view which shows the result of having performed zoom-in operation with respect to the object A of the multimedia content shown in FIG. It is a front view which shows the result of having performed zoom-in operation with respect to the object A of the multimedia content shown in FIG. It is a front view which shows the result of having performed zoom-in operation with respect to the object B of the multimedia content shown in FIG. It is a block diagram which shows the structure of the content editing apparatus concerning one Embodiment of this invention. It is a block diagram which shows the function structure concerning a content edit process. It is a front view which shows an example of the window displayed when execution of a zoom object setting means is selected. It is a front view which shows an example of the window after structure editing work. It is a front view which shows an example of the window which sets the correspondence of the zoom rate of a text, and a display state. It is a front view which shows an example of the window which sets the correspondence of the zoom rate of a still image, and a display state. It is a front view which shows an example of the window at the time of the definition setting of the zoom rate of a still image. It is a front view which shows an example of the window which sets the response | compatibility with the zoom rate of a moving image, and a display state. It is a front view which shows an example of the window at the time of the definition setting of the zoom factor of a moving image. It is a front view which shows an example of the window in the case of setting the layout of the zoom object which consists of a video and a text vertically. It is a front view which shows an example of the window in the case of setting the layout of the zoom object which consists of a video and a text side by side. It is a front view which shows an example of the window displayed when execution of a zoom propagation setting means is selected. It is a front view which shows an example of the window after propagation editing work. It is a front view which shows an example of the window after propagation editing work. It is a front view which shows an example of the window after propagation editing work. It is a front view which shows an example of the window for performing the association definition setting of zoom propagation.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Content editing apparatus 21 Content conversion means 22 Zoom behavior setting means 23 Content display means 221 Zoom object setting means 222 Zoom rate setting means 223 Layout setting means 224 Zoom propagation setting means

Claims (27)

A zooming operation / description that describes at least one of the correspondence between the zoom ratio and display state of each object to be zoomed constituting the content and the zoom propagation between the associated objects based on the structured content description Content conversion means for generating and outputting a zooming description relating to behavior;
A content editing apparatus characterized by that. Comprising zoom behavior setting means for editing a zooming description relating to a zooming operation / behavior for each object to be zoomed constituting the content, and outputting the zooming description after editing.
A content editing apparatus characterized by that. Zoom behavior setting means for editing a zooming description relating to a zooming operation / behavior generated by the content conversion means, and outputting the edited zooming description;
The content editing apparatus according to claim 1. Content display means for displaying content according to the set zooming description and realizing a zooming operation / behavior according to the description,
The content editing apparatus according to any one of claims 1 to 3, wherein The content conversion means includes
Means for classifying the terminal nodes of the content having a tree structure according to the type of the corresponding object, and setting the correspondence between the zoom ratio and the display state according to the classification;
For a non-terminal node, a zoom target that is configured from objects corresponding to each terminal node below the non-terminal node and that positions a non-terminal node lower than the non-terminal node as a lower zoom target is set to a higher zoom. Means to set zoom propagation from the target to the lower zoom target;
The content editing apparatus according to claim 1, comprising at least one of the following. The zoom behavior setting means
Zoom target setting means for editing a configuration of an object that is a zoom target to be a zoom operation;
Zoom rate setting means for setting the correspondence between the zoom rate and the display state for each object constituting the zoom target;
In the case of a zoom target composed of a plurality of objects, layout setting means for setting whether the object layout is arranged vertically or horizontally;
Zoom propagation setting means for setting a zoom propagation relationship between the associated zoom targets;
The content editing apparatus according to claim 2, comprising at least one of the following. In the zoom rate setting means, only the zoom rate at which the change tendency of the zoom target changes or the zoom rate at which display / non-display is switched is set, and the other zoom rates are interpolated.
The content editing apparatus according to claim 6. The zoom ratio setting means defines and sets the correspondence between the zoom ratio and the display size by changing the image size by directly enlarging / reducing and changing the zoom ratio.
The content editing apparatus according to claim 6. The zoom propagation setting means sets the zoom source of the propagation source zoom target when the propagation destination zoom target appears or the relative relationship of the zoom rate change in association with the line segment position and length ratio.
The content editing apparatus according to claim 6. A zooming operation / description that describes at least one of the correspondence between the zoom ratio and display state of each object to be zoomed constituting the content and the zoom propagation between the associated objects based on the structured content description Causing the computer to execute a content conversion function that generates and outputs a zooming description of the behavior,
A content editing program characterized by that. Edit zooming description related to zooming operation / behavior for each object to be zoomed constituting the content, and cause the computer to execute a zoom behavior setting function for outputting the zooming description after editing.
A content editing program characterized by that. Editing a zooming description relating to a zooming operation / behavior generated by the content conversion function, and causing the computer to further execute a zoom behavior setting function for outputting the zooming description after editing;
The content editing program according to claim 10. Displaying the content according to the set zooming description and causing the computer to further execute a content display function for realizing a zooming operation / behavior according to the description;
The content editing program according to any one of claims 10 to 12, wherein the program is a content editing program. The content conversion function is
A function for classifying the terminal nodes of the content having a tree structure according to the type of the corresponding object, and setting the correspondence between the zoom ratio and the display state according to the classification;
For a non-terminal node, a zoom target that is configured from objects corresponding to each terminal node below the non-terminal node and that positions a non-terminal node lower than the non-terminal node as a lower zoom target is set to a higher zoom. A function to set zoom propagation from the target to the lower zoom target,
The content editing program according to claim 10, wherein at least one of the above is executed by a computer. The zoom behavior setting function
A zoom target setting function for editing a configuration of an object that is a zoom target to be a zoom operation;
A zoom ratio setting function for setting the correspondence between the zoom ratio and the display state for each object constituting the zoom target;
In the case of a zoom target composed of a plurality of objects, a layout setting function for setting whether the object layout is arranged vertically or horizontally, and
Zoom propagation setting function to set the zoom propagation relationship between the associated zoom targets,
The content editing program according to claim 11 or 12, wherein at least one of the above is executed by a computer. In the zoom rate setting function, only the zoom rate at which the change tendency of the zoom target changes or the zoom rate at which display / non-display is switched is set, and the other zoom rates are interpolated.
The content editing program according to claim 15, wherein: The zoom ratio setting function defines and sets the correspondence between the zoom ratio and the display size by changing the image size by directly enlarging / reducing and changing the zoom ratio.
The content editing program according to claim 15, wherein: The zoom propagation setting function sets the relative relationship between the zoom ratio of the propagation source zoom object or the zoom ratio change when the propagation destination zoom object appears, in association with the position of the line segment and the ratio of the length,
The content editing program according to claim 15, wherein: A zooming operation / description that describes at least one of the correspondence between the zoom ratio and display state of each object to be zoomed constituting the content and the zoom propagation between the associated objects based on the structured content description Including a content conversion process that generates and outputs a zooming description of the behavior,
A content editing method characterized by that. Including a zoom behavior setting step of editing a zooming description related to a zooming operation / behavior for each object to be zoomed constituting the content, and outputting the zooming description after editing.
A content editing method characterized by that. A zoom behavior setting step of editing a zooming description about the zooming operation / behavior generated by the content conversion step and outputting the edited zooming description;
20. The content editing method according to claim 19, wherein: A content display step for displaying the content according to the set zooming description and realizing a zooming operation / behavior according to the description;
The content editing method according to any one of claims 19 to 21, characterized in that: The content conversion step includes
Categorizing the end nodes of the tree-structured content according to the type of the corresponding object, and setting the correspondence between the zoom ratio and the display state according to the classification;
For a non-terminal node, a zoom target that is configured from objects corresponding to each terminal node below the non-terminal node and that positions a non-terminal node lower than the non-terminal node as a lower zoom target is set to a higher zoom. Setting zoom propagation from the target to the lower zoom target;
20. The content editing method according to claim 19, comprising at least one of the following. The zoom behavior setting process
A zoom target setting step for editing the configuration of an object that is a zoom target to be a zoom operation;
A zoom ratio setting step for setting a correspondence between the zoom ratio and the display state for each object constituting the zoom target;
In the case of a zoom target composed of a plurality of objects, a layout setting step for setting whether the object layout is arranged vertically or horizontally, and
A zoom propagation setting step for setting a zoom propagation relationship between the associated zoom targets;
The content editing method according to claim 20 or 21, comprising at least one of the following. In the zoom ratio setting step, only the zoom ratio at which the change tendency of the zoom target changes or the zoom ratio at which display / non-display is switched is set, and the other zoom ratio is interpolated.
25. The content editing method according to claim 24. In the zoom ratio setting step, the correspondence between the zoom ratio and the display size is defined and set by changing the image size by directly enlarging / reducing and changing the zoom ratio.
25. The content editing method according to claim 24. In the zoom propagation setting step, the zoom ratio of the propagation source zoom object or the relative relationship of the zoom ratio change when the propagation destination zoom object appears is set in association with the position of the line segment and the ratio of the length.
25. The content editing method according to claim 24.

Images