JP2697646B2 - Multimedia editing device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The present invention relates to a character / still image / audio /
The present invention relates to a multimedia editing device that creates an application by associating multimedia data including a moving image and the like.

[0002]

2. Description of the Related Art In a conventional multimedia editing apparatus, a logical structure of an application including a hypermedia structure is stored as a template, such as Authorware Star which is a multimedia editing apparatus of Macromedia, and a similar logical structure is used. When creating an application including a file, a method of designating a file name of a logical structure template to be reused from a list is implemented.

[0003]

In a conventional multimedia editing apparatus, when a logical structure of an application including a hypermedia structure is templated and reused,
Since only the file name of the template is a clue for the search, it is not possible to determine the structure of the template at the time of the search, and it has been difficult to specify the target template.

[0004] It is an object of the present invention to easily search for a template that matches or is similar to the logical structure of an application to be created while visually recognizing the structure when the logical structure of the application is made into a template and reused. It is in.

[0005]

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and has an input / output management system comprising an input device such as a keyboard / mouse / pen input device / touch panel and an output device such as a CRT display. And multimedia information for editing multimedia data to be presented on a screen and storing associations between multimedia data identifiers and media information including multimedia data types / presentation size on screen / time length, etc. Editing / storage unit, media information An identifier of any multimedia data stored in the editing / storage unit and media information, and information relating a presentation position / presentation time on the screen of the multimedia data, and the like, An application that describes screen state transitions and dialogue branches when presenting the multimedia data When a logical structure template creation command is received for a scenario creation / management unit for creating an application scenario, a scenario storage unit for storing the created scenario, and an application scenario created by an editor, a state transition of an application screen is performed. Template information creating unit for extracting logical structure information of a scenario including a branch or a branch due to dialogue, and simultaneously creating a schematic image that visually expresses the extracted logical structure information; logical structure information extracted by the template information creating unit Is a multimedia editing apparatus, comprising: a template storage unit that stores a template as a template; and a schematic image storage unit that stores a schematic image created by the template information creation unit.

[0006]

Next, a multimedia editing apparatus according to an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing a multimedia editing apparatus according to this embodiment.

In FIG. 1, the present embodiment employs a keyboard /
An input / output management unit 11 composed of an input device such as a mouse / pen input device / touch panel and an output device such as a CRT display, edits multimedia data to be presented on a screen, and outputs multimedia data identifiers and multimedia data. Media information editing / storage section 16 for storing association with media information including data type / presentation size on screen / time length, etc., and arbitrary multimedia data stored in media information editing / storage section 16 In addition to information relating the identifier and the media information and the presentation position / presentation time of the multimedia data on the screen, the state transition of the screen when presenting the multimedia data, the branching by dialog, and the like are described. Scenario creation / management unit 15 for creating an application scenario,
A scenario storage unit 17 for storing a created scenario. Upon receiving a logical structure template creation command for an application scenario created by an editor, the scenario logical structure including a state transition of an application screen, branching by dialogue, and the like. A template information creating unit 12 for extracting information and creating a schematic image that visually represents the logical structure information extracted at the same time, and a template storage unit 13 for storing the logical structure information extracted by the template information creating unit 12 as a template And a schematic image storage unit 14 for storing the schematic image created by the template information creation unit 12.

Next, the operation of this embodiment will be described with reference to FIGS. 1, 2, 3, 4, 5, 5, 6, 7, 8, and 9.

[0010] Application created by editor /
Each time it is edited, the scenario for that application is
It is stored in the scenario storage unit 17 in FIG. 1 as shown in FIG. The scenario referred to here is a set of multimedia data related to each other, which is activated when an event such as time lapse or user interaction occurs, in addition to information relating the multimedia data identifier and its presentation method. A description of the behavior of a hyperlink object. Specifically, the scenario identifier in the scenario storage unit 17 (scenario number in this embodiment), the screen identifier in each scenario (screen number in this embodiment), and the multimedia presented in each screen・
Data identifier (in FIG. 2, file name such as BKG1.bmp), data identification (in FIG. 2, GRP is a still image, AU
D is audio), presentation position on the screen (upper left coordinate in this embodiment), presentation size, presentation time (in this embodiment, the time at which the screen was presented is 0.0 seconds), presentation time length, and the like. In addition to the information, the identifier of the hyperlink object in each screen ("TIMER1" or "BUTTO" in FIG. 2)
N1 ”), identification indicating that the object is a hyperlink object instead of media information (“ LIN ”in FIG. 2).
K "), the position of the area to wait for the event (the upper left coordinate of the rectangular area in this embodiment), the size of the area to wait for the event, the time to start waiting for the event, the length of time to wait for the event, and the type of event to react to (for example, FIG. Information such as "DblClick" if the mouse is double-clicked, and the behavior when a reacting event occurs (for example, "Open0" in FIG. 2 if the screen transits to "Screen 0") are described.

First, a case will be described in which only the logical structure information of an application created by an editor is extracted and stored as a template.

When the editor creates / edits an application and stores the scenario of the application in the scenario storage unit 17, when the editor issues a logical structure template creation command for the scenario, the scenario creation / management unit 15 The scenario is stored in the scenario storage unit 1.
7 and the template information creating unit 12
Extracts the attribute of the object whose type is “LINK” as the logical structure information from the scenario that has received the instruction via the scenario creation / management unit 15. In the present embodiment, when the editor creates an application corresponding to the scenario of scenario number 2 in FIG. 2 and stores the scenario in the scenario storage unit 17, it is assumed that the editor issues a logical structure template creation command. explain. In this case, as shown in FIG. 3, the attributes of the five hyperlink objects are extracted as logical structure information. Where TI
MER is a hyperlink object activated by the passage of time, and BUTTON is a hyperlink object activated by a mouse click event. The information to be extracted as attributes include the identifier of the screen on which each hyperlink is arranged, the identifier of the hyperlink object, the position of the area to wait for the event, the size of the area to wait for the event, the time to start waiting for the event, and the time to wait for the event Length, type of reacting event, and behavior when a reacting event occurs.

Next, the template information creation unit 12 adds a new template identifier (template number in this embodiment) not stored in the template storage unit 13 to the extracted logical structure information as shown in FIG. A logical structure template is stored in the template storage unit 13. Further, the template information creating unit 12 automatically creates a schematic image that visually represents the extracted logical structure information, and adds a template identifier to the schematic image storage unit 14.
To memorize. FIG. 4 is an example of a logical structure template stored in the template storage unit 13. FIG. 5 is an example of a schematic image stored in the schematic image storage unit 14, in which an event based on time is realized by a solid line, an event by a user is realized by a dotted line, and an end point of a state transition is realized by a horizontal solid line. Also, 0, 1, and 2 mean screen numbers which are screen identifiers in the scenario.

Next, a case where the logical structure template stored in the template storage unit 13 is reused will be described.
The reusable templates include templates previously stored in the multimedia editing apparatus of the present invention, in addition to the above-described templates extracted from the application created by the editor.

First, the scenario creation / management section 15 displays a plurality of schematic images stored in the schematic image storage section 14 on a CRT display or the like of the input / output management section 11 as shown in FIG. When a schematic image expressing the structure closest to the logical structure of the application to be created is selected via a mouse or the like of the input / output management unit 11, the logical structure corresponding to the template identifier added to the selected schematic image The template is stored in the template storage unit 13
Automatically read from. Here, in the present embodiment, it is assumed that Template2 is selected by the editor from the two options as shown in FIG. 6 and a logical structure template as shown in the figure whose template number is “2” is read.

Next, the scenario creation / management unit 15 stores the media information list stored in the media information editing / storage unit 16 as shown in FIG.
Display on an RT display or the like. Here, it is assumed that such a list of media information is separately edited using a conventional method, and is already stored in the media information editing / storage unit 16. The editor designates an arbitrary data file name from the displayed list of media information as an object to be presented on each screen of the read logical structure template via the mouse / keyboard or the like of the input / output management unit 11. In the present embodiment, in the logical structure template shown in FIG. 4, the screen of screen number 0 is displayed as “BKG4.bm
p, “BT1.bmp” and “BT2.bmp” are presented, and “BKG2.bmp” and “N
AR1. AUD "and" BT3.bmp "are presented and assigned, and a new scenario as shown in FIG. 8 is created. At this time, “presentation position on screen” and “presentation time” which are not originally possessed as media information but are required in the scenario are “0, 0”,
It is set by default as "0.0". The created scenario is stored in the scenario storage unit 17. After this,
If necessary, edit such as matching the position / size of the rectangular area of the hyperlink object waiting for the click event with the presentation position / size of the graphics expressing the button by using the mouse / input / output management unit 11. This is performed via a keyboard or the like, and for example, the scenario of FIG. 8 is updated as shown in FIG. In the example of FIG. 9, “BT1.bm
"p" and "BT2.bmp" and the presentation time, and "BT3.bmp" on screen 1 and "BT3.bm" on screen 2
The presentation position of “p” has been changed, and the presentation time of “NAR1.aud” on the screen 1 has been changed. The updated scenario is stored in the scenario storage unit 17 again.

In this embodiment, FIG. 4 is shown as an example of the logical structure template. However, the attributes required in the present invention include not only the identifier of the template but also the identifier of the screen on which each hyperlink is arranged. , The identifier of the hyperlink object, the type of the reacting event, the behavior when the reacting event occurs, the position of the area to wait for the event, the size of the area to wait for the event, the time to start waiting for the event, and Regarding the length of time to wait for an event, the effects of the present invention are not affected even if they are not included as attributes of the template.

[0018]

As described above, the multimedia editing apparatus of the present invention, when storing the logical structure of an application created by an editor as a template, generates a schematic image that visually represents the structure of the template. It can be automatically created and stored in association with a template as auxiliary information for facilitating a search. Thus, when the logical structure of the application is reused as a template, there is an effect that a template that matches or is similar to the logical structure of the application to be created can be easily searched while visually discriminating the structure.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention.

FIG. 2 is a diagram illustrating an example of a scenario stored in a scenario storage unit in the embodiment.

FIG. 3 is a diagram illustrating an example of logical structure information extracted from a target scenario when a scenario creating / managing unit according to the present embodiment receives a logical structure template creating instruction for an application scenario.

FIG. 4 is a diagram illustrating an example of a logical structure template according to the embodiment.

FIG. 5 is a diagram illustrating an example of a schematic image created by a template information creating unit according to the embodiment.

FIG. 6 is a diagram illustrating an example in which a plurality of schematic images stored in a schematic image storage unit according to the present embodiment are displayed in a list on an input / output management unit;

FIG. 7 is a diagram illustrating an example of multimedia data identifiers and media information associated therewith, which are stored in a media information editing / storage unit according to the embodiment.

FIG. 8 is a diagram illustrating an example of a scenario created by reusing a logical structure template stored in a template storage unit in the embodiment.

FIG. 9 is a diagram showing an example in which the scenario of FIG. 8 is updated.

[Explanation of symbols]

 Reference Signs List 11 input / output management unit 12 template information creation unit 13 template storage unit 14 schematic image storage unit 15 scenario creation / management unit 16 media information editing / storage unit 17 scenario storage unit

Continuation of the front page (56) References JP-A-63-153671 (JP, A) Eiichiro Tanaka et al., "Scenario Description System for Large-Scale Multimedia Authoring", Information Processing Society of Japan (AVM-4) Vol. . 94, no. 29 p. 57-62, March 18, 1994 Tetsuo Tanaka et al., "Development of Media Browser in Distributed Object Environment", Information Processing Society of Japan, Vol. 93, No. 78 (FI-31) p. 9-16, Fig. 5 (a), September 14, 1993 Hiroaki Harada et al., "Scenario Processor: A Concept-Level Scenario Creation Support Environment", Information Processing Society of Japan, Vol. 65 (DBS-84), p. 135-140, 3.6, July 18, 1991

Claims (3)

(57) [Claims] 1. Method for presenting multimedia data /
A multimedia editing apparatus for editing a scenario including designation of a position / timing, etc., comprising an input / output management unit, editing multimedia data to be presented on a screen, an identifier of multimedia data, and multimedia data. Media information editing / storage section for storing association with media information including the type / presentation size on screen / time length, and the identifier of arbitrary multimedia data stored in the media information editing / storage section In addition to media information and information relating the presentation position / presentation time on the screen of the multimedia data, the multimedia data
Scenario creation / management unit that creates an application scenario that describes screen state transitions and dialogue branches when presenting data, scenario storage unit that stores created scenarios, and applications created by editors When a logical structure template creation command is received for the scenario of the above, the logical structure information of the scenario including the transition of the screen state of the application and the branch by the dialog are extracted, and at the same time, the schematic image that visually represents the extracted logical structure information A template information creating unit, a template storage unit that stores the logical structure information extracted by the template information creating unit as a template, and a schematic image storage unit that stores the schematic image created by the template information creating unit. Multimedia editing device characterized by having 2. The multimedia editing apparatus according to claim 1, wherein said input / output management unit includes a keyboard / mouse / keyboard.
Input devices such as pen input devices / touch panels and CRTs
A multimedia editing device comprising an output device such as a display. 3. The multimedia editing apparatus according to claim 1, wherein an editor creates / edits an application,
When the scenario of the application is stored in the scenario storage unit, when an editor issues a logical structure template creation command for the scenario via the input / output management unit, the scenario creation / management unit stores the scenario in the scenario. Simultaneously with the storage in the storage unit, the template information creating unit extracts logical structure information from the commanded scenario via the scenario creating / managing unit, and creates a schematic image that visually represents the logical structure. The multimedia editing apparatus is characterized in that the extracted logical structure information is templated and stored in the template storage unit, and the created schematic image is stored in the schematic image storage unit.